2024-09-05T00:34:59.367 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T00:34:59.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T00:34:59.478 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599 branch: pr-56597 description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7889599' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: pr-56597 ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pr-56597 sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3056 sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 sleep_before_teardown: 0 suite: rgw suite_branch: pr-56597 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOS/Fu2V2f6Klum/rX9IHxYDDTlMeOzaQHM3OYqY3vprhBhC9Pcz6fLupv5jS3GXeeA6ldFi9JxtyBB0H43GH+E= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJPjI1t/XXUI7XoAjJeAIQGLE3gXuZK6QmM4Iub2cTA8E2R4a+P93FyhAJQ+nMr8R/UBhTWo3NCdv/futjcLgM= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-04_19:08:10 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T00:34:59.478 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa; will attempt to use it 2024-09-05T00:34:59.479 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks 2024-09-05T00:34:59.479 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T00:34:59.480 INFO:teuthology.task.internal:Checking packages... 2024-09-05T00:34:59.502 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ede1507024117d16395cd6d958c594ff4aaf4da5' 2024-09-05T00:34:59.502 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T00:34:59.503 INFO:teuthology.packaging:ref: None 2024-09-05T00:34:59.503 INFO:teuthology.packaging:tag: None 2024-09-05T00:34:59.503 INFO:teuthology.packaging:branch: pr-56597 2024-09-05T00:34:59.503 INFO:teuthology.packaging:sha1: ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:34:59.503 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=pr-56597 2024-09-05T00:34:59.657 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4712-gede15070-1jammy 2024-09-05T00:34:59.658 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T00:34:59.667 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T00:34:59.667 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T00:34:59.751 INFO:teuthology.task.internal:Saving configuration 2024-09-05T00:34:59.773 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T00:34:59.783 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T00:34:59.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 00:29:06.930553', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBxJaDMKSeSYCgdINXoDldfAb2W8NJKhIvYP4NQEKORa'} 2024-09-05T00:34:59.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 00:29:06.929192', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOclXHIZAanohHdEB727xWrLhIWxEoZDZWCG4uBljjva'} 2024-09-05T00:34:59.823 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T00:34:59.832 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-05T00:34:59.833 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-05T00:34:59.833 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T00:34:59.905 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c9f01bac0>, signals=[15]) 2024-09-05T00:34:59.905 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T00:34:59.914 INFO:teuthology.task.internal:Opening connections... 2024-09-05T00:34:59.915 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:34:59.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:34:59.996 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:34:59.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:35:00.075 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T00:35:00.083 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-05T00:35:00.088 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-05T00:35:00.089 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-05T00:35:00.134 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-05T00:35:00.135 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-05T00:35:00.135 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-09-05T00:35:00.135 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-05T00:35:00.158 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-09-05T00:35:00.163 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-09-05T00:35:00.163 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Ubuntu" 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="22.04" 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_CODENAME=jammy 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:ID=ubuntu 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE=debian 2024-09-05T00:35:00.210 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-05T00:35:00.211 INFO:teuthology.orchestra.run.smithi204.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-05T00:35:00.211 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-05T00:35:00.211 INFO:teuthology.orchestra.run.smithi204.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-05T00:35:00.211 INFO:teuthology.orchestra.run.smithi204.stdout:UBUNTU_CODENAME=jammy 2024-09-05T00:35:00.211 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-09-05T00:35:00.233 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T00:35:00.246 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T00:35:00.299 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T00:35:00.300 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-05T00:35:00.302 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-09-05T00:35:00.307 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T00:35:00.325 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T00:35:00.325 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-05T00:35:00.352 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-09-05T00:35:00.364 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T00:35:00.416 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T00:35:00.433 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-05T00:35:00.433 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-05T00:35:00.433 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T00:35:00.434 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T00:35:00.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:35:00.439 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-05T00:35:00.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:35:00.440 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-05T00:35:00.488 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-56-generic 2024-09-05T00:35:00.488 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.15.0-56-generic 2024-09-05T00:35:00.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-05T00:35:00.489 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-56-generic 2024-09-05T00:35:00.489 INFO:teuthology.task.kernel:Running kernel on smithi204: 5.15.0-56-generic 2024-09-05T00:35:00.490 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-09-05T00:35:00.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-05T00:35:00.633 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-05T00:35:00.779 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-05T00:35:00.891 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:35:00.918 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:35:00.918 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-05T00:35:00.958 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-05T00:35:00.973 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-05T00:35:00.997 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-05T00:35:01.064 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-05T00:35:01.104 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-05T00:35:01.104 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-05T00:35:01.104 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-05T00:35:01.122 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-05T00:35:01.122 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-05T00:35:01.125 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-05T00:35:01.125 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-05T00:35:01.129 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-05T00:35:01.134 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-05T00:35:01.135 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-05T00:35:01.137 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-05T00:35:01.153 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-05T00:35:01.154 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-05T00:35:01.154 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-05T00:35:01.314 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-05T00:35:01.328 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-05T00:35:01.337 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-05T00:35:01.452 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-05T00:35:01.466 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-05T00:35:01.660 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-05T00:35:01.769 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-05T00:35:01.772 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-05T00:35:01.786 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-05T00:35:01.794 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-05T00:35:01.795 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-05T00:35:01.807 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-05T00:35:01.821 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-05T00:35:01.822 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-05T00:35:01.823 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-05T00:35:01.824 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-05T00:35:01.835 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-05T00:35:01.836 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-05T00:35:01.837 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-05T00:35:01.891 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-05T00:35:01.892 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-05T00:35:01.904 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-05T00:35:01.920 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-05T00:35:01.920 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-05T00:35:01.927 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-05T00:35:01.927 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-05T00:35:01.927 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-05T00:35:01.935 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-05T00:35:01.935 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-05T00:35:01.947 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-05T00:35:01.948 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-05T00:35:01.957 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-05T00:35:01.967 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-05T00:35:01.970 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-05T00:35:01.971 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-05T00:35:01.972 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-05T00:35:01.972 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-05T00:35:01.974 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-05T00:35:01.975 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-05T00:35:01.978 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-05T00:35:01.979 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-05T00:35:01.979 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-05T00:35:01.980 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-05T00:35:01.987 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-05T00:35:01.987 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-05T00:35:01.988 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-05T00:35:01.989 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-05T00:35:02.020 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-05T00:35:02.031 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-05T00:35:02.031 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-05T00:35:02.054 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-05T00:35:02.055 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-05T00:35:02.056 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-05T00:35:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-05T00:35:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-05T00:35:02.062 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-05T00:35:02.064 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-05T00:35:02.065 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-05T00:35:02.065 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-05T00:35:02.066 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-05T00:35:02.068 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-05T00:35:02.101 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-05T00:35:02.102 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-05T00:35:02.102 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-05T00:35:02.149 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-05T00:35:02.150 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-05T00:35:07.437 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 15.8 MB in 2s (7,482 kB/s) 2024-09-05T00:35:07.995 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 15.8 MB in 3s (5,803 kB/s) 2024-09-05T00:35:09.027 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:35:09.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T00:35:09.097 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:35:09.289 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-05T00:35:09.290 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-05T00:35:09.434 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:35:09.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T00:35:09.460 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:35:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:35:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:35:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:35:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-05T00:35:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: python2.7-minimal 2024-09-05T00:35:09.461 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:35:09.462 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-05T00:35:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T00:35:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-05T00:35:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-05T00:35:09.464 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-05T00:35:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-05T00:35:09.465 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-05T00:35:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-09-05T00:35:09.517 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:35:09.524 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-05T00:35:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T00:35:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-05T00:35:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-05T00:35:09.526 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-09-05T00:35:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-05T00:35:09.708 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T00:35:09.708 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 113 MB of archives. 2024-09-05T00:35:09.708 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-05T00:35:09.708 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-05T00:35:09.737 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-05T00:35:09.738 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-05T00:35:09.917 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:35:09.917 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:35:09.917 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:35:09.918 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:35:09.918 INFO:teuthology.orchestra.run.smithi204.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-05T00:35:09.918 INFO:teuthology.orchestra.run.smithi204.stdout: python2.7-minimal 2024-09-05T00:35:09.918 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:35:09.919 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-09-05T00:35:09.920 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T00:35:09.920 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-05T00:35:09.920 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-05T00:35:09.921 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-09-05T00:35:09.921 INFO:teuthology.orchestra.run.smithi204.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-05T00:35:09.922 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-09-05T00:35:09.922 INFO:teuthology.orchestra.run.smithi204.stdout: thermald 2024-09-05T00:35:09.971 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-09-05T00:35:09.971 INFO:teuthology.orchestra.run.smithi204.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T00:35:09.971 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-05T00:35:09.972 INFO:teuthology.orchestra.run.smithi204.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-05T00:35:09.973 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages will be upgraded: 2024-09-05T00:35:09.973 INFO:teuthology.orchestra.run.smithi204.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-05T00:35:10.153 INFO:teuthology.orchestra.run.smithi204.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T00:35:10.153 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 113 MB of archives. 2024-09-05T00:35:10.153 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-05T00:35:10.153 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-05T00:35:11.093 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-05T00:35:11.471 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-05T00:35:11.561 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-05T00:35:11.911 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-05T00:35:13.615 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-05T00:35:13.615 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-05T00:35:13.615 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-05T00:35:14.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-05T00:35:14.092 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-05T00:35:14.130 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-05T00:35:14.130 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-05T00:35:14.130 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-05T00:35:14.505 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-05T00:35:14.521 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-05T00:35:14.573 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-05T00:35:14.711 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-05T00:35:14.966 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-05T00:35:15.165 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-05T00:35:16.890 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-05T00:35:16.896 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:17.116 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:17.195 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-05T00:35:17.199 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:17.279 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:19.300 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-05T00:35:19.321 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:19.427 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:19.447 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-05T00:35:19.468 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:19.552 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:19.924 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-05T00:35:19.944 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:20.009 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-05T00:35:20.030 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:20.059 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:20.144 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:27.020 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:27.141 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:27.145 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:27.285 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:27.453 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:27.557 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:27.592 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:27.688 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:27.860 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-05T00:35:27.883 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-05T00:35:27.927 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T00:35:28.058 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-05T00:35:28.080 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-05T00:35:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T00:35:34.126 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-05T00:35:34.158 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-05T00:35:34.162 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:34.196 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T00:35:34.200 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:34.233 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:37.840 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:37.962 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:38.321 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T00:35:38.442 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:38.568 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-05T00:35:38.660 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T00:35:38.697 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:38.810 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T00:35:39.168 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T00:35:39.315 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:39.441 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-05T00:35:39.589 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:40.060 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:35:40.061 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-05T00:35:40.061 INFO:teuthology.orchestra.run.smithi204.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:35:40.061 INFO:teuthology.orchestra.run.smithi204.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-05T00:35:40.207 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:40.927 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:35:40.928 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-05T00:35:40.928 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:35:40.928 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-05T00:35:41.120 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:41.609 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:43.322 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:43.419 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-05T00:35:43.545 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-05T00:35:43.654 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:43.726 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-05T00:35:43.726 INFO:teuthology.orchestra.run.smithi204.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:35:44.698 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-05T00:35:44.808 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-05T00:35:44.934 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T00:35:44.991 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-05T00:35:44.991 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:35:57.767 INFO:teuthology.orchestra.run.smithi204.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-05T00:35:57.767 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub' 2024-09-05T00:35:57.794 INFO:teuthology.orchestra.run.smithi204.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T00:35:57.808 INFO:teuthology.orchestra.run.smithi204.stdout:Generating grub configuration file ... 2024-09-05T00:35:58.096 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:35:58.110 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:35:58.463 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:35:58.469 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T00:35:58.536 INFO:teuthology.orchestra.run.smithi204.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T00:35:58.542 INFO:teuthology.orchestra.run.smithi204.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T00:35:58.695 INFO:teuthology.orchestra.run.smithi204.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T00:35:58.695 INFO:teuthology.orchestra.run.smithi204.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T00:35:58.695 INFO:teuthology.orchestra.run.smithi204.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T00:35:58.737 INFO:teuthology.orchestra.run.smithi204.stdout:done 2024-09-05T00:35:59.203 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-09-05T00:35:59.220 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T00:35:59.221 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-09-05T00:35:59.221 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.119.119 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-09-05T00:35:59.222 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-09-05T00:35:59.222 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-05T00:35:59.223 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-05T00:35:59.223 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-05T00:35:59.223 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-05T00:35:59.223 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=None, version=distro) 2024-09-05T00:35:59.223 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get clean 2024-09-05T00:35:59.279 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-05T00:35:59.279 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-09-05T00:35:59.300 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T00:35:59.317 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-09-05T00:35:59.410 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-05T00:35:59.521 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:35:59.639 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:35:59.642 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T00:35:59.660 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:36:00.015 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:36:00.021 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T00:36:00.089 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T00:36:00.094 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T00:36:00.274 INFO:teuthology.orchestra.run.smithi099.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T00:36:00.275 INFO:teuthology.orchestra.run.smithi099.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T00:36:00.275 INFO:teuthology.orchestra.run.smithi099.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T00:36:00.305 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-09-05T00:36:00.308 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T00:36:00.324 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T00:36:00.789 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-05T00:36:00.809 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-05T00:36:00.809 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-05T00:36:00.809 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-05T00:36:00.809 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-05T00:36:00.809 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.119.119 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-05T00:36:00.810 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-05T00:36:00.811 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-05T00:36:00.811 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-05T00:36:00.811 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-05T00:36:00.811 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-05T00:36:00.811 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-05T00:36:00.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-05T00:36:00.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-05T00:36:01.069 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-05T00:36:01.192 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:36:01.274 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T00:36:01.357 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T00:36:01.530 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 129 kB in 0s (301 kB/s) 2024-09-05T00:36:01.532 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:36:01.550 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T00:36:01.610 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:36:01.820 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-05T00:36:01.820 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-05T00:36:01.998 INFO:teuthology.orchestra.run.smithi204.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-05T00:36:01.998 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:36:01.998 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:36:01.998 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:36:01.999 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:36:01.999 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:36:01.999 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:36:01.999 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:36:02.040 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T00:36:02.042 DEBUG:teuthology.orchestra.run.smithi204:> dpkg -s linux-image-generic 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Package: linux-image-generic 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Status: install ok installed 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Priority: optional 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Section: kernel 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Installed-Size: 21 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: amd64 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Source: linux-meta 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Version: 5.15.0.119.119 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T00:36:02.057 INFO:teuthology.orchestra.run.smithi204.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T00:36:02.058 INFO:teuthology.orchestra.run.smithi204.stdout:Recommends: thermald 2024-09-05T00:36:02.058 INFO:teuthology.orchestra.run.smithi204.stdout:Description: Generic Linux kernel image 2024-09-05T00:36:02.058 INFO:teuthology.orchestra.run.smithi204.stdout: This package will always depend on the latest generic kernel image 2024-09-05T00:36:02.058 INFO:teuthology.orchestra.run.smithi204.stdout: available. 2024-09-05T00:36:02.058 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-05T00:36:02.102 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.GYtsKEfiPB 2024-09-05T00:36:02.102 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GYtsKEfiPB 2024-09-05T00:36:02.158 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.GYtsKEfiPB 2024-09-05T00:36:02.276 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.GYtsKEfiPB is 10KB 2024-09-05T00:36:02.289 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.GYtsKEfiPB 2024-09-05T00:36:02.295 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-05T00:36:02.350 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:36:02.350 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-05T00:36:02.350 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-05T00:36:02.428 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-05T00:36:02.429 DEBUG:teuthology.orchestra.run.smithi204:> sudo update-grub 2024-09-05T00:36:02.485 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:36:02.504 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T00:36:02.566 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:36:02.792 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-05T00:36:02.793 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-05T00:36:02.967 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-05T00:36:02.967 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:36:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:36:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:36:02.967 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:36:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:36:02.968 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:36:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:36:03.007 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T00:36:03.009 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-05T00:36:03.024 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-05T00:36:03.024 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-05T00:36:03.024 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-05T00:36:03.024 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.119.119 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-05T00:36:03.025 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-05T00:36:03.026 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-05T00:36:03.069 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.sKBVz7y3rH 2024-09-05T00:36:03.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.sKBVz7y3rH 2024-09-05T00:36:03.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.sKBVz7y3rH 2024-09-05T00:36:03.241 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.sKBVz7y3rH is 10KB 2024-09-05T00:36:03.253 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.sKBVz7y3rH 2024-09-05T00:36:03.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-05T00:36:03.313 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:36:03.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-05T00:36:03.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-05T00:36:03.381 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-05T00:36:03.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-09-05T00:36:03.672 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub' 2024-09-05T00:36:03.673 INFO:teuthology.orchestra.run.smithi204.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T00:36:03.674 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-09-05T00:36:03.860 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:36:03.865 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:36:04.113 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:36:04.119 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T00:36:04.160 INFO:teuthology.orchestra.run.smithi204.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T00:36:04.165 INFO:teuthology.orchestra.run.smithi204.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T00:36:04.297 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T00:36:04.298 INFO:teuthology.orchestra.run.smithi204.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T00:36:04.298 INFO:teuthology.orchestra.run.smithi204.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T00:36:04.320 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-09-05T00:36:04.332 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-09-05T00:36:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-09-05T00:36:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T00:36:04.802 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-05T00:36:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T00:36:04.982 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T00:36:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T00:36:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T00:36:05.257 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T00:36:05.262 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T00:36:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T00:36:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T00:36:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T00:36:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-05T00:36:05.418 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-05T00:36:34.361 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-05T00:36:34.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:36:34.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:36:35.421 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-05T00:36:35.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:36:35.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:37:09.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-09-05T00:37:10.081 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-05T00:37:18.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:37:18.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:37:19.083 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:37:19.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:37:37.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-05T00:37:49.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:37:49.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:37:49.792 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-05T00:37:50.568 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:37:50.568 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-05T00:37:50.569 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-05T00:37:50.574 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-119-generic 2024-09-05T00:37:50.574 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-05T00:37:50.574 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T00:37:50.574 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-05T00:37:51.575 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-05T00:37:51.575 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T00:37:51.653 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-05T00:37:51.674 DEBUG:teuthology.parallel:result is None 2024-09-05T00:38:18.067 DEBUG:teuthology.orchestra.remote:timed out 2024-09-05T00:38:30.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:38:30.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:38:30.660 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-05T00:38:31.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:38:31.299 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-05T00:38:31.299 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-09-05T00:38:31.345 INFO:teuthology.orchestra.run.smithi204.stdout:5.15.0-119-generic 2024-09-05T00:38:31.345 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-05T00:38:31.345 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T00:38:31.345 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-05T00:38:32.346 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-05T00:38:32.346 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T00:38:32.429 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-09-05T00:38:32.455 DEBUG:teuthology.parallel:result is None 2024-09-05T00:38:32.455 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T00:38:32.463 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T00:38:32.464 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T00:38:32.466 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T00:38:32.472 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T00:38:32.485 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T00:38:32.520 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T00:38:32.520 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T00:38:32.523 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T00:38:32.547 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T00:38:32.554 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T00:38:32.555 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T00:38:32.581 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T00:38:32.600 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T00:38:32.606 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T00:38:32.609 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T00:38:32.614 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T00:38:32.615 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T00:38:32.622 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T00:38:32.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T00:38:32.653 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T00:38:32.669 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T00:38:32.678 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T00:38:32.679 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T00:38:32.713 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T00:38:32.719 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T00:38:32.765 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T00:38:32.812 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:38:32.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T00:38:32.876 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T00:38:32.882 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T00:38:32.929 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:38:32.929 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T00:38:32.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-05T00:38:32.999 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-09-05T00:38:33.075 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T00:38:33.082 INFO:teuthology.task.internal:Starting timer... 2024-09-05T00:38:33.082 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T00:38:33.127 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T00:38:33.190 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-09-05T00:38:33.190 DEBUG:teuthology.task.selinux:Excluding smithi204: OS 'ubuntu' does not support SELinux 2024-09-05T00:38:33.190 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T00:38:33.190 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-05T00:38:33.190 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T00:38:33.190 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T00:38:33.254 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-05T00:38:33.257 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-05T00:38:33.367 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T00:38:33.377 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T00:38:33.379 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T00:45:58.221 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-09-05T00:45:58.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:45:58.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:45:58.307 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-05T00:45:58.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-05T00:45:58.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:45:58.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T00:45:58.468 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-09-05T00:45:58.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-09-05T00:45:58.545 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T00:45:58.560 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T00:45:58.560 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T00:45:58.561 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T00:45:58.563 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T00:45:58.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T00:45:58.589 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-05T00:45:58.589 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Command line: ntpd -gq 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: ---------------------------------------------------- 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: ntp-4 is maintained by Network Time Foundation, 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: corporation. Support and training for ntp-4 are 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: available at https://www.nwtime.org/support 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: ---------------------------------------------------- 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: proto: precision = 0.043 usec (-24) 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: basedate set to 2022-02-04 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: gps base set to 2022-02-06 (week 2196) 2024-09-05T00:45:58.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T00:45:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T00:45:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: restrict ::: KOD does nothing without LIMITED. 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen and drop on 0 v6wildcard [::]:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen normally on 2 lo 127.0.0.1:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen normally on 4 lo [::1]:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-09-05T00:45:58.592 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:45:58 ntpd[18448]: Listening on routing socket on fd #22 for interface updates 2024-09-05T00:45:58.614 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Command line: ntpd -gq 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: ---------------------------------------------------- 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: ntp-4 is maintained by Network Time Foundation, 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: corporation. Support and training for ntp-4 are 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: available at https://www.nwtime.org/support 2024-09-05T00:45:58.615 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: ---------------------------------------------------- 2024-09-05T00:45:58.616 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: proto: precision = 0.059 usec (-24) 2024-09-05T00:45:58.616 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: basedate set to 2022-02-04 2024-09-05T00:45:58.616 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: gps base set to 2022-02-06 (week 2196) 2024-09-05T00:45:58.616 INFO:teuthology.orchestra.run.smithi204.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T00:45:58.617 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T00:45:58.617 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: restrict ::: KOD does nothing without LIMITED. 2024-09-05T00:45:58.617 INFO:teuthology.orchestra.run.smithi204.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen and drop on 0 v6wildcard [::]:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen normally on 2 lo 127.0.0.1:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen normally on 3 enp3s0f1 172.21.15.204:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen normally on 4 lo [::1]:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ab%5]:123 2024-09-05T00:45:58.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:45:58 ntpd[18418]: Listening on routing socket on fd #22 for interface updates 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:45:59.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:45:59 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:45:59.615 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.615 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.615 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:45:59.615 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:45:59.615 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:45:59.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:45:59 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:01.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:01.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:01 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:01.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:01.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:01 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:02.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:02 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:03.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:03.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:03 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:03.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:03.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:03.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:03.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:03.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:03.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:03 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:04.589 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:04.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:04.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:04.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:04.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:04.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:04 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:05.590 INFO:teuthology.orchestra.run.smithi099.stdout: 5 Sep 00:46:05 ntpd[18448]: ntpd: time slew -0.000745 s 2024-09-05T00:46:05.591 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew -0.000745s 2024-09-05T00:46:05.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-05T00:46:05.591 INFO:teuthology.orchestra.run.smithi099.stderr: 5 Sep 00:46:05 ntpd[18448]: can't open /var/log/ntpstats/loopstats.20240905: Permission denied 2024-09-05T00:46:05.616 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:05.617 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stdout: 5 Sep 00:46:05 ntpd[18418]: ntpd: time slew -0.000596 s 2024-09-05T00:46:05.618 INFO:teuthology.orchestra.run.smithi204.stdout:ntpd: time slew -0.000596s 2024-09-05T00:46:05.619 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-05T00:46:05.619 INFO:teuthology.orchestra.run.smithi204.stderr: 5 Sep 00:46:05 ntpd[18418]: can't open /var/log/ntpstats/loopstats.20240905: Permission denied 2024-09-05T00:46:05.637 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T00:46:05.638 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-05T00:46:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.638 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.666 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T00:46:05.667 INFO:teuthology.run_tasks:Running task install... 2024-09-05T00:46:05.676 DEBUG:teuthology.task.install:project ceph 2024-09-05T00:46:05.677 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'}} 2024-09-05T00:46:05.677 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'} 2024-09-05T00:46:05.677 INFO:teuthology.task.install:Using flavor: default 2024-09-05T00:46:05.683 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-05T00:46:05.683 INFO:teuthology.task.install:extra packages: [] 2024-09-05T00:46:05.683 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-09-05T00:46:05.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-key list | grep Ceph 2024-09-05T00:46:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-05T00:46:05.765 INFO:teuthology.orchestra.run.smithi204.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-05T00:46:05.770 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-05T00:46:05.770 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-09-05T00:46:05.771 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-05T00:46:05.771 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-05T00:46:05.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:46:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-05T00:46:05.791 INFO:teuthology.orchestra.run.smithi204.stdout:uid [ unknown] Ceph.com (release key) 2024-09-05T00:46:05.791 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-05T00:46:05.791 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-05T00:46:05.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:46:05.919 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default/ 2024-09-05T00:46:05.920 INFO:teuthology.task.install.deb:Package version is 19.3.0-4712-gede15070-1jammy 2024-09-05T00:46:05.935 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default/ 2024-09-05T00:46:05.935 INFO:teuthology.task.install.deb:Package version is 19.3.0-4712-gede15070-1jammy 2024-09-05T00:46:06.030 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:46:06.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-05T00:46:06.043 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:46:06.043 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-05T00:46:06.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-05T00:46:06.058 DEBUG:teuthology.orchestra.run.smithi204:> sudo apt-get update 2024-09-05T00:46:06.225 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:46:06.234 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T00:46:06.251 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T00:46:06.271 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy InRelease 2024-09-05T00:46:06.280 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy InRelease 2024-09-05T00:46:06.292 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-05T00:46:06.301 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-05T00:46:06.315 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-05T00:46:06.323 INFO:teuthology.orchestra.run.smithi204.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-05T00:46:06.337 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-05T00:46:06.345 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-05T00:46:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T00:46:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T00:46:06.350 INFO:teuthology.orchestra.run.smithi204.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T00:46:06.373 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-05T00:46:06.377 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2024-09-05T00:46:06.419 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T00:46:06.501 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T00:46:06.575 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 29.3 kB in 0s (86.5 kB/s) 2024-09-05T00:46:06.707 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 29.3 kB in 0s (60.8 kB/s) 2024-09-05T00:46:07.625 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:46:07.642 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4712-gede15070-1jammy cephadm=19.3.0-4712-gede15070-1jammy ceph-mds=19.3.0-4712-gede15070-1jammy ceph-mgr=19.3.0-4712-gede15070-1jammy ceph-common=19.3.0-4712-gede15070-1jammy ceph-fuse=19.3.0-4712-gede15070-1jammy ceph-test=19.3.0-4712-gede15070-1jammy ceph-volume=19.3.0-4712-gede15070-1jammy radosgw=19.3.0-4712-gede15070-1jammy python3-rados=19.3.0-4712-gede15070-1jammy python3-rgw=19.3.0-4712-gede15070-1jammy python3-cephfs=19.3.0-4712-gede15070-1jammy python3-rbd=19.3.0-4712-gede15070-1jammy libcephfs2=19.3.0-4712-gede15070-1jammy libcephfs-dev=19.3.0-4712-gede15070-1jammy librados2=19.3.0-4712-gede15070-1jammy librbd1=19.3.0-4712-gede15070-1jammy rbd-fuse=19.3.0-4712-gede15070-1jammy 2024-09-05T00:46:07.697 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:46:07.729 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:46:07.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4712-gede15070-1jammy cephadm=19.3.0-4712-gede15070-1jammy ceph-mds=19.3.0-4712-gede15070-1jammy ceph-mgr=19.3.0-4712-gede15070-1jammy ceph-common=19.3.0-4712-gede15070-1jammy ceph-fuse=19.3.0-4712-gede15070-1jammy ceph-test=19.3.0-4712-gede15070-1jammy ceph-volume=19.3.0-4712-gede15070-1jammy radosgw=19.3.0-4712-gede15070-1jammy python3-rados=19.3.0-4712-gede15070-1jammy python3-rgw=19.3.0-4712-gede15070-1jammy python3-cephfs=19.3.0-4712-gede15070-1jammy python3-rbd=19.3.0-4712-gede15070-1jammy libcephfs2=19.3.0-4712-gede15070-1jammy libcephfs-dev=19.3.0-4712-gede15070-1jammy librados2=19.3.0-4712-gede15070-1jammy librbd1=19.3.0-4712-gede15070-1jammy rbd-fuse=19.3.0-4712-gede15070-1jammy 2024-09-05T00:46:07.808 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:46:07.890 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-05T00:46:07.891 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-05T00:46:08.006 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-05T00:46:08.007 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-05T00:46:08.082 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:46:08.082 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:46:08.082 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:46:08.083 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:46:08.083 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:46:08.083 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:46:08.083 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:46:08.084 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-09-05T00:46:08.084 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-05T00:46:08.084 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-05T00:46:08.084 INFO:teuthology.orchestra.run.smithi204.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-05T00:46:08.084 INFO:teuthology.orchestra.run.smithi204.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-05T00:46:08.085 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-05T00:46:08.085 INFO:teuthology.orchestra.run.smithi204.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-05T00:46:08.085 INFO:teuthology.orchestra.run.smithi204.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-05T00:46:08.085 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-05T00:46:08.086 INFO:teuthology.orchestra.run.smithi204.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet zip 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-05T00:46:08.087 INFO:teuthology.orchestra.run.smithi204.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-05T00:46:08.088 INFO:teuthology.orchestra.run.smithi204.stdout:Recommended packages: 2024-09-05T00:46:08.088 INFO:teuthology.orchestra.run.smithi204.stdout: btrfs-tools 2024-09-05T00:46:08.190 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-09-05T00:46:08.190 INFO:teuthology.orchestra.run.smithi204.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-05T00:46:08.191 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-05T00:46:08.191 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-05T00:46:08.191 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-05T00:46:08.191 INFO:teuthology.orchestra.run.smithi204.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-05T00:46:08.191 INFO:teuthology.orchestra.run.smithi204.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T00:46:08.192 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-05T00:46:08.193 INFO:teuthology.orchestra.run.smithi204.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-05T00:46:08.201 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:46:08.201 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:46:08.201 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:46:08.202 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:46:08.202 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:46:08.202 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:46:08.202 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:46:08.203 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-05T00:46:08.203 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-05T00:46:08.203 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-05T00:46:08.204 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-05T00:46:08.204 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T00:46:08.205 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-05T00:46:08.206 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet zip 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-05T00:46:08.207 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-09-05T00:46:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-05T00:46:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-05T00:46:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-05T00:46:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-05T00:46:08.307 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-05T00:46:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-05T00:46:08.308 INFO:teuthology.orchestra.run.smithi099.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T00:46:08.309 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-05T00:46:08.310 INFO:teuthology.orchestra.run.smithi099.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-05T00:46:08.335 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T00:46:08.335 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 251 MB of archives. 2024-09-05T00:46:08.335 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-05T00:46:08.335 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4712-gede15070-1jammy [3,621 kB] 2024-09-05T00:46:08.401 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-05T00:46:08.450 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T00:46:08.450 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 251 MB of archives. 2024-09-05T00:46:08.450 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-05T00:46:08.450 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4712-gede15070-1jammy [3,621 kB] 2024-09-05T00:46:08.497 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-05T00:46:08.527 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4712-gede15070-1jammy [3,322 kB] 2024-09-05T00:46:08.579 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4712-gede15070-1jammy [722 kB] 2024-09-05T00:46:08.591 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4712-gede15070-1jammy [356 kB] 2024-09-05T00:46:08.596 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4712-gede15070-1jammy [32.8 kB] 2024-09-05T00:46:08.597 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4712-gede15070-1jammy [180 kB] 2024-09-05T00:46:08.599 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4712-gede15070-1jammy [71.2 kB] 2024-09-05T00:46:08.601 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4712-gede15070-1jammy [339 kB] 2024-09-05T00:46:08.605 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4712-gede15070-1jammy [7,984 kB] 2024-09-05T00:46:08.760 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4712-gede15070-1jammy [112 kB] 2024-09-05T00:46:08.762 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4712-gede15070-1jammy [473 kB] 2024-09-05T00:46:08.768 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4712-gede15070-1jammy [28.2 MB] 2024-09-05T00:46:08.821 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-05T00:46:08.836 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-05T00:46:08.914 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-05T00:46:08.918 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-05T00:46:08.931 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-05T00:46:09.003 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4712-gede15070-1jammy [3,322 kB] 2024-09-05T00:46:09.013 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-05T00:46:09.143 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-05T00:46:09.154 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-05T00:46:09.184 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-05T00:46:09.193 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-05T00:46:09.194 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-05T00:46:09.195 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-05T00:46:09.213 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-05T00:46:09.217 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-05T00:46:09.222 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-05T00:46:09.232 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-05T00:46:09.242 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-05T00:46:09.253 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-05T00:46:09.282 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-05T00:46:09.290 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-05T00:46:09.291 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-05T00:46:09.293 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-05T00:46:09.314 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4712-gede15070-1jammy [722 kB] 2024-09-05T00:46:09.316 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-05T00:46:09.320 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-05T00:46:09.324 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-05T00:46:09.328 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-05T00:46:09.333 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-05T00:46:09.374 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4712-gede15070-1jammy [356 kB] 2024-09-05T00:46:09.382 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4712-gede15070-1jammy [32.8 kB] 2024-09-05T00:46:09.383 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-05T00:46:09.383 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4712-gede15070-1jammy [180 kB] 2024-09-05T00:46:09.388 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4712-gede15070-1jammy [71.2 kB] 2024-09-05T00:46:09.393 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4712-gede15070-1jammy [339 kB] 2024-09-05T00:46:09.401 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4712-gede15070-1jammy [7,984 kB] 2024-09-05T00:46:09.407 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-05T00:46:09.411 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-05T00:46:09.416 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-05T00:46:09.419 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-05T00:46:09.420 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-05T00:46:09.421 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-05T00:46:09.453 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-05T00:46:09.453 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4712-gede15070-1jammy [5,206 kB] 2024-09-05T00:46:09.457 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-05T00:46:09.459 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-05T00:46:09.459 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-05T00:46:09.461 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-05T00:46:09.462 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-05T00:46:09.463 INFO:teuthology.orchestra.run.smithi204.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-05T00:46:09.463 INFO:teuthology.orchestra.run.smithi204.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-05T00:46:09.486 INFO:teuthology.orchestra.run.smithi204.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-05T00:46:09.490 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-05T00:46:09.490 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-05T00:46:09.491 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-05T00:46:09.492 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-05T00:46:09.527 INFO:teuthology.orchestra.run.smithi204.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4712-gede15070-1jammy [251 kB] 2024-09-05T00:46:09.530 INFO:teuthology.orchestra.run.smithi204.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4712-gede15070-1jammy [124 kB] 2024-09-05T00:46:09.531 INFO:teuthology.orchestra.run.smithi204.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4712-gede15070-1jammy [1,561 kB] 2024-09-05T00:46:09.546 INFO:teuthology.orchestra.run.smithi204.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-05T00:46:09.547 INFO:teuthology.orchestra.run.smithi204.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-05T00:46:09.553 INFO:teuthology.orchestra.run.smithi204.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4712-gede15070-1jammy [6,310 kB] 2024-09-05T00:46:09.553 INFO:teuthology.orchestra.run.smithi204.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-05T00:46:09.554 INFO:teuthology.orchestra.run.smithi204.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-05T00:46:09.555 INFO:teuthology.orchestra.run.smithi204.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-05T00:46:09.556 INFO:teuthology.orchestra.run.smithi204.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-05T00:46:09.558 INFO:teuthology.orchestra.run.smithi204.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-05T00:46:09.559 INFO:teuthology.orchestra.run.smithi204.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-05T00:46:09.570 INFO:teuthology.orchestra.run.smithi204.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-05T00:46:09.572 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-05T00:46:09.573 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-05T00:46:09.574 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-05T00:46:09.579 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-05T00:46:09.580 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-05T00:46:09.581 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-05T00:46:09.641 INFO:teuthology.orchestra.run.smithi204.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-05T00:46:09.643 INFO:teuthology.orchestra.run.smithi204.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-05T00:46:09.644 INFO:teuthology.orchestra.run.smithi204.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-05T00:46:09.654 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-05T00:46:09.654 INFO:teuthology.orchestra.run.smithi204.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-05T00:46:09.655 INFO:teuthology.orchestra.run.smithi204.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-05T00:46:09.655 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-05T00:46:09.656 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-05T00:46:09.656 INFO:teuthology.orchestra.run.smithi204.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-05T00:46:09.657 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-05T00:46:09.657 INFO:teuthology.orchestra.run.smithi204.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-05T00:46:09.660 INFO:teuthology.orchestra.run.smithi204.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-05T00:46:09.664 INFO:teuthology.orchestra.run.smithi204.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-05T00:46:09.696 INFO:teuthology.orchestra.run.smithi204.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4712-gede15070-1jammy [23.1 MB] 2024-09-05T00:46:09.715 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4712-gede15070-1jammy [112 kB] 2024-09-05T00:46:09.718 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4712-gede15070-1jammy [473 kB] 2024-09-05T00:46:09.732 INFO:teuthology.orchestra.run.smithi204.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-05T00:46:09.735 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-05T00:46:09.735 INFO:teuthology.orchestra.run.smithi204.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-05T00:46:09.736 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-05T00:46:09.737 INFO:teuthology.orchestra.run.smithi204.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-05T00:46:09.737 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-05T00:46:09.748 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-05T00:46:09.748 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-05T00:46:09.750 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-05T00:46:09.760 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4712-gede15070-1jammy [28.2 MB] 2024-09-05T00:46:09.814 INFO:teuthology.orchestra.run.smithi204.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-05T00:46:09.815 INFO:teuthology.orchestra.run.smithi204.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-05T00:46:09.816 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-05T00:46:09.817 INFO:teuthology.orchestra.run.smithi204.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-05T00:46:09.819 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-05T00:46:09.822 INFO:teuthology.orchestra.run.smithi204.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-05T00:46:09.823 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-05T00:46:09.824 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-05T00:46:09.898 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-05T00:46:09.899 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-05T00:46:09.904 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-05T00:46:09.905 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-05T00:46:09.906 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-05T00:46:09.911 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-05T00:46:09.984 INFO:teuthology.orchestra.run.smithi204.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-05T00:46:09.986 INFO:teuthology.orchestra.run.smithi204.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-05T00:46:09.988 INFO:teuthology.orchestra.run.smithi204.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-05T00:46:09.989 INFO:teuthology.orchestra.run.smithi204.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-05T00:46:09.991 INFO:teuthology.orchestra.run.smithi204.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-05T00:46:10.027 INFO:teuthology.orchestra.run.smithi204.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-05T00:46:10.030 INFO:teuthology.orchestra.run.smithi204.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-05T00:46:10.030 INFO:teuthology.orchestra.run.smithi204.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-05T00:46:10.070 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-05T00:46:10.071 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-05T00:46:10.074 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-05T00:46:10.074 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-05T00:46:10.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-05T00:46:10.088 INFO:teuthology.orchestra.run.smithi204.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-05T00:46:10.088 INFO:teuthology.orchestra.run.smithi204.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-05T00:46:10.110 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-05T00:46:10.143 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-05T00:46:10.144 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-05T00:46:10.151 INFO:teuthology.orchestra.run.smithi204.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-05T00:46:10.152 INFO:teuthology.orchestra.run.smithi204.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-05T00:46:10.152 INFO:teuthology.orchestra.run.smithi204.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-05T00:46:10.154 INFO:teuthology.orchestra.run.smithi204.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-05T00:46:10.154 INFO:teuthology.orchestra.run.smithi204.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-05T00:46:10.155 INFO:teuthology.orchestra.run.smithi204.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-05T00:46:10.161 INFO:teuthology.orchestra.run.smithi204.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-05T00:46:10.175 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-05T00:46:10.175 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-05T00:46:10.232 INFO:teuthology.orchestra.run.smithi204.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-05T00:46:10.235 INFO:teuthology.orchestra.run.smithi204.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-05T00:46:10.236 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-05T00:46:10.237 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-05T00:46:10.237 INFO:teuthology.orchestra.run.smithi204.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-05T00:46:10.237 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-05T00:46:10.238 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-05T00:46:10.239 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-05T00:46:10.240 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-05T00:46:10.247 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-05T00:46:10.313 INFO:teuthology.orchestra.run.smithi204.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-05T00:46:10.317 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-05T00:46:10.320 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-05T00:46:10.322 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-05T00:46:10.343 INFO:teuthology.orchestra.run.smithi204.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-05T00:46:10.344 INFO:teuthology.orchestra.run.smithi204.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4712-gede15070-1jammy [14.0 kB] 2024-09-05T00:46:10.345 INFO:teuthology.orchestra.run.smithi204.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4712-gede15070-1jammy [880 kB] 2024-09-05T00:46:10.345 INFO:teuthology.orchestra.run.smithi204.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-05T00:46:10.346 INFO:teuthology.orchestra.run.smithi204.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-05T00:46:10.358 INFO:teuthology.orchestra.run.smithi204.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-05T00:46:10.358 INFO:teuthology.orchestra.run.smithi204.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4712-gede15070-1jammy [2,437 kB] 2024-09-05T00:46:10.359 INFO:teuthology.orchestra.run.smithi204.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-05T00:46:10.367 INFO:teuthology.orchestra.run.smithi204.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-05T00:46:10.394 INFO:teuthology.orchestra.run.smithi204.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4712-gede15070-1jammy [812 kB] 2024-09-05T00:46:10.395 INFO:teuthology.orchestra.run.smithi204.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-05T00:46:10.397 INFO:teuthology.orchestra.run.smithi204.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-05T00:46:10.397 INFO:teuthology.orchestra.run.smithi204.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-05T00:46:10.398 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-05T00:46:10.404 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-05T00:46:10.406 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-05T00:46:10.408 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-05T00:46:10.408 INFO:teuthology.orchestra.run.smithi204.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4712-gede15070-1jammy [160 kB] 2024-09-05T00:46:10.419 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-05T00:46:10.421 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-05T00:46:10.428 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-05T00:46:10.444 INFO:teuthology.orchestra.run.smithi204.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4712-gede15070-1jammy [61.4 MB] 2024-09-05T00:46:10.476 INFO:teuthology.orchestra.run.smithi204.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-05T00:46:10.478 INFO:teuthology.orchestra.run.smithi204.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-05T00:46:10.479 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-05T00:46:10.480 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-05T00:46:10.481 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-05T00:46:10.495 INFO:teuthology.orchestra.run.smithi204.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-05T00:46:10.496 INFO:teuthology.orchestra.run.smithi204.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-05T00:46:10.497 INFO:teuthology.orchestra.run.smithi204.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-05T00:46:10.502 INFO:teuthology.orchestra.run.smithi204.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-05T00:46:10.503 INFO:teuthology.orchestra.run.smithi204.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-05T00:46:10.560 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-05T00:46:10.562 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-05T00:46:10.579 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-05T00:46:10.580 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-05T00:46:10.580 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-05T00:46:10.585 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-05T00:46:10.587 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-05T00:46:10.802 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4712-gede15070-1jammy [5,206 kB] 2024-09-05T00:46:10.873 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4712-gede15070-1jammy [251 kB] 2024-09-05T00:46:10.875 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4712-gede15070-1jammy [124 kB] 2024-09-05T00:46:10.877 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4712-gede15070-1jammy [1,561 kB] 2024-09-05T00:46:10.890 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4712-gede15070-1jammy [6,310 kB] 2024-09-05T00:46:11.018 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4712-gede15070-1jammy [23.1 MB] 2024-09-05T00:46:11.582 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4712-gede15070-1jammy [14.0 kB] 2024-09-05T00:46:11.582 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4712-gede15070-1jammy [880 kB] 2024-09-05T00:46:11.594 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4712-gede15070-1jammy [2,437 kB] 2024-09-05T00:46:11.629 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4712-gede15070-1jammy [812 kB] 2024-09-05T00:46:11.639 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4712-gede15070-1jammy [160 kB] 2024-09-05T00:46:11.641 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4712-gede15070-1jammy [61.4 MB] 2024-09-05T00:46:13.362 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4712-gede15070-1jammy [8,625 kB] 2024-09-05T00:46:13.514 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4712-gede15070-1jammy [14.2 kB] 2024-09-05T00:46:13.515 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4712-gede15070-1jammy [55.8 MB] 2024-09-05T00:46:13.747 INFO:teuthology.orchestra.run.smithi204.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4712-gede15070-1jammy [8,625 kB] 2024-09-05T00:46:14.003 INFO:teuthology.orchestra.run.smithi204.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4712-gede15070-1jammy [14.2 kB] 2024-09-05T00:46:14.004 INFO:teuthology.orchestra.run.smithi204.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4712-gede15070-1jammy [55.8 MB] 2024-09-05T00:46:15.265 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4712-gede15070-1jammy [130 kB] 2024-09-05T00:46:15.267 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4712-gede15070-1jammy [38.9 kB] 2024-09-05T00:46:15.268 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4712-gede15070-1jammy [15.9 MB] 2024-09-05T00:46:15.809 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4712-gede15070-1jammy [91.3 kB] 2024-09-05T00:46:15.967 INFO:teuthology.orchestra.run.smithi204.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4712-gede15070-1jammy [130 kB] 2024-09-05T00:46:15.970 INFO:teuthology.orchestra.run.smithi204.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4712-gede15070-1jammy [38.9 kB] 2024-09-05T00:46:15.971 INFO:teuthology.orchestra.run.smithi204.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4712-gede15070-1jammy [15.9 MB] 2024-09-05T00:46:16.278 INFO:teuthology.orchestra.run.smithi204.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/pr-56597/ede1507024117d16395cd6d958c594ff4aaf4da5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4712-gede15070-1jammy [91.3 kB] 2024-09-05T00:46:16.355 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 251 MB in 7s (33.5 MB/s) 2024-09-05T00:46:16.490 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-05T00:46:16.588 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-05T00:46:16.594 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-05T00:46:16.680 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T00:46:16.863 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 251 MB in 8s (31.1 MB/s) 2024-09-05T00:46:17.026 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-05T00:46:17.034 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-05T00:46:17.060 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-05T00:46:17.100 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T00:46:17.126 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-05T00:46:17.131 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-05T00:46:17.216 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T00:46:17.429 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-05T00:46:17.455 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-05T00:46:17.495 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T00:46:17.553 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-05T00:46:17.579 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-05T00:46:17.611 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T00:46:17.891 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-05T00:46:17.917 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:17.931 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-05T00:46:17.957 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-05T00:46:17.965 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:17.998 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T00:46:18.369 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-05T00:46:18.395 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:18.435 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:18.501 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-05T00:46:18.528 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:18.576 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:18.739 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-05T00:46:18.765 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:18.797 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:18.963 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-05T00:46:18.989 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:19.021 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:19.117 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-05T00:46:19.143 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-05T00:46:19.184 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T00:46:19.383 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-05T00:46:19.408 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T00:46:19.449 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:46:19.528 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librados2. 2024-09-05T00:46:19.554 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-librados2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:19.595 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:19.786 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-05T00:46:19.812 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-05T00:46:19.852 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T00:46:20.023 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librbd1. 2024-09-05T00:46:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-librbd1_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:20.081 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:20.172 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librados2. 2024-09-05T00:46:20.198 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../007-librados2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:20.238 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librados2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:20.534 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-09-05T00:46:20.560 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:20.600 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:20.683 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librbd1. 2024-09-05T00:46:20.709 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../008-librbd1_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:20.741 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librbd1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:20.886 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-09-05T00:46:20.913 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:20.953 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:21.178 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs2. 2024-09-05T00:46:21.204 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:21.244 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:21.247 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-05T00:46:21.274 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:21.314 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:21.533 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-09-05T00:46:21.555 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rados. 2024-09-05T00:46:21.560 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:21.570 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:21.600 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:21.613 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rados (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:22.112 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-05T00:46:22.124 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-05T00:46:22.137 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:22.150 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:22.178 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:22.182 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-argparse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:22.410 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cephfs. 2024-09-05T00:46:22.425 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:22.468 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cephfs (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:22.523 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-05T00:46:22.549 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-05T00:46:22.598 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T00:46:22.788 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-05T00:46:22.814 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:22.854 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:22.884 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-09-05T00:46:22.910 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-05T00:46:22.951 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-05T00:46:23.182 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-05T00:46:23.209 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-05T00:46:23.220 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-09-05T00:46:23.235 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:23.249 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T00:46:23.278 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:23.527 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-prettytable. 2024-09-05T00:46:23.553 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-05T00:46:23.585 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-05T00:46:23.625 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-05T00:46:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-05T00:46:23.692 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T00:46:23.838 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rbd. 2024-09-05T00:46:23.853 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:23.896 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rbd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:23.927 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-05T00:46:23.943 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-05T00:46:23.977 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T00:46:24.249 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-05T00:46:24.256 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-05T00:46:24.271 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-05T00:46:24.276 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-05T00:46:24.314 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T00:46:24.315 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T00:46:24.606 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-05T00:46:24.617 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-05T00:46:24.651 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua5.1. 2024-09-05T00:46:24.652 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T00:46:24.677 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-05T00:46:24.718 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-05T00:46:24.913 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-05T00:46:24.928 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-05T00:46:24.963 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T00:46:25.012 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-any. 2024-09-05T00:46:25.039 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-05T00:46:25.071 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-05T00:46:25.273 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package zip. 2024-09-05T00:46:25.288 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-05T00:46:25.308 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua5.1. 2024-09-05T00:46:25.331 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking zip (3.0-12build2) ... 2024-09-05T00:46:25.334 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-05T00:46:25.374 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-05T00:46:25.635 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package unzip. 2024-09-05T00:46:25.661 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-05T00:46:25.694 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-any. 2024-09-05T00:46:25.701 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-05T00:46:25.709 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-05T00:46:25.752 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-05T00:46:25.972 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package zip. 2024-09-05T00:46:25.987 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-05T00:46:26.022 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking zip (3.0-12build2) ... 2024-09-05T00:46:26.072 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package luarocks. 2024-09-05T00:46:26.099 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-05T00:46:26.139 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-05T00:46:26.341 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package unzip. 2024-09-05T00:46:26.368 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-05T00:46:26.408 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-05T00:46:26.514 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-09-05T00:46:26.540 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-librgw2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:26.605 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:26.795 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package luarocks. 2024-09-05T00:46:26.821 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-05T00:46:26.862 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-05T00:46:27.233 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-09-05T00:46:27.248 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:27.262 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package librgw2. 2024-09-05T00:46:27.288 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../025-librgw2_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:27.291 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:27.328 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking librgw2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:27.645 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-05T00:46:27.671 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-05T00:46:27.711 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T00:46:27.914 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rgw. 2024-09-05T00:46:27.929 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:27.972 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:28.022 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-09-05T00:46:28.049 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:28.089 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:28.317 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-05T00:46:28.343 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-05T00:46:28.383 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T00:46:28.434 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-09-05T00:46:28.461 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:28.501 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libradosstriper1. 2024-09-05T00:46:28.721 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:28.761 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libradosstriper1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:29.223 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-common. 2024-09-05T00:46:29.249 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:29.281 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:29.990 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-09-05T00:46:30.019 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:30.058 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:30.653 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-05T00:46:30.679 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-05T00:46:30.719 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-05T00:46:30.870 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-base. 2024-09-05T00:46:30.896 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:30.954 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-base (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:31.022 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cheroot. 2024-09-05T00:46:31.049 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-05T00:46:31.105 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T00:46:31.417 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-05T00:46:31.444 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-05T00:46:31.483 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-05T00:46:31.599 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-05T00:46:31.625 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-05T00:46:31.674 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-05T00:46:31.787 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-05T00:46:31.813 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-05T00:46:31.853 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-05T00:46:32.010 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cheroot. 2024-09-05T00:46:32.036 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-05T00:46:32.077 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T00:46:32.156 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-05T00:46:32.183 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-05T00:46:32.356 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-05T00:46:32.614 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-05T00:46:32.640 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-05T00:46:32.676 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempora. 2024-09-05T00:46:32.680 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-05T00:46:32.702 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-05T00:46:32.742 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-05T00:46:33.008 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-05T00:46:33.034 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-05T00:46:33.045 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-portend. 2024-09-05T00:46:33.072 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-05T00:46:33.074 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-05T00:46:33.112 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-05T00:46:33.353 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-05T00:46:33.379 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-05T00:46:33.410 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-05T00:46:33.415 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-05T00:46:33.442 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-05T00:46:33.481 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-05T00:46:33.688 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempora. 2024-09-05T00:46:33.715 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-05T00:46:33.755 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-05T00:46:33.768 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-05T00:46:33.795 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-05T00:46:33.828 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-05T00:46:34.058 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-portend. 2024-09-05T00:46:34.084 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-05T00:46:34.124 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-05T00:46:34.164 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-09-05T00:46:34.190 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-05T00:46:34.230 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-05T00:46:34.428 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-05T00:46:34.454 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-05T00:46:34.494 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-05T00:46:34.516 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-09-05T00:46:34.532 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-05T00:46:34.566 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-05T00:46:34.730 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-05T00:46:34.757 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-05T00:46:34.789 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-05T00:46:34.845 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-05T00:46:34.872 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-05T00:46:34.911 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-05T00:46:35.142 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-natsort. 2024-09-05T00:46:35.169 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-05T00:46:35.197 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-09-05T00:46:35.208 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-05T00:46:35.224 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-05T00:46:35.264 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T00:46:35.514 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-logutils. 2024-09-05T00:46:35.540 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-05T00:46:35.580 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-05T00:46:35.601 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-05T00:46:35.628 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-05T00:46:35.667 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-05T00:46:35.883 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-05T00:46:35.910 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-05T00:46:35.945 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-05T00:46:35.950 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-05T00:46:35.961 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-05T00:46:35.995 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-05T00:46:36.220 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-mako. 2024-09-05T00:46:36.246 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-05T00:46:36.256 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-09-05T00:46:36.280 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T00:46:36.282 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-05T00:46:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T00:46:36.607 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-05T00:46:36.633 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-05T00:46:36.673 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-05T00:46:36.676 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-09-05T00:46:36.703 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-05T00:46:36.746 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T00:46:37.001 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-05T00:46:37.027 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-05T00:46:37.054 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-09-05T00:46:37.067 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-05T00:46:37.080 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-05T00:46:37.121 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T00:46:37.370 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webob. 2024-09-05T00:46:37.397 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-05T00:46:37.432 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-09-05T00:46:37.437 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T00:46:37.458 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-05T00:46:37.499 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T00:46:37.773 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-waitress. 2024-09-05T00:46:37.789 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-05T00:46:37.802 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-05T00:46:37.826 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T00:46:37.828 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-05T00:46:37.868 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T00:46:38.076 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-tempita. 2024-09-05T00:46:38.099 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-05T00:46:38.134 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T00:46:38.155 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-05T00:46:38.181 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-05T00:46:38.221 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-05T00:46:38.438 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-paste. 2024-09-05T00:46:38.464 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-05T00:46:38.504 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T00:46:38.524 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-09-05T00:46:38.551 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-05T00:46:38.591 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-05T00:46:38.841 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-05T00:46:38.856 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-05T00:46:38.891 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T00:46:39.003 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-09-05T00:46:39.029 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-05T00:46:39.069 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T00:46:39.186 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-05T00:46:39.212 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-05T00:46:39.252 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-05T00:46:39.399 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-certifi. 2024-09-05T00:46:39.426 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-05T00:46:39.457 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-05T00:46:39.564 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-webtest. 2024-09-05T00:46:39.590 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-05T00:46:39.630 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-05T00:46:39.786 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-idna. 2024-09-05T00:46:39.812 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-05T00:46:39.852 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T00:46:39.942 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pecan. 2024-09-05T00:46:39.968 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-05T00:46:40.065 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T00:46:40.172 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-urllib3. 2024-09-05T00:46:40.198 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-05T00:46:40.238 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T00:46:40.346 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-certifi. 2024-09-05T00:46:40.373 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-05T00:46:40.421 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-05T00:46:40.567 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests. 2024-09-05T00:46:40.593 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-05T00:46:40.633 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T00:46:40.750 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-idna. 2024-09-05T00:46:40.776 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-05T00:46:40.816 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T00:46:40.961 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-05T00:46:40.988 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-05T00:46:41.028 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T00:46:41.136 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-urllib3. 2024-09-05T00:46:41.162 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-05T00:46:41.202 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T00:46:41.298 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-05T00:46:41.313 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:41.356 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:41.522 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests. 2024-09-05T00:46:41.550 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-05T00:46:41.964 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T00:46:42.553 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-05T00:46:42.580 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:42.621 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:42.734 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-05T00:46:42.761 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-05T00:46:42.800 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T00:46:43.056 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-05T00:46:43.082 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-05T00:46:43.122 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-05T00:46:43.212 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-05T00:46:43.227 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:43.270 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:43.417 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-09-05T00:46:43.443 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-05T00:46:43.484 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-05T00:46:43.659 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-05T00:46:43.685 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:43.725 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:43.812 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-09-05T00:46:43.838 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:43.878 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:44.045 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-05T00:46:44.072 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-05T00:46:44.111 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-05T00:46:44.232 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-09-05T00:46:44.247 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:44.281 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:44.440 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-openssl. 2024-09-05T00:46:44.468 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-05T00:46:44.506 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-05T00:46:44.826 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr. 2024-09-05T00:46:44.852 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:44.892 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:44.910 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-09-05T00:46:44.937 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:44.977 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:45.271 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mon. 2024-09-05T00:46:45.297 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:45.337 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mon (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:45.958 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-osd. 2024-09-05T00:46:45.984 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:46.024 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-osd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:46.055 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-09-05T00:46:46.070 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-ceph_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:46.113 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:46.383 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-09-05T00:46:46.409 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:46.441 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:46.803 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-09-05T00:46:46.829 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:46.869 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:47.061 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph. 2024-09-05T00:46:47.076 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../066-ceph_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:47.119 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:47.264 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-09-05T00:46:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-cephadm_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:47.347 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:47.465 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-fuse. 2024-09-05T00:46:47.491 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:47.530 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:47.626 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-05T00:46:47.641 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-05T00:46:47.675 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-05T00:46:47.909 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mds. 2024-09-05T00:46:47.935 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:47.975 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mds (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:48.003 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-05T00:46:48.030 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T00:46:48.094 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T00:46:48.370 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package cephadm. 2024-09-05T00:46:48.396 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../069-cephadm_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:46:48.428 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:48.748 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-05T00:46:48.774 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-05T00:46:48.814 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-05T00:46:49.067 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-babel. 2024-09-05T00:46:49.094 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T00:46:49.109 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-05T00:46:49.124 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T00:46:49.141 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T00:46:49.167 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T00:46:49.461 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-09-05T00:46:49.488 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-05T00:46:49.528 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T00:46:49.873 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-05T00:46:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:49.939 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:50.239 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-babel. 2024-09-05T00:46:50.267 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T00:46:50.276 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-05T00:46:50.303 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-05T00:46:50.305 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T00:46:50.343 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-05T00:46:50.621 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-09-05T00:46:50.642 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-jinja2. 2024-09-05T00:46:50.647 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-05T00:46:50.668 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-05T00:46:50.687 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T00:46:50.708 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T00:46:51.024 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-05T00:46:51.045 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-05T00:46:51.050 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:51.072 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:51.090 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:51.111 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:51.432 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-05T00:46:51.458 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-05T00:46:51.498 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-05T00:46:51.768 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-routes. 2024-09-05T00:46:51.795 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-05T00:46:51.826 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T00:46:52.171 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-05T00:46:52.198 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:52.240 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:53.762 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-05T00:46:53.780 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-05T00:46:53.821 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T00:46:54.333 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-09-05T00:46:54.360 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-05T00:46:54.399 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T00:46:54.720 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-05T00:46:54.735 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-05T00:46:54.769 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-05T00:46:55.064 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-09-05T00:46:55.091 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-05T00:46:55.130 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T00:46:55.176 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-05T00:46:55.193 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-05T00:46:55.234 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T00:46:55.721 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-joblib. 2024-09-05T00:46:55.749 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-05T00:46:55.788 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T00:46:55.898 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-05T00:46:55.928 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:56.050 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:56.175 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-05T00:46:56.202 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-05T00:46:56.241 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-05T00:46:56.561 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-sklearn. 2024-09-05T00:46:56.588 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-05T00:46:56.627 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T00:46:57.004 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-09-05T00:46:57.031 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-05T00:46:57.070 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-05T00:46:57.362 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-05T00:46:57.373 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-05T00:46:57.390 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:46:57.401 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-05T00:46:57.440 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-05T00:46:57.514 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:46:57.735 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-05T00:46:57.763 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-05T00:46:57.793 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T00:46:58.055 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-09-05T00:46:58.068 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-05T00:46:58.097 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-05T00:46:58.434 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-09-05T00:46:58.462 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-05T00:46:58.476 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-cachetools. 2024-09-05T00:46:58.504 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-05T00:46:58.509 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-05T00:46:58.534 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-05T00:46:58.812 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-05T00:46:58.840 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-05T00:46:58.854 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-05T00:46:58.879 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-05T00:46:58.882 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-05T00:46:58.920 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T00:46:59.207 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-09-05T00:46:59.216 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-05T00:46:59.235 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-05T00:46:59.244 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-05T00:46:59.273 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-05T00:46:59.282 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T00:46:59.552 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-05T00:46:59.580 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-05T00:46:59.594 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-rsa. 2024-09-05T00:46:59.619 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T00:46:59.622 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-05T00:46:59.660 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-05T00:46:59.997 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-google-auth. 2024-09-05T00:47:00.025 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-05T00:47:00.064 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-05T00:47:00.324 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-05T00:47:00.341 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:47:00.359 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-05T00:47:00.382 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:00.386 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-05T00:47:00.417 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T00:47:00.654 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-websocket. 2024-09-05T00:47:00.660 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-05T00:47:00.681 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-05T00:47:00.688 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-05T00:47:00.719 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T00:47:00.720 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-05T00:47:01.016 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-05T00:47:01.043 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-05T00:47:01.055 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-05T00:47:01.082 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T00:47:01.083 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T00:47:01.122 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T00:47:01.383 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-09-05T00:47:01.399 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T00:47:01.441 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-05T00:47:01.671 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-09-05T00:47:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-05T00:47:01.737 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-05T00:47:01.771 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-05T00:47:01.787 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:47:01.821 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:02.066 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-09-05T00:47:02.082 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-05T00:47:02.107 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-05T00:47:02.124 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-05T00:47:02.135 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-05T00:47:02.174 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T00:47:02.495 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-09-05T00:47:02.518 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-05T00:47:02.523 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:02.546 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T00:47:02.562 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:02.585 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T00:47:02.863 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package jq. 2024-09-05T00:47:02.891 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T00:47:02.929 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-05T00:47:03.291 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package socat. 2024-09-05T00:47:03.307 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-05T00:47:03.349 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-05T00:47:03.686 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package xmlstarlet. 2024-09-05T00:47:03.702 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-05T00:47:03.744 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-05T00:47:04.082 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-test. 2024-09-05T00:47:04.110 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:04.148 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-test (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:05.150 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-09-05T00:47:05.177 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:47:05.224 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:05.537 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-05T00:47:05.553 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:05.595 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:05.914 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-05T00:47:05.942 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-05T00:47:05.981 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T00:47:06.311 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-05T00:47:06.339 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-05T00:47:06.369 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-05T00:47:06.732 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-09-05T00:47:06.759 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-05T00:47:06.798 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T00:47:06.861 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package ceph-volume. 2024-09-05T00:47:06.889 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4712-gede15070-1jammy_all.deb ... 2024-09-05T00:47:06.927 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking ceph-volume (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:07.240 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-05T00:47:07.245 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pkg-config. 2024-09-05T00:47:07.269 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:07.273 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-05T00:47:07.306 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcephfs-dev (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:07.311 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T00:47:07.573 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-05T00:47:07.601 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-05T00:47:07.639 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-05T00:47:07.660 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-05T00:47:07.688 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-05T00:47:07.726 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T00:47:08.059 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-05T00:47:08.081 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-05T00:47:08.087 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-05T00:47:08.109 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-05T00:47:08.125 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-05T00:47:08.147 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-05T00:47:08.494 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package nvme-cli. 2024-09-05T00:47:08.522 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-05T00:47:08.560 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T00:47:08.687 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-09-05T00:47:08.715 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-05T00:47:08.753 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-05T00:47:08.982 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package pkg-config. 2024-09-05T00:47:09.010 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-05T00:47:09.057 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T00:47:09.082 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-09-05T00:47:09.110 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-05T00:47:09.148 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-05T00:47:09.318 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-05T00:47:09.346 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-05T00:47:09.384 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-05T00:47:09.459 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-09-05T00:47:09.487 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-05T00:47:09.526 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-05T00:47:09.805 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-05T00:47:09.833 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-05T00:47:09.871 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-05T00:47:09.879 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-09-05T00:47:09.907 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-05T00:47:09.946 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-05T00:47:10.183 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pastescript. 2024-09-05T00:47:10.211 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-05T00:47:10.249 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-05T00:47:10.282 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pygments. 2024-09-05T00:47:10.311 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-05T00:47:10.349 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T00:47:10.536 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pluggy. 2024-09-05T00:47:10.552 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-05T00:47:10.585 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-05T00:47:10.770 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-05T00:47:10.798 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-05T00:47:10.828 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-05T00:47:10.863 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-psutil. 2024-09-05T00:47:10.892 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-05T00:47:10.930 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-05T00:47:11.131 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-toml. 2024-09-05T00:47:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-05T00:47:11.197 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-05T00:47:11.300 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-py. 2024-09-05T00:47:11.328 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-05T00:47:11.358 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-05T00:47:11.500 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-09-05T00:47:11.528 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-05T00:47:11.566 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T00:47:11.656 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pygments. 2024-09-05T00:47:11.682 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-05T00:47:11.720 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T00:47:11.904 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-09-05T00:47:11.932 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-05T00:47:11.970 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-05T00:47:12.191 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-05T00:47:12.219 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-05T00:47:12.240 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-05T00:47:12.257 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-05T00:47:12.268 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-05T00:47:12.306 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-05T00:47:12.568 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-toml. 2024-09-05T00:47:12.596 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-05T00:47:12.635 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-05T00:47:12.913 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-pytest. 2024-09-05T00:47:12.941 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-05T00:47:12.979 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T00:47:13.019 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-09-05T00:47:13.047 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-radosgw_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:13.085 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:13.342 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-simplejson. 2024-09-05T00:47:13.369 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-05T00:47:13.408 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-05T00:47:13.686 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-05T00:47:13.714 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-05T00:47:13.752 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-05T00:47:14.005 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-09-05T00:47:14.033 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:14.071 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:14.359 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-05T00:47:14.518 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package radosgw. 2024-09-05T00:47:14.543 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../116-radosgw_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:14.581 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking radosgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:14.618 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T00:47:14.744 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T00:47:14.984 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-05T00:47:15.322 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-05T00:47:15.511 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package rbd-fuse. 2024-09-05T00:47:15.528 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4712-gede15070-1jammy_amd64.deb ... 2024-09-05T00:47:15.569 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking rbd-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:15.750 INFO:teuthology.orchestra.run.smithi099.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-05T00:47:15.813 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:15.881 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-05T00:47:16.124 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T00:47:16.251 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T00:47:16.313 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-09-05T00:47:16.469 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T00:47:16.518 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-05T00:47:16.720 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-05T00:47:16.859 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-05T00:47:16.980 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-05T00:47:17.089 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-05T00:47:17.286 INFO:teuthology.orchestra.run.smithi204.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-05T00:47:17.353 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:17.357 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-05T00:47:17.616 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T00:47:17.751 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-05T00:47:18.053 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T00:47:18.337 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user cephadm....done 2024-09-05T00:47:18.396 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-05T00:47:18.486 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T00:47:18.648 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-05T00:47:18.754 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-05T00:47:18.907 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-05T00:47:19.013 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-05T00:47:19.139 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-05T00:47:19.175 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-05T00:47:19.390 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-05T00:47:19.435 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-05T00:47:19.641 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T00:47:19.686 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-05T00:47:19.760 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-05T00:47:19.904 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:20.086 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T00:47:20.155 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T00:47:20.281 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T00:47:20.432 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T00:47:20.438 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-05T00:47:20.558 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-05T00:47:20.690 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-05T00:47:20.817 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-05T00:47:20.949 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-05T00:47:21.151 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-05T00:47:21.199 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-05T00:47:21.233 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-05T00:47:21.296 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T00:47:21.397 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-05T00:47:21.410 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-05T00:47:21.661 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-05T00:47:21.756 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T00:47:21.882 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-05T00:47:21.929 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-argparse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:22.150 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T00:47:22.172 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T00:47:22.298 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T00:47:22.424 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T00:47:22.426 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-05T00:47:22.550 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-05T00:47:22.727 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up zip (3.0-12build2) ... 2024-09-05T00:47:22.818 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-05T00:47:22.845 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T00:47:23.238 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-05T00:47:23.265 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-05T00:47:23.330 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T00:47:23.447 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-05T00:47:23.489 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T00:47:23.740 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T00:47:23.815 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T00:47:23.866 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-05T00:47:23.916 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-05T00:47:24.168 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T00:47:24.342 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T00:47:24.427 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-05T00:47:24.643 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-05T00:47:24.737 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up zip (3.0-12build2) ... 2024-09-05T00:47:24.863 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T00:47:25.044 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-05T00:47:25.279 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T00:47:25.515 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T00:47:25.647 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T00:47:25.749 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T00:47:25.875 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-05T00:47:25.956 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T00:47:26.010 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T00:47:26.319 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-05T00:47:26.325 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-05T00:47:26.576 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-05T00:47:26.695 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-05T00:47:26.702 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:26.930 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T00:47:27.003 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T00:47:27.290 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T00:47:27.304 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T00:47:27.575 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T00:47:27.901 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-05T00:47:28.152 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-05T00:47:28.278 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:28.485 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T00:47:28.571 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T00:47:28.906 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T00:47:28.928 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:29.054 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-05T00:47:29.330 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T00:47:29.457 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-05T00:47:29.582 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T00:47:29.876 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-05T00:47:30.110 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-05T00:47:30.111 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T00:47:30.338 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:30.345 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:30.471 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-05T00:47:30.506 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-05T00:47:30.757 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T00:47:30.789 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-05T00:47:30.883 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-05T00:47:31.018 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T00:47:31.040 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-05T00:47:31.319 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-05T00:47:31.332 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-05T00:47:31.562 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-05T00:47:31.592 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-05T00:47:31.796 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:31.827 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-05T00:47:31.922 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-05T00:47:32.086 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T00:47:32.212 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-05T00:47:32.232 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-05T00:47:32.497 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T00:47:32.500 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-05T00:47:32.622 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T00:47:32.776 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-05T00:47:32.915 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T00:47:33.036 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-05T00:47:33.216 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-05T00:47:33.262 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-05T00:47:33.476 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T00:47:33.513 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T00:47:33.577 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-05T00:47:33.639 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-05T00:47:33.686 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T00:47:33.776 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-05T00:47:33.907 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T00:47:34.033 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T00:47:34.038 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T00:47:34.164 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T00:47:34.351 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T00:47:34.557 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-05T00:47:34.652 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-05T00:47:34.825 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-05T00:47:34.895 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T00:47:34.934 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-05T00:47:35.021 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-05T00:47:35.130 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T00:47:35.169 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:35.220 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-05T00:47:35.270 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T00:47:35.457 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T00:47:35.558 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T00:47:35.579 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T00:47:35.880 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T00:47:35.935 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-05T00:47:36.157 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-05T00:47:36.195 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-05T00:47:36.282 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-05T00:47:36.344 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-05T00:47:36.559 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-05T00:47:36.571 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T00:47:36.689 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T00:47:36.818 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T00:47:37.023 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T00:47:37.155 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-05T00:47:37.333 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T00:47:37.540 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-05T00:47:37.609 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-05T00:47:37.735 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-05T00:47:37.841 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T00:47:38.003 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-05T00:47:38.202 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T00:47:38.271 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T00:47:38.354 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:38.480 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:38.599 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-05T00:47:38.605 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-05T00:47:38.942 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:38.985 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-05T00:47:39.051 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.153 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-05T00:47:39.270 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T00:47:39.429 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.580 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.588 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T00:47:39.698 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librados2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.706 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.807 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:39.917 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-05T00:47:39.926 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T00:47:39.926 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T00:47:40.262 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.388 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libradosstriper1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.432 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.514 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-05T00:47:40.559 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.660 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.761 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T00:47:40.807 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librbd1 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:40.908 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-modules-core (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:41.443 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:41.678 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T00:47:41.678 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T00:47:41.998 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.124 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.127 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcephfs-dev (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.228 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rados (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.258 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.330 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up librgw2 (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.367 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.447 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T00:47:42.468 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:42.994 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-09-05T00:47:43.346 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-09-05T00:47:43.523 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-09-05T00:47:43.541 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-05T00:47:43.660 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rbd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:43.678 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-05T00:47:43.786 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up rbd-fuse (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:43.912 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-rgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:43.998 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-05T00:47:44.038 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-cephfs (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:44.164 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-common (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:44.485 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:44.657 INFO:teuthology.orchestra.run.smithi204.stdout:Adding group ceph....done 2024-09-05T00:47:44.692 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:45.084 INFO:teuthology.orchestra.run.smithi204.stdout:Adding system user ceph....done 2024-09-05T00:47:45.253 INFO:teuthology.orchestra.run.smithi204.stdout:Setting system user ceph properties....done 2024-09-05T00:47:45.266 INFO:teuthology.orchestra.run.smithi204.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-05T00:47:45.403 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-05T00:47:45.517 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T00:47:45.518 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T00:47:45.773 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-05T00:47:45.983 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:46.258 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-test (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:46.299 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-05T00:47:46.384 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up radosgw (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:46.760 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:46.877 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T00:47:46.877 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T00:47:46.999 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T00:47:47.000 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T00:47:47.390 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-base (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:47.479 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:47.703 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T00:47:47.703 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T00:47:47.831 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-05T00:47:48.180 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:48.273 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mds (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:48.457 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T00:47:48.457 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T00:47:48.487 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T00:47:48.487 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T00:47:48.907 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:48.908 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:49.041 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:49.121 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T00:47:49.121 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T00:47:49.167 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:49.380 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T00:47:49.380 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T00:47:49.560 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-osd (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:49.810 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:49.858 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T00:47:49.858 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T00:47:49.936 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.054 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.205 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.354 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.479 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.603 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-05T00:47:50.631 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mon (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:50.704 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-05T00:47:50.834 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T00:47:50.834 INFO:teuthology.orchestra.run.smithi204.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T00:47:50.855 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T00:47:51.282 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-cephadm (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:51.425 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:51.551 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-mgr-dashboard (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:51.563 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-05T00:47:51.693 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up ceph-volume (19.3.0-4712-gede15070-1jammy) ... 2024-09-05T00:47:52.072 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-05T00:47:52.165 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-05T00:47:52.224 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T00:47:52.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-05T00:47:52.285 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T00:47:52.326 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T00:47:52.496 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-05T00:47:52.497 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-05T00:47:52.687 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:47:52.687 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:47:52.687 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:47:52.687 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:47:52.687 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:47:52.688 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:47:52.688 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-05T00:47:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-05T00:47:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-05T00:47:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-05T00:47:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: s3cmd 2024-09-05T00:47:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T00:47:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 10.4 MB of archives. 2024-09-05T00:47:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-05T00:47:52.930 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-05T00:47:53.012 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-05T00:47:53.012 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-05T00:47:53.029 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-05T00:47:53.059 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-05T00:47:53.193 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-05T00:47:53.263 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-05T00:47:53.271 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-05T00:47:53.405 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-05T00:47:53.497 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-05T00:47:53.498 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-05T00:47:53.501 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-05T00:47:53.645 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-05T00:47:53.646 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-05T00:47:53.686 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-05T00:47:53.686 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-05T00:47:53.688 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-05T00:47:53.689 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-05T00:47:53.690 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-05T00:47:53.696 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-05T00:47:53.697 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-05T00:47:53.713 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T00:47:53.716 DEBUG:teuthology.orchestra.run.smithi204:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-05T00:47:53.741 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-05T00:47:53.744 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-05T00:47:53.794 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-05T00:47:53.795 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-05T00:47:53.796 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-05T00:47:53.798 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-05T00:47:53.799 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-05T00:47:53.819 INFO:teuthology.orchestra.run.smithi204.stdout:Reading package lists... 2024-09-05T00:47:53.823 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-05T00:47:53.831 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-05T00:47:53.835 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-05T00:47:53.904 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-05T00:47:53.904 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-05T00:47:53.935 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-05T00:47:53.936 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-05T00:47:53.936 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-05T00:47:54.029 INFO:teuthology.orchestra.run.smithi204.stdout:Building dependency tree... 2024-09-05T00:47:54.030 INFO:teuthology.orchestra.run.smithi204.stdout:Reading state information... 2024-09-05T00:47:54.217 INFO:teuthology.orchestra.run.smithi204.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T00:47:54.217 INFO:teuthology.orchestra.run.smithi204.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T00:47:54.217 INFO:teuthology.orchestra.run.smithi204.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T00:47:54.218 INFO:teuthology.orchestra.run.smithi204.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T00:47:54.218 INFO:teuthology.orchestra.run.smithi204.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T00:47:54.218 INFO:teuthology.orchestra.run.smithi204.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T00:47:54.218 INFO:teuthology.orchestra.run.smithi204.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout:The following additional packages will be installed: 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-05T00:47:54.220 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout:Suggested packages: 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-05T00:47:54.221 INFO:teuthology.orchestra.run.smithi204.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-05T00:47:54.222 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-05T00:47:54.222 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-05T00:47:54.260 INFO:teuthology.orchestra.run.smithi204.stdout:The following NEW packages will be installed: 2024-09-05T00:47:54.260 INFO:teuthology.orchestra.run.smithi204.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-05T00:47:54.260 INFO:teuthology.orchestra.run.smithi204.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-05T00:47:54.260 INFO:teuthology.orchestra.run.smithi204.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-05T00:47:54.260 INFO:teuthology.orchestra.run.smithi204.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-05T00:47:54.261 INFO:teuthology.orchestra.run.smithi204.stdout: s3cmd 2024-09-05T00:47:54.379 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 10.4 MB in 1s (8,644 kB/s) 2024-09-05T00:47:54.442 INFO:teuthology.orchestra.run.smithi204.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T00:47:54.442 INFO:teuthology.orchestra.run.smithi204.stdout:Need to get 10.4 MB of archives. 2024-09-05T00:47:54.442 INFO:teuthology.orchestra.run.smithi204.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-05T00:47:54.442 INFO:teuthology.orchestra.run.smithi204.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-05T00:47:54.467 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-05T00:47:54.524 INFO:teuthology.orchestra.run.smithi204.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-05T00:47:54.524 INFO:teuthology.orchestra.run.smithi204.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-05T00:47:54.527 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-05T00:47:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-05T00:47:54.541 INFO:teuthology.orchestra.run.smithi204.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-05T00:47:54.575 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-05T00:47:54.704 INFO:teuthology.orchestra.run.smithi204.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-05T00:47:54.774 INFO:teuthology.orchestra.run.smithi204.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-05T00:47:54.783 INFO:teuthology.orchestra.run.smithi204.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-05T00:47:54.828 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-05T00:47:54.844 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-05T00:47:54.886 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-05T00:47:54.917 INFO:teuthology.orchestra.run.smithi204.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-05T00:47:55.008 INFO:teuthology.orchestra.run.smithi204.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-05T00:47:55.010 INFO:teuthology.orchestra.run.smithi204.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-05T00:47:55.013 INFO:teuthology.orchestra.run.smithi204.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-05T00:47:55.144 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-05T00:47:55.157 INFO:teuthology.orchestra.run.smithi204.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-05T00:47:55.157 INFO:teuthology.orchestra.run.smithi204.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-05T00:47:55.172 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-05T00:47:55.197 INFO:teuthology.orchestra.run.smithi204.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-05T00:47:55.198 INFO:teuthology.orchestra.run.smithi204.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-05T00:47:55.200 INFO:teuthology.orchestra.run.smithi204.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-05T00:47:55.201 INFO:teuthology.orchestra.run.smithi204.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-05T00:47:55.202 INFO:teuthology.orchestra.run.smithi204.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-05T00:47:55.207 INFO:teuthology.orchestra.run.smithi204.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-05T00:47:55.208 INFO:teuthology.orchestra.run.smithi204.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-05T00:47:55.213 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-05T00:47:55.253 INFO:teuthology.orchestra.run.smithi204.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-05T00:47:55.255 INFO:teuthology.orchestra.run.smithi204.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-05T00:47:55.305 INFO:teuthology.orchestra.run.smithi204.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-05T00:47:55.307 INFO:teuthology.orchestra.run.smithi204.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-05T00:47:55.307 INFO:teuthology.orchestra.run.smithi204.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-05T00:47:55.310 INFO:teuthology.orchestra.run.smithi204.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-05T00:47:55.310 INFO:teuthology.orchestra.run.smithi204.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-05T00:47:55.336 INFO:teuthology.orchestra.run.smithi204.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-05T00:47:55.344 INFO:teuthology.orchestra.run.smithi204.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-05T00:47:55.348 INFO:teuthology.orchestra.run.smithi204.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-05T00:47:55.415 INFO:teuthology.orchestra.run.smithi204.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-05T00:47:55.415 INFO:teuthology.orchestra.run.smithi204.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-05T00:47:55.448 INFO:teuthology.orchestra.run.smithi204.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-05T00:47:55.448 INFO:teuthology.orchestra.run.smithi204.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-05T00:47:55.448 INFO:teuthology.orchestra.run.smithi204.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-05T00:47:55.492 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-05T00:47:55.520 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-05T00:47:55.550 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-05T00:47:55.803 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-05T00:47:55.831 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-05T00:47:55.869 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-05T00:47:55.895 INFO:teuthology.orchestra.run.smithi204.stdout:Fetched 10.4 MB in 1s (8,784 kB/s) 2024-09-05T00:47:55.981 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-05T00:47:56.041 INFO:teuthology.orchestra.run.smithi204.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-05T00:47:56.046 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-05T00:47:56.097 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-05T00:47:56.121 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-05T00:47:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-05T00:47:56.205 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-05T00:47:56.350 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-05T00:47:56.379 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-05T00:47:56.416 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-05T00:47:56.457 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-05T00:47:56.485 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-05T00:47:56.524 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-05T00:47:56.678 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-05T00:47:56.695 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-05T00:47:56.736 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-05T00:47:56.768 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-05T00:47:56.785 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-05T00:47:56.818 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-05T00:47:57.048 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-05T00:47:57.066 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-05T00:47:57.106 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-05T00:47:57.112 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-05T00:47:57.128 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-05T00:47:57.170 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-05T00:47:57.384 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-05T00:47:57.409 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-05T00:47:57.422 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjsr305-java. 2024-09-05T00:47:57.450 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-05T00:47:57.451 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-05T00:47:57.489 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-05T00:47:57.712 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-05T00:47:57.728 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-05T00:47:57.742 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libguava-java. 2024-09-05T00:47:57.770 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-05T00:47:57.770 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-05T00:47:57.808 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-05T00:47:58.022 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-05T00:47:58.039 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-05T00:47:58.080 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-05T00:47:58.244 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-05T00:47:58.260 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-05T00:47:58.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-05T00:47:58.325 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-05T00:47:58.341 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-05T00:47:58.374 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-05T00:47:58.555 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libguice-java. 2024-09-05T00:47:58.570 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-05T00:47:58.613 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-05T00:47:58.653 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-05T00:47:58.669 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-05T00:47:58.711 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-05T00:47:58.991 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-05T00:47:59.008 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-05T00:47:59.013 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjsr305-java. 2024-09-05T00:47:59.042 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-05T00:47:59.050 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-05T00:47:59.080 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-05T00:47:59.294 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-05T00:47:59.310 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-05T00:47:59.341 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libguava-java. 2024-09-05T00:47:59.344 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-05T00:47:59.370 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-05T00:47:59.408 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-05T00:47:59.530 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjansi-java. 2024-09-05T00:47:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-05T00:47:59.580 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-05T00:47:59.819 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-05T00:47:59.836 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-05T00:47:59.857 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-05T00:47:59.877 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-05T00:47:59.885 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-05T00:47:59.923 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-05T00:48:00.130 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libguice-java. 2024-09-05T00:48:00.146 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-05T00:48:00.188 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-05T00:48:00.193 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-05T00:48:00.209 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-05T00:48:00.251 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-05T00:48:00.576 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-05T00:48:00.604 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-05T00:48:00.641 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-05T00:48:00.642 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-05T00:48:00.669 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-05T00:48:00.705 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-05T00:48:00.878 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-05T00:48:00.907 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-05T00:48:00.937 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-05T00:48:00.958 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-05T00:48:00.974 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-05T00:48:01.016 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-05T00:48:01.164 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libjansi-java. 2024-09-05T00:48:01.181 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-05T00:48:01.222 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-05T00:48:01.337 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-05T00:48:01.353 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-05T00:48:01.395 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-05T00:48:01.475 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-05T00:48:01.492 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-05T00:48:01.533 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-05T00:48:01.639 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-05T00:48:01.655 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-05T00:48:01.697 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-05T00:48:01.794 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-05T00:48:01.811 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-05T00:48:01.852 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-05T00:48:01.950 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-05T00:48:01.966 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-05T00:48:02.008 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-05T00:48:02.244 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-05T00:48:02.249 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-05T00:48:02.272 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-05T00:48:02.277 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-05T00:48:02.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-05T00:48:02.307 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-05T00:48:02.521 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-05T00:48:02.537 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-05T00:48:02.551 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-05T00:48:02.568 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-05T00:48:02.571 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-05T00:48:02.610 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-05T00:48:02.782 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-05T00:48:02.798 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-05T00:48:02.840 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-05T00:48:02.931 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-05T00:48:02.951 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-05T00:48:02.989 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-05T00:48:03.100 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libslf4j-java. 2024-09-05T00:48:03.128 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-05T00:48:03.167 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-05T00:48:03.250 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-05T00:48:03.279 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-05T00:48:03.317 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-05T00:48:03.471 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-05T00:48:03.487 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-05T00:48:03.529 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-05T00:48:03.546 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-05T00:48:03.563 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-05T00:48:03.604 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-05T00:48:03.815 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-05T00:48:03.843 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-05T00:48:03.857 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-05T00:48:03.874 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-05T00:48:03.881 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-05T00:48:03.915 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-05T00:48:04.159 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-05T00:48:04.168 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-05T00:48:04.187 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-05T00:48:04.193 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-05T00:48:04.234 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-05T00:48:04.234 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-05T00:48:04.453 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-05T00:48:04.470 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-05T00:48:04.503 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-05T00:48:04.596 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-05T00:48:04.613 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-05T00:48:04.646 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-05T00:48:04.748 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libslf4j-java. 2024-09-05T00:48:04.764 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-05T00:48:04.798 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-05T00:48:04.882 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-05T00:48:04.898 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-05T00:48:04.940 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-05T00:48:05.077 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-05T00:48:05.105 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-05T00:48:05.135 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-05T00:48:05.410 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package maven. 2024-09-05T00:48:05.421 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-05T00:48:05.437 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-05T00:48:05.438 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-05T00:48:05.476 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking maven (3.6.3-5) ... 2024-09-05T00:48:05.479 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-05T00:48:05.757 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-05T00:48:05.773 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-05T00:48:05.813 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-magic. 2024-09-05T00:48:05.815 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-05T00:48:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-05T00:48:05.896 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-05T00:48:06.166 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package s3cmd. 2024-09-05T00:48:06.194 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-05T00:48:06.203 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-05T00:48:06.232 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-05T00:48:06.232 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-05T00:48:06.269 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-05T00:48:06.480 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-05T00:48:06.494 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-05T00:48:06.530 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-05T00:48:06.603 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-05T00:48:06.729 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-05T00:48:06.855 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-05T00:48:06.992 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package maven. 2024-09-05T00:48:07.056 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-05T00:48:07.056 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-05T00:48:07.083 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking maven (3.6.3-5) ... 2024-09-05T00:48:07.116 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-05T00:48:07.225 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-05T00:48:07.328 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-05T00:48:07.445 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package python3-magic. 2024-09-05T00:48:07.460 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-05T00:48:07.474 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-05T00:48:07.511 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-05T00:48:07.586 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-05T00:48:07.711 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-05T00:48:07.781 INFO:teuthology.orchestra.run.smithi204.stdout:Selecting previously unselected package s3cmd. 2024-09-05T00:48:07.810 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-05T00:48:07.837 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-05T00:48:07.839 INFO:teuthology.orchestra.run.smithi204.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-05T00:48:07.963 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-05T00:48:08.089 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-05T00:48:08.202 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-05T00:48:08.207 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-05T00:48:08.308 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-05T00:48:08.311 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-05T00:48:08.409 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-05T00:48:08.412 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-05T00:48:08.547 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-05T00:48:08.668 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-05T00:48:08.673 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-05T00:48:08.794 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-05T00:48:08.799 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-05T00:48:08.903 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-05T00:48:08.942 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-05T00:48:09.004 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-05T00:48:09.068 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-05T00:48:09.114 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-05T00:48:09.202 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-05T00:48:09.265 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-05T00:48:09.319 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-05T00:48:09.462 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-05T00:48:09.647 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-05T00:48:09.674 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-05T00:48:09.798 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-05T00:48:09.924 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-05T00:48:09.975 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-05T00:48:10.050 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-05T00:48:10.101 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-05T00:48:10.176 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-05T00:48:10.227 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libguava-java (29.0-6) ... 2024-09-05T00:48:10.370 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-05T00:48:10.435 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-05T00:48:10.516 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-05T00:48:10.578 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-05T00:48:10.647 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-05T00:48:10.679 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-05T00:48:10.789 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-05T00:48:10.832 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-05T00:48:10.915 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-05T00:48:10.933 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-05T00:48:11.040 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-05T00:48:11.042 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-05T00:48:11.167 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-05T00:48:11.168 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-05T00:48:11.294 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-05T00:48:11.420 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up maven (3.6.3-5) ... 2024-09-05T00:48:11.476 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-05T00:48:11.602 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-05T00:48:11.677 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-05T00:48:11.733 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T00:48:11.745 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libguava-java (29.0-6) ... 2024-09-05T00:48:11.879 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-05T00:48:11.997 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-05T00:48:12.124 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-05T00:48:12.606 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-05T00:48:12.843 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-05T00:48:12.986 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-05T00:48:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T00:48:13.054 DEBUG:teuthology.parallel:result is None 2024-09-05T00:48:13.128 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-05T00:48:13.279 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-05T00:48:13.439 INFO:teuthology.orchestra.run.smithi204.stdout:Setting up maven (3.6.3-5) ... 2024-09-05T00:48:13.738 INFO:teuthology.orchestra.run.smithi204.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-05T00:48:13.802 INFO:teuthology.orchestra.run.smithi204.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T00:48:15.171 INFO:teuthology.orchestra.run.smithi204.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T00:48:15.176 DEBUG:teuthology.parallel:result is None 2024-09-05T00:48:15.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:48:15.317 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-09-05T00:48:15.336 INFO:teuthology.orchestra.run.smithi099.stdout:19.3.0-4712-gede15070-1jammy 2024-09-05T00:48:15.337 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4712-gede15070-1jammy 2024-09-05T00:48:15.337 INFO:teuthology.task.install:The correct ceph version 19.3.0-4712-gede15070-1jammy is installed. 2024-09-05T00:48:15.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:48:15.474 DEBUG:teuthology.orchestra.run.smithi204:> dpkg-query -W -f '${Version}' ceph 2024-09-05T00:48:15.494 INFO:teuthology.orchestra.run.smithi204.stdout:19.3.0-4712-gede15070-1jammy 2024-09-05T00:48:15.494 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4712-gede15070-1jammy 2024-09-05T00:48:15.494 INFO:teuthology.task.install:The correct ceph version 19.3.0-4712-gede15070-1jammy is installed. 2024-09-05T00:48:15.496 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T00:48:15.496 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:15.496 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T00:48:15.511 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:15.511 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T00:48:15.547 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T00:48:15.548 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:15.548 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T00:48:15.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T00:48:15.622 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:15.623 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T00:48:15.635 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T00:48:15.690 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T00:48:15.691 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:15.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T00:48:15.703 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T00:48:15.761 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:15.761 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T00:48:15.773 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T00:48:15.826 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T00:48:15.827 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:15.827 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T00:48:15.839 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T00:48:15.895 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:15.895 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T00:48:15.908 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T00:48:15.963 INFO:teuthology.run_tasks:Running task ceph... 2024-09-05T00:48:16.054 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-05T00:48:16.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-05T00:48:16.057 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /var/log/ceph 2024-09-05T00:48:16.069 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-05T00:48:16.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T00:48:16.113 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T00:48:16.125 INFO:tasks.ceph:Creating extra log directories... 2024-09-05T00:48:16.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T00:48:16.170 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T00:48:16.194 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-05T00:48:16.194 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-05T00:48:16.194 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599', 'branch': 'pr-56597', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7889599', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'pr-56597'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pr-56597', 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3056, 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'pr-56597', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5', 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOS/Fu2V2f6Klum/rX9IHxYDDTlMeOzaQHM3OYqY3vprhBhC9Pcz6fLupv5jS3GXeeA6ldFi9JxtyBB0H43GH+E=', 'smithi204.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJJPjI1t/XXUI7XoAjJeAIQGLE3gXuZK6QmM4Iub2cTA8E2R4a+P93FyhAJQ+nMr8R/UBhTWo3NCdv/futjcLgM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'ede1507024117d16395cd6d958c594ff4aaf4da5'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-04_19:08:10', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-05T00:48:16.194 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T00:48:16.225 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T00:48:16.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T00:48:16.273 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T00:48:16.287 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:16.287 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T00:48:16.332 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T00:48:16.332 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-05T00:48:16.380 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T00:48:16.380 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:16.380 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-05T00:48:16.380 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:16.380 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-05 00:42:29.739940223 +0000 2024-09-05T00:48:16.381 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-05 00:42:29.471942617 +0000 2024-09-05T00:48:16.381 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-05 00:42:29.471942617 +0000 2024-09-05T00:48:16.381 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-05T00:48:16.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T00:48:16.434 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-05T00:48:16.434 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-05T00:48:16.434 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00046089 s, 1.1 MB/s 2024-09-05T00:48:16.435 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T00:48:16.485 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-05 00:42:30.227935863 +0000 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-05 00:42:29.963938222 +0000 2024-09-05T00:48:16.532 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-05 00:42:29.963938222 +0000 2024-09-05T00:48:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-05T00:48:16.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T00:48:16.585 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-05T00:48:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-05T00:48:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000361997 s, 1.4 MB/s 2024-09-05T00:48:16.587 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T00:48:16.637 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-05T00:48:16.683 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 919 Links: 1 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-05 00:42:30.491933506 +0000 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-05 00:42:30.487933541 +0000 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-05 00:42:30.487933541 +0000 2024-09-05T00:48:16.684 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-05T00:48:16.684 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T00:48:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-05T00:48:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-05T00:48:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000327825 s, 1.6 MB/s 2024-09-05T00:48:16.740 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T00:48:16.789 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-05T00:48:16.835 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T00:48:16.835 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:16.835 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-09-05T00:48:16.836 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:16.836 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-05 00:42:30.967929254 +0000 2024-09-05T00:48:16.836 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-05 00:42:30.963929290 +0000 2024-09-05T00:48:16.836 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-05 00:42:30.963929290 +0000 2024-09-05T00:48:16.836 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-05T00:48:16.836 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T00:48:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-05T00:48:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-05T00:48:16.890 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000363473 s, 1.4 MB/s 2024-09-05T00:48:16.891 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T00:48:16.941 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:16.941 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:16.941 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T00:48:16.947 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T00:48:16.947 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-05 00:42:29.656419048 +0000 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-05 00:42:29.400421336 +0000 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-05 00:42:29.400421336 +0000 2024-09-05T00:48:16.997 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-05T00:48:16.997 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T00:48:17.051 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-05T00:48:17.051 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-05T00:48:17.051 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000442707 s, 1.2 MB/s 2024-09-05T00:48:17.052 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T00:48:17.101 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-09-05T00:48:17.147 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-05 00:42:30.124414868 +0000 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-05 00:42:29.880417047 +0000 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-05 00:42:29.880417047 +0000 2024-09-05T00:48:17.148 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-05T00:48:17.148 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T00:48:17.202 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-05T00:48:17.202 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-05T00:48:17.202 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000377876 s, 1.4 MB/s 2024-09-05T00:48:17.203 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T00:48:17.253 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-05 00:42:30.636410295 +0000 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-05 00:42:30.364412724 +0000 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-05 00:42:30.364412724 +0000 2024-09-05T00:48:17.300 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-05T00:48:17.301 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T00:48:17.353 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-05T00:48:17.353 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-05T00:48:17.354 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000339453 s, 1.5 MB/s 2024-09-05T00:48:17.355 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T00:48:17.404 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 938 Links: 1 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-09-05 00:42:31.120405971 +0000 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-09-05 00:42:30.884408080 +0000 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-09-05 00:42:30.884408080 +0000 2024-09-05T00:48:17.452 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: - 2024-09-05T00:48:17.453 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T00:48:17.505 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-09-05T00:48:17.506 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-09-05T00:48:17.506 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000341719 s, 1.5 MB/s 2024-09-05T00:48:17.507 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T00:48:17.557 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:17.557 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T00:48:17.557 INFO:tasks.ceph:Generating config... 2024-09-05T00:48:17.558 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-05T00:48:17.558 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-05T00:48:17.558 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-05T00:48:17.559 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-05T00:48:17.560 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-05T00:48:17.560 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-05T00:48:17.560 INFO:tasks.ceph:[client] setuser = ceph 2024-09-05T00:48:17.560 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-05T00:48:17.560 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-05T00:48:17.560 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-05T00:48:17.560 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-05T00:48:17.560 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-05T00:48:17.560 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-05T00:48:17.560 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-05T00:48:17.560 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-05T00:48:17.560 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-05T00:48:17.561 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-05T00:48:17.561 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-05T00:48:17.561 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-05T00:48:17.562 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-05T00:48:17.562 INFO:tasks.ceph:Setting up mon.a... 2024-09-05T00:48:17.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-05T00:48:17.597 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-09-05T00:48:17.613 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-05T00:48:17.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T00:48:17.747 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]'), ('mon.b', '172.21.15.204')] 2024-09-05T00:48:17.748 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.204', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-05T00:48:17.748 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:17.749 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T00:48:17.796 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --add b 172.21.15.204 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:17.883 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:48:17.883 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:48:17.883 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-05T00:48:17.885524+0000 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T00:48:17.884 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-05T00:48:17.886 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T00:48:17.931 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1... 2024-09-05T00:48:17.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T00:48:17.977 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T00:48:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.204" 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: mon client directed command retry = 5 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: ms inject socket failures = 5000 2024-09-05T00:48:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: osd heartbeat grace = 40 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd_max_pg_log_entries = 10 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd_min_pg_log_entries = 10 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-05T00:48:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-05T00:48:18.010 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-05T00:48:18.011 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-09-05T00:48:18.012 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: debug objclass = 20 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-05T00:48:18.013 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd fast shutdown = False 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: osd shutdown pgref assert = True 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-05T00:48:18.014 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-05T00:48:18.015 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T00:48:18.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd crush smoke test = False 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T00:48:18.017 INFO:teuthology.orchestra.run.smithi099.stdout: debug rgw = 20 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: debug rgw notification = 20 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw bucket counters cache = True 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt require ssl = False 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt s3 kms backend = testing 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw max chunk size = 4194304 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw obj stripe size = 6291456 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw reshard progress judge interval = 10 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw s3 auth use sts = True 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw sts key = abcdefghijklmnop 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw torrent flag = True 2024-09-05T00:48:18.018 INFO:teuthology.orchestra.run.smithi099.stdout: rgw user counters cache = True 2024-09-05T00:48:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: setgroup = ceph 2024-09-05T00:48:18.019 INFO:teuthology.orchestra.run.smithi099.stdout: setuser = ceph 2024-09-05T00:48:18.019 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-05T00:48:18.019 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-09-05T00:48:18.019 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-09-05T00:48:18.020 INFO:teuthology.orchestra.run.smithi204.stdout:[global] 2024-09-05T00:48:18.020 INFO:teuthology.orchestra.run.smithi204.stdout: chdir = "" 2024-09-05T00:48:18.020 INFO:teuthology.orchestra.run.smithi204.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T00:48:18.020 INFO:teuthology.orchestra.run.smithi204.stdout: auth supported = cephx 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: filestore xattr use omap = true 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: mon clock drift allowed = 1.000 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: osd crush chooseleaf type = 0 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: auth debug = true 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on old message = true 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: ms die on bug = true 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.021 INFO:teuthology.orchestra.run.smithi204.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: mon pg warn max object skew = 0 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default size = 2 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow primary affinity = true 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd allow pg remap = true 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on legacy crush tunables = false 2024-09-05T00:48:18.022 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on crush straw calc version zero = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on no sortbitwise = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on osd down out interval zero = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon warn on too few osds = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon_allow_pool_size_one = true 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: osd default data pool replay window = 5 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: mon allow pool delete = true 2024-09-05T00:48:18.023 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: mon cluster log file level = debug 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: debug asserts on shutdown = true 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: mon health detail to clog = false 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.204" 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: mon client directed command retry = 5 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: ms inject socket failures = 5000 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: osd heartbeat grace = 40 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: osd_max_pg_log_entries = 10 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: osd_min_pg_log_entries = 10 2024-09-05T00:48:18.024 INFO:teuthology.orchestra.run.smithi204.stdout: fsid = 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout:[osd] 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd journal size = 100 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub load threshold = 5.0 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd scrub max interval = 600 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd mclock profile = high_recovery_ops 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd recover clone overlap = true 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd recovery max chunk = 1048576 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.025 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug shutdown = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug op order = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug verify stray on activate = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug trim objects = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd open classes on start = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug pg log writeout = true 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd deep scrub update digest min age = 30 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: osd map max advance = 10 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.026 INFO:teuthology.orchestra.run.smithi204.stdout: journal zero on create = true 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: filestore ondisk finisher threads = 3 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: filestore apply finisher threads = 3 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bdev debug aio = true 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: osd debug misdirected ops = true 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bdev async discard = True 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bdev enable discard = True 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore allocator = bitmap 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore block size = 96636764160 2024-09-05T00:48:18.027 INFO:teuthology.orchestra.run.smithi204.stdout: bluestore fsck on mount = True 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluefs = 1/20 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug bluestore = 1/20 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug objclass = 20 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug osd = 20 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: debug rocksdb = 4/10 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd full ratio = 0.9 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd nearfull ratio = 0.8 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: osd failsafe full ratio = 0.95 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: osd fast shutdown = False 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: osd objectstore = bluestore 2024-09-05T00:48:18.028 INFO:teuthology.orchestra.run.smithi204.stdout: osd shutdown pgref assert = True 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr] 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: debug mgr = 20 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: mgr/telemetry/nag = false 2024-09-05T00:48:18.029 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout:[mon] 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: debug ms = 1 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: debug mon = 20 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: debug paxos = 20 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: debug auth = 20 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon data avail warn = 5 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon mgr mkfs grace = 240 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min pgs per osd = 4 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd reporter subtree level = osd 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd prime pg temp = true 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: mon reweight min bytes per osd = 10 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.030 INFO:teuthology.orchestra.run.smithi204.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: # 1m isn't quite enough 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: mon_down_mkfs_grace = 2m 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.031 INFO:teuthology.orchestra.run.smithi204.stdout: mon_warn_on_filestore_osds = false 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: mon osd crush smoke test = False 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout:[client] 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: rgw cache enabled = true 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable ops log = true 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: rgw enable usage log = true 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw = 20 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: debug rgw notification = 20 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: rgw bucket counters cache = True 2024-09-05T00:48:18.032 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt require ssl = False 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms backend = testing 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw max chunk size = 4194304 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw obj stripe size = 6291456 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw reshard progress judge interval = 10 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw s3 auth use sts = True 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw sts key = abcdefghijklmnop 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw torrent flag = True 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: rgw user counters cache = True 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: setgroup = ceph 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout: setuser = ceph 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.a] 2024-09-05T00:48:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.c] 2024-09-05T00:48:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:[mon.b] 2024-09-05T00:48:18.034 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-05T00:48:18.034 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-05T00:48:18.111 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-05T00:48:18.111 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:18.112 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-05T00:48:18.117 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:18.118 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-05T00:48:18.163 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:48:18.163 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:18.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T00:48:18.164 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T00:48:18.230 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:18.230 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:18.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:48:18.276 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:18.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T00:48:18.276 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T00:48:18.300 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:18.300 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:18.348 INFO:tasks.ceph:Setting up mon nodes... 2024-09-05T00:48:18.348 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-05T00:48:18.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T00:48:18.392 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T00:48:18.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T00:48:18.439 INFO:teuthology.orchestra.run.smithi204.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T00:48:18.449 INFO:tasks.ceph:Setting up mds nodes... 2024-09-05T00:48:18.450 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-05T00:48:18.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T00:48:18.488 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-05T00:48:18.498 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-05T00:48:18.533 INFO:teuthology.orchestra.run.smithi204.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-05T00:48:18.546 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-05T00:48:18.546 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi204.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T00:48:18.546 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-05T00:48:18.559 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:18.559 INFO:tasks.ceph:role: osd.0 2024-09-05T00:48:18.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:48:18.559 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T00:48:18.622 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:18.622 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:18.622 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:18.623 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:19.107 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-05T00:48:19.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-05T00:48:19.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-05T00:48:19.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-05T00:48:19.263 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:19.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:19.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-05T00:48:19.320 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:19.320 INFO:tasks.ceph:role: osd.1 2024-09-05T00:48:19.320 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:48:19.320 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T00:48:19.384 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:19.384 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:19.384 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:19.385 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:19.829 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-05T00:48:19.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-05T00:48:19.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-05T00:48:19.923 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-05T00:48:19.932 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:19.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:19.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-05T00:48:19.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:19.985 INFO:tasks.ceph:role: osd.2 2024-09-05T00:48:19.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:48:19.985 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:20.049 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:20.507 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-05T00:48:20.511 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-05T00:48:20.511 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-05T00:48:20.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-05T00:48:20.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:20.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-05T00:48:20.682 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:20.682 INFO:tasks.ceph:role: osd.3 2024-09-05T00:48:20.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T00:48:20.682 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:20.748 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:20.749 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:21.237 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-05T00:48:21.239 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-05T00:48:21.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-05T00:48:21.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-05T00:48:21.414 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:21.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:21.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:21.532+0000 7f63559047c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-05T00:48:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:21.536+0000 7f63559047c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-05T00:48:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:21.536+0000 7f63559047c0 -1 bdev(0x555a3e73d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:21.536+0000 7f63559047c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-05T00:48:24.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-05T00:48:24.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:24.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:24.768+0000 7fc9327337c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-05T00:48:24.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:24.768+0000 7fc9327337c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-05T00:48:24.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:24.768+0000 7fc9327337c0 -1 bdev(0x555f1029f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:24.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:24.768+0000 7fc9327337c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-05T00:48:27.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-05T00:48:27.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:28.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:28.076+0000 7f253ad6b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-05T00:48:28.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:28.076+0000 7f253ad6b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-05T00:48:28.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:28.076+0000 7f253ad6b7c0 -1 bdev(0x556597525800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:28.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:28.076+0000 7f253ad6b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-05T00:48:31.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-05T00:48:31.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:31.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:31.376+0000 7f9428daa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-05T00:48:31.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:31.376+0000 7f9428daa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-05T00:48:31.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:31.376+0000 7f9428daa7c0 -1 bdev(0x56401ccd3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:31.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:48:31.376+0000 7f9428daa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-05T00:48:34.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-05T00:48:34.575 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-05T00:48:34.590 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:34.590 INFO:tasks.ceph:role: osd.4 2024-09-05T00:48:34.590 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:48:34.591 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:34.656 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:34.657 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:34.657 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:34.657 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:34.657 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:35.136 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-05T00:48:35.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-05T00:48:35.138 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-05T00:48:35.291 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-05T00:48:35.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:35.303 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:35.303 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-05T00:48:35.359 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:35.359 INFO:tasks.ceph:role: osd.5 2024-09-05T00:48:35.359 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:48:35.359 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T00:48:35.422 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:35.422 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:35.422 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:35.422 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:35.422 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:35.423 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:35.423 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:35.423 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:35.423 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:35.423 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:35.877 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-05T00:48:35.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-05T00:48:35.879 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-05T00:48:35.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-05T00:48:36.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:36.025 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:36.025 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-05T00:48:36.079 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:36.079 INFO:tasks.ceph:role: osd.6 2024-09-05T00:48:36.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:48:36.079 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T00:48:36.142 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:36.142 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:36.142 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:36.143 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:36.603 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-05T00:48:36.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-05T00:48:36.606 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-05T00:48:36.739 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-05T00:48:36.748 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:36.749 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:36.749 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-05T00:48:36.805 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T00:48:36.805 INFO:tasks.ceph:role: osd.7 2024-09-05T00:48:36.805 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T00:48:36.805 DEBUG:teuthology.orchestra.run.smithi204:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout: = sunit=0 swidth=0 blks 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T00:48:36.866 INFO:teuthology.orchestra.run.smithi204.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T00:48:36.867 INFO:teuthology.orchestra.run.smithi204.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T00:48:36.867 INFO:teuthology.orchestra.run.smithi204.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T00:48:37.363 INFO:teuthology.orchestra.run.smithi204.stdout:Discarding blocks...Done. 2024-09-05T00:48:37.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi204.front.sepia.ceph.com -o noatime 2024-09-05T00:48:37.366 DEBUG:teuthology.orchestra.run.smithi204:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-05T00:48:37.519 DEBUG:teuthology.orchestra.run.smithi204:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-05T00:48:37.530 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T00:48:37.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:48:37.531 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:37.648 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:37.647+0000 7f3cfdc6d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-05T00:48:37.652 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:37.651+0000 7f3cfdc6d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-05T00:48:37.652 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:37.651+0000 7f3cfdc6d7c0 -1 bdev(0x562995049800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:37.652 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:37.651+0000 7f3cfdc6d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-05T00:48:40.788 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-05T00:48:40.801 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:40.885 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:40.883+0000 7ff672fee7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-05T00:48:40.885 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:40.883+0000 7ff672fee7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-05T00:48:40.885 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:40.883+0000 7ff672fee7c0 -1 bdev(0x56492c91b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:40.885 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:40.883+0000 7ff672fee7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-05T00:48:44.059 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-05T00:48:44.115 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:44.196 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:44.195+0000 7f88b5c327c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-05T00:48:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:44.195+0000 7f88b5c327c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-05T00:48:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:44.195+0000 7f88b5c327c0 -1 bdev(0x55f29280d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:44.197 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:44.195+0000 7f88b5c327c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-05T00:48:47.311 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-05T00:48:47.372 DEBUG:teuthology.orchestra.run.smithi204:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:47.458 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:47.454+0000 7f57f423a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-05T00:48:47.459 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:47.454+0000 7f57f423a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-05T00:48:47.459 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:47.458+0000 7f57f423a7c0 -1 bdev(0x55df54959800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-05T00:48:47.459 INFO:teuthology.orchestra.run.smithi204.stderr:2024-09-05T00:48:47.458+0000 7f57f423a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-05T00:48:50.618 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-05T00:48:50.675 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-05T00:48:50.676 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:50.676 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-05T00:48:50.692 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:50.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-05T00:48:50.747 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:50.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-05T00:48:50.802 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:50.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-05T00:48:50.858 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:50.858 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-05T00:48:50.915 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:50.915 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-05T00:48:50.928 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:50.928 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-05T00:48:50.986 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:50.987 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-05T00:48:51.043 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:51.043 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-05T00:48:51.098 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:51.098 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-05T00:48:51.150 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:51.150 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-05T00:48:51.157 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:51.157 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-05T00:48:51.200 INFO:tasks.ceph:Adding keys to all mons... 2024-09-05T00:48:51.200 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T00:48:51.202 DEBUG:teuthology.orchestra.run.smithi204:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T00:48:51.245 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-09-05T00:48:51.245 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDS/9hmZ2iFFxAAy60PtjC1eyMiOVoBlt7HOg== 2024-09-05T00:48:51.245 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDV/9hmdOfxHxAAfx0SlaPln3+MvD6UYkSSGg== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDY/9hmyWH2LRAA1q0jmQSlFCOnmfnt1thIMA== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDc/9hmxJ3GBBAAsx88CdQdjqJADlZt7j9vJA== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDf/9hm71KtFhAArVNAAProhvXucZXSk8BiSg== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDS/9hm6JM8GhAAK5G7zXppeohZb7AhW9GwaQ== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDl/9hmVwqyJhAAalp3P617zcQsp073OievTQ== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDo/9hmp0DENBAAfaBt0pmFA/6XiZfh5Bnwng== 2024-09-05T00:48:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDs/9hmgei1CxAA4qRvyiRmFP9tt03mvrCKAQ== 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDv/9hm1olaGxAAJPv+bAKWIrKJlvrzo3cXNw== 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDS/9hmZa4zHRAAPkCsdohR9NKl61mKbpZSMg== 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-05T00:48:51.247 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDS/9hmFI7QHxAAgIzY/D87STBrWzz+jZDwNQ== 2024-09-05T00:48:51.253 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.y] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDS/9hmZ2iFFxAAy60PtjC1eyMiOVoBlt7HOg== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.0] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDV/9hmdOfxHxAAfx0SlaPln3+MvD6UYkSSGg== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.1] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDY/9hmyWH2LRAA1q0jmQSlFCOnmfnt1thIMA== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.2] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDc/9hmxJ3GBBAAsx88CdQdjqJADlZt7j9vJA== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.3] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDf/9hm71KtFhAArVNAAProhvXucZXSk8BiSg== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[mgr.x] 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDS/9hm6JM8GhAAK5G7zXppeohZb7AhW9GwaQ== 2024-09-05T00:48:51.254 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.4] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDl/9hmVwqyJhAAalp3P617zcQsp073OievTQ== 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.5] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDo/9hmp0DENBAAfaBt0pmFA/6XiZfh5Bnwng== 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.6] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDs/9hmgei1CxAA4qRvyiRmFP9tt03mvrCKAQ== 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout:[osd.7] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDv/9hm1olaGxAAJPv+bAKWIrKJlvrzo3cXNw== 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout:[client.0] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDS/9hmZa4zHRAAPkCsdohR9NKl61mKbpZSMg== 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout:[client.1] 2024-09-05T00:48:51.255 INFO:teuthology.orchestra.run.smithi204.stdout: key = AQDS/9hmFI7QHxAAgIzY/D87STBrWzz+jZDwNQ== 2024-09-05T00:48:51.256 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T00:48:51.292 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T00:48:51.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.346 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.428 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.516 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.600 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.652 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T00:48:51.684 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T00:48:51.735 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.772 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.940 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:51.990 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:52.024 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T00:48:52.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T00:48:52.107 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T00:48:52.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T00:48:52.192 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T00:48:52.236 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-05T00:48:52.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-05T00:48:52.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T00:48:52.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-05T00:48:52.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-05T00:48:52.443 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T00:48:52.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-05T00:48:52.589 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-05T00:48:52.603 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T00:48:52.701 DEBUG:teuthology.orchestra.run.smithi204:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-05T00:48:52.712 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:52.714 DEBUG:teuthology.orchestra.run.smithi204:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T00:48:52.763 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-05T00:48:52.763 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-05T00:48:52.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-05T00:48:52.765 INFO:tasks.ceph.mon.a:Started 2024-09-05T00:48:52.765 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-05T00:48:52.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-05T00:48:52.768 INFO:tasks.ceph.mon.c:Started 2024-09-05T00:48:52.768 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-05T00:48:52.768 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-05T00:48:52.812 INFO:tasks.ceph.mon.b:Started 2024-09-05T00:48:52.813 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-05T00:48:52.813 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-05T00:48:52.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-05T00:48:52.816 INFO:tasks.ceph.mgr.y:Started 2024-09-05T00:48:52.816 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-05T00:48:52.816 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-05T00:48:52.818 INFO:tasks.ceph.mgr.x:Started 2024-09-05T00:48:52.818 DEBUG:tasks.ceph:set 0 configs 2024-09-05T00:48:52.819 INFO:tasks.ceph:Setting crush tunables to default 2024-09-05T00:48:52.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-09-05T00:48:58.278 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-09-05T00:48:58.296 INFO:tasks.ceph:check_enable_crimson: False 2024-09-05T00:48:58.296 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-05T00:48:58.297 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:58.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-05T00:48:58.308 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:58.308 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-05T00:48:58.360 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:58.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-05T00:48:58.412 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:48:58.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-05T00:48:58.465 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:58.465 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-05T00:48:58.479 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:58.479 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-05T00:48:58.535 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:58.535 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-05T00:48:58.590 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-09-05T00:48:58.590 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-05T00:48:58.646 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 630d5d03-eea4-4b71-ba69-a93245b87399 0 2024-09-05T00:48:58.896 INFO:teuthology.orchestra.run.smithi204.stdout:0 2024-09-05T00:48:58.915 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new cebd19e6-fe2e-43cc-a87a-67b2cac669dc 1 2024-09-05T00:48:59.124 INFO:teuthology.orchestra.run.smithi204.stdout:1 2024-09-05T00:48:59.140 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 65ce1394-f6ca-4017-8572-fd91dfdd6f88 2 2024-09-05T00:48:59.343 INFO:teuthology.orchestra.run.smithi204.stdout:2 2024-09-05T00:48:59.364 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new b455fb2f-afaf-4f6d-bc57-464679994b31 3 2024-09-05T00:48:59.569 INFO:teuthology.orchestra.run.smithi204.stdout:3 2024-09-05T00:48:59.586 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 69e1536e-8d52-4983-847a-632c03d62dec 4 2024-09-05T00:48:59.793 INFO:teuthology.orchestra.run.smithi204.stdout:4 2024-09-05T00:48:59.810 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 0e5485c5-36e2-457f-980e-6e854cd4e8ae 5 2024-09-05T00:49:00.015 INFO:teuthology.orchestra.run.smithi204.stdout:5 2024-09-05T00:49:00.031 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new fe0d7896-af4f-47e1-8887-21f8f8af252a 6 2024-09-05T00:49:00.230 INFO:teuthology.orchestra.run.smithi204.stdout:6 2024-09-05T00:49:00.246 DEBUG:teuthology.orchestra.run.smithi204:> sudo ceph --cluster ceph osd new 206caed4-741a-43cc-9812-6a8221de1bcf 7 2024-09-05T00:49:00.460 INFO:teuthology.orchestra.run.smithi204.stdout:7 2024-09-05T00:49:00.476 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-05T00:49:00.476 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-05T00:49:00.479 INFO:tasks.ceph.osd.0:Started 2024-09-05T00:49:00.479 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-05T00:49:00.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-05T00:49:00.481 INFO:tasks.ceph.osd.1:Started 2024-09-05T00:49:00.481 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-05T00:49:00.482 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-05T00:49:00.484 INFO:tasks.ceph.osd.2:Started 2024-09-05T00:49:00.484 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-05T00:49:00.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-05T00:49:00.486 INFO:tasks.ceph.osd.3:Started 2024-09-05T00:49:00.486 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-05T00:49:00.486 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-05T00:49:00.488 INFO:tasks.ceph.osd.4:Started 2024-09-05T00:49:00.488 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-05T00:49:00.489 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-05T00:49:00.490 INFO:tasks.ceph.osd.5:Started 2024-09-05T00:49:00.491 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-05T00:49:00.491 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-05T00:49:00.492 INFO:tasks.ceph.osd.6:Started 2024-09-05T00:49:00.493 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-05T00:49:00.493 DEBUG:teuthology.orchestra.run.smithi204:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-05T00:49:00.495 INFO:tasks.ceph.osd.7:Started 2024-09-05T00:49:00.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:00.700 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:00.700 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:00.458832+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:00.716 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-05T00:49:00.716 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-05T00:49:01.182 INFO:tasks.ceph.mgr.x.smithi204.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-05T00:49:01.182 INFO:tasks.ceph.mgr.x.smithi204.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-05T00:49:01.182 INFO:tasks.ceph.mgr.x.smithi204.stderr: from numpy import show_config as show_numpy_config 2024-09-05T00:49:01.306 INFO:tasks.ceph.mgr.y.smithi099.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-05T00:49:01.307 INFO:tasks.ceph.mgr.y.smithi099.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-05T00:49:01.307 INFO:tasks.ceph.mgr.y.smithi099.stderr: from numpy import show_config as show_numpy_config 2024-09-05T00:49:01.523 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:01.604 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-05T00:49:01.602+0000 7f7c430f87c0 -1 Falling back to public interface 2024-09-05T00:49:01.700 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-05T00:49:01.700+0000 7f9fd48307c0 -1 Falling back to public interface 2024-09-05T00:49:01.704 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-05T00:49:01.705 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":10,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:00.458832+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:01.720 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-05T00:49:01.920 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-05T00:49:01.920+0000 7f3fff06a7c0 -1 Falling back to public interface 2024-09-05T00:49:02.084 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-05T00:49:02.082+0000 7f72f3a287c0 -1 Falling back to public interface 2024-09-05T00:49:02.128 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-05T00:49:02.128+0000 7f79bf1917c0 -1 Falling back to public interface 2024-09-05T00:49:02.171 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-05T00:49:02.170+0000 7ff553bb17c0 -1 Falling back to public interface 2024-09-05T00:49:02.195 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-05T00:49:02.194+0000 7f075a1867c0 -1 Falling back to public interface 2024-09-05T00:49:02.216 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-05T00:49:02.216+0000 7f96591427c0 -1 Falling back to public interface 2024-09-05T00:49:04.065 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-05T00:49:04.062+0000 7f95cd1b8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-05T00:49:04.065 INFO:tasks.ceph.mgr.x.smithi204.stderr:2024-09-05T00:49:04.062+0000 7f95cd1b8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-05T00:49:05.815 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-05T00:49:05.816+0000 7f9fd48307c0 -1 osd.0 0 log_to_monitors true 2024-09-05T00:49:05.829 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-05T00:49:05.826+0000 7f7c430f87c0 -1 osd.5 0 log_to_monitors true 2024-09-05T00:49:06.057 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-05T00:49:06.054+0000 7f72f3a287c0 -1 osd.4 0 log_to_monitors true 2024-09-05T00:49:06.171 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-05T00:49:06.172+0000 7f79bf1917c0 -1 osd.2 0 log_to_monitors true 2024-09-05T00:49:06.241 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-05T00:49:06.240+0000 7f3fff06a7c0 -1 osd.1 0 log_to_monitors true 2024-09-05T00:49:06.266 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-05T00:49:06.262+0000 7ff553bb17c0 -1 osd.7 0 log_to_monitors true 2024-09-05T00:49:06.375 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-05T00:49:06.374+0000 7f075a1867c0 -1 osd.6 0 log_to_monitors true 2024-09-05T00:49:06.771 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-05T00:49:06.772+0000 7f96591427c0 -1 osd.3 0 log_to_monitors true 2024-09-05T00:49:08.046 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-05T00:49:08.044+0000 7f9fd07d9640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T00:49:08.067 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-05T00:49:08.068+0000 7f9fc860b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:08.172 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-05T00:49:08.170+0000 7f7c3f8b3640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T00:49:08.271 INFO:tasks.ceph.osd.5.smithi204.stderr:2024-09-05T00:49:08.270+0000 7f7c36ed3640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:08.527 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:08.908 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-05T00:49:08.908 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":13,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:08.067628+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:08.927 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-05T00:49:09.718 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-05T00:49:09.714+0000 7f72ef9d1640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T00:49:09.747 INFO:tasks.ceph.osd.4.smithi204.stderr:2024-09-05T00:49:09.746+0000 7f72e7803640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:09.789 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-05T00:49:09.786+0000 7ff54fb5a640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T00:49:09.805 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-05T00:49:09.804+0000 7f3ffb013640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T00:49:09.811 INFO:tasks.ceph.osd.7.smithi204.stderr:2024-09-05T00:49:09.810+0000 7ff54798c640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:09.819 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-05T00:49:09.818+0000 7f0756941640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T00:49:09.831 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-05T00:49:09.832+0000 7f3ff2e45640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:09.835 INFO:tasks.ceph.osd.6.smithi204.stderr:2024-09-05T00:49:09.834+0000 7f074df61640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:09.843 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-05T00:49:09.844+0000 7f79bb94c640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T00:49:09.853 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-05T00:49:09.852+0000 7f96550eb640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T00:49:09.871 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-05T00:49:09.872+0000 7f79b2f6c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:09.879 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-05T00:49:09.880+0000 7f964cf1d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T00:49:15.735 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:16.044 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-05T00:49:16.044 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":18,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:13.737883+0000","last_up_change":"2024-09-05T00:49:10.725685+0000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T00:49:11.104281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6801","nonce":4087752053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6803","nonce":4087752053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6807","nonce":4087752053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6805","nonce":4087752053}]},"public_addr":"172.21.15.99:6801/4087752053","cluster_addr":"172.21.15.99:6803/4087752053","heartbeat_back_addr":"172.21.15.99:6807/4087752053","heartbeat_front_addr":"172.21.15.99:6805/4087752053","state":["exists","up"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6809","nonce":643721128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6811","nonce":643721128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6815","nonce":643721128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6813","nonce":643721128}]},"public_addr":"172.21.15.99:6809/643721128","cluster_addr":"172.21.15.99:6811/643721128","heartbeat_back_addr":"172.21.15.99:6815/643721128","heartbeat_front_addr":"172.21.15.99:6813/643721128","state":["exists","up"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6817","nonce":3137608818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6819","nonce":3137608818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6823","nonce":3137608818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6821","nonce":3137608818}]},"public_addr":"172.21.15.99:6817/3137608818","cluster_addr":"172.21.15.99:6819/3137608818","heartbeat_back_addr":"172.21.15.99:6823/3137608818","heartbeat_front_addr":"172.21.15.99:6821/3137608818","state":["exists","up"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6825","nonce":2421217256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6827","nonce":2421217256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6831","nonce":2421217256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6829","nonce":2421217256}]},"public_addr":"172.21.15.99:6825/2421217256","cluster_addr":"172.21.15.99:6827/2421217256","heartbeat_back_addr":"172.21.15.99:6831/2421217256","heartbeat_front_addr":"172.21.15.99:6829/2421217256","state":["exists","up"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6809","nonce":2199271947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6811","nonce":2199271947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6815","nonce":2199271947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6813","nonce":2199271947}]},"public_addr":"172.21.15.204:6809/2199271947","cluster_addr":"172.21.15.204:6811/2199271947","heartbeat_back_addr":"172.21.15.204:6815/2199271947","heartbeat_front_addr":"172.21.15.204:6813/2199271947","state":["exists","up"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6801","nonce":444489520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6803","nonce":444489520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6807","nonce":444489520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6805","nonce":444489520}]},"public_addr":"172.21.15.204:6801/444489520","cluster_addr":"172.21.15.204:6803/444489520","heartbeat_back_addr":"172.21.15.204:6807/444489520","heartbeat_front_addr":"172.21.15.204:6805/444489520","state":["exists","up"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6825","nonce":2123851170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6827","nonce":2123851170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6831","nonce":2123851170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6829","nonce":2123851170}]},"public_addr":"172.21.15.204:6825/2123851170","cluster_addr":"172.21.15.204:6827/2123851170","heartbeat_back_addr":"172.21.15.204:6831/2123851170","heartbeat_front_addr":"172.21.15.204:6829/2123851170","state":["exists","up"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6817","nonce":4289187000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6819","nonce":4289187000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6823","nonce":4289187000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6821","nonce":4289187000}]},"public_addr":"172.21.15.204:6817/4289187000","cluster_addr":"172.21.15.204:6819/4289187000","heartbeat_back_addr":"172.21.15.204:6823/4289187000","heartbeat_front_addr":"172.21.15.204:6821/4289187000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.841654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.196772+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.198579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.740973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.031860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.793053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.330521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.307079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:16.061 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-05T00:49:16.062 INFO:tasks.ceph:Creating RBD pool 2024-09-05T00:49:16.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-05T00:49:16.772 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'rbd' created 2024-09-05T00:49:16.797 DEBUG:teuthology.orchestra.run.smithi099:> rbd --cluster ceph pool init rbd 2024-09-05T00:49:16.928 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:16.929 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:19.956 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-05T00:49:19.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-05T00:49:19.957 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-05T00:49:20.277 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:20.296 INFO:teuthology.orchestra.run.smithi099.stdout:[{"version":9,"timestamp":"2024-09-05T00:49:09.856797+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5468.985675"}]}] 2024-09-05T00:49:20.296 INFO:tasks.ceph_manager:config epoch is 9 2024-09-05T00:49:20.296 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T00:49:20.297 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-05T00:49:20.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-05T00:49:20.647 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:20.662 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":2863914563},{"type":"v1","addr":"172.21.15.204:6833","nonce":2863914563}]},"active_addr":"172.21.15.204:6833/2863914563","active_change":"2024-09-05T00:49:03.041626+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":462614907}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":2188495006}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":1100502513}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.204:0","nonce":4215255763}]}]} 2024-09-05T00:49:20.666 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-05T00:49:20.666 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-05T00:49:20.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:20.971 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:20.971 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:19.795295+0000","last_up_change":"2024-09-05T00:49:10.725685+0000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T00:49:11.104281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T00:49:16.374250+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6801","nonce":4087752053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6803","nonce":4087752053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6807","nonce":4087752053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6805","nonce":4087752053}]},"public_addr":"172.21.15.99:6801/4087752053","cluster_addr":"172.21.15.99:6803/4087752053","heartbeat_back_addr":"172.21.15.99:6807/4087752053","heartbeat_front_addr":"172.21.15.99:6805/4087752053","state":["exists","up"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6809","nonce":643721128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6811","nonce":643721128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6815","nonce":643721128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6813","nonce":643721128}]},"public_addr":"172.21.15.99:6809/643721128","cluster_addr":"172.21.15.99:6811/643721128","heartbeat_back_addr":"172.21.15.99:6815/643721128","heartbeat_front_addr":"172.21.15.99:6813/643721128","state":["exists","up"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6817","nonce":3137608818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6819","nonce":3137608818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6823","nonce":3137608818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6821","nonce":3137608818}]},"public_addr":"172.21.15.99:6817/3137608818","cluster_addr":"172.21.15.99:6819/3137608818","heartbeat_back_addr":"172.21.15.99:6823/3137608818","heartbeat_front_addr":"172.21.15.99:6821/3137608818","state":["exists","up"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6825","nonce":2421217256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6827","nonce":2421217256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6831","nonce":2421217256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6829","nonce":2421217256}]},"public_addr":"172.21.15.99:6825/2421217256","cluster_addr":"172.21.15.99:6827/2421217256","heartbeat_back_addr":"172.21.15.99:6831/2421217256","heartbeat_front_addr":"172.21.15.99:6829/2421217256","state":["exists","up"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6809","nonce":2199271947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6811","nonce":2199271947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6815","nonce":2199271947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6813","nonce":2199271947}]},"public_addr":"172.21.15.204:6809/2199271947","cluster_addr":"172.21.15.204:6811/2199271947","heartbeat_back_addr":"172.21.15.204:6815/2199271947","heartbeat_front_addr":"172.21.15.204:6813/2199271947","state":["exists","up"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6801","nonce":444489520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6803","nonce":444489520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6807","nonce":444489520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6805","nonce":444489520}]},"public_addr":"172.21.15.204:6801/444489520","cluster_addr":"172.21.15.204:6803/444489520","heartbeat_back_addr":"172.21.15.204:6807/444489520","heartbeat_front_addr":"172.21.15.204:6805/444489520","state":["exists","up"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6825","nonce":2123851170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6827","nonce":2123851170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6831","nonce":2123851170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6829","nonce":2123851170}]},"public_addr":"172.21.15.204:6825/2123851170","cluster_addr":"172.21.15.204:6827/2123851170","heartbeat_back_addr":"172.21.15.204:6831/2123851170","heartbeat_front_addr":"172.21.15.204:6829/2123851170","state":["exists","up"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6817","nonce":4289187000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6819","nonce":4289187000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6823","nonce":4289187000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6821","nonce":4289187000}]},"public_addr":"172.21.15.204:6817/4289187000","cluster_addr":"172.21.15.204:6819/4289187000","heartbeat_back_addr":"172.21.15.204:6823/4289187000","heartbeat_front_addr":"172.21.15.204:6821/4289187000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.841654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.196772+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.198579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.740973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.031860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.793053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.330521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.307079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:20.989 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-05T00:49:20.989 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T00:49:21.280 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:21.280 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T00:49:19.795295+0000","last_up_change":"2024-09-05T00:49:10.725685+0000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T00:49:11.104281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T00:49:16.374250+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6801","nonce":4087752053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6803","nonce":4087752053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6807","nonce":4087752053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6805","nonce":4087752053}]},"public_addr":"172.21.15.99:6801/4087752053","cluster_addr":"172.21.15.99:6803/4087752053","heartbeat_back_addr":"172.21.15.99:6807/4087752053","heartbeat_front_addr":"172.21.15.99:6805/4087752053","state":["exists","up"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6809","nonce":643721128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6811","nonce":643721128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6815","nonce":643721128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6813","nonce":643721128}]},"public_addr":"172.21.15.99:6809/643721128","cluster_addr":"172.21.15.99:6811/643721128","heartbeat_back_addr":"172.21.15.99:6815/643721128","heartbeat_front_addr":"172.21.15.99:6813/643721128","state":["exists","up"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6817","nonce":3137608818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6819","nonce":3137608818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6823","nonce":3137608818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6821","nonce":3137608818}]},"public_addr":"172.21.15.99:6817/3137608818","cluster_addr":"172.21.15.99:6819/3137608818","heartbeat_back_addr":"172.21.15.99:6823/3137608818","heartbeat_front_addr":"172.21.15.99:6821/3137608818","state":["exists","up"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6825","nonce":2421217256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6827","nonce":2421217256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6831","nonce":2421217256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6829","nonce":2421217256}]},"public_addr":"172.21.15.99:6825/2421217256","cluster_addr":"172.21.15.99:6827/2421217256","heartbeat_back_addr":"172.21.15.99:6831/2421217256","heartbeat_front_addr":"172.21.15.99:6829/2421217256","state":["exists","up"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6809","nonce":2199271947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6811","nonce":2199271947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6815","nonce":2199271947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6813","nonce":2199271947}]},"public_addr":"172.21.15.204:6809/2199271947","cluster_addr":"172.21.15.204:6811/2199271947","heartbeat_back_addr":"172.21.15.204:6815/2199271947","heartbeat_front_addr":"172.21.15.204:6813/2199271947","state":["exists","up"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6801","nonce":444489520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6803","nonce":444489520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6807","nonce":444489520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6805","nonce":444489520}]},"public_addr":"172.21.15.204:6801/444489520","cluster_addr":"172.21.15.204:6803/444489520","heartbeat_back_addr":"172.21.15.204:6807/444489520","heartbeat_front_addr":"172.21.15.204:6805/444489520","state":["exists","up"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6825","nonce":2123851170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6827","nonce":2123851170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6831","nonce":2123851170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6829","nonce":2123851170}]},"public_addr":"172.21.15.204:6825/2123851170","cluster_addr":"172.21.15.204:6827/2123851170","heartbeat_back_addr":"172.21.15.204:6831/2123851170","heartbeat_front_addr":"172.21.15.204:6829/2123851170","state":["exists","up"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6817","nonce":4289187000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6819","nonce":4289187000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6823","nonce":4289187000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6821","nonce":4289187000}]},"public_addr":"172.21.15.204:6817/4289187000","cluster_addr":"172.21.15.204:6819/4289187000","heartbeat_back_addr":"172.21.15.204:6823/4289187000","heartbeat_front_addr":"172.21.15.204:6821/4289187000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.841654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.196772+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.198579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.740973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.031860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.793053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.330521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.307079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T00:49:21.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-05T00:49:21.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-05T00:49:21.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-05T00:49:21.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-05T00:49:21.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-05T00:49:21.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-05T00:49:21.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-05T00:49:21.300 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-05T00:49:21.552 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:21.552 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T00:49:21.558 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:21.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T00:49:21.562 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:21.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T00:49:21.563 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:21.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T00:49:21.567 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:21.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T00:49:21.570 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:21.571 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T00:49:21.582 INFO:teuthology.orchestra.run.smithi099.stdout:60129542149 2024-09-05T00:49:21.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T00:49:21.587 INFO:teuthology.orchestra.run.smithi099.stdout:60129542150 2024-09-05T00:49:21.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T00:49:22.083 INFO:teuthology.orchestra.run.smithi099.stdout:64424509442 2024-09-05T00:49:22.089 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:22.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.4 2024-09-05T00:49:22.111 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:22.113 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:22.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-05T00:49:22.116 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:22.137 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:22.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-05T00:49:22.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-05T00:49:22.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-05T00:49:22.149 INFO:teuthology.orchestra.run.smithi099.stdout:60129542149 2024-09-05T00:49:22.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-05T00:49:22.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-05T00:49:22.168 INFO:teuthology.orchestra.run.smithi099.stdout:60129542148 2024-09-05T00:49:22.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-05T00:49:23.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T00:49:23.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T00:49:23.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T00:49:23.139 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T00:49:23.147 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T00:49:23.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T00:49:23.168 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T00:49:23.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T00:49:23.666 INFO:teuthology.orchestra.run.smithi099.stdout:64424509442 2024-09-05T00:49:23.678 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:23.686 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:23.689 INFO:teuthology.orchestra.run.smithi099.stdout:60129542148 2024-09-05T00:49:23.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.4 2024-09-05T00:49:23.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-05T00:49:23.709 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:23.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2024-09-05T00:49:23.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-05T00:49:23.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.3 2024-09-05T00:49:23.753 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:23.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-05T00:49:23.775 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:23.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-05T00:49:23.801 INFO:teuthology.orchestra.run.smithi099.stdout:60129542149 2024-09-05T00:49:23.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-05T00:49:24.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T00:49:24.702 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T00:49:24.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T00:49:24.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T00:49:24.731 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T00:49:24.770 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T00:49:24.795 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T00:49:24.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T00:49:25.190 INFO:teuthology.orchestra.run.smithi099.stdout:64424509444 2024-09-05T00:49:25.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.4 2024-09-05T00:49:25.213 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.236 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:25.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-05T00:49:25.262 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.263 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:25.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-09-05T00:49:25.281 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.303 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:25.308 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:25.313 INFO:teuthology.orchestra.run.smithi099.stdout:60129542149 2024-09-05T00:49:25.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-05T00:49:25.325 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-05T00:49:25.338 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-05T00:49:25.339 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.352 INFO:teuthology.orchestra.run.smithi099.stdout:60129542150 2024-09-05T00:49:25.353 INFO:teuthology.orchestra.run.smithi099.stdout:64424509446 2024-09-05T00:49:25.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-05T00:49:25.372 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-05T00:49:25.373 DEBUG:teuthology.parallel:result is None 2024-09-05T00:49:25.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T00:49:25.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T00:49:25.686 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:25.687 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T00:49:25.703 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-05T00:49:25.054590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":227476,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747244,"statfs":{"total":773094113280,"available":772861177856,"internally_reserved":0,"allocated":2965504,"data_stored":1779334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.271160"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.240352+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T00:49:20.240352+0000","last_peered":"2024-09-05T00:49:20.240352+0000","last_clean":"2024-09-05T00:49:20.240352+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T00:49:20.240352+0000","last_undegraded":"2024-09-05T00:49:20.240352+0000","last_fullsized":"2024-09-05T00:49:20.240352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.809653+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T00:49:19.809653+0000","last_peered":"2024-09-05T00:49:19.809653+0000","last_clean":"2024-09-05T00:49:19.809653+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T00:49:19.809653+0000","last_undegraded":"2024-09-05T00:49:19.809653+0000","last_fullsized":"2024-09-05T00:49:19.809653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.850501+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T00:49:20.850501+0000","last_peered":"2024-09-05T00:49:20.850501+0000","last_clean":"2024-09-05T00:49:20.850501+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T00:49:20.850501+0000","last_undegraded":"2024-09-05T00:49:20.850501+0000","last_fullsized":"2024-09-05T00:49:20.850501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.809494+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T00:49:19.809494+0000","last_peered":"2024-09-05T00:49:19.809494+0000","last_clean":"2024-09-05T00:49:19.809494+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T00:49:19.809494+0000","last_undegraded":"2024-09-05T00:49:19.809494+0000","last_fullsized":"2024-09-05T00:49:19.809494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.816492+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T00:49:19.816492+0000","last_peered":"2024-09-05T00:49:19.816492+0000","last_clean":"2024-09-05T00:49:19.816492+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T00:49:19.816492+0000","last_undegraded":"2024-09-05T00:49:19.816492+0000","last_fullsized":"2024-09-05T00:49:19.816492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.810209+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T00:49:19.810209+0000","last_peered":"2024-09-05T00:49:19.810209+0000","last_clean":"2024-09-05T00:49:19.810209+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T00:49:19.810209+0000","last_undegraded":"2024-09-05T00:49:19.810209+0000","last_fullsized":"2024-09-05T00:49:19.810209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.850382+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T00:49:20.850382+0000","last_peered":"2024-09-05T00:49:20.850382+0000","last_clean":"2024-09-05T00:49:20.850382+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T00:49:20.850382+0000","last_undegraded":"2024-09-05T00:49:20.850382+0000","last_fullsized":"2024-09-05T00:49:20.850382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.814283+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T00:49:19.814283+0000","last_peered":"2024-09-05T00:49:19.814283+0000","last_clean":"2024-09-05T00:49:19.814283+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T00:49:19.814283+0000","last_undegraded":"2024-09-05T00:49:19.814283+0000","last_fullsized":"2024-09-05T00:49:19.814283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.848880+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T00:49:20.848880+0000","last_peered":"2024-09-05T00:49:20.848880+0000","last_clean":"2024-09-05T00:49:20.848880+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T00:49:20.848880+0000","last_undegraded":"2024-09-05T00:49:20.848880+0000","last_fullsized":"2024-09-05T00:49:20.848880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T00:49:25.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T00:49:25.980 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:25.980 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T00:49:25.996 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-05T00:49:25.054590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":227476,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754747244,"statfs":{"total":773094113280,"available":772861177856,"internally_reserved":0,"allocated":2965504,"data_stored":1779334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.271160"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.240352+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T00:49:20.240352+0000","last_peered":"2024-09-05T00:49:20.240352+0000","last_clean":"2024-09-05T00:49:20.240352+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T00:49:20.240352+0000","last_undegraded":"2024-09-05T00:49:20.240352+0000","last_fullsized":"2024-09-05T00:49:20.240352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.809653+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T00:49:19.809653+0000","last_peered":"2024-09-05T00:49:19.809653+0000","last_clean":"2024-09-05T00:49:19.809653+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T00:49:19.809653+0000","last_undegraded":"2024-09-05T00:49:19.809653+0000","last_fullsized":"2024-09-05T00:49:19.809653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.850501+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T00:49:20.850501+0000","last_peered":"2024-09-05T00:49:20.850501+0000","last_clean":"2024-09-05T00:49:20.850501+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T00:49:20.850501+0000","last_undegraded":"2024-09-05T00:49:20.850501+0000","last_fullsized":"2024-09-05T00:49:20.850501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.809494+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T00:49:19.809494+0000","last_peered":"2024-09-05T00:49:19.809494+0000","last_clean":"2024-09-05T00:49:19.809494+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T00:49:19.809494+0000","last_undegraded":"2024-09-05T00:49:19.809494+0000","last_fullsized":"2024-09-05T00:49:19.809494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.816492+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T00:49:19.816492+0000","last_peered":"2024-09-05T00:49:19.816492+0000","last_clean":"2024-09-05T00:49:19.816492+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T00:49:19.816492+0000","last_undegraded":"2024-09-05T00:49:19.816492+0000","last_fullsized":"2024-09-05T00:49:19.816492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.810209+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T00:49:19.810209+0000","last_peered":"2024-09-05T00:49:19.810209+0000","last_clean":"2024-09-05T00:49:19.810209+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T00:49:19.810209+0000","last_undegraded":"2024-09-05T00:49:19.810209+0000","last_fullsized":"2024-09-05T00:49:19.810209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.850382+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T00:49:20.850382+0000","last_peered":"2024-09-05T00:49:20.850382+0000","last_clean":"2024-09-05T00:49:20.850382+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T00:49:20.850382+0000","last_undegraded":"2024-09-05T00:49:20.850382+0000","last_fullsized":"2024-09-05T00:49:20.850382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:19.814283+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T00:49:19.814283+0000","last_peered":"2024-09-05T00:49:19.814283+0000","last_clean":"2024-09-05T00:49:19.814283+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T00:49:19.814283+0000","last_undegraded":"2024-09-05T00:49:19.814283+0000","last_fullsized":"2024-09-05T00:49:19.814283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T00:49:20.848880+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T00:49:20.848880+0000","last_peered":"2024-09-05T00:49:20.848880+0000","last_clean":"2024-09-05T00:49:20.848880+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T00:49:20.848880+0000","last_undegraded":"2024-09-05T00:49:20.848880+0000","last_fullsized":"2024-09-05T00:49:20.848880+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T00:49:25.997 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T00:49:25.997 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T00:49:25.998 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-05T00:49:25.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-05T00:49:26.316 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T00:49:26.316 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T00:49:26.333 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-05T00:49:26.333 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-05T00:49:26.347 INFO:teuthology.run_tasks:Running task rgw... 2024-09-05T00:49:26.390 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-05T00:49:26.390 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-05T00:49:26.390 INFO:tasks.rgw:Creating data pools 2024-09-05T00:49:26.390 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-05T00:49:26.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-05T00:49:27.131 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.data' created 2024-09-05T00:49:27.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-05T00:49:27.854 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-05T00:49:27.898 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-05T00:49:28.857 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.index' created 2024-09-05T00:49:28.894 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-05T00:49:29.903 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-05T00:49:29.941 DEBUG:tasks.rgw:Pools created 2024-09-05T00:49:29.941 INFO:tasks.rgw:Configuring compression type = random 2024-09-05T00:49:29.942 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-05T00:49:29.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-05T00:49:29.942 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-05T00:49:29.998 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:29.998 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.975+0000 7f0bdb5e5640 0 -- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5560727a4740 msgr2=0x5560727a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2024-09-05T00:49:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.979+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdb5e5640 0 -- 172.21.15.99:0/598918883 >> [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] conn(0x7f0aa0070ae0 msgr2=0x7f0aa0072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 realm 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.983+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.987+0000 7f0bdd2de9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-05T00:49:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:31.987+0000 7f0bdd2de9c0 20 searching for the correct realm 2024-09-05T00:49:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:49:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:49:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 zone default found 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 4 Realm: () 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 zonegroup default 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:32.007+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:33.919+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:33.919+0000 7f0bdd2de9c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:33.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:33.923+0000 7f0bdd2de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:33.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:33.923+0000 7f0bdd2de9c0 20 started sync module instance, tier type = 2024-09-05T00:49:33.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:33.923+0000 7f0bdd2de9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=0 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=1 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=2 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=3 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=4 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=5 2024-09-05T00:49:35.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=6 2024-09-05T00:49:35.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 add_watcher() i=7 2024-09-05T00:49:35.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:49:35.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-05T00:49:35.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-05T00:49:35.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.963+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-05T00:49:35.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-05T00:49:35.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-05T00:49:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-05T00:49:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-05T00:49:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-05T00:49:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-05T00:49:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-05T00:49:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.967+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-05T00:49:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-05T00:49:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-05T00:49:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-05T00:49:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-05T00:49:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-05T00:49:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.971+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-05T00:49:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-05T00:49:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-05T00:49:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-05T00:49:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-05T00:49:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-05T00:49:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.975+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-05T00:49:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-05T00:49:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-05T00:49:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-05T00:49:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-05T00:49:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-05T00:49:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-05T00:49:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-05T00:49:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-05T00:49:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-05T00:49:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-05T00:49:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.979+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-05T00:49:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-05T00:49:35.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-05T00:49:35.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-05T00:49:35.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-05T00:49:35.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-05T00:49:35.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-05T00:49:35.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-05T00:49:35.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-05T00:49:35.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.983+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-05T00:49:35.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-05T00:49:35.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-05T00:49:35.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-05T00:49:35.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.987+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-05T00:49:35.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-05T00:49:35.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-05T00:49:35.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-05T00:49:35.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-05T00:49:35.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-05T00:49:35.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.991+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-05T00:49:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-05T00:49:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-05T00:49:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-05T00:49:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-05T00:49:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-05T00:49:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-05T00:49:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-05T00:49:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-05T00:49:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-05T00:49:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-05T00:49:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.995+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-05T00:49:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-05T00:49:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-05T00:49:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-05T00:49:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-05T00:49:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-05T00:49:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-05T00:49:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:35.999+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-05T00:49:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-05T00:49:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-05T00:49:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-05T00:49:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-05T00:49:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-05T00:49:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-05T00:49:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-05T00:49:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.003+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-05T00:49:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-05T00:49:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-05T00:49:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-05T00:49:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-05T00:49:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-05T00:49:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-05T00:49:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-05T00:49:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-05T00:49:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-05T00:49:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-05T00:49:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.007+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-05T00:49:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-05T00:49:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-05T00:49:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-05T00:49:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-05T00:49:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-05T00:49:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-05T00:49:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-05T00:49:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-05T00:49:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.011+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-05T00:49:36.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-05T00:49:36.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-05T00:49:36.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-05T00:49:36.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-05T00:49:36.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-05T00:49:36.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.015+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-05T00:49:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-05T00:49:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-05T00:49:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-05T00:49:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-05T00:49:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-05T00:49:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-05T00:49:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-05T00:49:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.019+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-05T00:49:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-05T00:49:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-05T00:49:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-05T00:49:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-05T00:49:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-05T00:49:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-05T00:49:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-05T00:49:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-05T00:49:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.023+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-05T00:49:36.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-05T00:49:36.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-05T00:49:36.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-05T00:49:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-05T00:49:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-05T00:49:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-05T00:49:36.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-05T00:49:36.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.027+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-05T00:49:36.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-05T00:49:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-05T00:49:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-05T00:49:36.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-05T00:49:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-05T00:49:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-05T00:49:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-05T00:49:36.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-05T00:49:36.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-05T00:49:36.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-05T00:49:36.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.031+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-05T00:49:36.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-05T00:49:36.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-05T00:49:36.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-05T00:49:36.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-05T00:49:36.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.035+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-05T00:49:36.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-05T00:49:36.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-05T00:49:36.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-05T00:49:36.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-05T00:49:36.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-05T00:49:36.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-05T00:49:36.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-05T00:49:36.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-05T00:49:36.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-05T00:49:36.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-05T00:49:36.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.039+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-05T00:49:36.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.043+0000 7f0bdd2de9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-05T00:49:36.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.055+0000 7f0a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:36.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.055+0000 7f0bdd2de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:36.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:36.055+0000 7f0bdd2de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:38.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.914+0000 7f0bdd2de9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-05T00:49:38.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.914+0000 7f0bdd2de9c0 5 note: GC not initialized 2024-09-05T00:49:39.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.998+0000 7f0a8cfe1640 20 reqs_thread_entry: start 2024-09-05T00:49:39.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.998+0000 7f0bdd2de9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:49:39.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.998+0000 7f0bdd2de9c0 20 Filter name: none 2024-09-05T00:49:39.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:38.998+0000 7f0a85ffb640 20 reqs_thread_entry: start 2024-09-05T00:49:39.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.054+0000 7f0a8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.058+0000 7f0bdd2de9c0 20 remove_watcher() i=0 2024-09-05T00:49:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.058+0000 7f0bdd2de9c0 2 removed watcher, disabling cache 2024-09-05T00:49:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.062+0000 7f0bdd2de9c0 20 remove_watcher() i=1 2024-09-05T00:49:39.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.062+0000 7f0bdd2de9c0 20 remove_watcher() i=2 2024-09-05T00:49:39.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.066+0000 7f0bdd2de9c0 20 remove_watcher() i=3 2024-09-05T00:49:39.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.070+0000 7f0bdd2de9c0 20 remove_watcher() i=4 2024-09-05T00:49:39.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.070+0000 7f0bdd2de9c0 20 remove_watcher() i=5 2024-09-05T00:49:39.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.074+0000 7f0bdd2de9c0 20 remove_watcher() i=6 2024-09-05T00:49:39.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.074+0000 7f0bdd2de9c0 20 remove_watcher() i=7 2024-09-05T00:49:39.095 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-05T00:49:39.096 DEBUG:tasks.util.rgw: json result: [] 2024-09-05T00:49:39.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-05T00:49:39.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-05T00:49:39.096 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-05T00:49:39.138 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:39.138 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:39.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.162+0000 7f32fe8489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:39.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.162+0000 7f32fe8489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:39.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.170+0000 7f31527fc640 20 reqs_thread_entry: start 2024-09-05T00:49:39.192 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"029be2ba-89f5-4a66-997f-b36b11292c2c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-05T00:49:39.193 DEBUG:tasks.util.rgw: json result: {'id': '029be2ba-89f5-4a66-997f-b36b11292c2c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-05T00:49:39.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-05T00:49:39.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-05T00:49:39.193 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-05T00:49:39.268 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:39.268 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:39.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.302+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 realm 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-05T00:49:39.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.306+0000 7f4d25ed49c0 20 searching for the correct realm 2024-09-05T00:49:39.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.314+0000 7f4d239da640 0 -- 172.21.15.99:0/3312938088 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f4d1400ead0 msgr2=0x7f4d14029430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:49:39.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.322+0000 7f4d239da640 0 -- 172.21.15.99:0/3312938088 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f4d1403b440 msgr2=0x7f4d1403b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:49:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.326+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 zone default found 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 4 Realm: () 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:49:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:49:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:49:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 zonegroup default 2024-09-05T00:49:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 started sync module instance, tier type = 2024-09-05T00:49:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.330+0000 7f4d25ed49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:49:39.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=0 2024-09-05T00:49:39.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=1 2024-09-05T00:49:39.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=2 2024-09-05T00:49:39.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=3 2024-09-05T00:49:39.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=4 2024-09-05T00:49:39.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=5 2024-09-05T00:49:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=6 2024-09-05T00:49:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 20 add_watcher() i=7 2024-09-05T00:49:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.350+0000 7f4d25ed49c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:49:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4d25ed49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4d25ed49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4d25ed49c0 5 note: GC not initialized 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4bd8fe1640 20 reqs_thread_entry: start 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4d25ed49c0 20 init_complete bucket index max shards: 11 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4d25ed49c0 20 Filter name: none 2024-09-05T00:49:39.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.354+0000 7f4b527fc640 20 reqs_thread_entry: start 2024-09-05T00:49:39.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.374+0000 7f4bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:39.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.378+0000 7f4d25ed49c0 20 remove_watcher() i=0 2024-09-05T00:49:39.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.378+0000 7f4d25ed49c0 2 removed watcher, disabling cache 2024-09-05T00:49:39.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.382+0000 7f4d25ed49c0 20 remove_watcher() i=1 2024-09-05T00:49:39.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.382+0000 7f4d25ed49c0 20 remove_watcher() i=2 2024-09-05T00:49:39.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.386+0000 7f4d25ed49c0 20 remove_watcher() i=3 2024-09-05T00:49:39.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.386+0000 7f4d25ed49c0 20 remove_watcher() i=4 2024-09-05T00:49:39.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.386+0000 7f4d25ed49c0 20 remove_watcher() i=5 2024-09-05T00:49:39.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.390+0000 7f4d25ed49c0 20 remove_watcher() i=6 2024-09-05T00:49:39.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.390+0000 7f4d25ed49c0 20 remove_watcher() i=7 2024-09-05T00:49:39.408 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-05T00:49:39.408 DEBUG:tasks.util.rgw: json result: [] 2024-09-05T00:49:39.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-05T00:49:39.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-05T00:49:39.408 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-05T00:49:39.493 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:39.493 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.522+0000 7fc79ad489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.522+0000 7fc79ad489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:39.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.526+0000 7fc5deffd640 20 reqs_thread_entry: start 2024-09-05T00:49:39.550 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"029be2ba-89f5-4a66-997f-b36b11292c2c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-05T00:49:39.550 DEBUG:tasks.util.rgw: json result: {'id': '029be2ba-89f5-4a66-997f-b36b11292c2c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-05T00:49:39.550 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-05T00:49:39.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-05T00:49:39.551 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-05T00:49:39.620 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:39.620 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:39.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.654+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 realm 2024-09-05T00:49:39.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:49:39.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:39.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.658+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.662+0000 7f48be5519c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-05T00:49:39.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.662+0000 7f48be5519c0 20 searching for the correct realm 2024-09-05T00:49:39.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.666+0000 7f48bc858640 0 -- 172.21.15.99:0/1782247127 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f48b007d440 msgr2=0x7f48b0003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:49:39.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.882+0000 7f48bc858640 0 -- 172.21.15.99:0/1782247127 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f48b007d440 msgr2=0x7f48b0003a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:49:39.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.894+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:49:39.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-05T00:49:39.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 zone default found 2024-09-05T00:49:39.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 4 Realm: () 2024-09-05T00:49:39.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 zonegroup default 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.898+0000 7f48be5519c0 20 rados->read ofs=0 len=0 2024-09-05T00:49:39.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.902+0000 7f48be5519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:49:39.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.902+0000 7f48be5519c0 20 started sync module instance, tier type = 2024-09-05T00:49:39.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.902+0000 7f48be5519c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=0 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=1 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=2 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=3 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=4 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=5 2024-09-05T00:49:39.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.922+0000 7f48be5519c0 20 add_watcher() i=6 2024-09-05T00:49:39.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.926+0000 7f48be5519c0 20 add_watcher() i=7 2024-09-05T00:49:39.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.926+0000 7f48be5519c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:49:39.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.926+0000 7f4772fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:39.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.926+0000 7f48be5519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:39.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.926+0000 7f48be5519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:39.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.930+0000 7f48be5519c0 5 note: GC not initialized 2024-09-05T00:49:39.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.930+0000 7f4771fdb640 20 reqs_thread_entry: start 2024-09-05T00:49:39.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.930+0000 7f48be5519c0 20 init_complete bucket index max shards: 11 2024-09-05T00:49:39.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.930+0000 7f48be5519c0 20 Filter name: none 2024-09-05T00:49:39.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.930+0000 7f46e37fe640 20 reqs_thread_entry: start 2024-09-05T00:49:39.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.950+0000 7f4772fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:49:39.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.954+0000 7f48be5519c0 20 remove_watcher() i=0 2024-09-05T00:49:39.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.954+0000 7f48be5519c0 2 removed watcher, disabling cache 2024-09-05T00:49:39.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.958+0000 7f48be5519c0 20 remove_watcher() i=1 2024-09-05T00:49:39.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.962+0000 7f48be5519c0 20 remove_watcher() i=2 2024-09-05T00:49:39.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.962+0000 7f48be5519c0 20 remove_watcher() i=3 2024-09-05T00:49:39.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.966+0000 7f48be5519c0 20 remove_watcher() i=4 2024-09-05T00:49:39.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.966+0000 7f48be5519c0 20 remove_watcher() i=5 2024-09-05T00:49:39.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.966+0000 7f48be5519c0 20 remove_watcher() i=6 2024-09-05T00:49:39.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:39.970+0000 7f48be5519c0 20 remove_watcher() i=7 2024-09-05T00:49:39.987 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-05T00:49:39.987 DEBUG:tasks.util.rgw: json result: [] 2024-09-05T00:49:39.987 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-05T00:49:39.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-05T00:49:39.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-05T00:49:39.988 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-05T00:49:40.069 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:40.069 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:40.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.098+0000 7f05396c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:40.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.098+0000 7f05396c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:40.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.102+0000 7f03edffb640 20 reqs_thread_entry: start 2024-09-05T00:49:40.125 INFO:teuthology.orchestra.run.smithi099.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-05T00:49:40.126 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-05T00:49:40.126 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-05T00:49:40.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-05T00:49:40.126 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-05T00:49:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.230+0000 7fde2a4e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.230+0000 7fde2a4e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.234+0000 7fdc6dffb640 20 reqs_thread_entry: start 2024-09-05T00:49:40.261 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"029be2ba-89f5-4a66-997f-b36b11292c2c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-05T00:49:40.261 DEBUG:tasks.util.rgw: json result: {'id': '029be2ba-89f5-4a66-997f-b36b11292c2c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-05T00:49:40.262 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-05T00:49:40.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-05T00:49:40.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-05T00:49:40.262 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-05T00:49:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:40.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.370+0000 7f6eb657b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:40.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.370+0000 7f6eb657b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:40.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.374+0000 7f6cfa7fc640 20 reqs_thread_entry: start 2024-09-05T00:49:40.394 INFO:teuthology.orchestra.run.smithi099.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-05T00:49:40.394 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-05T00:49:40.395 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-05T00:49:40.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-05T00:49:40.395 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-05T00:49:40.478 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:49:40.478 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:49:40.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.502+0000 7fd8ade4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:49:40.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.502+0000 7fd8ade4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:49:40.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T00:49:40.506+0000 7fd709ffb640 20 reqs_thread_entry: start 2024-09-05T00:49:40.530 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"029be2ba-89f5-4a66-997f-b36b11292c2c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-05T00:49:40.530 DEBUG:tasks.util.rgw: json result: {'id': '029be2ba-89f5-4a66-997f-b36b11292c2c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-05T00:49:40.531 INFO:tasks.rgw:Starting rgw... 2024-09-05T00:49:40.531 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-05T00:49:40.531 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-05T00:49:40.531 DEBUG:teuthology.orchestra.run.smithi099:> sudo echo -n http://smithi099.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-05T00:49:40.585 INFO:teuthology.orchestra.run.smithi099.stdout:http://smithi099.front.sepia.ceph.com:80 2024-09-05T00:49:40.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-05T00:49:40.638 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-05T00:49:40.638 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-05T00:49:40.638 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-05T00:49:40.681 INFO:tasks.rgw.client.0:Started 2024-09-05T00:49:40.681 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:40.681 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:40.705 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:49:40.705 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:49:40.705 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-05T00:49:40.705 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-05T00:49:40.706 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-05T00:49:41.707 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:41.718 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-05T00:49:41.718 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:49:41.719 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:49:41.719 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-05T00:49:41.719 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-05T00:49:43.720 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:43.730 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:49:43.731 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:49:43.731 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-05T00:49:43.731 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-05T00:49:43.731 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-05T00:49:47.732 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:47.744 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:49:47.745 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:49:47.745 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-05T00:49:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-05T00:49:47.745 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-05T00:49:55.747 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:49:55.757 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:49:55.757 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:49:55.758 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-05T00:49:55.759 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-05T00:49:55.759 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-05T00:50:11.760 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-05T00:50:11.772 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-05T00:50:11.772 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-05T00:50:12.262 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 381 0 --:--:-- --:--:-- --:--:-- 381 2024-09-05T00:50:12.264 INFO:teuthology.orchestra.run.smithi099.stdout:anonymous 2024-09-05T00:50:12.264 INFO:teuthology.run_tasks:Running task tox... 2024-09-05T00:50:12.275 INFO:tasks.tox:Deploying tox from pip... 2024-09-05T00:50:12.275 DEBUG:teuthology.orchestra.run.smithi099:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-05T00:50:15.274 DEBUG:teuthology.orchestra.run.smithi099:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-05T00:50:15.932 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting tox==3.15.0 2024-09-05T00:50:16.033 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-05T00:50:16.095 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 82.1/82.1 KB 1.3 MB/s eta 0:00:00 2024-09-05T00:50:16.247 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting filelock<4,>=3.0.0 2024-09-05T00:50:16.263 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading filelock-3.15.4-py3-none-any.whl (16 kB) 2024-09-05T00:50:16.368 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting six<2,>=1.14.0 2024-09-05T00:50:16.384 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-05T00:50:16.663 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-05T00:50:16.678 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading virtualenv-20.26.3-py3-none-any.whl (5.7 MB) 2024-09-05T00:50:17.209 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 5.7/5.7 MB 10.8 MB/s eta 0:00:00 2024-09-05T00:50:17.315 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting toml>=0.9.4 2024-09-05T00:50:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-05T00:50:17.466 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting pluggy<1,>=0.12.0 2024-09-05T00:50:17.482 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-05T00:50:17.609 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting py<2,>=1.4.17 2024-09-05T00:50:17.635 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-05T00:50:17.666 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 98.7/98.7 KB 3.3 MB/s eta 0:00:00 2024-09-05T00:50:17.768 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting packaging>=14 2024-09-05T00:50:17.784 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-05T00:50:17.817 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 54.0/54.0 KB 1.5 MB/s eta 0:00:00 2024-09-05T00:50:17.981 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-05T00:50:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading platformdirs-4.2.2-py3-none-any.whl (18 kB) 2024-09-05T00:50:18.099 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting distlib<1,>=0.3.7 2024-09-05T00:50:18.121 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-05T00:50:18.178 INFO:teuthology.orchestra.run.smithi099.stdout: --------------------------------------- 468.9/468.9 KB 8.9 MB/s eta 0:00:00 2024-09-05T00:50:18.349 INFO:teuthology.orchestra.run.smithi099.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-05T00:50:19.288 INFO:teuthology.orchestra.run.smithi099.stdout:Successfully installed distlib-0.3.8 filelock-3.15.4 packaging-24.1 platformdirs-4.2.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.3 2024-09-05T00:50:19.376 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T00:50:19.390 INFO:tasks.workunit:Pulling workunits from ref ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:50:19.390 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T00:50:19.390 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T00:50:19.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:50:19.396 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-05T00:50:19.396 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T00:50:19.444 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-05T00:50:19.444 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-05T00:50:19.492 INFO:tasks.workunit:timeout=3h 2024-09-05T00:50:19.492 INFO:tasks.workunit:cleanup=True 2024-09-05T00:50:19.492 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:50:19.543 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T00:51:15.364 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 95% (12170/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'ede1507024117d16395cd6d958c594ff4aaf4da5'. 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-05T00:51:15.978 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at ede15070241 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-09-05T00:51:15.985 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T00:51:16.033 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T00:51:16.037 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T00:51:16.037 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T00:51:16.908 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T00:51:16.981 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T00:51:17.038 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T00:51:17.040 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T00:51:17.040 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T00:51:17.087 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T00:51:17.091 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:51:17.091 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T00:51:17.137 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-05T00:51:17.138 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-05T00:51:17.138 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-05T00:51:17.189 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-05T00:51:17.190 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T00:51:17.190 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T00:51:20.111 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-05T00:51:20.111 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-09-05T00:51:20.111 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-09-05T00:51:20.112 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T00:51:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-09-05T00:51:20.470 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-05T00:51:20.714 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-09-05T00:51:20.812 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-05T00:51:21.101 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 1.8/1.8 MB 6.3 MB/s eta 0:00:00 2024-09-05T00:51:21.176 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-09-05T00:51:21.176 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-09-05T00:51:21.176 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-09-05T00:51:21.474 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-09-05T00:51:21.481 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-09-05T00:51:22.497 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.2 2024-09-05T00:51:22.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install boto3 2024-09-05T00:51:23.697 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-09-05T00:51:23.742 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading boto3-1.35.12-py3-none-any.whl.metadata (6.6 kB) 2024-09-05T00:51:24.380 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.36.0,>=1.35.12 (from boto3) 2024-09-05T00:51:24.395 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading botocore-1.35.12-py3-none-any.whl.metadata (5.7 kB) 2024-09-05T00:51:24.524 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-05T00:51:24.540 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-05T00:51:24.685 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-05T00:51:24.701 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-05T00:51:24.856 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T00:51:24.877 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-05T00:51:25.081 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T00:51:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-05T00:51:25.372 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T00:51:25.386 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-05T00:51:25.460 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading boto3-1.35.12-py3-none-any.whl (139 kB) 2024-09-05T00:51:25.554 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading botocore-1.35.12-py3-none-any.whl (12.5 MB) 2024-09-05T00:51:25.798 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 12.5/12.5 MB 54.1 MB/s eta 0:00:00 2024-09-05T00:51:25.815 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-05T00:51:25.889 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-05T00:51:25.957 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-05T00:51:26.024 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-05T00:51:26.101 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-05T00:51:26.277 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-05T00:51:27.402 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.35.12 botocore-1.35.12 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-05T00:51:27.828 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-05T00:51:27.980 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-05T00:51:28.017 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:28.017 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:28.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 realm 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.054+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.058+0000 7f0d5d3739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:28.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.058+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.058+0000 7f0d5d3739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:28.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.058+0000 7f0d5d3739c0 20 searching for the correct realm 2024-09-05T00:51:28.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.062+0000 7f0d5b67a640 0 -- 172.21.15.99:0/3257649605 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0d440bf020 msgr2=0x7f0d44100ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:28.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.278+0000 7f0d52678640 0 -- 172.21.15.99:0/3257649605 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x562360d375e0 msgr2=0x562360d399d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:28.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:28.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:28.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:28.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:28.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:28.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:28.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:28.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 zone default found 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 4 Realm: () 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 zonegroup default 2024-09-05T00:51:28.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.290+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.294+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.294+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.294+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.294+0000 7f0d5d3739c0 20 started sync module instance, tier type = 2024-09-05T00:51:28.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.294+0000 7f0d5d3739c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:28.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=0 2024-09-05T00:51:28.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=1 2024-09-05T00:51:28.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=2 2024-09-05T00:51:28.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=3 2024-09-05T00:51:28.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=4 2024-09-05T00:51:28.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=5 2024-09-05T00:51:28.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.314+0000 7f0d5d3739c0 20 add_watcher() i=6 2024-09-05T00:51:28.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.318+0000 7f0d5d3739c0 20 add_watcher() i=7 2024-09-05T00:51:28.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.318+0000 7f0d5d3739c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:28.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0c117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:28.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:28.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 5 note: GC not initialized 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0b8bfff640 20 reqs_thread_entry: start 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 Filter name: none 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0b89ffb640 20 reqs_thread_entry: start 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-05T00:51:28.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-05T00:51:28.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-05T00:51:28.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-05T00:51:28.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.322+0000 7f0d5d3739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:28.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.326+0000 7f0d5d3739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:28.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.326+0000 7f0d5d3739c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-05T00:51:28.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.326+0000 7f0d5d3739c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-05T00:51:28.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.326+0000 7f0d5d3739c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-05T00:51:28.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.326+0000 7f0d5d3739c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-05T00:51:28.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0d5d3739c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-05T00:51:28.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0d5d3739c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-05T00:51:28.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0d5d3739c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-05T00:51:28.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0c3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94709948351376 notifier 4674 bl.length()=593 2024-09-05T00:51:28.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0c3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-05T00:51:28.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.330+0000 7f0c3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-05T00:51:28.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0d5d3739c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-05T00:51:28.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0d5d3739c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-05T00:51:28.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0d5d3739c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-05T00:51:28.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0c3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94709948320720 notifier 4674 bl.length()=186 2024-09-05T00:51:28.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0c3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-05T00:51:28.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.362+0000 7f0c3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-05T00:51:28.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.366+0000 7f0c117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:28.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.370+0000 7f0d5d3739c0 20 remove_watcher() i=0 2024-09-05T00:51:28.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.370+0000 7f0d5d3739c0 2 removed watcher, disabling cache 2024-09-05T00:51:28.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.374+0000 7f0d5d3739c0 20 remove_watcher() i=1 2024-09-05T00:51:28.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.378+0000 7f0d5d3739c0 20 remove_watcher() i=2 2024-09-05T00:51:28.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.378+0000 7f0d5d3739c0 20 remove_watcher() i=3 2024-09-05T00:51:28.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.382+0000 7f0d5d3739c0 20 remove_watcher() i=4 2024-09-05T00:51:28.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.382+0000 7f0d5d3739c0 20 remove_watcher() i=5 2024-09-05T00:51:28.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.386+0000 7f0d5d3739c0 20 remove_watcher() i=6 2024-09-05T00:51:28.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:28.386+0000 7f0d5d3739c0 20 remove_watcher() i=7 2024-09-05T00:51:32.109 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: recalculated bucket check stats are correct 2024-09-05T00:51:32.110 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:32.110 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-05T00:51:32.143 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:32.143 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:32.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.182+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 realm 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.186+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.190+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:32.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.190+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.190+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:32.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.190+0000 7fb871c519c0 20 searching for the correct realm 2024-09-05T00:51:32.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.194+0000 7fb86ff58640 0 -- 172.21.15.99:0/3786051061 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb858008030 msgr2=0x7fb858039470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:32.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.410+0000 7fb86ff58640 0 -- 172.21.15.99:0/3786051061 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb858008030 msgr2=0x7fb858039470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:32.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:32.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:32.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 zone default found 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 4 Realm: () 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 zonegroup default 2024-09-05T00:51:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.422+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 started sync module instance, tier type = 2024-09-05T00:51:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.426+0000 7fb871c519c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=0 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=1 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=2 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=3 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=4 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=5 2024-09-05T00:51:32.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.454+0000 7fb871c519c0 20 add_watcher() i=6 2024-09-05T00:51:32.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.458+0000 7fb871c519c0 20 add_watcher() i=7 2024-09-05T00:51:32.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.458+0000 7fb871c519c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:32.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:32.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb871c519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:32.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb871c519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:32.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb871c519c0 5 note: GC not initialized 2024-09-05T00:51:32.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb724fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:32.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb871c519c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:32.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb871c519c0 20 Filter name: none 2024-09-05T00:51:32.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.462+0000 7fb69e7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:32.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:32.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:32.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:32.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:32.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:32.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:32.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:32.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:32.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.466+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:32.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.470+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:32.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.470+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:32.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.470+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:32.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.470+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:32.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.474+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:32.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.474+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:32.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.474+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:32.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.478+0000 7fb871c519c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:32.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.490+0000 7fb725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:32.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.494+0000 7fb871c519c0 20 remove_watcher() i=0 2024-09-05T00:51:32.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.494+0000 7fb871c519c0 2 removed watcher, disabling cache 2024-09-05T00:51:32.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.498+0000 7fb871c519c0 20 remove_watcher() i=1 2024-09-05T00:51:32.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.498+0000 7fb871c519c0 20 remove_watcher() i=2 2024-09-05T00:51:32.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.502+0000 7fb871c519c0 20 remove_watcher() i=3 2024-09-05T00:51:32.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.502+0000 7fb871c519c0 20 remove_watcher() i=4 2024-09-05T00:51:32.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.506+0000 7fb871c519c0 20 remove_watcher() i=5 2024-09-05T00:51:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.506+0000 7fb871c519c0 20 remove_watcher() i=6 2024-09-05T00:51:32.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.510+0000 7fb871c519c0 20 remove_watcher() i=7 2024-09-05T00:51:32.529 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-05T00:51:32.556 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:32.556 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:32.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.594+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 realm 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:32.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:32.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.598+0000 7f91323ff9c0 20 searching for the correct realm 2024-09-05T00:51:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.602+0000 7f9130706640 0 -- 172.21.15.99:0/584157164 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f9124008040 msgr2=0x7f9124027920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:32.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.818+0000 7f9130706640 0 -- 172.21.15.99:0/584157164 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f9124008040 msgr2=0x7f9124027920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.830+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 zone default found 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 4 Realm: () 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 zonegroup default 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 started sync module instance, tier type = 2024-09-05T00:51:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.834+0000 7f91323ff9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:32.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=0 2024-09-05T00:51:32.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=1 2024-09-05T00:51:32.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=2 2024-09-05T00:51:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=3 2024-09-05T00:51:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=4 2024-09-05T00:51:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=5 2024-09-05T00:51:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=6 2024-09-05T00:51:32.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 20 add_watcher() i=7 2024-09-05T00:51:32.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.862+0000 7f91323ff9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.866+0000 7f8fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 5 note: GC not initialized 2024-09-05T00:51:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f8fe4fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 Filter name: none 2024-09-05T00:51:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f8f5e7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:32.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.870+0000 7f91323ff9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:32.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.874+0000 7f91323ff9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:32.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.874+0000 7f91323ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:32.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.874+0000 7f8fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:32.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.882+0000 7f91323ff9c0 20 remove_watcher() i=0 2024-09-05T00:51:32.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.882+0000 7f91323ff9c0 2 removed watcher, disabling cache 2024-09-05T00:51:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.882+0000 7f91323ff9c0 20 remove_watcher() i=1 2024-09-05T00:51:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.886+0000 7f91323ff9c0 20 remove_watcher() i=2 2024-09-05T00:51:32.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.890+0000 7f91323ff9c0 20 remove_watcher() i=3 2024-09-05T00:51:32.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.890+0000 7f91323ff9c0 20 remove_watcher() i=4 2024-09-05T00:51:32.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.894+0000 7f91323ff9c0 20 remove_watcher() i=5 2024-09-05T00:51:32.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.894+0000 7f91323ff9c0 20 remove_watcher() i=6 2024-09-05T00:51:32.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.898+0000 7f91323ff9c0 20 remove_watcher() i=7 2024-09-05T00:51:32.925 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-05T00:51:32.925 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-05T00:51:32.925 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:32.925 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-05T00:51:32.958 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:32.958 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:33.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:32.998+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 realm 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:33.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:33.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:33.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.002+0000 7fecac6849c0 20 searching for the correct realm 2024-09-05T00:51:33.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.006+0000 7feca9989640 0 -- 172.21.15.99:0/139429194 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fec9c0ca930 msgr2=0x7fec9c0d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:33.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.218+0000 7fecaa18a640 0 -- 172.21.15.99:0/139429194 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x563e3dd84fd0 msgr2=0x7feca408d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.442+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:33.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 zone default found 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 4 Realm: () 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 zonegroup default 2024-09-05T00:51:33.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.446+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.450+0000 7fecac6849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:33.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.450+0000 7fecac6849c0 20 started sync module instance, tier type = 2024-09-05T00:51:33.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.450+0000 7fecac6849c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=0 2024-09-05T00:51:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=1 2024-09-05T00:51:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=2 2024-09-05T00:51:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=3 2024-09-05T00:51:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=4 2024-09-05T00:51:33.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=5 2024-09-05T00:51:33.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.470+0000 7fecac6849c0 20 add_watcher() i=6 2024-09-05T00:51:33.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.474+0000 7fecac6849c0 20 add_watcher() i=7 2024-09-05T00:51:33.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.474+0000 7fecac6849c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:33.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.474+0000 7feb60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 5 note: GC not initialized 2024-09-05T00:51:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7feadb7fe640 20 reqs_thread_entry: start 2024-09-05T00:51:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 Filter name: none 2024-09-05T00:51:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fead97fa640 20 reqs_thread_entry: start 2024-09-05T00:51:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.478+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-05T00:51:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T00:51:33.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T00:51:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T00:51:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.482+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:33.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-05T00:51:33.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:33.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T00:51:33.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:33.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T00:51:33.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.486+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:33.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-05T00:51:33.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:33.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T00:51:33.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:33.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-05T00:51:33.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7fecac6849c0 1 NOTICE: finished all shards (0 entries found) 2024-09-05T00:51:33.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.490+0000 7feb60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:33.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.498+0000 7fecac6849c0 20 remove_watcher() i=0 2024-09-05T00:51:33.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.498+0000 7fecac6849c0 2 removed watcher, disabling cache 2024-09-05T00:51:33.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.498+0000 7fecac6849c0 20 remove_watcher() i=1 2024-09-05T00:51:33.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.502+0000 7fecac6849c0 20 remove_watcher() i=2 2024-09-05T00:51:33.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.502+0000 7fecac6849c0 20 remove_watcher() i=3 2024-09-05T00:51:33.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.506+0000 7fecac6849c0 20 remove_watcher() i=4 2024-09-05T00:51:33.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.506+0000 7fecac6849c0 20 remove_watcher() i=5 2024-09-05T00:51:33.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.510+0000 7fecac6849c0 20 remove_watcher() i=6 2024-09-05T00:51:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:33.510+0000 7fecac6849c0 20 remove_watcher() i=7 2024-09-05T00:51:33.531 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-05T00:51:33.974 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-05T00:51:35.617 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:35.618 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-05T00:51:35.654 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:35.654 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:35.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 realm 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:35.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.694+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.698+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:35.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.698+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.698+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:35.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.698+0000 7fef8f2ce9c0 20 searching for the correct realm 2024-09-05T00:51:35.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.702+0000 7fef8d5d5640 0 -- 172.21.15.99:0/3094758957 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fef80008040 msgr2=0x7fef8000c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:35.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.710+0000 7fef8d5d5640 0 -- 172.21.15.99:0/3094758957 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fee5807de40 msgr2=0x7fee58080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:35.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:35.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 zone default found 2024-09-05T00:51:35.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 4 Realm: () 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 zonegroup default 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.718+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.722+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.722+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.722+0000 7fef8f2ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:35.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.722+0000 7fef8f2ce9c0 20 started sync module instance, tier type = 2024-09-05T00:51:35.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.722+0000 7fef8f2ce9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:35.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=0 2024-09-05T00:51:35.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=1 2024-09-05T00:51:35.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=2 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=3 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=4 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=5 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.738+0000 7fef8f2ce9c0 20 add_watcher() i=6 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 20 add_watcher() i=7 2024-09-05T00:51:35.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:35.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fee42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:35.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:35.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:35.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 5 note: GC not initialized 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fee41fe3640 20 reqs_thread_entry: start 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fef8f2ce9c0 20 Filter name: none 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.742+0000 7fedb37fe640 20 reqs_thread_entry: start 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: starting shard=0 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:35.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: starting shard=1 2024-09-05T00:51:35.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:35.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: starting shard=2 2024-09-05T00:51:35.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:35.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 INFO: main: starting shard=3 2024-09-05T00:51:35.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.746+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:35.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: starting shard=4 2024-09-05T00:51:35.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:35.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: starting shard=5 2024-09-05T00:51:35.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:35.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: starting shard=6 2024-09-05T00:51:35.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: starting shard=7 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 INFO: main: starting shard=8 2024-09-05T00:51:35.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.750+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:35.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-05T00:51:35.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: starting shard=9 2024-09-05T00:51:35.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:35.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: starting shard=10 2024-09-05T00:51:35.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:35.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:35.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fef8f2ce9c0 20 INFO: main: done 2024-09-05T00:51:35.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.754+0000 7fee42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:35.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.762+0000 7fef8f2ce9c0 20 remove_watcher() i=0 2024-09-05T00:51:35.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.762+0000 7fef8f2ce9c0 2 removed watcher, disabling cache 2024-09-05T00:51:35.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.762+0000 7fef8f2ce9c0 20 remove_watcher() i=1 2024-09-05T00:51:35.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.766+0000 7fef8f2ce9c0 20 remove_watcher() i=2 2024-09-05T00:51:35.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.766+0000 7fef8f2ce9c0 20 remove_watcher() i=3 2024-09-05T00:51:35.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.770+0000 7fef8f2ce9c0 20 remove_watcher() i=4 2024-09-05T00:51:35.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.770+0000 7fef8f2ce9c0 20 remove_watcher() i=5 2024-09-05T00:51:35.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.774+0000 7fef8f2ce9c0 20 remove_watcher() i=6 2024-09-05T00:51:35.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:35.774+0000 7fef8f2ce9c0 20 remove_watcher() i=7 2024-09-05T00:51:36.037 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:36.038 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-05T00:51:36.078 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:36.078 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:36.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.118+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.118+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.118+0000 7f81067c29c0 20 realm 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.118+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:36.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.122+0000 7f81067c29c0 20 searching for the correct realm 2024-09-05T00:51:36.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.126+0000 7f8104ac9640 0 -- 172.21.15.99:0/1554972015 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f80f80b7800 msgr2=0x7f80f80ad450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:36.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.134+0000 7f8104ac9640 0 -- 172.21.15.99:0/1554972015 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fcc07ddc0 msgr2=0x7f7fcc0801f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:36.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:36.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 zone default found 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 4 Realm: () 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 zonegroup default 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.142+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.146+0000 7f81067c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.146+0000 7f81067c29c0 20 started sync module instance, tier type = 2024-09-05T00:51:36.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.146+0000 7f81067c29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:36.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=0 2024-09-05T00:51:36.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=1 2024-09-05T00:51:36.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=2 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=3 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=4 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=5 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=6 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 20 add_watcher() i=7 2024-09-05T00:51:36.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.166+0000 7f81067c29c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:36.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f7fba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 5 note: GC not initialized 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f7fb97e2640 20 reqs_thread_entry: start 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 Filter name: none 2024-09-05T00:51:36.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f7f2affd640 20 reqs_thread_entry: start 2024-09-05T00:51:36.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:36.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 INFO: main: starting shard=0 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.170+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: starting shard=1 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: starting shard=2 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: starting shard=3 2024-09-05T00:51:36.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:36.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: starting shard=4 2024-09-05T00:51:36.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:36.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 INFO: main: starting shard=5 2024-09-05T00:51:36.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.174+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:36.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-05T00:51:36.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: starting shard=6 2024-09-05T00:51:36.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:36.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: starting shard=7 2024-09-05T00:51:36.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:36.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: starting shard=8 2024-09-05T00:51:36.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:36.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 INFO: main: starting shard=9 2024-09-05T00:51:36.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.178+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:36.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f81067c29c0 20 INFO: main: starting shard=10 2024-09-05T00:51:36.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f81067c29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:36.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f81067c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f81067c29c0 20 INFO: main: done 2024-09-05T00:51:36.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.182+0000 7f7fba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.186+0000 7f81067c29c0 20 remove_watcher() i=0 2024-09-05T00:51:36.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.186+0000 7f81067c29c0 2 removed watcher, disabling cache 2024-09-05T00:51:36.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.190+0000 7f81067c29c0 20 remove_watcher() i=1 2024-09-05T00:51:36.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.190+0000 7f81067c29c0 20 remove_watcher() i=2 2024-09-05T00:51:36.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.194+0000 7f81067c29c0 20 remove_watcher() i=3 2024-09-05T00:51:36.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.194+0000 7f81067c29c0 20 remove_watcher() i=4 2024-09-05T00:51:36.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.198+0000 7f81067c29c0 20 remove_watcher() i=5 2024-09-05T00:51:36.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.198+0000 7f81067c29c0 20 remove_watcher() i=6 2024-09-05T00:51:36.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.198+0000 7f81067c29c0 20 remove_watcher() i=7 2024-09-05T00:51:36.445 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:36.446 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-05T00:51:36.481 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:36.481 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:36.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 realm 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.522+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.526+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.526+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.526+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:36.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.526+0000 7fc57e32f9c0 20 searching for the correct realm 2024-09-05T00:51:36.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.530+0000 7fc57c636640 0 -- 172.21.15.99:0/2597587793 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc56c0ca070 msgr2=0x7fc56c001710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:36.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.538+0000 7fc57c636640 0 -- 172.21.15.99:0/2597587793 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc44407de40 msgr2=0x7fc444080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.546+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 zone default found 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 4 Realm: () 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 zonegroup default 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 started sync module instance, tier type = 2024-09-05T00:51:36.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.550+0000 7fc57e32f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=0 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=1 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=2 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=3 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=4 2024-09-05T00:51:36.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=5 2024-09-05T00:51:36.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=6 2024-09-05T00:51:36.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 20 add_watcher() i=7 2024-09-05T00:51:36.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.574+0000 7fc57e32f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:36.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc431fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:36.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:36.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 5 note: GC not initialized 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc430fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 Filter name: none 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc3aa7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:36.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:36.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:36.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:36.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 INFO: main: starting shard=0 2024-09-05T00:51:36.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.578+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: starting shard=1 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: starting shard=2 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: starting shard=3 2024-09-05T00:51:36.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:36.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: starting shard=4 2024-09-05T00:51:36.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:36.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 INFO: main: starting shard=5 2024-09-05T00:51:36.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.582+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:36.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: starting shard=6 2024-09-05T00:51:36.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:36.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: starting shard=7 2024-09-05T00:51:36.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:36.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: starting shard=8 2024-09-05T00:51:36.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:36.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 INFO: main: starting shard=9 2024-09-05T00:51:36.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.586+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:36.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc57e32f9c0 20 INFO: main: starting shard=10 2024-09-05T00:51:36.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc57e32f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:36.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc57e32f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc57e32f9c0 20 INFO: main: done 2024-09-05T00:51:36.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.590+0000 7fc431fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.594+0000 7fc57e32f9c0 20 remove_watcher() i=0 2024-09-05T00:51:36.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.594+0000 7fc57e32f9c0 2 removed watcher, disabling cache 2024-09-05T00:51:36.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.598+0000 7fc57e32f9c0 20 remove_watcher() i=1 2024-09-05T00:51:36.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.598+0000 7fc57e32f9c0 20 remove_watcher() i=2 2024-09-05T00:51:36.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.602+0000 7fc57e32f9c0 20 remove_watcher() i=3 2024-09-05T00:51:36.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.602+0000 7fc57e32f9c0 20 remove_watcher() i=4 2024-09-05T00:51:36.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.606+0000 7fc57e32f9c0 20 remove_watcher() i=5 2024-09-05T00:51:36.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.606+0000 7fc57e32f9c0 20 remove_watcher() i=6 2024-09-05T00:51:36.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.606+0000 7fc57e32f9c0 20 remove_watcher() i=7 2024-09-05T00:51:36.790 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:36.790 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-05T00:51:36.825 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:36.825 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:36.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 realm 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.866+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.870+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.870+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.870+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:36.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.870+0000 7fa68f41e9c0 20 searching for the correct realm 2024-09-05T00:51:36.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.874+0000 7fa68d725640 0 -- 172.21.15.99:0/657233770 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa680031920 msgr2=0x7fa68003b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:36.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.882+0000 7fa68d725640 0 -- 172.21.15.99:0/657233770 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa55807de40 msgr2=0x7fa558080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:36.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 zone default found 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 4 Realm: () 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 zonegroup default 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:36.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 started sync module instance, tier type = 2024-09-05T00:51:36.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.890+0000 7fa68f41e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:36.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=0 2024-09-05T00:51:36.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=1 2024-09-05T00:51:36.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=2 2024-09-05T00:51:36.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=3 2024-09-05T00:51:36.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=4 2024-09-05T00:51:36.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=5 2024-09-05T00:51:36.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.914+0000 7fa68f41e9c0 20 add_watcher() i=6 2024-09-05T00:51:36.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.918+0000 7fa68f41e9c0 20 add_watcher() i=7 2024-09-05T00:51:36.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.918+0000 7fa68f41e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.918+0000 7fa542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 5 note: GC not initialized 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa541fe3640 20 reqs_thread_entry: start 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:36.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 Filter name: none 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa4b37fe640 20 reqs_thread_entry: start 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:36.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: starting shard=0 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: starting shard=1 2024-09-05T00:51:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 INFO: main: starting shard=2 2024-09-05T00:51:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.922+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: starting shard=3 2024-09-05T00:51:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: starting shard=4 2024-09-05T00:51:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: starting shard=5 2024-09-05T00:51:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: starting shard=6 2024-09-05T00:51:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:36.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 INFO: main: starting shard=7 2024-09-05T00:51:36.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.926+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:36.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: starting shard=8 2024-09-05T00:51:36.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:36.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: starting shard=9 2024-09-05T00:51:36.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:36.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:36.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: starting shard=10 2024-09-05T00:51:36.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:36.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T00:51:36.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.930+0000 7fa68f41e9c0 20 INFO: main: done 2024-09-05T00:51:36.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.934+0000 7fa542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:36.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.938+0000 7fa68f41e9c0 20 remove_watcher() i=0 2024-09-05T00:51:36.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.938+0000 7fa68f41e9c0 2 removed watcher, disabling cache 2024-09-05T00:51:36.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.942+0000 7fa68f41e9c0 20 remove_watcher() i=1 2024-09-05T00:51:36.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.942+0000 7fa68f41e9c0 20 remove_watcher() i=2 2024-09-05T00:51:36.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.946+0000 7fa68f41e9c0 20 remove_watcher() i=3 2024-09-05T00:51:36.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.946+0000 7fa68f41e9c0 20 remove_watcher() i=4 2024-09-05T00:51:36.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.946+0000 7fa68f41e9c0 20 remove_watcher() i=5 2024-09-05T00:51:36.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.950+0000 7fa68f41e9c0 20 remove_watcher() i=6 2024-09-05T00:51:36.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:36.950+0000 7fa68f41e9c0 20 remove_watcher() i=7 2024-09-05T00:51:36.998 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-05T00:51:37.424 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-05T00:51:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-05T00:51:37.848 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-05T00:51:37.875 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:37.875 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:37.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 realm 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.910+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.914+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:37.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.914+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.914+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:37.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.914+0000 7f2fb32759c0 20 searching for the correct realm 2024-09-05T00:51:37.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.918+0000 7f2fb0d7b640 0 -- 172.21.15.99:0/1137252882 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f2fa8062060 msgr2=0x7f2fa8060ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:37.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.926+0000 7f2fb0d7b640 0 -- 172.21.15.99:0/1137252882 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f2fa806ab50 msgr2=0x7f2fa807b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.930+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:37.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 zone default found 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 4 Realm: () 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 zonegroup default 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:37.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 started sync module instance, tier type = 2024-09-05T00:51:37.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.934+0000 7f2fb32759c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=0 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=1 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=2 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=3 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=4 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=5 2024-09-05T00:51:37.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=6 2024-09-05T00:51:37.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 20 add_watcher() i=7 2024-09-05T00:51:37.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.954+0000 7f2fb32759c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:37.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 5 note: GC not initialized 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2e667e4640 20 reqs_thread_entry: start 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:37.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 Filter name: none 2024-09-05T00:51:37.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2e5f7fe640 20 reqs_thread_entry: start 2024-09-05T00:51:37.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:37.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:37.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.958+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T00:51:37.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:37.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T00:51:37.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:37.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T00:51:37.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:37.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:37.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T00:51:37.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.962+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:37.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T00:51:37.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:37.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:37.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T00:51:37.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:37.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-05T00:51:37.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-05T00:51:37.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-05T00:51:37.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-05T00:51:37.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2fb32759c0 1 NOTICE: finished all shards (4 entries found) 2024-09-05T00:51:37.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.966+0000 7f2e677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:37.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.974+0000 7f2fb32759c0 20 remove_watcher() i=0 2024-09-05T00:51:37.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.974+0000 7f2fb32759c0 2 removed watcher, disabling cache 2024-09-05T00:51:37.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.974+0000 7f2fb32759c0 20 remove_watcher() i=1 2024-09-05T00:51:37.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.978+0000 7f2fb32759c0 20 remove_watcher() i=2 2024-09-05T00:51:37.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.978+0000 7f2fb32759c0 20 remove_watcher() i=3 2024-09-05T00:51:37.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.982+0000 7f2fb32759c0 20 remove_watcher() i=4 2024-09-05T00:51:37.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.982+0000 7f2fb32759c0 20 remove_watcher() i=5 2024-09-05T00:51:37.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.982+0000 7f2fb32759c0 20 remove_watcher() i=6 2024-09-05T00:51:37.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:37.982+0000 7f2fb32759c0 20 remove_watcher() i=7 2024-09-05T00:51:37.999 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: unlinked entries are not listable 2024-09-05T00:51:37.999 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:38.185 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-05T00:51:38.186 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:38.409 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-05T00:51:38.410 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:38.410 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-05T00:51:38.450 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:38.450 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:38.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.490+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 realm 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:38.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.494+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.498+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:38.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.498+0000 7f463b98d9c0 20 searching for the correct realm 2024-09-05T00:51:38.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.502+0000 7f4639c94640 0 -- 172.21.15.99:0/814422229 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4630008050 msgr2=0x7f463003d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:38.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.506+0000 7f4639c94640 0 -- 172.21.15.99:0/814422229 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f450407de70 msgr2=0x7f45040802a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:38.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:38.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 zone default found 2024-09-05T00:51:38.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 4 Realm: () 2024-09-05T00:51:38.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 zonegroup default 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.514+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.518+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.518+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.518+0000 7f463b98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:38.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.518+0000 7f463b98d9c0 20 started sync module instance, tier type = 2024-09-05T00:51:38.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.518+0000 7f463b98d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=0 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=1 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=2 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=3 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=4 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=5 2024-09-05T00:51:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=6 2024-09-05T00:51:38.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 20 add_watcher() i=7 2024-09-05T00:51:38.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.534+0000 7f463b98d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f44ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 5 note: GC not initialized 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f44ee7e4640 20 reqs_thread_entry: start 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 Filter name: none 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f445ffff640 20 reqs_thread_entry: start 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:38.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:38.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:38.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:38.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-05T00:51:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.538+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:38.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-05T00:51:38.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:38.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-05T00:51:38.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:38.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-05T00:51:38.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:38.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-05T00:51:38.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:38.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-05T00:51:38.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.542+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:38.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-05T00:51:38.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e8781d3b0 obj=check-bucket:e state=0x564e87b62728 s->prefetch_data=0 2024-09-05T00:51:38.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.546+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e878c2910 obj=check-bucket:d state=0x564e87b5c838 s->prefetch_data=0 2024-09-05T00:51:38.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b67330 obj=check-bucket:c state=0x564e87b601c8 s->prefetch_data=0 2024-09-05T00:51:38.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b64fc0 obj=check-bucket:f state=0x564e87b5d8a8 s->prefetch_data=0 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to m2u1hbsi81n779e3ske9sr6ycob58hnt 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state_impl: setting s->olh_tag to l0np2q0y78ztfyiaydeir1lj9xpth27e 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l0np2q0y78ztfyiaydeir1lj9xpth27e 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to mlep0ten9sx80uk1etvwu634czuv26r7 2024-09-05T00:51:38.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state_impl: setting s->olh_tag to l0jm4ppu5yj2qkhoykvkl7ev3r7r9mks 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l0jm4ppu5yj2qkhoykvkl7ev3r7r9mks 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to h2m1s7up1c09ov1gov9jm9yjyno6i9pf 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state_impl: setting s->olh_tag to 8zk3rdf4q2old0huex7raae1fx3bsljt 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zk3rdf4q2old0huex7raae1fx3bsljt 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to qsjrssrlafbz9r03kq155kz2e4aqhvdj 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 get_obj_state_impl: setting s->olh_tag to 67xpnn3hs5rlxb793il19jyy70sb8h80 2024-09-05T00:51:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=67xpnn3hs5rlxb793il19jyy70sb8h80 2024-09-05T00:51:38.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.550+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-05T00:51:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 olh_log_entry: epoch=2 op=3 key=f[1OS-cACQE5i.fYl0dePPvSWs1ZOX6f9] 2024-09-05T00:51:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b64fc0 obj=check-bucket:_:1OS-cACQE5i.fYl0dePPvSWs1ZOX6f9_f state=0x564e87c087b8 s->prefetch_data=0 2024-09-05T00:51:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 olh_log_entry: epoch=3 op=3 key=d[taoveaZZV.te65v.gF-v7Wd2thZEMKx] 2024-09-05T00:51:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e878c2910 obj=check-bucket:_:taoveaZZV.te65v.gF-v7Wd2thZEMKx_d state=0x564e87c0e208 s->prefetch_data=0 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 10 manifest: total_size = 9 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16382158284506116052 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b64fc0 obj=check-bucket:_:1OS-cACQE5i.fYl0dePPvSWs1ZOX6f9_f state=0x564e87c087b8 s->prefetch_data=0 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 prepare_atomic_modification: state is not atomic. state=0x564e87c087b8 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 10 manifest: total_size = 22 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5464655189472506124 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e878c2910 obj=check-bucket:_:taoveaZZV.te65v.gF-v7Wd2thZEMKx_d state=0x564e87c0e208 s->prefetch_data=0 2024-09-05T00:51:38.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 prepare_atomic_modification: state is not atomic. state=0x564e87c0e208 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.554+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 olh_log_entry: epoch=2 op=3 key=e[Zc.0OBNpOZw9O5s-f21v4u1hiDuK3UV] 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e8781d3b0 obj=check-bucket:_:Zc.0OBNpOZw9O5s-f21v4u1hiDuK3UV_e state=0x564e87c1a3b8 s->prefetch_data=0 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 olh_log_entry: epoch=3 op=3 key=c[ZPac06PkKT32TElssNJEparhqd9tMft] 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b67330 obj=check-bucket:_:ZPac06PkKT32TElssNJEparhqd9tMft_c state=0x564e87c201b8 s->prefetch_data=0 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 10 manifest: total_size = 12 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.979410888144782618 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e8781d3b0 obj=check-bucket:_:Zc.0OBNpOZw9O5s-f21v4u1hiDuK3UV_e state=0x564e87c1a3b8 s->prefetch_data=0 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 prepare_atomic_modification: state is not atomic. state=0x564e87c1a3b8 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 10 manifest: total_size = 22 2024-09-05T00:51:38.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2022150048517080798 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b67330 obj=check-bucket:_:ZPac06PkKT32TElssNJEparhqd9tMft_c state=0x564e87c201b8 s->prefetch_data=0 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 prepare_atomic_modification: state is not atomic. state=0x564e87c201b8 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-05T00:51:38.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:1OS-cACQE5i.fYl0dePPvSWs1ZOX6f9_.2gm6mu5Y_KKy-fvfdrAqIQLuow4e6cG_0 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.558+0000 7f463b98d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:taoveaZZV.te65v.gF-v7Wd2thZEMKx_.cVZ1FS-l-DAfNMQvRE2sng_8vW9jPZA_0 2024-09-05T00:51:38.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f451cff9640 20 handle_completion(): completion ok for obj=f[1OS-cACQE5i.fYl0dePPvSWs1ZOX6f9] 2024-09-05T00:51:38.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:38.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:38.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-05T00:51:38.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:38.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:Zc.0OBNpOZw9O5s-f21v4u1hiDuK3UV_.I3RbqpqFfxJfXO3SAEygg3qEG53gV7b_0 2024-09-05T00:51:38.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:38.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T00:51:38.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:38.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.562+0000 7f463b98d9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:ZPac06PkKT32TElssNJEparhqd9tMft_.zhVk7lTOvdcjQR3saBTNjreKIQ9dYqm_0 2024-09-05T00:51:38.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f450bfff640 20 handle_completion(): completion ok for obj=d[taoveaZZV.te65v.gF-v7Wd2thZEMKx] 2024-09-05T00:51:38.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f463b98d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:38.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e87b64fc0 obj=check-bucket:f state=0x564e87b5d8a8 s->prefetch_data=0 2024-09-05T00:51:38.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=67xpnn3hs5rlxb793il19jyy70sb8h80 2024-09-05T00:51:38.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.566+0000 7f450bfff640 20 handle_completion(): completion ok for obj=c[ZPac06PkKT32TElssNJEparhqd9tMft] 2024-09-05T00:51:38.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.570+0000 7f451cff9640 20 handle_completion(): completion ok for obj=e[Zc.0OBNpOZw9O5s-f21v4u1hiDuK3UV] 2024-09-05T00:51:38.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.570+0000 7f463b98d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:38.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.570+0000 7f463b98d9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:38.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.570+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:38.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.570+0000 7f463b98d9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-05T00:51:38.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 get_obj_state: octx=0x564e8781d3b0 obj=check-bucket:e state=0x564e87b62728 s->prefetch_data=0 2024-09-05T00:51:38.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l0np2q0y78ztfyiaydeir1lj9xpth27e 2024-09-05T00:51:38.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:38.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-05T00:51:38.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.574+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:38.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-05T00:51:38.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:38.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-05T00:51:38.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f463b98d9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-05T00:51:38.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.578+0000 7f44ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:38.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.582+0000 7f463b98d9c0 20 remove_watcher() i=0 2024-09-05T00:51:38.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.582+0000 7f463b98d9c0 2 removed watcher, disabling cache 2024-09-05T00:51:38.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.586+0000 7f463b98d9c0 20 remove_watcher() i=1 2024-09-05T00:51:38.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.590+0000 7f463b98d9c0 20 remove_watcher() i=2 2024-09-05T00:51:38.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.590+0000 7f463b98d9c0 20 remove_watcher() i=3 2024-09-05T00:51:38.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.594+0000 7f463b98d9c0 20 remove_watcher() i=4 2024-09-05T00:51:38.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.594+0000 7f463b98d9c0 20 remove_watcher() i=5 2024-09-05T00:51:38.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.594+0000 7f463b98d9c0 20 remove_watcher() i=6 2024-09-05T00:51:38.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:38.598+0000 7f463b98d9c0 20 remove_watcher() i=7 2024-09-05T00:51:38.740 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-05T00:51:38.740 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:39.132 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-05T00:51:39.132 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:39.133 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-05T00:51:39.171 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:39.171 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:39.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.210+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 realm 2024-09-05T00:51:39.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:39.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:39.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.214+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.218+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:39.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.218+0000 7f84c62739c0 20 searching for the correct realm 2024-09-05T00:51:39.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.222+0000 7f84c457a640 0 -- 172.21.15.99:0/3030878974 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f84ac038070 msgr2=0x7f84ac038450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:39.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.438+0000 7f84c457a640 0 -- 172.21.15.99:0/3030878974 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f84ac038070 msgr2=0x7f84ac038450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.450+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:39.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 zone default found 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 4 Realm: () 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 zonegroup default 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:39.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 started sync module instance, tier type = 2024-09-05T00:51:39.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.454+0000 7f84c62739c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:39.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=0 2024-09-05T00:51:39.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=1 2024-09-05T00:51:39.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=2 2024-09-05T00:51:39.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=3 2024-09-05T00:51:39.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=4 2024-09-05T00:51:39.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=5 2024-09-05T00:51:39.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.478+0000 7f84c62739c0 20 add_watcher() i=6 2024-09-05T00:51:39.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.482+0000 7f84c62739c0 20 add_watcher() i=7 2024-09-05T00:51:39.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.482+0000 7f84c62739c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:39.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f8379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:39.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:39.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:39.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 5 note: GC not initialized 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f8378fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 Filter name: none 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f82f27fc640 20 reqs_thread_entry: start 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:39.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:39.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:39.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:39.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:39.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:39.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:39.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:39.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:39.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.486+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-05T00:51:39.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:39.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T00:51:39.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:39.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T00:51:39.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:39.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T00:51:39.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.490+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:39.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-05T00:51:39.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:39.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T00:51:39.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:39.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T00:51:39.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:39.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-05T00:51:39.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:39.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T00:51:39.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.494+0000 7f84c62739c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:39.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.498+0000 7f84c62739c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-05T00:51:39.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.498+0000 7f84c62739c0 1 NOTICE: finished all shards (0 entries found) 2024-09-05T00:51:39.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.498+0000 7f8379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:39.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.506+0000 7f84c62739c0 20 remove_watcher() i=0 2024-09-05T00:51:39.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.506+0000 7f84c62739c0 2 removed watcher, disabling cache 2024-09-05T00:51:39.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.506+0000 7f84c62739c0 20 remove_watcher() i=1 2024-09-05T00:51:39.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.510+0000 7f84c62739c0 20 remove_watcher() i=2 2024-09-05T00:51:39.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.514+0000 7f84c62739c0 20 remove_watcher() i=3 2024-09-05T00:51:39.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.514+0000 7f84c62739c0 20 remove_watcher() i=4 2024-09-05T00:51:39.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.518+0000 7f84c62739c0 20 remove_watcher() i=5 2024-09-05T00:51:39.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.518+0000 7f84c62739c0 20 remove_watcher() i=6 2024-09-05T00:51:39.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:39.518+0000 7f84c62739c0 20 remove_watcher() i=7 2024-09-05T00:51:39.968 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-05T00:51:40.004 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:40.004 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:40.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 realm 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.042+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:40.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.046+0000 7ff4ef3fe9c0 20 searching for the correct realm 2024-09-05T00:51:40.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.050+0000 7ff4ed705640 0 -- 172.21.15.99:0/1226625130 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff4d40e1040 msgr2=0x7ff4d40d4770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.058+0000 7ff4ecf04640 0 -- 172.21.15.99:0/1226625130 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7ff4e404b3f0 msgr2=0x7ff4e404b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:40.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:40.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 zone default found 2024-09-05T00:51:40.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 4 Realm: () 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 zonegroup default 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.066+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.070+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.070+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.070+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.070+0000 7ff4ef3fe9c0 20 started sync module instance, tier type = 2024-09-05T00:51:40.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.070+0000 7ff4ef3fe9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:40.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=0 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=1 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=2 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=3 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=4 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=5 2024-09-05T00:51:40.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=6 2024-09-05T00:51:40.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 20 add_watcher() i=7 2024-09-05T00:51:40.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.086+0000 7ff4ef3fe9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:40.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff3a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 5 note: GC not initialized 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff3a1fe3640 20 reqs_thread_entry: start 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 Filter name: none 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff3137fe640 20 reqs_thread_entry: start 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:40.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=0 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=1 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.090+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=2 2024-09-05T00:51:40.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:40.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=3 2024-09-05T00:51:40.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=4 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=5 2024-09-05T00:51:40.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.094+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-05T00:51:40.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=6 2024-09-05T00:51:40.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:40.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=7 2024-09-05T00:51:40.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:40.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=8 2024-09-05T00:51:40.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=9 2024-09-05T00:51:40.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:40.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 INFO: main: starting shard=10 2024-09-05T00:51:40.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.098+0000 7ff4ef3fe9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:40.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.102+0000 7ff4ef3fe9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.102+0000 7ff4ef3fe9c0 20 INFO: main: done 2024-09-05T00:51:40.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.102+0000 7ff3a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.106+0000 7ff4ef3fe9c0 20 remove_watcher() i=0 2024-09-05T00:51:40.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.106+0000 7ff4ef3fe9c0 2 removed watcher, disabling cache 2024-09-05T00:51:40.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.110+0000 7ff4ef3fe9c0 20 remove_watcher() i=1 2024-09-05T00:51:40.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.110+0000 7ff4ef3fe9c0 20 remove_watcher() i=2 2024-09-05T00:51:40.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.114+0000 7ff4ef3fe9c0 20 remove_watcher() i=3 2024-09-05T00:51:40.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.114+0000 7ff4ef3fe9c0 20 remove_watcher() i=4 2024-09-05T00:51:40.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.118+0000 7ff4ef3fe9c0 20 remove_watcher() i=5 2024-09-05T00:51:40.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.118+0000 7ff4ef3fe9c0 20 remove_watcher() i=6 2024-09-05T00:51:40.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.118+0000 7ff4ef3fe9c0 20 remove_watcher() i=7 2024-09-05T00:51:40.137 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-05T00:51:40.166 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:40.166 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.206+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.206+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.206+0000 7f77f5e0c9c0 20 realm 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.206+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:40.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.210+0000 7f77f5e0c9c0 20 searching for the correct realm 2024-09-05T00:51:40.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.214+0000 7f77f4113640 0 -- 172.21.15.99:0/439166358 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f77e8081c20 msgr2=0x7f77e8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.430+0000 7f77f4113640 0 -- 172.21.15.99:0/439166358 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f77e8081c20 msgr2=0x7f77e8071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:40.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.442+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:40.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 zone default found 2024-09-05T00:51:40.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 4 Realm: () 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 zonegroup default 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 started sync module instance, tier type = 2024-09-05T00:51:40.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.446+0000 7f77f5e0c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=0 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=1 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=2 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=3 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=4 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=5 2024-09-05T00:51:40.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=6 2024-09-05T00:51:40.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 20 add_watcher() i=7 2024-09-05T00:51:40.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.474+0000 7f77f5e0c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:40.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.478+0000 7f76a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:40.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:40.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 5 note: GC not initialized 2024-09-05T00:51:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f76a8fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 Filter name: none 2024-09-05T00:51:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f76227fc640 20 reqs_thread_entry: start 2024-09-05T00:51:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:40.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:40.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:40.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 INFO: main: starting shard=0 2024-09-05T00:51:40.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:40.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 INFO: main: starting shard=1 2024-09-05T00:51:40.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.482+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:40.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: starting shard=2 2024-09-05T00:51:40.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:40.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: starting shard=3 2024-09-05T00:51:40.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:40.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: starting shard=4 2024-09-05T00:51:40.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:40.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 INFO: main: starting shard=5 2024-09-05T00:51:40.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.486+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: starting shard=6 2024-09-05T00:51:40.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:40.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: starting shard=7 2024-09-05T00:51:40.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:40.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: starting shard=8 2024-09-05T00:51:40.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-05T00:51:40.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 INFO: main: starting shard=9 2024-09-05T00:51:40.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.490+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:40.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f77f5e0c9c0 20 INFO: main: starting shard=10 2024-09-05T00:51:40.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f77f5e0c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:40.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f77f5e0c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f77f5e0c9c0 20 INFO: main: done 2024-09-05T00:51:40.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.494+0000 7f76a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.498+0000 7f77f5e0c9c0 20 remove_watcher() i=0 2024-09-05T00:51:40.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.498+0000 7f77f5e0c9c0 2 removed watcher, disabling cache 2024-09-05T00:51:40.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.502+0000 7f77f5e0c9c0 20 remove_watcher() i=1 2024-09-05T00:51:40.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.506+0000 7f77f5e0c9c0 20 remove_watcher() i=2 2024-09-05T00:51:40.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.506+0000 7f77f5e0c9c0 20 remove_watcher() i=3 2024-09-05T00:51:40.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.510+0000 7f77f5e0c9c0 20 remove_watcher() i=4 2024-09-05T00:51:40.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.514+0000 7f77f5e0c9c0 20 remove_watcher() i=5 2024-09-05T00:51:40.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.514+0000 7f77f5e0c9c0 20 remove_watcher() i=6 2024-09-05T00:51:40.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.514+0000 7f77f5e0c9c0 20 remove_watcher() i=7 2024-09-05T00:51:40.534 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-05T00:51:40.535 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:40.535 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-05T00:51:40.568 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:40.568 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.606+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 realm 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:40.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.610+0000 7f1121a2c9c0 20 searching for the correct realm 2024-09-05T00:51:40.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.618+0000 7f111f532640 0 -- 172.21.15.99:0/1583386737 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f1118074c20 msgr2=0x7f111805d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.626+0000 7f111f532640 0 -- 172.21.15.99:0/1583386737 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f1118024070 msgr2=0x7f1118091a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:40.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:40.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 zone default found 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 4 Realm: () 2024-09-05T00:51:40.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 zonegroup default 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.630+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.634+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.634+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.634+0000 7f1121a2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.634+0000 7f1121a2c9c0 20 started sync module instance, tier type = 2024-09-05T00:51:40.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.634+0000 7f1121a2c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=0 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=1 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=2 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=3 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=4 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=5 2024-09-05T00:51:40.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=6 2024-09-05T00:51:40.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 20 add_watcher() i=7 2024-09-05T00:51:40.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.650+0000 7f1121a2c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f0fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 5 note: GC not initialized 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f0fd4fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 Filter name: none 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f0f4e7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.654+0000 7f1121a2c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:40.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T00:51:40.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:40.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T00:51:40.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:40.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T00:51:40.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.658+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-05T00:51:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T00:51:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T00:51:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-05T00:51:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.662+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:40.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.666+0000 7f1121a2c9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T00:51:40.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.666+0000 7f1121a2c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:40.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.666+0000 7f1121a2c9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-05T00:51:40.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.666+0000 7f1121a2c9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-05T00:51:40.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.666+0000 7f0fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.674+0000 7f1121a2c9c0 20 remove_watcher() i=0 2024-09-05T00:51:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.674+0000 7f1121a2c9c0 2 removed watcher, disabling cache 2024-09-05T00:51:40.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.674+0000 7f1121a2c9c0 20 remove_watcher() i=1 2024-09-05T00:51:40.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.678+0000 7f1121a2c9c0 20 remove_watcher() i=2 2024-09-05T00:51:40.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.678+0000 7f1121a2c9c0 20 remove_watcher() i=3 2024-09-05T00:51:40.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.682+0000 7f1121a2c9c0 20 remove_watcher() i=4 2024-09-05T00:51:40.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.682+0000 7f1121a2c9c0 20 remove_watcher() i=5 2024-09-05T00:51:40.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.682+0000 7f1121a2c9c0 20 remove_watcher() i=6 2024-09-05T00:51:40.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.686+0000 7f1121a2c9c0 20 remove_watcher() i=7 2024-09-05T00:51:40.701 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-05T00:51:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:40.702 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-05T00:51:40.732 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:40.733 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 realm 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.770+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.774+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.774+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.774+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.774+0000 7fe75e0669c0 20 searching for the correct realm 2024-09-05T00:51:40.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.778+0000 7fe75c36d640 0 -- 172.21.15.99:0/4108667277 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe75008b070 msgr2=0x7fe750076a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.786+0000 7fe75bb6c640 0 -- 172.21.15.99:0/4108667277 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fe75404b040 msgr2=0x7fe75404c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:40.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:40.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:40.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 zone default found 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 4 Realm: () 2024-09-05T00:51:40.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 zonegroup default 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 started sync module instance, tier type = 2024-09-05T00:51:40.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.794+0000 7fe75e0669c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:40.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=0 2024-09-05T00:51:40.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=1 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=2 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=3 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=4 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=5 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.810+0000 7fe75e0669c0 20 add_watcher() i=6 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.814+0000 7fe75e0669c0 20 add_watcher() i=7 2024-09-05T00:51:40.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.814+0000 7fe75e0669c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:40.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.814+0000 7fe611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 5 note: GC not initialized 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe610fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 Filter name: none 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe58a7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:40.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:40.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:40.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:40.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:40.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-05T00:51:40.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:40.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-05T00:51:40.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.818+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffbf4f3b0 obj=check-bucket:d state=0x55fffc296d18 s->prefetch_data=0 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.822+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffbff4900 obj=check-bucket:c state=0x55fffc292678 s->prefetch_data=0 2024-09-05T00:51:40.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:40.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-05T00:51:40.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:40.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 get_obj_state: setting s->obj_tag to mlep0ten9sx80uk1etvwu634czuv26r7 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 get_obj_state_impl: setting s->olh_tag to l0jm4ppu5yj2qkhoykvkl7ev3r7r9mks 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 get_obj_state: setting s->obj_tag to h2m1s7up1c09ov1gov9jm9yjyno6i9pf 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 get_obj_state_impl: setting s->olh_tag to 8zk3rdf4q2old0huex7raae1fx3bsljt 2024-09-05T00:51:40.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.826+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 olh_log_entry: epoch=4 op=3 key=d[ErpD1LSLlI.Woq-q8B-VrNjUu-xGFad] 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffc2beaa0 obj=check-bucket:_:ErpD1LSLlI.Woq-q8B-VrNjUu-xGFad_d state=0x55fffc290f68 s->prefetch_data=0 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 olh_log_entry: epoch=4 op=3 key=c[NEdXjoLnF4jW5nPWWwe3f7BvJIuW6r.] 2024-09-05T00:51:40.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffc2deaa0 obj=check-bucket:_:NEdXjoLnF4jW5nPWWwe3f7BvJIuW6r._c state=0x55fffc2e8df8 s->prefetch_data=0 2024-09-05T00:51:40.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffc2beaa0 obj=check-bucket:d state=0x55fffc2e8df8 s->prefetch_data=0 2024-09-05T00:51:40.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 get_obj_state: setting s->obj_tag to mlep0ten9sx80uk1etvwu634czuv26r7 2024-09-05T00:51:40.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 get_obj_state_impl: setting s->olh_tag to l0jm4ppu5yj2qkhoykvkl7ev3r7r9mks 2024-09-05T00:51:40.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.830+0000 7fe75e0669c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l0jm4ppu5yj2qkhoykvkl7ev3r7r9mks 2024-09-05T00:51:40.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 20 get_obj_state: octx=0x55fffc2deaa0 obj=check-bucket:c state=0x55fffc2e3da8 s->prefetch_data=0 2024-09-05T00:51:40.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 20 get_obj_state: setting s->obj_tag to h2m1s7up1c09ov1gov9jm9yjyno6i9pf 2024-09-05T00:51:40.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 20 get_obj_state_impl: setting s->olh_tag to 8zk3rdf4q2old0huex7raae1fx3bsljt 2024-09-05T00:51:40.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zk3rdf4q2old0huex7raae1fx3bsljt 2024-09-05T00:51:40.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:40.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.834+0000 7fe75e0669c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-05T00:51:40.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.838+0000 7fe75e0669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:40.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.842+0000 7fe75e0669c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-05T00:51:40.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.842+0000 7fe75e0669c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-05T00:51:40.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.842+0000 7fe611fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.846+0000 7fe75e0669c0 20 remove_watcher() i=0 2024-09-05T00:51:40.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.846+0000 7fe75e0669c0 2 removed watcher, disabling cache 2024-09-05T00:51:40.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.850+0000 7fe75e0669c0 20 remove_watcher() i=1 2024-09-05T00:51:40.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.850+0000 7fe75e0669c0 20 remove_watcher() i=2 2024-09-05T00:51:40.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.854+0000 7fe75e0669c0 20 remove_watcher() i=3 2024-09-05T00:51:40.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.854+0000 7fe75e0669c0 20 remove_watcher() i=4 2024-09-05T00:51:40.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.858+0000 7fe75e0669c0 20 remove_watcher() i=5 2024-09-05T00:51:40.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.858+0000 7fe75e0669c0 20 remove_watcher() i=6 2024-09-05T00:51:40.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.858+0000 7fe75e0669c0 20 remove_watcher() i=7 2024-09-05T00:51:40.877 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-05T00:51:40.906 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:40.906 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:40.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.942+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 realm 2024-09-05T00:51:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:40.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.946+0000 7fb28ae989c0 20 searching for the correct realm 2024-09-05T00:51:40.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.950+0000 7fb28919f640 0 -- 172.21.15.99:0/2798539138 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb27c091c20 msgr2=0x7fb27c010400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.958+0000 7fb28899e640 0 -- 172.21.15.99:0/2798539138 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fb2800687e0 msgr2=0x7fb28005f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:40.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:40.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:40.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 zone default found 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 4 Realm: () 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:40.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 zonegroup default 2024-09-05T00:51:40.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.966+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.970+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.970+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.970+0000 7fb28ae989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:40.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.970+0000 7fb28ae989c0 20 started sync module instance, tier type = 2024-09-05T00:51:40.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.970+0000 7fb28ae989c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:40.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=0 2024-09-05T00:51:40.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=1 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=2 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=3 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=4 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=5 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=6 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 20 add_watcher() i=7 2024-09-05T00:51:40.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.986+0000 7fb28ae989c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:40.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb13efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 5 note: GC not initialized 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb13dfe3640 20 reqs_thread_entry: start 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 Filter name: none 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb0af7fe640 20 reqs_thread_entry: start 2024-09-05T00:51:40.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:40.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:40.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: starting shard=0 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: starting shard=1 2024-09-05T00:51:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 INFO: main: starting shard=2 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.990+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: starting shard=3 2024-09-05T00:51:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:40.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: starting shard=4 2024-09-05T00:51:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: starting shard=5 2024-09-05T00:51:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:41.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 INFO: main: starting shard=6 2024-09-05T00:51:41.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.994+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: starting shard=7 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: starting shard=8 2024-09-05T00:51:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:41.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: starting shard=9 2024-09-05T00:51:41.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:41.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: starting shard=10 2024-09-05T00:51:41.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:41.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:40.998+0000 7fb28ae989c0 20 INFO: main: done 2024-09-05T00:51:41.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.002+0000 7fb13efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:41.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.006+0000 7fb28ae989c0 20 remove_watcher() i=0 2024-09-05T00:51:41.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.006+0000 7fb28ae989c0 2 removed watcher, disabling cache 2024-09-05T00:51:41.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.006+0000 7fb28ae989c0 20 remove_watcher() i=1 2024-09-05T00:51:41.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.010+0000 7fb28ae989c0 20 remove_watcher() i=2 2024-09-05T00:51:41.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.010+0000 7fb28ae989c0 20 remove_watcher() i=3 2024-09-05T00:51:41.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.014+0000 7fb28ae989c0 20 remove_watcher() i=4 2024-09-05T00:51:41.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.014+0000 7fb28ae989c0 20 remove_watcher() i=5 2024-09-05T00:51:41.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.018+0000 7fb28ae989c0 20 remove_watcher() i=6 2024-09-05T00:51:41.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.018+0000 7fb28ae989c0 20 remove_watcher() i=7 2024-09-05T00:51:41.036 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-05T00:51:41.065 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:41.065 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:41.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.102+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 realm 2024-09-05T00:51:41.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:41.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:41.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:41.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.106+0000 7f98da4259c0 20 searching for the correct realm 2024-09-05T00:51:41.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.114+0000 7f98d7f2b640 0 -- 172.21.15.99:0/2312272140 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f98c80cb070 msgr2=0x7f98c812e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:41.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.118+0000 7f98d7f2b640 0 -- 172.21.15.99:0/2312272140 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f97a007ddf0 msgr2=0x7f97a0080220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:41.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:41.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:41.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:41.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:41.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 zone default found 2024-09-05T00:51:41.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 4 Realm: () 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 zonegroup default 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.126+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 started sync module instance, tier type = 2024-09-05T00:51:41.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.130+0000 7f98da4259c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=0 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=1 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=2 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=3 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=4 2024-09-05T00:51:41.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.146+0000 7f98da4259c0 20 add_watcher() i=5 2024-09-05T00:51:41.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.150+0000 7f98da4259c0 20 add_watcher() i=6 2024-09-05T00:51:41.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.150+0000 7f98da4259c0 20 add_watcher() i=7 2024-09-05T00:51:41.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.150+0000 7f98da4259c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:41.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f978dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:41.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 5 note: GC not initialized 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f978cfe1640 20 reqs_thread_entry: start 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 Filter name: none 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f97067fc640 20 reqs_thread_entry: start 2024-09-05T00:51:41.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:41.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:41.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:41.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: starting shard=0 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: starting shard=1 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 INFO: main: starting shard=2 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.154+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:41.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: starting shard=3 2024-09-05T00:51:41.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:41.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: starting shard=4 2024-09-05T00:51:41.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:41.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: starting shard=5 2024-09-05T00:51:41.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:41.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 INFO: main: starting shard=6 2024-09-05T00:51:41.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.158+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: starting shard=7 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: starting shard=8 2024-09-05T00:51:41.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:41.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: starting shard=9 2024-09-05T00:51:41.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: starting shard=10 2024-09-05T00:51:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.162+0000 7f98da4259c0 20 INFO: main: done 2024-09-05T00:51:41.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.166+0000 7f978dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:41.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.170+0000 7f98da4259c0 20 remove_watcher() i=0 2024-09-05T00:51:41.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.170+0000 7f98da4259c0 2 removed watcher, disabling cache 2024-09-05T00:51:41.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.170+0000 7f98da4259c0 20 remove_watcher() i=1 2024-09-05T00:51:41.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.174+0000 7f98da4259c0 20 remove_watcher() i=2 2024-09-05T00:51:41.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.178+0000 7f98da4259c0 20 remove_watcher() i=3 2024-09-05T00:51:41.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.178+0000 7f98da4259c0 20 remove_watcher() i=4 2024-09-05T00:51:41.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.178+0000 7f98da4259c0 20 remove_watcher() i=5 2024-09-05T00:51:41.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.182+0000 7f98da4259c0 20 remove_watcher() i=6 2024-09-05T00:51:41.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.182+0000 7f98da4259c0 20 remove_watcher() i=7 2024-09-05T00:51:41.200 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-05T00:51:41.200 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:41.201 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-05T00:51:41.229 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:41.229 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:41.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 realm 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.474+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:41.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:41.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.478+0000 7f669f5ec9c0 20 searching for the correct realm 2024-09-05T00:51:41.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.482+0000 7f669d8f3640 0 -- 172.21.15.99:0/1456296264 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6694123310 msgr2=0x7f669410f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:41.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.490+0000 7f669d8f3640 0 -- 172.21.15.99:0/1456296264 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f656807df00 msgr2=0x7f6568080330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.498+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:41.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 zone default found 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 4 Realm: () 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 zonegroup default 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:41.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 started sync module instance, tier type = 2024-09-05T00:51:41.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.502+0000 7f669f5ec9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:41.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=0 2024-09-05T00:51:41.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=1 2024-09-05T00:51:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=2 2024-09-05T00:51:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=3 2024-09-05T00:51:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=4 2024-09-05T00:51:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=5 2024-09-05T00:51:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.522+0000 7f669f5ec9c0 20 add_watcher() i=6 2024-09-05T00:51:41.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.526+0000 7f669f5ec9c0 20 add_watcher() i=7 2024-09-05T00:51:41.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.526+0000 7f669f5ec9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:41.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f6553fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:41.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:41.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:41.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 5 note: GC not initialized 2024-09-05T00:51:41.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f6552fe5640 20 reqs_thread_entry: start 2024-09-05T00:51:41.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:41.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 Filter name: none 2024-09-05T00:51:41.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f6550fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:41.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:41.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:41.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.530+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-05T00:51:41.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T00:51:41.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.534+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:41.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-05T00:51:41.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:41.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T00:51:41.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:41.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T00:51:41.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:41.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-05T00:51:41.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:41.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T00:51:41.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.538+0000 7f669f5ec9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:41.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.542+0000 7f669f5ec9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-05T00:51:41.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.542+0000 7f669f5ec9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-05T00:51:41.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.542+0000 7f6553fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:41.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.546+0000 7f669f5ec9c0 20 remove_watcher() i=0 2024-09-05T00:51:41.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.546+0000 7f669f5ec9c0 2 removed watcher, disabling cache 2024-09-05T00:51:41.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.550+0000 7f669f5ec9c0 20 remove_watcher() i=1 2024-09-05T00:51:41.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.550+0000 7f669f5ec9c0 20 remove_watcher() i=2 2024-09-05T00:51:41.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.554+0000 7f669f5ec9c0 20 remove_watcher() i=3 2024-09-05T00:51:41.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.558+0000 7f669f5ec9c0 20 remove_watcher() i=4 2024-09-05T00:51:41.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.558+0000 7f669f5ec9c0 20 remove_watcher() i=5 2024-09-05T00:51:41.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.558+0000 7f669f5ec9c0 20 remove_watcher() i=6 2024-09-05T00:51:41.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:41.562+0000 7f669f5ec9c0 20 remove_watcher() i=7 2024-09-05T00:51:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-05T00:51:41.584 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:41.732 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-05T00:51:41.733 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:51:43.570 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-05T00:51:44.014 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-05T00:51:45.577 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:45.578 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-05T00:51:45.614 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:45.614 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:45.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:45.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:45.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 realm 2024-09-05T00:51:45.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:45.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:45.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:45.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:45.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:45.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.862+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:45.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.866+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:45.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.866+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:45.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.866+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:45.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.866+0000 7fc006fd79c0 20 searching for the correct realm 2024-09-05T00:51:45.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:45.870+0000 7fc0042dc640 0 -- 172.21.15.99:0/880640036 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fbff408c070 msgr2=0x7fbff405d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:46.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.086+0000 7fc004add640 0 -- 172.21.15.99:0/880640036 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x55763d32b1f0 msgr2=0x7fbffc025400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:46.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.098+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:46.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 zone default found 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 4 Realm: () 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:46.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:46.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 zonegroup default 2024-09-05T00:51:46.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 started sync module instance, tier type = 2024-09-05T00:51:46.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.102+0000 7fc006fd79c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=0 2024-09-05T00:51:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=1 2024-09-05T00:51:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=2 2024-09-05T00:51:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=3 2024-09-05T00:51:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=4 2024-09-05T00:51:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.130+0000 7fc006fd79c0 20 add_watcher() i=5 2024-09-05T00:51:46.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.134+0000 7fc006fd79c0 20 add_watcher() i=6 2024-09-05T00:51:46.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.134+0000 7fc006fd79c0 20 add_watcher() i=7 2024-09-05T00:51:46.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.134+0000 7fc006fd79c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:46.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fbebafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:46.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fc006fd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:46.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fc006fd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:46.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fc006fd79c0 5 note: GC not initialized 2024-09-05T00:51:46.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fbeb9fe3640 20 reqs_thread_entry: start 2024-09-05T00:51:46.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.138+0000 7fc006fd79c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:46.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 Filter name: none 2024-09-05T00:51:46.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fbe2b7fe640 20 reqs_thread_entry: start 2024-09-05T00:51:46.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:46.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: starting shard=0 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: starting shard=1 2024-09-05T00:51:46.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:46.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: starting shard=2 2024-09-05T00:51:46.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:46.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.142+0000 7fc006fd79c0 20 INFO: main: starting shard=3 2024-09-05T00:51:46.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:46.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: starting shard=4 2024-09-05T00:51:46.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:46.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: starting shard=5 2024-09-05T00:51:46.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:46.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 INFO: main: starting shard=6 2024-09-05T00:51:46.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.146+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:46.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: starting shard=7 2024-09-05T00:51:46.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:46.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: starting shard=8 2024-09-05T00:51:46.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:46.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-05T00:51:46.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: starting shard=9 2024-09-05T00:51:46.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:46.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 INFO: main: starting shard=10 2024-09-05T00:51:46.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.150+0000 7fc006fd79c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:46.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.154+0000 7fc006fd79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.154+0000 7fc006fd79c0 20 INFO: main: done 2024-09-05T00:51:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.154+0000 7fbebafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:46.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.158+0000 7fc006fd79c0 20 remove_watcher() i=0 2024-09-05T00:51:46.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.158+0000 7fc006fd79c0 2 removed watcher, disabling cache 2024-09-05T00:51:46.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.162+0000 7fc006fd79c0 20 remove_watcher() i=1 2024-09-05T00:51:46.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.162+0000 7fc006fd79c0 20 remove_watcher() i=2 2024-09-05T00:51:46.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.166+0000 7fc006fd79c0 20 remove_watcher() i=3 2024-09-05T00:51:46.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.170+0000 7fc006fd79c0 20 remove_watcher() i=4 2024-09-05T00:51:46.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.170+0000 7fc006fd79c0 20 remove_watcher() i=5 2024-09-05T00:51:46.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.174+0000 7fc006fd79c0 20 remove_watcher() i=6 2024-09-05T00:51:46.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.174+0000 7fc006fd79c0 20 remove_watcher() i=7 2024-09-05T00:51:46.446 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:46.446 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-05T00:51:46.483 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:46.483 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:46.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.522+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 realm 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:46.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.526+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.530+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:46.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.530+0000 7f60ed4819c0 20 searching for the correct realm 2024-09-05T00:51:46.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.530+0000 7f60ea786640 0 -- 172.21.15.99:0/2763707900 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f60dc025050 msgr2=0x7f60dc063a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:46.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.742+0000 7f60eaf87640 0 -- 172.21.15.99:0/2763707900 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f60e403f060 msgr2=0x7f60e4068a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:46.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:46.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:46.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 zone default found 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 4 Realm: () 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 zonegroup default 2024-09-05T00:51:46.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.758+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:46.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 started sync module instance, tier type = 2024-09-05T00:51:46.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.762+0000 7f60ed4819c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=0 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=1 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=2 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=3 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=4 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=5 2024-09-05T00:51:46.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.786+0000 7f60ed4819c0 20 add_watcher() i=6 2024-09-05T00:51:46.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.790+0000 7f60ed4819c0 20 add_watcher() i=7 2024-09-05T00:51:46.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.790+0000 7f60ed4819c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:46.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.794+0000 7f5fa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:46.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.794+0000 7f60ed4819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:46.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.794+0000 7f60ed4819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:46.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.794+0000 7f60ed4819c0 5 note: GC not initialized 2024-09-05T00:51:46.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f5f1bfff640 20 reqs_thread_entry: start 2024-09-05T00:51:46.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:46.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 Filter name: none 2024-09-05T00:51:46.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f5f19ffb640 20 reqs_thread_entry: start 2024-09-05T00:51:46.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:46.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:46.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:46.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:46.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:46.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: starting shard=0 2024-09-05T00:51:46.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:46.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: starting shard=1 2024-09-05T00:51:46.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:46.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 INFO: main: starting shard=2 2024-09-05T00:51:46.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.798+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:46.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: starting shard=3 2024-09-05T00:51:46.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:46.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: starting shard=4 2024-09-05T00:51:46.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:46.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 INFO: main: starting shard=5 2024-09-05T00:51:46.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.802+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:46.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-05T00:51:46.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: starting shard=6 2024-09-05T00:51:46.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:46.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: starting shard=7 2024-09-05T00:51:46.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:46.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: starting shard=8 2024-09-05T00:51:46.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:46.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 INFO: main: starting shard=9 2024-09-05T00:51:46.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.806+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:46.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f60ed4819c0 20 INFO: main: starting shard=10 2024-09-05T00:51:46.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f60ed4819c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:46.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f60ed4819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:46.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f60ed4819c0 20 INFO: main: done 2024-09-05T00:51:46.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.810+0000 7f5fa17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:46.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.818+0000 7f60ed4819c0 20 remove_watcher() i=0 2024-09-05T00:51:46.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.818+0000 7f60ed4819c0 2 removed watcher, disabling cache 2024-09-05T00:51:46.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.818+0000 7f60ed4819c0 20 remove_watcher() i=1 2024-09-05T00:51:46.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.822+0000 7f60ed4819c0 20 remove_watcher() i=2 2024-09-05T00:51:46.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.822+0000 7f60ed4819c0 20 remove_watcher() i=3 2024-09-05T00:51:46.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.826+0000 7f60ed4819c0 20 remove_watcher() i=4 2024-09-05T00:51:46.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.826+0000 7f60ed4819c0 20 remove_watcher() i=5 2024-09-05T00:51:46.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.830+0000 7f60ed4819c0 20 remove_watcher() i=6 2024-09-05T00:51:46.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:46.830+0000 7f60ed4819c0 20 remove_watcher() i=7 2024-09-05T00:51:47.074 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:47.074 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-05T00:51:47.109 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:47.109 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:47.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 realm 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.150+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.154+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:47.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.154+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.154+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:47.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.154+0000 7f53486e29c0 20 searching for the correct realm 2024-09-05T00:51:47.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.158+0000 7f53461e8640 0 -- 172.21.15.99:0/3768132597 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f5340026040 msgr2=0x7f5340060d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:47.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.166+0000 7f53461e8640 0 -- 172.21.15.99:0/3768132597 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f5340017020 msgr2=0x7f5340067a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:47.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:47.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:47.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:47.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:47.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:47.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:47.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 zone default found 2024-09-05T00:51:47.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 4 Realm: () 2024-09-05T00:51:47.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:47.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 zonegroup default 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 started sync module instance, tier type = 2024-09-05T00:51:47.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.174+0000 7f53486e29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=0 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=1 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=2 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=3 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=4 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=5 2024-09-05T00:51:47.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=6 2024-09-05T00:51:47.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 20 add_watcher() i=7 2024-09-05T00:51:47.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.194+0000 7f53486e29c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:47.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f51fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 5 note: GC not initialized 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f51777fe640 20 reqs_thread_entry: start 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 Filter name: none 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f51757fa640 20 reqs_thread_entry: start 2024-09-05T00:51:47.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:47.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.198+0000 7f53486e29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=0 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=1 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=2 2024-09-05T00:51:47.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:47.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=3 2024-09-05T00:51:47.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:47.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=4 2024-09-05T00:51:47.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:47.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 INFO: main: starting shard=5 2024-09-05T00:51:47.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.202+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:47.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: starting shard=6 2024-09-05T00:51:47.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:47.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: starting shard=7 2024-09-05T00:51:47.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:47.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: starting shard=8 2024-09-05T00:51:47.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:47.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 INFO: main: starting shard=9 2024-09-05T00:51:47.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.206+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:47.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f53486e29c0 20 INFO: main: starting shard=10 2024-09-05T00:51:47.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f53486e29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:47.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f53486e29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f53486e29c0 20 INFO: main: done 2024-09-05T00:51:47.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.210+0000 7f51fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:47.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.214+0000 7f53486e29c0 20 remove_watcher() i=0 2024-09-05T00:51:47.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.214+0000 7f53486e29c0 2 removed watcher, disabling cache 2024-09-05T00:51:47.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.218+0000 7f53486e29c0 20 remove_watcher() i=1 2024-09-05T00:51:47.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.218+0000 7f53486e29c0 20 remove_watcher() i=2 2024-09-05T00:51:47.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.222+0000 7f53486e29c0 20 remove_watcher() i=3 2024-09-05T00:51:47.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.222+0000 7f53486e29c0 20 remove_watcher() i=4 2024-09-05T00:51:47.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.226+0000 7f53486e29c0 20 remove_watcher() i=5 2024-09-05T00:51:47.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.226+0000 7f53486e29c0 20 remove_watcher() i=6 2024-09-05T00:51:47.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.230+0000 7f53486e29c0 20 remove_watcher() i=7 2024-09-05T00:51:47.390 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T00:51:47.390 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-05T00:51:47.425 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:47.425 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:47.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.462+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 realm 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.466+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.470+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.470+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.470+0000 7fd12c1529c0 20 searching for the correct realm 2024-09-05T00:51:47.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.474+0000 7fd12a459640 0 -- 172.21.15.99:0/2097704200 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd12007ea70 msgr2=0x7fd12009a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:47.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.482+0000 7fd12a459640 0 -- 172.21.15.99:0/2097704200 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fcff407de70 msgr2=0x7fcff40802a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:47.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:47.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.490+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 zone default found 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 4 Realm: () 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:47.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:47.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:47.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 zonegroup default 2024-09-05T00:51:47.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:47.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 started sync module instance, tier type = 2024-09-05T00:51:47.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.494+0000 7fd12c1529c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=0 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=1 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=2 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=3 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=4 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=5 2024-09-05T00:51:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.514+0000 7fd12c1529c0 20 add_watcher() i=6 2024-09-05T00:51:47.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.518+0000 7fd12c1529c0 20 add_watcher() i=7 2024-09-05T00:51:47.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.518+0000 7fd12c1529c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:47.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.518+0000 7fcfdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:47.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:47.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:47.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 5 note: GC not initialized 2024-09-05T00:51:47.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fcfda7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:47.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:47.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 Filter name: none 2024-09-05T00:51:47.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fcf4bfff640 20 reqs_thread_entry: start 2024-09-05T00:51:47.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T00:51:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: starting shard=0 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: starting shard=1 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: starting shard=2 2024-09-05T00:51:47.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:47.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 INFO: main: starting shard=3 2024-09-05T00:51:47.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.522+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: starting shard=4 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: starting shard=5 2024-09-05T00:51:47.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:47.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: starting shard=6 2024-09-05T00:51:47.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:47.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 INFO: main: starting shard=7 2024-09-05T00:51:47.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.526+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: starting shard=8 2024-09-05T00:51:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: starting shard=9 2024-09-05T00:51:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:47.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T00:51:47.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: starting shard=10 2024-09-05T00:51:47.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:47.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T00:51:47.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.530+0000 7fd12c1529c0 20 INFO: main: done 2024-09-05T00:51:47.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.534+0000 7fcfdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:47.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.538+0000 7fd12c1529c0 20 remove_watcher() i=0 2024-09-05T00:51:47.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.538+0000 7fd12c1529c0 2 removed watcher, disabling cache 2024-09-05T00:51:47.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.538+0000 7fd12c1529c0 20 remove_watcher() i=1 2024-09-05T00:51:47.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.542+0000 7fd12c1529c0 20 remove_watcher() i=2 2024-09-05T00:51:47.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.542+0000 7fd12c1529c0 20 remove_watcher() i=3 2024-09-05T00:51:47.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.546+0000 7fd12c1529c0 20 remove_watcher() i=4 2024-09-05T00:51:47.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.546+0000 7fd12c1529c0 20 remove_watcher() i=5 2024-09-05T00:51:47.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.550+0000 7fd12c1529c0 20 remove_watcher() i=6 2024-09-05T00:51:47.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:47.550+0000 7fd12c1529c0 20 remove_watcher() i=7 2024-09-05T00:51:47.594 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-05T00:51:48.028 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-05T00:51:48.460 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-05T00:51:48.489 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:48.490 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:48.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.526+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 realm 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:48.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:48.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.530+0000 7f29ae20f9c0 20 searching for the correct realm 2024-09-05T00:51:48.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.534+0000 7f29ab514640 0 -- 172.21.15.99:0/3820250715 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55c972f646c0 msgr2=0x55c972f66b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:48.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.542+0000 7f29ab514640 0 -- 172.21.15.99:0/3820250715 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f287407de40 msgr2=0x7f2874080270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:48.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 zone default found 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 4 Realm: () 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 zonegroup default 2024-09-05T00:51:48.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 started sync module instance, tier type = 2024-09-05T00:51:48.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.550+0000 7f29ae20f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:48.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=0 2024-09-05T00:51:48.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=1 2024-09-05T00:51:48.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=2 2024-09-05T00:51:48.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=3 2024-09-05T00:51:48.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=4 2024-09-05T00:51:48.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=5 2024-09-05T00:51:48.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.566+0000 7f29ae20f9c0 20 add_watcher() i=6 2024-09-05T00:51:48.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.570+0000 7f29ae20f9c0 20 add_watcher() i=7 2024-09-05T00:51:48.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.570+0000 7f29ae20f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:48.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.570+0000 7f2861fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:48.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:48.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:48.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 5 note: GC not initialized 2024-09-05T00:51:48.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f2860fe1640 20 reqs_thread_entry: start 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 Filter name: none 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f27da7fc640 20 reqs_thread_entry: start 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:48.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:48.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:48.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:48.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:48.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:48.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.574+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:48.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.578+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:48.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.578+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.578+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:48.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.578+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:48.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.582+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.582+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:48.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.582+0000 7f29ae20f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.594+0000 7f2861fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:48.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.598+0000 7f29ae20f9c0 20 remove_watcher() i=0 2024-09-05T00:51:48.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.598+0000 7f29ae20f9c0 2 removed watcher, disabling cache 2024-09-05T00:51:48.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.598+0000 7f29ae20f9c0 20 remove_watcher() i=1 2024-09-05T00:51:48.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.602+0000 7f29ae20f9c0 20 remove_watcher() i=2 2024-09-05T00:51:48.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.602+0000 7f29ae20f9c0 20 remove_watcher() i=3 2024-09-05T00:51:48.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.606+0000 7f29ae20f9c0 20 remove_watcher() i=4 2024-09-05T00:51:48.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.606+0000 7f29ae20f9c0 20 remove_watcher() i=5 2024-09-05T00:51:48.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.606+0000 7f29ae20f9c0 20 remove_watcher() i=6 2024-09-05T00:51:48.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.606+0000 7f29ae20f9c0 20 remove_watcher() i=7 2024-09-05T00:51:48.623 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-05T00:51:48.654 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:48.654 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:48.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 realm 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.690+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.694+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:48.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.694+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.694+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:48.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.694+0000 7fe8a6e199c0 20 searching for the correct realm 2024-09-05T00:51:48.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.694+0000 7fe8a411e640 0 -- 172.21.15.99:0/730765074 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fe89412ac20 msgr2=0x7fe8940e4a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:48.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.702+0000 7fe8a491f640 0 -- 172.21.15.99:0/730765074 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fe89c025040 msgr2=0x7fe89c025930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 zone default found 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 4 Realm: () 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 zonegroup default 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.710+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:48.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 started sync module instance, tier type = 2024-09-05T00:51:48.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.714+0000 7fe8a6e199c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=0 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=1 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=2 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=3 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=4 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=5 2024-09-05T00:51:48.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.730+0000 7fe8a6e199c0 20 add_watcher() i=6 2024-09-05T00:51:48.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.734+0000 7fe8a6e199c0 20 add_watcher() i=7 2024-09-05T00:51:48.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.734+0000 7fe8a6e199c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:48.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe75b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 5 note: GC not initialized 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe75a7e4640 20 reqs_thread_entry: start 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 Filter name: none 2024-09-05T00:51:48.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe7537fe640 20 reqs_thread_entry: start 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 : miss 2024-09-05T00:51:48.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 info.flags=0x17 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 to cache LRU end 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.0 2024-09-05T00:51:48.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.2 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.738+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.3 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-05T00:51:48.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.4 2024-09-05T00:51:48.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-05T00:51:48.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.6 2024-09-05T00:51:48.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-05T00:51:48.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.7 2024-09-05T00:51:48.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-05T00:51:48.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.742+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.9 2024-09-05T00:51:48.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-05T00:51:48.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df2ff763b0 obj=check-bucket:e state=0x55df302b87e8 s->prefetch_data=0 2024-09-05T00:51:48.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df3001b910 obj=check-bucket:d state=0x55df302b12c8 s->prefetch_data=0 2024-09-05T00:51:48.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.746+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302b7e40 obj=check-bucket:c state=0x55df302b54a8 s->prefetch_data=0 2024-09-05T00:51:48.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302bc940 obj=check-bucket:f state=0x55df302b2b88 s->prefetch_data=0 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to alpao1axbqijwctbxhj0o11mv7u2g6gd 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state_impl: setting s->olh_tag to 2hvpdo047m4keny55yormb4krphfd5nj 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2hvpdo047m4keny55yormb4krphfd5nj 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 3ka155sbr4k7b4y5c2pyo6sh0vbbuzv7 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state_impl: setting s->olh_tag to qo45mf90b82p4xnc7tfqo4o2as6bbmcm 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qo45mf90b82p4xnc7tfqo4o2as6bbmcm 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to ip1zyd0ojgiuc13kdp75ba2mxino8kvg 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state_impl: setting s->olh_tag to u8t966f1266d9o2r2wzsxskf106hfkdu 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u8t966f1266d9o2r2wzsxskf106hfkdu 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 7ceqf8ooives7005xvdusf6rv6s5bmvh 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 get_obj_state_impl: setting s->olh_tag to lhf5a3ek61i27xxayyfjv7xdx5n50kks 2024-09-05T00:51:48.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lhf5a3ek61i27xxayyfjv7xdx5n50kks 2024-09-05T00:51:48.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.750+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 olh_log_entry: epoch=3 op=3 key=d[pWWvGxjs5RIIgMmL45pXzQ0i0gbgmKx] 2024-09-05T00:51:48.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df3001b910 obj=check-bucket:_:pWWvGxjs5RIIgMmL45pXzQ0i0gbgmKx_d state=0x55df303531c8 s->prefetch_data=0 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 10 manifest: total_size = 22 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9976651105809940200 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df3001b910 obj=check-bucket:_:pWWvGxjs5RIIgMmL45pXzQ0i0gbgmKx_d state=0x55df303531c8 s->prefetch_data=0 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 prepare_atomic_modification: state is not atomic. state=0x55df303531c8 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-05T00:51:48.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 olh_log_entry: epoch=2 op=3 key=f[OthJ4Uakxcg8hlNHTNo-iI5oXq5sinb] 2024-09-05T00:51:48.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302bc940 obj=check-bucket:_:OthJ4Uakxcg8hlNHTNo-iI5oXq5sinb_f state=0x55df303679f8 s->prefetch_data=0 2024-09-05T00:51:48.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 10 manifest: total_size = 11 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12061074673116976574 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302bc940 obj=check-bucket:_:OthJ4Uakxcg8hlNHTNo-iI5oXq5sinb_f state=0x55df303679f8 s->prefetch_data=0 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 prepare_atomic_modification: state is not atomic. state=0x55df303679f8 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 olh_log_entry: epoch=2 op=3 key=e[DVQdSMpO3uC7oJ-EQW2SgFhbgdKr8ZF] 2024-09-05T00:51:48.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.754+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df2ff763b0 obj=check-bucket:_:DVQdSMpO3uC7oJ-EQW2SgFhbgdKr8ZF_e state=0x55df30371168 s->prefetch_data=0 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 10 manifest: total_size = 22 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2511547775102044478 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df2ff763b0 obj=check-bucket:_:DVQdSMpO3uC7oJ-EQW2SgFhbgdKr8ZF_e state=0x55df30371168 s->prefetch_data=0 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 prepare_atomic_modification: state is not atomic. state=0x55df30371168 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 olh_log_entry: epoch=3 op=3 key=c[pJfzqdfV7Uoi2-uWJAfQAd-nWEj-Ati] 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302b7e40 obj=check-bucket:_:pJfzqdfV7Uoi2-uWJAfQAd-nWEj-Ati_c state=0x55df30375488 s->prefetch_data=0 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:OthJ4Uakxcg8hlNHTNo-iI5oXq5sinb_.Jh4lXCeHSG6pt6oVNDKg6u24mlfGTao_0 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 10 manifest: total_size = 22 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10064584877731824069 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302b7e40 obj=check-bucket:_:pJfzqdfV7Uoi2-uWJAfQAd-nWEj-Ati_c state=0x55df30375488 s->prefetch_data=0 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 prepare_atomic_modification: state is not atomic. state=0x55df30375488 2024-09-05T00:51:48.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:48.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T00:51:48.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:48.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.758+0000 7fe8a6e199c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:pWWvGxjs5RIIgMmL45pXzQ0i0gbgmKx_.0MAU8Hl5zgUFSFgqGSYMHwepkb7pR0q_0 2024-09-05T00:51:48.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.762+0000 7fe77b7fe640 20 handle_completion(): completion ok for obj=f[OthJ4Uakxcg8hlNHTNo-iI5oXq5sinb] 2024-09-05T00:51:48.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe77b7fe640 20 handle_completion(): completion ok for obj=d[pWWvGxjs5RIIgMmL45pXzQ0i0gbgmKx] 2024-09-05T00:51:48.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:DVQdSMpO3uC7oJ-EQW2SgFhbgdKr8ZF_.MxWNr2h0eF0M2d0oQXdUqHE8Unpv7T-_0 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe77b7fe640 20 handle_completion(): completion ok for obj=e[DVQdSMpO3uC7oJ-EQW2SgFhbgdKr8ZF] 2024-09-05T00:51:48.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T00:51:48.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T00:51:48.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 0 deleting objects inline since gc isn't initialized 2024-09-05T00:51:48.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.766+0000 7fe8a6e199c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1__shadow:pJfzqdfV7Uoi2-uWJAfQAd-nWEj-Ati_.AAY-vIqGip8VV84wPnJRlBab_XNHKek_0 2024-09-05T00:51:48.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df302bc940 obj=check-bucket:f state=0x55df302b2b88 s->prefetch_data=0 2024-09-05T00:51:48.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lhf5a3ek61i27xxayyfjv7xdx5n50kks 2024-09-05T00:51:48.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:48.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.5 2024-09-05T00:51:48.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-05T00:51:48.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.770+0000 7fe8a6e199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T00:51:48.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.774+0000 7fe77bfff640 20 handle_completion(): completion ok for obj=c[pJfzqdfV7Uoi2-uWJAfQAd-nWEj-Ati] 2024-09-05T00:51:48.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.774+0000 7fe8a6e199c0 20 get_obj_state: octx=0x55df2ff763b0 obj=check-bucket:e state=0x55df302b87e8 s->prefetch_data=0 2024-09-05T00:51:48.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.774+0000 7fe8a6e199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2hvpdo047m4keny55yormb4krphfd5nj 2024-09-05T00:51:48.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.774+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.774+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.778+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.778+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.10 2024-09-05T00:51:48.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.778+0000 7fe8a6e199c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-05T00:51:48.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.778+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.8 2024-09-05T00:51:48.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.778+0000 7fe8a6e199c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-05T00:51:48.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.782+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.782+0000 7fe8a6e199c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1.1 2024-09-05T00:51:48.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.782+0000 7fe8a6e199c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-05T00:51:48.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.782+0000 7fe8a6e199c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-05T00:51:48.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.782+0000 7fe75b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:48.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.790+0000 7fe8a6e199c0 20 remove_watcher() i=0 2024-09-05T00:51:48.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.790+0000 7fe8a6e199c0 2 removed watcher, disabling cache 2024-09-05T00:51:48.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.790+0000 7fe8a6e199c0 20 remove_watcher() i=1 2024-09-05T00:51:48.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.794+0000 7fe8a6e199c0 20 remove_watcher() i=2 2024-09-05T00:51:48.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.794+0000 7fe8a6e199c0 20 remove_watcher() i=3 2024-09-05T00:51:48.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.798+0000 7fe8a6e199c0 20 remove_watcher() i=4 2024-09-05T00:51:48.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.798+0000 7fe8a6e199c0 20 remove_watcher() i=5 2024-09-05T00:51:48.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.802+0000 7fe8a6e199c0 20 remove_watcher() i=6 2024-09-05T00:51:48.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:48.802+0000 7fe8a6e199c0 20 remove_watcher() i=7 2024-09-05T00:51:49.288 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-05T00:51:49.322 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:51:49.322 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:51:49.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 realm 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.366+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.370+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:49.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.370+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.370+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:51:49.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.370+0000 7ffae78489c0 20 searching for the correct realm 2024-09-05T00:51:49.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.374+0000 7ffae5b4f640 0 -- 172.21.15.99:0/1601216156 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ffadc0c5040 msgr2=0x7ffadc0d2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:51:49.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.790+0000 7ffae4b4d640 0 -- 172.21.15.99:0/1601216156 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x563416bdc520 msgr2=0x563416bde910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T00:51:49.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:51:49.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:51:49.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:51:49.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:51:49.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:51:49.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:51:49.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:51:49.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 zone default found 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 4 Realm: () 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:51:49.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:51:49.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 zonegroup default 2024-09-05T00:51:49.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.806+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:51:49.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 started sync module instance, tier type = 2024-09-05T00:51:49.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.810+0000 7ffae78489c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:51:49.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=0 2024-09-05T00:51:49.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=1 2024-09-05T00:51:49.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=2 2024-09-05T00:51:49.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=3 2024-09-05T00:51:49.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=4 2024-09-05T00:51:49.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=5 2024-09-05T00:51:49.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=6 2024-09-05T00:51:49.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 20 add_watcher() i=7 2024-09-05T00:51:49.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.834+0000 7ffae78489c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:51:49.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ff99b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:49.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:51:49.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:51:49.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 5 note: GC not initialized 2024-09-05T00:51:49.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ff99a7e4640 20 reqs_thread_entry: start 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 20 init_complete bucket index max shards: 11 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 20 Filter name: none 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ff90bfff640 20 reqs_thread_entry: start 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.838+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:49.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados->read ofs=0 len=0 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-05T00:51:49.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.842+0000 7ffae78489c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T00:51:49.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.846+0000 7ff99b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:51:49.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.850+0000 7ffae78489c0 20 remove_watcher() i=0 2024-09-05T00:51:49.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.850+0000 7ffae78489c0 2 removed watcher, disabling cache 2024-09-05T00:51:49.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.854+0000 7ffae78489c0 20 remove_watcher() i=1 2024-09-05T00:51:49.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.854+0000 7ffae78489c0 20 remove_watcher() i=2 2024-09-05T00:51:49.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.858+0000 7ffae78489c0 20 remove_watcher() i=3 2024-09-05T00:51:49.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.858+0000 7ffae78489c0 20 remove_watcher() i=4 2024-09-05T00:51:49.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.862+0000 7ffae78489c0 20 remove_watcher() i=5 2024-09-05T00:51:49.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.862+0000 7ffae78489c0 20 remove_watcher() i=6 2024-09-05T00:51:49.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:51:49.862+0000 7ffae78489c0 20 remove_watcher() i=7 2024-09-05T00:51:49.883 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-05T00:51:49.883 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket check-bucket 2024-09-05T00:51:50.461 INFO:tasks.workunit.client.0.smithi099.stderr:Completed bucket check tests 2024-09-05T00:51:50.461 INFO:tasks.workunit.client.0.smithi099.stdout:connected to http://localhost:80 2024-09-05T00:51:50.548 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-09-05T00:51:50.548 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-05T00:51:50.548 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T00:51:50.548 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-09-05T00:51:50.549 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-09-05T00:51:50.550 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-09-05T00:51:50.551 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:51:50.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:51:50.604 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-05T00:51:50.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T00:51:51.011 DEBUG:teuthology.parallel:result is None 2024-09-05T00:51:51.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T00:51:51.024 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T00:51:51.024 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T00:51:51.093 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T00:51:51.093 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T00:51:51.105 INFO:tasks.workunit:Pulling workunits from ref ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:51:51.105 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T00:51:51.106 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T00:51:51.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T00:51:51.142 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-05T00:51:51.142 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T00:51:51.190 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-05T00:51:51.190 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-05T00:51:51.238 INFO:tasks.workunit:timeout=3h 2024-09-05T00:51:51.238 INFO:tasks.workunit:cleanup=True 2024-09-05T00:51:51.239 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T00:51:51.287 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T00:52:47.472 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'ede1507024117d16395cd6d958c594ff4aaf4da5'. 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.473 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T00:52:47.474 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at ede15070241 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-09-05T00:52:47.478 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T00:52:47.525 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T00:52:47.527 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T00:52:47.527 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T00:52:47.589 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T00:52:47.645 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T00:52:47.691 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T00:52:47.692 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T00:52:47.692 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T00:52:47.732 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T00:52:47.736 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T00:52:47.736 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T00:52:47.784 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-05T00:52:47.786 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-05T00:52:47.786 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-05T00:52:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:52:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-05T00:52:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:52:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from ClsLock 2024-09-05T00:52:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-05T00:52:49.302 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:49.303 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-09-05T00:52:49.303 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:49.303 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:49.303 INFO:tasks.workunit.client.0.smithi099.stdout: client.5193 expiration=2024-09-05T00:54:49.293433+0000 addr=v1:172.21.15.99:0/1058060833 cookie= 2024-09-05T00:52:49.314 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:49.314 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-09-05T00:52:49.314 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:49.315 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:49.315 INFO:tasks.workunit.client.0.smithi099.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.99:0/1173787040 cookie= 2024-09-05T00:52:49.315 INFO:tasks.workunit.client.0.smithi099.stdout: client.5193 expiration=2024-09-05T00:54:49.308152+0000 addr=v1:172.21.15.99:0/1058060833 cookie= 2024-09-05T00:52:49.318 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:49.318 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-09-05T00:52:49.318 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:49.318 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:49.318 INFO:tasks.workunit.client.0.smithi099.stdout: client.5033 expiration=0.000000 addr=v1:172.21.15.99:0/1173787040 cookie= 2024-09-05T00:52:50.245 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMultiLocking (2397 ms) 2024-09-05T00:52:50.246 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMeta 2024-09-05T00:52:52.339 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:52.339 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-09-05T00:52:52.339 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:52.339 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:52.339 INFO:tasks.workunit.client.0.smithi099.stdout: client.5211 expiration=0.000000 addr=v1:172.21.15.99:0/2822667211 cookie= 2024-09-05T00:52:52.344 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:52.344 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-09-05T00:52:52.344 INFO:tasks.workunit.client.0.smithi099.stdout: tag: new_tag 2024-09-05T00:52:52.344 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:52.344 INFO:tasks.workunit.client.0.smithi099.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.99:0/1434826886 cookie= 2024-09-05T00:52:53.291 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMeta (3045 ms) 2024-09-05T00:52:53.291 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestCookie 2024-09-05T00:52:55.588 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:55.588 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-09-05T00:52:55.588 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:55.588 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:55.590 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-09-05T00:52:55.590 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-09-05T00:52:55.591 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-09-05T00:52:55.591 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-09-05T00:52:55.591 INFO:tasks.workunit.client.0.smithi099.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.99:0/2978536351 cookie= 2024-09-05T00:52:55.591 INFO:tasks.workunit.client.0.smithi099.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.99:0/2978536351 cookie=new cookie 2024-09-05T00:52:56.355 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestCookie (3065 ms) 2024-09-05T00:52:56.356 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-05T00:52:59.403 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMultipleLocks (3047 ms) 2024-09-05T00:52:59.403 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-05T00:53:06.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestLockDuration (7119 ms) 2024-09-05T00:53:06.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-05T00:53:09.536 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestAssertLocked (3007 ms) 2024-09-05T00:53:09.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-05T00:53:12.584 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestSetCookie (3056 ms) 2024-09-05T00:53:12.585 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestRenew 2024-09-05T00:53:33.271 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestRenew (20686 ms) 2024-09-05T00:53:33.272 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-05T00:53:39.346 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6075 ms) 2024-09-05T00:53:39.347 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-05T00:53:46.426 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7080 ms) 2024-09-05T00:53:46.426 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-05T00:53:54.271 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7845 ms) 2024-09-05T00:53:54.272 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from ClsLock (66423 ms total) 2024-09-05T00:53:54.272 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:53:54.272 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:53:54.272 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (66423 ms total) 2024-09-05T00:53:54.272 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-09-05T00:53:54.277 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:53:54.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:53:54.333 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-05T00:53:54.335 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-05T00:53:54.335 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-05T00:53:54.398 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:53:54.398 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-05T00:53:54.398 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:53:54.398 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from cls_log 2024-09-05T00:53:54.398 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-05T00:53:57.292 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.test_log_add_same_time (2893 ms) 2024-09-05T00:53:57.292 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-05T00:54:00.349 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.test_log_add_different_time (3058 ms) 2024-09-05T00:54:00.349 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.trim_by_time 2024-09-05T00:54:03.365 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.trim_by_time (3016 ms) 2024-09-05T00:54:03.365 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.trim_by_marker (3063 ms) 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from cls_log (12030 ms total) 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (12030 ms total) 2024-09-05T00:54:06.433 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-09-05T00:54:06.437 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:54:06.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:54:06.496 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-05T00:54:06.497 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-05T00:54:06.498 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-05T00:54:06.559 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:54:06.559 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-05T00:54:06.559 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:54:06.559 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from cls_refcount 2024-09-05T00:54:06.559 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-05T00:54:09.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit (2887 ms) 2024-09-05T00:54:09.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-05T00:54:12.490 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3044 ms) 2024-09-05T00:54:12.490 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-05T00:54:21.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_put_snap (9086 ms) 2024-09-05T00:54:21.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-05T00:54:24.624 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_explicit (3048 ms) 2024-09-05T00:54:24.624 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.set 2024-09-05T00:54:27.632 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.set (3007 ms) 2024-09-05T00:54:27.632 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-05T00:54:34.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_ec (7066 ms) 2024-09-05T00:54:34.698 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-05T00:54:41.770 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7073 ms) 2024-09-05T00:54:41.770 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-05T00:54:53.907 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_put_snap_ec (12138 ms) 2024-09-05T00:54:53.908 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-05T00:55:00.983 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_explicit_ec (7075 ms) 2024-09-05T00:55:00.983 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.set_ec 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.set_ec (7042 ms) 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from cls_refcount (61466 ms total) 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 10 tests from 1 test suite ran. (61466 ms total) 2024-09-05T00:55:08.025 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 10 tests. 2024-09-05T00:55:08.033 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:55:08.034 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:55:08.089 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-05T00:55:08.090 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-05T00:55:08.090 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-05T00:55:08.159 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:55:08.160 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-05T00:55:08.160 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:55:08.160 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 18 tests from cls_rgw 2024-09-05T00:55:10.023 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_basic 2024-09-05T00:55:10.098 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_basic (76 ms) 2024-09-05T00:55:10.098 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-05T00:55:10.183 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (84 ms) 2024-09-05T00:55:10.183 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-05T00:55:10.292 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_remove_object (108 ms) 2024-09-05T00:55:10.292 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-05T00:55:12.784 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_suggest (2493 ms) 2024-09-05T00:55:12.784 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-05T00:55:12.798 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-09-05T00:55:12.798 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_list 2024-09-05T00:55:12.859 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_list (61 ms) 2024-09-05T00:55:12.859 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-05T00:55:55.462 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_list_delimited (42602 ms) 2024-09-05T00:55:55.463 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.bi_list 2024-09-05T00:55:55.582 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.bi_list (120 ms) 2024-09-05T00:55:55.582 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_set 2024-09-05T00:55:55.597 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_set (16 ms) 2024-09-05T00:55:55.597 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_list 2024-09-05T00:55:55.612 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_list (15 ms) 2024-09-05T00:55:55.612 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-05T00:56:02.478 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_defer (6866 ms) 2024-09-05T00:56:02.479 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-05T00:56:02.902 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_basic (423 ms) 2024-09-05T00:56:02.902 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-05T00:56:02.904 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-05T00:56:02.904 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-05T00:56:03.113 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_clear (210 ms) 2024-09-05T00:56:03.114 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-05T00:56:03.229 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.bi_log_trim (115 ms) 2024-09-05T00:56:03.229 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-05T00:56:03.266 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_racing_removes (37 ms) 2024-09-05T00:56:03.267 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-05T00:56:03.302 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.reshardlog_list (36 ms) 2024-09-05T00:56:03.302 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-05T00:56:03.326 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.reshardlog_num (24 ms) 2024-09-05T00:56:03.485 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 18 tests from cls_rgw (53304 ms total) 2024-09-05T00:56:03.485 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:56:03.485 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:56:03.485 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 18 tests from 1 test suite ran. (55326 ms total) 2024-09-05T00:56:03.486 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 18 tests. 2024-09-05T00:56:03.492 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:56:03.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:56:03.548 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-05T00:56:03.549 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-05T00:56:03.549 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-05T00:56:03.629 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:56:03.629 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-05T00:56:03.629 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:56:03.630 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-05T00:56:03.630 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.init 2024-09-05T00:56:05.485 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.init (1856 ms) 2024-09-05T00:56:05.485 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-05T00:56:05.516 INFO:tasks.workunit.client.0.smithi099.stderr:[ ] list info tag = chain-0 2024-09-05T00:56:05.517 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (31 ms) 2024-09-05T00:56:05.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-05T00:56:05.530 INFO:tasks.workunit.client.0.smithi099.stderr:[ ] next_marker is: = 0/4263 2024-09-05T00:56:05.530 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (14 ms) 2024-09-05T00:56:05.530 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-05T00:56:05.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (18 ms) 2024-09-05T00:56:05.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-05T00:56:05.886 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (338 ms) 2024-09-05T00:56:05.887 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-05T00:56:05.905 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (19 ms) 2024-09-05T00:56:05.905 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-05T00:56:05.922 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-05T00:56:05.922 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-05T00:56:05.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-05T00:56:05.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.finalize (563 ms) 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from cls_rgw_gc (2874 ms total) 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (2874 ms total) 2024-09-05T00:56:06.503 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-09-05T00:56:06.507 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:56:06.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:56:06.564 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-05T00:56:06.565 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-05T00:56:06.565 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-05T00:56:06.639 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:56:06.639 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:56:06.640 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 1 test from 1 test suite. 2024-09-05T00:56:06.640 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:56:08.529 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 1 test from cls_rgw_stats 2024-09-05T00:56:08.529 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-05T00:56:08.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.561+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.0 size=1048576 2024-09-05T00:56:08.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.561+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.1 size=1048576 2024-09-05T00:56:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.565+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.2 size=876063 2024-09-05T00:56:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.565+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=OLKNXQ8O0WCD tag=TXYJJ5QC1U29 type=write size=4021791 2024-09-05T00:56:08.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.569+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=CLTP5YSVW7TL type=del size=1459302 2024-09-05T00:56:08.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.569+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=QL8YHY3HQHY5 type=del size=3093013 2024-09-05T00:56:08.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.573+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=RCODYUZOX3U9 type=write size=447301 2024-09-05T00:56:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.573+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=PDZK1FBJ3PFK type=del size=1303690 2024-09-05T00:56:08.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.577+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=OCT7BIBAYXC3 type=del size=3435912 2024-09-05T00:56:08.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.581+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0027EV0S6FG9.0 size=1048576 2024-09-05T00:56:08.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.581+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0027EV0S6FG9.1 size=173495 2024-09-05T00:56:08.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.581+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=0027EV0S6FG9 tag=XO11RE9FJZW8 type=write size=2270647 2024-09-05T00:56:08.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.585+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=ZBKEL9X8RKKM type=write size=479839 2024-09-05T00:56:08.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.585+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=B5GYQR3FKHB9 type=del size=368082 2024-09-05T00:56:08.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.589+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=28Z3PZ67LEWA type=del size=1470398 2024-09-05T00:56:08.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.589+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=DJOQU1V147OT type=del size=2714913 2024-09-05T00:56:08.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.593+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=KM57GP7JHC70 type=del size=151456 2024-09-05T00:56:08.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.597+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.0 size=1048576 2024-09-05T00:56:08.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.597+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.1 size=1048576 2024-09-05T00:56:08.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.601+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.2 size=608886 2024-09-05T00:56:08.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.601+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=T8SNQF9KXM17 tag=ZN0VRLL44983 type=write size=3754614 2024-09-05T00:56:08.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.601+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=LWUP3AK4KYQ3 type=write size=373861 2024-09-05T00:56:08.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.605+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=Z0L5I9Q9JMYX type=del size=3574760 2024-09-05T00:56:08.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.609+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.0 size=1048576 2024-09-05T00:56:08.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.609+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.1 size=1048576 2024-09-05T00:56:08.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.613+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.2 size=245286 2024-09-05T00:56:08.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.613+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=UOTX73M3L90C tag=KZZPH2PPCLV7 type=write size=3391014 2024-09-05T00:56:08.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.613+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.0 size=1048576 2024-09-05T00:56:08.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.617+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.1 size=1048576 2024-09-05T00:56:08.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.617+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~OLKNXQ8O0WCD.2 size=876063 2024-09-05T00:56:08.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.621+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=OLKNXQ8O0WCD tag=TXYJJ5QC1U29 type=write size=4021791 2024-09-05T00:56:08.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.625+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~WZJT2DM9DA6W.0 size=984107 2024-09-05T00:56:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.625+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=WZJT2DM9DA6W tag=II7GVEO52E5M type=write size=2032683 2024-09-05T00:56:08.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.629+0000 7f325adab8c0 1 < suggested remove operation key=079QFDETDGGC tag=CLTP5YSVW7TL type=del 2024-09-05T00:56:08.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.633+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=EF7WI79WYC3M type=write size=982147 2024-09-05T00:56:08.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.637+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=QL8YHY3HQHY5 type=del 2024-09-05T00:56:08.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.637+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=N86J180D4UYD type=write size=111166 2024-09-05T00:56:08.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.641+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=RCODYUZOX3U9 type=write size=447301 2024-09-05T00:56:08.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.645+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=H2TQPO4X8N3W type=write size=699366 2024-09-05T00:56:08.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.645+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=PDZK1FBJ3PFK type=del 2024-09-05T00:56:08.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.649+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=KM1BVIB4LCAQ type=del size=2575438 2024-09-05T00:56:08.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.653+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=OCT7BIBAYXC3 type=del 2024-09-05T00:56:08.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.653+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=BX9WLKCF9KD7 type=del size=2245326 2024-09-05T00:56:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.657+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0027EV0S6FG9.0 size=1048576 2024-09-05T00:56:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.657+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~0027EV0S6FG9.1 size=173495 2024-09-05T00:56:08.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.661+0000 7f325adab8c0 1 < canceled multipart upload key=O0RSK2S88XHP upload=0027EV0S6FG9 tag=XO11RE9FJZW8 type=write size=2270647 2024-09-05T00:56:08.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.665+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.0 size=1048576 2024-09-05T00:56:08.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.669+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.1 size=1048576 2024-09-05T00:56:08.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.669+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.2 size=834906 2024-09-05T00:56:08.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.669+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=OPWLFW3V156X tag=FEU87R18MDPE type=write size=3980634 2024-09-05T00:56:08.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.673+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=ZBKEL9X8RKKM type=write size=479839 2024-09-05T00:56:08.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.677+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=A1Z1C2J4C9MN type=del size=843794 2024-09-05T00:56:08.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.677+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=B5GYQR3FKHB9 type=del 2024-09-05T00:56:08.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.681+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~C0LWFUCQPPB6.0 size=1048576 2024-09-05T00:56:08.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.685+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~C0LWFUCQPPB6.1 size=770076 2024-09-05T00:56:08.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.685+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=C0LWFUCQPPB6 tag=UF8XT8FCNXO7 type=write size=2867228 2024-09-05T00:56:08.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.689+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=28Z3PZ67LEWA type=del 2024-09-05T00:56:08.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.689+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=P234FWAEENI6 type=del size=1150036 2024-09-05T00:56:08.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.693+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=DJOQU1V147OT type=del 2024-09-05T00:56:08.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.697+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~WMN6AE17XLFM.0 size=1048576 2024-09-05T00:56:08.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.701+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~WMN6AE17XLFM.1 size=836957 2024-09-05T00:56:08.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.701+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=WMN6AE17XLFM tag=KQ5ZIGRV6VSF type=write size=2934109 2024-09-05T00:56:08.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.705+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=KM57GP7JHC70 type=del 2024-09-05T00:56:08.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.705+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=1CAJ83RSXVU6 type=del size=540361 2024-09-05T00:56:08.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.705+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.0 size=1048576 2024-09-05T00:56:08.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.709+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.1 size=1048576 2024-09-05T00:56:08.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.709+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~T8SNQF9KXM17.2 size=608886 2024-09-05T00:56:08.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.713+0000 7f325adab8c0 1 < canceled multipart upload key=GF6OC9O60D5E upload=T8SNQF9KXM17 tag=ZN0VRLL44983 type=write size=3754614 2024-09-05T00:56:08.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.717+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=0S1I65YI066B type=del size=2205486 2024-09-05T00:56:08.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.717+0000 7f325adab8c0 1 < completed write operation key=VYMRZPO6VKGS tag=LWUP3AK4KYQ3 type=write size=373861 2024-09-05T00:56:08.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.721+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=9159WBZX0PJQ type=del size=112977 2024-09-05T00:56:08.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.725+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=Z0L5I9Q9JMYX type=del 2024-09-05T00:56:08.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.729+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~PDCMC0Z80C1U.0 size=714798 2024-09-05T00:56:08.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.729+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=PDCMC0Z80C1U tag=20FCUJ0EJGIN type=write size=1763374 2024-09-05T00:56:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.733+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.0 size=1048576 2024-09-05T00:56:08.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.733+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.1 size=1048576 2024-09-05T00:56:08.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.737+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~UOTX73M3L90C.2 size=245286 2024-09-05T00:56:08.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.741+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=UOTX73M3L90C tag=KZZPH2PPCLV7 type=write size=3391014 2024-09-05T00:56:08.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.745+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.0 size=1048576 2024-09-05T00:56:08.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.749+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.1 size=1048576 2024-09-05T00:56:08.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.749+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.2 size=525961 2024-09-05T00:56:08.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.749+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=UEFYFW34P2WH tag=39SWVFOP00RG type=write size=3671689 2024-09-05T00:56:08.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.753+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~WZJT2DM9DA6W.0 size=984107 2024-09-05T00:56:08.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.753+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=WZJT2DM9DA6W tag=II7GVEO52E5M type=write size=2032683 2024-09-05T00:56:08.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.757+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=S059LOPS1ZIX type=del size=2235257 2024-09-05T00:56:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.757+0000 7f325adab8c0 1 < completed write operation key=ZYT3WYNFIIZN tag=EF7WI79WYC3M type=write size=982147 2024-09-05T00:56:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.761+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=268KAU6V4R6T type=del size=2758401 2024-09-05T00:56:08.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.765+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=N86J180D4UYD type=write size=111166 2024-09-05T00:56:08.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.765+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=R5LB7OMHIHTH type=del size=2713161 2024-09-05T00:56:08.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.769+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=H2TQPO4X8N3W type=write size=699366 2024-09-05T00:56:08.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.769+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=GMYEX99Y2PZL type=write size=420876 2024-09-05T00:56:08.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.773+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=KM1BVIB4LCAQ type=del size=2575438 2024-09-05T00:56:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.777+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=OHIS9YT2TNN0 type=del size=3790283 2024-09-05T00:56:08.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.777+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=BX9WLKCF9KD7 type=del 2024-09-05T00:56:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.785+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WM2SABZ6RNE9.0 size=1048576 2024-09-05T00:56:08.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.785+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WM2SABZ6RNE9.1 size=548312 2024-09-05T00:56:08.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.785+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=WM2SABZ6RNE9 tag=NUYC4XHZ7EOI type=write size=2645464 2024-09-05T00:56:08.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.789+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.0 size=1048576 2024-09-05T00:56:08.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.789+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.1 size=1048576 2024-09-05T00:56:08.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.793+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~OPWLFW3V156X.2 size=834906 2024-09-05T00:56:08.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.797+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=OPWLFW3V156X tag=FEU87R18MDPE type=write size=3980634 2024-09-05T00:56:08.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.797+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=L84OJ5NPJY66 type=del size=2504996 2024-09-05T00:56:08.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.801+0000 7f325adab8c0 1 < suggested update operation key=J9UIQE3CKYHM tag=A1Z1C2J4C9MN type=del size=843794 2024-09-05T00:56:08.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.801+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=80PRIGZ1WOTJ type=del size=1592321 2024-09-05T00:56:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.805+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~C0LWFUCQPPB6.0 size=1048576 2024-09-05T00:56:08.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.809+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~C0LWFUCQPPB6.1 size=770076 2024-09-05T00:56:08.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.813+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=C0LWFUCQPPB6 tag=UF8XT8FCNXO7 type=write size=2867228 2024-09-05T00:56:08.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.813+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.0 size=1048576 2024-09-05T00:56:08.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.817+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.1 size=1048576 2024-09-05T00:56:08.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.817+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.2 size=688808 2024-09-05T00:56:08.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.817+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=C07ADYUFKFFN tag=7ZYM6N6SVP8S type=write size=3834536 2024-09-05T00:56:08.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.821+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=P234FWAEENI6 type=del 2024-09-05T00:56:08.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.821+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=KXHFZLL53YBP type=del size=2923840 2024-09-05T00:56:08.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.825+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~WMN6AE17XLFM.0 size=1048576 2024-09-05T00:56:08.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.825+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~WMN6AE17XLFM.1 size=836957 2024-09-05T00:56:08.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.829+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=WMN6AE17XLFM tag=KQ5ZIGRV6VSF type=write size=2934109 2024-09-05T00:56:08.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.833+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=F4OOZQIKASET type=del size=3296754 2024-09-05T00:56:08.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.833+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=1CAJ83RSXVU6 type=del 2024-09-05T00:56:08.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.837+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.0 size=1048576 2024-09-05T00:56:08.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.837+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.1 size=1048576 2024-09-05T00:56:08.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.841+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.2 size=863508 2024-09-05T00:56:08.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.841+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=G6O9QB583F8O tag=2JJ00QA68EXL type=write size=4009236 2024-09-05T00:56:08.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.845+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=0S1I65YI066B type=del size=2205486 2024-09-05T00:56:08.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.845+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~2KG4YBYR5PY2.0 size=1048576 2024-09-05T00:56:08.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.849+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~2KG4YBYR5PY2.1 size=183888 2024-09-05T00:56:08.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.849+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=2KG4YBYR5PY2 tag=6IEIBKK40GKT type=write size=2281040 2024-09-05T00:56:08.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.853+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=9159WBZX0PJQ type=del 2024-09-05T00:56:08.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.853+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=3ZR8AN84KS1O type=del size=430745 2024-09-05T00:56:08.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.857+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~PDCMC0Z80C1U.0 size=714798 2024-09-05T00:56:08.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.861+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=PDCMC0Z80C1U tag=20FCUJ0EJGIN type=write size=1763374 2024-09-05T00:56:08.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.865+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~EVI4URZG6O05.0 size=1048576 2024-09-05T00:56:08.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.865+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~EVI4URZG6O05.1 size=645631 2024-09-05T00:56:08.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.865+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=EVI4URZG6O05 tag=FUP09BFU74SV type=write size=2742783 2024-09-05T00:56:08.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.869+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.0 size=1048576 2024-09-05T00:56:08.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.869+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.1 size=1048576 2024-09-05T00:56:08.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.873+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UEFYFW34P2WH.2 size=525961 2024-09-05T00:56:08.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.877+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=UEFYFW34P2WH tag=39SWVFOP00RG type=write size=3671689 2024-09-05T00:56:08.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.881+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~43I3S3J144IG.0 size=814349 2024-09-05T00:56:08.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.881+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=43I3S3J144IG tag=SD72D2VRHAM6 type=write size=1862925 2024-09-05T00:56:08.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.885+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=S059LOPS1ZIX type=del 2024-09-05T00:56:08.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.885+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=V9JYU6B4DHOE type=del size=3741668 2024-09-05T00:56:08.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.889+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=268KAU6V4R6T type=del 2024-09-05T00:56:08.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.893+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~VSK1OGPOQ23E.0 size=1048576 2024-09-05T00:56:08.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.893+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~VSK1OGPOQ23E.1 size=365522 2024-09-05T00:56:08.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.893+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=VSK1OGPOQ23E tag=0Y9PYWLOXHJT type=write size=2462674 2024-09-05T00:56:08.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.897+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=R5LB7OMHIHTH type=del 2024-09-05T00:56:08.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.901+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~GVJB1LMAMJGF.0 size=1048576 2024-09-05T00:56:08.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.905+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~GVJB1LMAMJGF.1 size=581474 2024-09-05T00:56:08.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.905+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=GVJB1LMAMJGF tag=92F69U1Y231H type=write size=2678626 2024-09-05T00:56:08.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.905+0000 7f325adab8c0 1 < completed write operation key=ZYT3WYNFIIZN tag=GMYEX99Y2PZL type=write size=420876 2024-09-05T00:56:08.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.909+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=2BKK7C16R3EJ type=del size=386239 2024-09-05T00:56:08.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.909+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=OHIS9YT2TNN0 type=del 2024-09-05T00:56:08.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.913+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=FO563980UKQJ type=del size=2893490 2024-09-05T00:56:08.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.917+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~WM2SABZ6RNE9.0 size=1048576 2024-09-05T00:56:08.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.917+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~WM2SABZ6RNE9.1 size=548312 2024-09-05T00:56:08.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.921+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=WM2SABZ6RNE9 tag=NUYC4XHZ7EOI type=write size=2645464 2024-09-05T00:56:08.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.925+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=49UWAG0C9IA0 type=del size=1695055 2024-09-05T00:56:08.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.929+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=L84OJ5NPJY66 type=del 2024-09-05T00:56:08.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.929+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=9BK8YXIHFOXP type=del size=1341873 2024-09-05T00:56:08.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.933+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=80PRIGZ1WOTJ type=del 2024-09-05T00:56:08.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.937+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=6CDKINBUV07I type=del size=841013 2024-09-05T00:56:08.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.937+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.0 size=1048576 2024-09-05T00:56:08.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.941+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.1 size=1048576 2024-09-05T00:56:08.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.941+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~C07ADYUFKFFN.2 size=688808 2024-09-05T00:56:08.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.949+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=C07ADYUFKFFN tag=7ZYM6N6SVP8S type=write size=3834536 2024-09-05T00:56:08.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.949+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=ORDKVYQR8FVH type=del size=2105055 2024-09-05T00:56:08.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.953+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=KXHFZLL53YBP type=del 2024-09-05T00:56:08.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.957+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=Y76LK5QMMD0B type=del size=1865266 2024-09-05T00:56:08.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.957+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=F4OOZQIKASET type=del 2024-09-05T00:56:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.965+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~FG9SJ36UI2D8.0 size=1048576 2024-09-05T00:56:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.965+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~FG9SJ36UI2D8.1 size=990450 2024-09-05T00:56:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.965+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=FG9SJ36UI2D8 tag=2OHLZT8ORUDA type=write size=3087602 2024-09-05T00:56:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.969+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.0 size=1048576 2024-09-05T00:56:08.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.969+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.1 size=1048576 2024-09-05T00:56:08.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.969+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~G6O9QB583F8O.2 size=863508 2024-09-05T00:56:08.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.973+0000 7f325adab8c0 1 < canceled multipart upload key=GF6OC9O60D5E upload=G6O9QB583F8O tag=2JJ00QA68EXL type=write size=4009236 2024-09-05T00:56:08.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.981+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MRSEWV02KGME.0 size=280014 2024-09-05T00:56:08.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.981+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=MRSEWV02KGME tag=SIF769LX08BQ type=write size=1328590 2024-09-05T00:56:08.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.981+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~2KG4YBYR5PY2.0 size=1048576 2024-09-05T00:56:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.985+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~2KG4YBYR5PY2.1 size=183888 2024-09-05T00:56:08.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.989+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=2KG4YBYR5PY2 tag=6IEIBKK40GKT type=write size=2281040 2024-09-05T00:56:08.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.993+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~SXNATGMJ0RAE.0 size=173736 2024-09-05T00:56:08.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.993+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=SXNATGMJ0RAE tag=DQAK0XEEB7XW type=write size=1222312 2024-09-05T00:56:09.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:08.997+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=3ZR8AN84KS1O type=del 2024-09-05T00:56:09.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.001+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~BZDITWDCM0UJ.0 size=1048576 2024-09-05T00:56:09.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.001+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~BZDITWDCM0UJ.1 size=735491 2024-09-05T00:56:09.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.001+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=BZDITWDCM0UJ tag=HKVAMMQGE22I type=write size=2832643 2024-09-05T00:56:09.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.005+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~EVI4URZG6O05.0 size=1048576 2024-09-05T00:56:09.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.005+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~EVI4URZG6O05.1 size=645631 2024-09-05T00:56:09.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.009+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=EVI4URZG6O05 tag=FUP09BFU74SV type=write size=2742783 2024-09-05T00:56:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.013+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~PHBB7MM22FNX.0 size=1048576 2024-09-05T00:56:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.017+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~PHBB7MM22FNX.1 size=804627 2024-09-05T00:56:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.017+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=PHBB7MM22FNX tag=L7ONZLDDT2JX type=write size=2901779 2024-09-05T00:56:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.017+0000 7f325adab8c0 1 < canceled part key=_multipart_D6HSFIRN2X4Q.2~43I3S3J144IG.0 size=814349 2024-09-05T00:56:09.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.021+0000 7f325adab8c0 1 < canceled multipart upload key=D6HSFIRN2X4Q upload=43I3S3J144IG tag=SD72D2VRHAM6 type=write size=1862925 2024-09-05T00:56:09.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.021+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=PBW07FA8DFNB type=del size=725458 2024-09-05T00:56:09.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.025+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=V9JYU6B4DHOE type=del 2024-09-05T00:56:09.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.029+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~P0OLWYFRR761.0 size=1048576 2024-09-05T00:56:09.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.033+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~P0OLWYFRR761.1 size=817079 2024-09-05T00:56:09.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.033+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=P0OLWYFRR761 tag=PP34FMQRMLXE type=write size=2914231 2024-09-05T00:56:09.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.037+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~VSK1OGPOQ23E.0 size=1048576 2024-09-05T00:56:09.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.037+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~VSK1OGPOQ23E.1 size=365522 2024-09-05T00:56:09.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.041+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=VSK1OGPOQ23E tag=0Y9PYWLOXHJT type=write size=2462674 2024-09-05T00:56:09.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.045+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=P2R0096HDTZZ type=write size=813316 2024-09-05T00:56:09.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.049+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~GVJB1LMAMJGF.0 size=1048576 2024-09-05T00:56:09.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.049+0000 7f325adab8c0 1 < canceled part key=_multipart_VYMRZPO6VKGS.2~GVJB1LMAMJGF.1 size=581474 2024-09-05T00:56:09.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.053+0000 7f325adab8c0 1 < canceled multipart upload key=VYMRZPO6VKGS upload=GVJB1LMAMJGF tag=92F69U1Y231H type=write size=2678626 2024-09-05T00:56:09.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.053+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=DYH9GLKBIKC9 type=del size=2889219 2024-09-05T00:56:09.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.057+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=2BKK7C16R3EJ type=del 2024-09-05T00:56:09.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.057+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=CW0WAMS3HR5Y type=del size=1623763 2024-09-05T00:56:09.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.061+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=FO563980UKQJ type=del 2024-09-05T00:56:09.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.065+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=4S8KV3QDA22G type=del size=3717311 2024-09-05T00:56:09.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.065+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=49UWAG0C9IA0 type=del 2024-09-05T00:56:09.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.069+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.0 size=1048576 2024-09-05T00:56:09.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.073+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.1 size=1048576 2024-09-05T00:56:09.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.073+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.2 size=539083 2024-09-05T00:56:09.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.073+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=K6QE5EAHN8NI tag=RLT1CAK4GH2F type=write size=3684811 2024-09-05T00:56:09.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.077+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=9BK8YXIHFOXP type=del 2024-09-05T00:56:09.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.081+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VFH76569NOOT.0 size=1048576 2024-09-05T00:56:09.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.081+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VFH76569NOOT.1 size=1048576 2024-09-05T00:56:09.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.085+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VFH76569NOOT.2 size=765437 2024-09-05T00:56:09.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.085+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=VFH76569NOOT tag=DJMFR1HJ4RE4 type=write size=3911165 2024-09-05T00:56:09.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.085+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=6CDKINBUV07I type=del 2024-09-05T00:56:09.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.089+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=QVN5QA24G0KM type=del size=2829570 2024-09-05T00:56:09.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.093+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=ORDKVYQR8FVH type=del 2024-09-05T00:56:09.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.101+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~1UGQOAD5YUK5.0 size=634794 2024-09-05T00:56:09.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.101+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=1UGQOAD5YUK5 tag=7E9W0MOVP980 type=write size=1683370 2024-09-05T00:56:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.105+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=Y76LK5QMMD0B type=del 2024-09-05T00:56:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.105+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=5CUKZ7S1XIO7 type=write size=185417 2024-09-05T00:56:09.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.109+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~FG9SJ36UI2D8.0 size=1048576 2024-09-05T00:56:09.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.109+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~FG9SJ36UI2D8.1 size=990450 2024-09-05T00:56:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.113+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=FG9SJ36UI2D8 tag=2OHLZT8ORUDA type=write size=3087602 2024-09-05T00:56:09.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.117+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=WDLMRWSEJE74 type=del size=1781506 2024-09-05T00:56:09.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.121+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~MRSEWV02KGME.0 size=280014 2024-09-05T00:56:09.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.125+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=MRSEWV02KGME tag=SIF769LX08BQ type=write size=1328590 2024-09-05T00:56:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.125+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=P624DK49DW7T type=del size=2341193 2024-09-05T00:56:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.125+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~SXNATGMJ0RAE.0 size=173736 2024-09-05T00:56:09.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.129+0000 7f325adab8c0 1 < canceled multipart upload key=5WOUI4SHYTSS upload=SXNATGMJ0RAE tag=DQAK0XEEB7XW type=write size=1222312 2024-09-05T00:56:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.133+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=617U6J7PPWAD type=del size=2816886 2024-09-05T00:56:09.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.137+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~BZDITWDCM0UJ.0 size=1048576 2024-09-05T00:56:09.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.137+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~BZDITWDCM0UJ.1 size=735491 2024-09-05T00:56:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.145+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=BZDITWDCM0UJ tag=HKVAMMQGE22I type=write size=2832643 2024-09-05T00:56:09.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.145+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=ZTG1CIYD3ZWI type=del size=2363398 2024-09-05T00:56:09.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.149+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~PHBB7MM22FNX.0 size=1048576 2024-09-05T00:56:09.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.153+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~PHBB7MM22FNX.1 size=804627 2024-09-05T00:56:09.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.157+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=PHBB7MM22FNX tag=L7ONZLDDT2JX type=write size=2901779 2024-09-05T00:56:09.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.165+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.0 size=1048576 2024-09-05T00:56:09.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.165+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.1 size=1048576 2024-09-05T00:56:09.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.169+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.2 size=308567 2024-09-05T00:56:09.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.169+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=LZDHTICWSEN1 tag=Y7HMDV3MHNWL type=write size=3454295 2024-09-05T00:56:09.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.173+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=PBW07FA8DFNB type=del 2024-09-05T00:56:09.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.177+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~S19SZX13G1FH.0 size=53911 2024-09-05T00:56:09.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.177+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=S19SZX13G1FH tag=KPSUYK1S5QWX type=write size=1102487 2024-09-05T00:56:09.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.181+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~P0OLWYFRR761.0 size=1048576 2024-09-05T00:56:09.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.181+0000 7f325adab8c0 1 < canceled part key=_multipart_GU25IIQWQNR2.2~P0OLWYFRR761.1 size=817079 2024-09-05T00:56:09.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.185+0000 7f325adab8c0 1 < canceled multipart upload key=GU25IIQWQNR2 upload=P0OLWYFRR761 tag=PP34FMQRMLXE type=write size=2914231 2024-09-05T00:56:09.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.189+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~0ASDQQ5L78BT.0 size=1048576 2024-09-05T00:56:09.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.189+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~0ASDQQ5L78BT.1 size=304020 2024-09-05T00:56:09.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.189+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=0ASDQQ5L78BT tag=DXUAHDG6489U type=write size=2401172 2024-09-05T00:56:09.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.193+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=P2R0096HDTZZ type=write size=813316 2024-09-05T00:56:09.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.193+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=4S40EM8X6WT5 type=del size=2436404 2024-09-05T00:56:09.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.197+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=DYH9GLKBIKC9 type=del 2024-09-05T00:56:09.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.201+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~UEUNJEDUUCDO.0 size=1048576 2024-09-05T00:56:09.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.205+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~UEUNJEDUUCDO.1 size=448661 2024-09-05T00:56:09.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.205+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=UEUNJEDUUCDO tag=NBJFM7QIDF3C type=write size=2545813 2024-09-05T00:56:09.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.205+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=CW0WAMS3HR5Y type=del 2024-09-05T00:56:09.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.209+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~R2URLWPMA0CQ.0 size=1048576 2024-09-05T00:56:09.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.213+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~R2URLWPMA0CQ.1 size=308856 2024-09-05T00:56:09.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.213+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=R2URLWPMA0CQ tag=I5XU5CTLGAPT type=write size=2406008 2024-09-05T00:56:09.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.217+0000 7f325adab8c0 1 < suggested remove operation key=MAS6EB753KO9 tag=4S8KV3QDA22G type=del 2024-09-05T00:56:09.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.221+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.0 size=1048576 2024-09-05T00:56:09.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.225+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.1 size=1048576 2024-09-05T00:56:09.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.225+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.2 size=154467 2024-09-05T00:56:09.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.225+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=940MBE77CL6Q tag=2AVZG4QWI58N type=write size=3300195 2024-09-05T00:56:09.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.229+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.0 size=1048576 2024-09-05T00:56:09.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.229+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.1 size=1048576 2024-09-05T00:56:09.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.233+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~K6QE5EAHN8NI.2 size=539083 2024-09-05T00:56:09.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.237+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=K6QE5EAHN8NI tag=RLT1CAK4GH2F type=write size=3684811 2024-09-05T00:56:09.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.241+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~XNUPR2BQ69YL.0 size=1048576 2024-09-05T00:56:09.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.245+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~XNUPR2BQ69YL.1 size=875297 2024-09-05T00:56:09.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.245+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=XNUPR2BQ69YL tag=OVNADNEYM9NC type=write size=2972449 2024-09-05T00:56:09.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.245+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VFH76569NOOT.0 size=1048576 2024-09-05T00:56:09.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.249+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VFH76569NOOT.1 size=1048576 2024-09-05T00:56:09.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.249+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VFH76569NOOT.2 size=765437 2024-09-05T00:56:09.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.253+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=VFH76569NOOT tag=DJMFR1HJ4RE4 type=write size=3911165 2024-09-05T00:56:09.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.261+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~6K496VOAFTRA.0 size=854890 2024-09-05T00:56:09.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.261+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=6K496VOAFTRA tag=A7TQAYZZGVWR type=write size=1903466 2024-09-05T00:56:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.265+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=QVN5QA24G0KM type=del 2024-09-05T00:56:09.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.265+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=G3WVQ5YQV3QI type=del size=1901383 2024-09-05T00:56:09.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.269+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~1UGQOAD5YUK5.0 size=634794 2024-09-05T00:56:09.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.273+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=1UGQOAD5YUK5 tag=7E9W0MOVP980 type=write size=1683370 2024-09-05T00:56:09.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.273+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=DSNBCX69QRG9 type=write size=615714 2024-09-05T00:56:09.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.277+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=5CUKZ7S1XIO7 type=write size=185417 2024-09-05T00:56:09.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.281+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=3TH9QEWYYGP2 type=del size=89708 2024-09-05T00:56:09.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.281+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=WDLMRWSEJE74 type=del 2024-09-05T00:56:09.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.285+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.0 size=1048576 2024-09-05T00:56:09.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.289+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.1 size=1048576 2024-09-05T00:56:09.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.293+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.2 size=534710 2024-09-05T00:56:09.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.293+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=FNLFM9I21L2S tag=6JSAABS5Q9JB type=write size=3680438 2024-09-05T00:56:09.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.293+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=P624DK49DW7T type=del size=2341193 2024-09-05T00:56:09.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.297+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.0 size=1048576 2024-09-05T00:56:09.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.301+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.1 size=1048576 2024-09-05T00:56:09.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.305+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.2 size=682641 2024-09-05T00:56:09.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.305+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=YFB7HX3U8V57 tag=Q0ICM1M2ZN3I type=write size=3828369 2024-09-05T00:56:09.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.305+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=617U6J7PPWAD type=del 2024-09-05T00:56:09.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.309+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=UYA3RVRUSKXA type=del size=1489371 2024-09-05T00:56:09.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.313+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=ZTG1CIYD3ZWI type=del 2024-09-05T00:56:09.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.313+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=673GSG2QD6YF type=del size=2600755 2024-09-05T00:56:09.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.317+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.0 size=1048576 2024-09-05T00:56:09.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.317+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.1 size=1048576 2024-09-05T00:56:09.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.321+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~LZDHTICWSEN1.2 size=308567 2024-09-05T00:56:09.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.325+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=LZDHTICWSEN1 tag=Y7HMDV3MHNWL type=write size=3454295 2024-09-05T00:56:09.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.329+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~LCKEPO72UC39.0 size=722628 2024-09-05T00:56:09.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.329+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=LCKEPO72UC39 tag=69LJJ8PZQ0NN type=write size=1771204 2024-09-05T00:56:09.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.329+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~S19SZX13G1FH.0 size=53911 2024-09-05T00:56:09.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.333+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=S19SZX13G1FH tag=KPSUYK1S5QWX type=write size=1102487 2024-09-05T00:56:09.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.337+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=PIZIAIAXHY62 type=del size=3658526 2024-09-05T00:56:09.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.341+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~0ASDQQ5L78BT.0 size=1048576 2024-09-05T00:56:09.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.341+0000 7f325adab8c0 1 < canceled part key=_multipart_YG43HSBBCRKH.2~0ASDQQ5L78BT.1 size=304020 2024-09-05T00:56:09.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.345+0000 7f325adab8c0 1 < canceled multipart upload key=YG43HSBBCRKH upload=0ASDQQ5L78BT tag=DXUAHDG6489U type=write size=2401172 2024-09-05T00:56:09.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.345+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=K0U02YX1LMIT type=del size=3703425 2024-09-05T00:56:09.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.349+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=4S40EM8X6WT5 type=del size=2436404 2024-09-05T00:56:09.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.353+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~E0UQ3KQCNAOZ.0 size=1048576 2024-09-05T00:56:09.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.357+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~E0UQ3KQCNAOZ.1 size=274860 2024-09-05T00:56:09.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.357+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=E0UQ3KQCNAOZ tag=HKP6PT3W86WM type=write size=2372012 2024-09-05T00:56:09.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.357+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~UEUNJEDUUCDO.0 size=1048576 2024-09-05T00:56:09.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.361+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~UEUNJEDUUCDO.1 size=448661 2024-09-05T00:56:09.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.365+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=UEUNJEDUUCDO tag=NBJFM7QIDF3C type=write size=2545813 2024-09-05T00:56:09.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.369+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=SFILI5GATQ1R type=write size=543885 2024-09-05T00:56:09.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.369+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~R2URLWPMA0CQ.0 size=1048576 2024-09-05T00:56:09.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.373+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~R2URLWPMA0CQ.1 size=308856 2024-09-05T00:56:09.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.377+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=R2URLWPMA0CQ tag=I5XU5CTLGAPT type=write size=2406008 2024-09-05T00:56:09.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.377+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=YZLQ81LSDUHV type=del size=1648405 2024-09-05T00:56:09.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.381+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.0 size=1048576 2024-09-05T00:56:09.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.385+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.1 size=1048576 2024-09-05T00:56:09.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.385+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~940MBE77CL6Q.2 size=154467 2024-09-05T00:56:09.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.385+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=940MBE77CL6Q tag=2AVZG4QWI58N type=write size=3300195 2024-09-05T00:56:09.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.389+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=LZ3FO7W0U7LY type=write size=501633 2024-09-05T00:56:09.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.393+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~XNUPR2BQ69YL.0 size=1048576 2024-09-05T00:56:09.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.393+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~XNUPR2BQ69YL.1 size=875297 2024-09-05T00:56:09.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.397+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=XNUPR2BQ69YL tag=OVNADNEYM9NC type=write size=2972449 2024-09-05T00:56:09.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.401+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=U596CG32672V type=del size=728189 2024-09-05T00:56:09.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.401+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~6K496VOAFTRA.0 size=854890 2024-09-05T00:56:09.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.405+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=6K496VOAFTRA tag=A7TQAYZZGVWR type=write size=1903466 2024-09-05T00:56:09.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.409+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=15YUAZ3MRHE8 type=del size=3062210 2024-09-05T00:56:09.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.409+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=G3WVQ5YQV3QI type=del 2024-09-05T00:56:09.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.413+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.0 size=1048576 2024-09-05T00:56:09.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.417+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.1 size=1048576 2024-09-05T00:56:09.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.417+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.2 size=789324 2024-09-05T00:56:09.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.417+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=WUMVKTEEIRII tag=2OTNS8XOXY9N type=write size=3935052 2024-09-05T00:56:09.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.421+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=DSNBCX69QRG9 type=write size=615714 2024-09-05T00:56:09.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.425+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~JXI596ZY5YRS.0 size=166250 2024-09-05T00:56:09.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.425+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=JXI596ZY5YRS tag=6NTA1B1GSIKE type=write size=1214826 2024-09-05T00:56:09.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.429+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=3TH9QEWYYGP2 type=del 2024-09-05T00:56:09.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.433+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=L5SIA9KH64Z6 type=del size=2753435 2024-09-05T00:56:09.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.433+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.0 size=1048576 2024-09-05T00:56:09.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.437+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.1 size=1048576 2024-09-05T00:56:09.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.437+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~FNLFM9I21L2S.2 size=534710 2024-09-05T00:56:09.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.441+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=FNLFM9I21L2S tag=6JSAABS5Q9JB type=write size=3680438 2024-09-05T00:56:09.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.445+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=DHW8PF7XEWWN type=del size=3341955 2024-09-05T00:56:09.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.445+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.0 size=1048576 2024-09-05T00:56:09.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.449+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.1 size=1048576 2024-09-05T00:56:09.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.449+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~YFB7HX3U8V57.2 size=682641 2024-09-05T00:56:09.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.453+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=YFB7HX3U8V57 tag=Q0ICM1M2ZN3I type=write size=3828369 2024-09-05T00:56:09.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.457+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.0 size=1048576 2024-09-05T00:56:09.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.461+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.1 size=1048576 2024-09-05T00:56:09.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.461+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.2 size=767628 2024-09-05T00:56:09.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.461+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=XSI6GXS2H420 tag=B2IC22OJ6JFF type=write size=3913356 2024-09-05T00:56:09.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.465+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=UYA3RVRUSKXA type=del 2024-09-05T00:56:09.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.465+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=7BAZOVADMMQB type=del size=3949959 2024-09-05T00:56:09.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.469+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=673GSG2QD6YF type=del 2024-09-05T00:56:09.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.469+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=23QBBOMNJBCC type=del size=3502637 2024-09-05T00:56:09.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.469+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~LCKEPO72UC39.0 size=722628 2024-09-05T00:56:09.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.473+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=LCKEPO72UC39 tag=69LJJ8PZQ0NN type=write size=1771204 2024-09-05T00:56:09.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.477+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=UVJB49PV987T type=del size=1439187 2024-09-05T00:56:09.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.481+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=PIZIAIAXHY62 type=del 2024-09-05T00:56:09.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.481+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=P5XEA1BVFC4R type=del size=2574187 2024-09-05T00:56:09.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.485+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=K0U02YX1LMIT type=del 2024-09-05T00:56:09.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.489+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=MR040QWL7JXJ type=del size=2245910 2024-09-05T00:56:09.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.489+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~E0UQ3KQCNAOZ.0 size=1048576 2024-09-05T00:56:09.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.489+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~E0UQ3KQCNAOZ.1 size=274860 2024-09-05T00:56:09.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.493+0000 7f325adab8c0 1 < canceled multipart upload key=GF6OC9O60D5E upload=E0UQ3KQCNAOZ tag=HKP6PT3W86WM type=write size=2372012 2024-09-05T00:56:09.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.497+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=HVDHIIXJSL2Y type=del size=1153855 2024-09-05T00:56:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.501+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=SFILI5GATQ1R type=write size=543885 2024-09-05T00:56:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.505+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=S04Q09IESAKF type=del size=3323787 2024-09-05T00:56:09.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.505+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=YZLQ81LSDUHV type=del 2024-09-05T00:56:09.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.509+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=YV8NB4O8Q4CX type=del size=3301617 2024-09-05T00:56:09.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.509+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=LZ3FO7W0U7LY type=write size=501633 2024-09-05T00:56:09.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.517+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~7BZ1KGJ833Z2.0 size=1048576 2024-09-05T00:56:09.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.521+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~7BZ1KGJ833Z2.1 size=77934 2024-09-05T00:56:09.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.521+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=7BZ1KGJ833Z2 tag=Y2XBVZ43BM3N type=write size=2175086 2024-09-05T00:56:09.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.533+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=U596CG32672V type=del 2024-09-05T00:56:09.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.537+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~S94T2CRZBQE3.0 size=450486 2024-09-05T00:56:09.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.537+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=S94T2CRZBQE3 tag=OFWK6507K2T8 type=write size=1499062 2024-09-05T00:56:09.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.541+0000 7f325adab8c0 1 < suggested update operation key=J9UIQE3CKYHM tag=15YUAZ3MRHE8 type=del size=3062210 2024-09-05T00:56:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.545+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=CIS7VL7Z69J4 type=write size=83441 2024-09-05T00:56:09.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.545+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.0 size=1048576 2024-09-05T00:56:09.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.549+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.1 size=1048576 2024-09-05T00:56:09.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.549+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~WUMVKTEEIRII.2 size=789324 2024-09-05T00:56:09.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.553+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=WUMVKTEEIRII tag=2OTNS8XOXY9N type=write size=3935052 2024-09-05T00:56:09.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.557+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=V8HU96WMND26 type=del size=1017285 2024-09-05T00:56:09.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.557+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~JXI596ZY5YRS.0 size=166250 2024-09-05T00:56:09.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.561+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=JXI596ZY5YRS tag=6NTA1B1GSIKE type=write size=1214826 2024-09-05T00:56:09.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.561+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=MLKE16JWZ59Y type=del size=1470693 2024-09-05T00:56:09.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.565+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=L5SIA9KH64Z6 type=del 2024-09-05T00:56:09.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.565+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=S9JK5DQI2MSU type=del size=3249029 2024-09-05T00:56:09.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.569+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=DHW8PF7XEWWN type=del 2024-09-05T00:56:09.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.569+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=0AA59O3D0LN7 type=write size=305711 2024-09-05T00:56:09.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.573+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.0 size=1048576 2024-09-05T00:56:09.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.573+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.1 size=1048576 2024-09-05T00:56:09.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.573+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~XSI6GXS2H420.2 size=767628 2024-09-05T00:56:09.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.573+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=XSI6GXS2H420 tag=B2IC22OJ6JFF type=write size=3913356 2024-09-05T00:56:09.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.577+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=DL5SDIJJZDG0 type=del size=3844379 2024-09-05T00:56:09.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.577+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=7BAZOVADMMQB type=del 2024-09-05T00:56:09.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.581+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=K4DDIU11GNGE type=del size=1619879 2024-09-05T00:56:09.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.581+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=23QBBOMNJBCC type=del 2024-09-05T00:56:09.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.581+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=4X4GSAXWOCNU type=write size=557457 2024-09-05T00:56:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.585+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=UVJB49PV987T type=del 2024-09-05T00:56:09.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.585+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=Z2F4RQ0T4VLP type=write size=289035 2024-09-05T00:56:09.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.585+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=P5XEA1BVFC4R type=del 2024-09-05T00:56:09.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.589+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=37813OM4UQD3 type=del size=407589 2024-09-05T00:56:09.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.589+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=MR040QWL7JXJ type=del size=2245910 2024-09-05T00:56:09.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.593+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=0LQUTQI25QOH type=del size=549124 2024-09-05T00:56:09.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.593+0000 7f325adab8c0 1 < canceled operation key=SP188HM5LG2D tag=HVDHIIXJSL2Y type=del size=1153855 2024-09-05T00:56:09.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.593+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=ZAGYFIJMOOPD type=del size=1909509 2024-09-05T00:56:09.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.597+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=S04Q09IESAKF type=del 2024-09-05T00:56:09.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.597+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~KMSGV1FJU6XP.0 size=57670 2024-09-05T00:56:09.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.597+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=KMSGV1FJU6XP tag=VLCJBC01KGZ3 type=write size=1106246 2024-09-05T00:56:09.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.601+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=YV8NB4O8Q4CX type=del size=3301617 2024-09-05T00:56:09.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.601+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=BV5ZWBR9W8GQ type=del size=590485 2024-09-05T00:56:09.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.605+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~7BZ1KGJ833Z2.0 size=1048576 2024-09-05T00:56:09.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.605+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~7BZ1KGJ833Z2.1 size=77934 2024-09-05T00:56:09.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.609+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=7BZ1KGJ833Z2 tag=Y2XBVZ43BM3N type=write size=2175086 2024-09-05T00:56:09.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.609+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=4N0G91QCDLSW type=write size=607298 2024-09-05T00:56:09.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.613+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~S94T2CRZBQE3.0 size=450486 2024-09-05T00:56:09.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.613+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=S94T2CRZBQE3 tag=OFWK6507K2T8 type=write size=1499062 2024-09-05T00:56:09.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.617+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=0KG88YH4WPV2 type=del size=979673 2024-09-05T00:56:09.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.617+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=CIS7VL7Z69J4 type=write size=83441 2024-09-05T00:56:09.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.621+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.0 size=1048576 2024-09-05T00:56:09.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.621+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.1 size=1048576 2024-09-05T00:56:09.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.621+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.2 size=276743 2024-09-05T00:56:09.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.621+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=NEC3KZ6MCGOI tag=LY96XRSS06AA type=write size=3422471 2024-09-05T00:56:09.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.625+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=V8HU96WMND26 type=del 2024-09-05T00:56:09.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.625+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.0 size=1048576 2024-09-05T00:56:09.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.629+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.1 size=1048576 2024-09-05T00:56:09.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.629+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.2 size=699179 2024-09-05T00:56:09.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.629+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=YT1YYP55UXY8 tag=QWPO62KOT6BL type=write size=3844907 2024-09-05T00:56:09.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.629+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=MLKE16JWZ59Y type=del size=1470693: (22) Invalid argument 2024-09-05T00:56:09.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.633+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~9ER1TNPB2IR1.0 size=639147 2024-09-05T00:56:09.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.633+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=9ER1TNPB2IR1 tag=4224I9ECN131 type=write size=1687723 2024-09-05T00:56:09.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.633+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=S9JK5DQI2MSU type=del size=3249029: (22) Invalid argument 2024-09-05T00:56:09.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.637+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~6AI6F9N08GYZ.0 size=1048576 2024-09-05T00:56:09.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.637+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~6AI6F9N08GYZ.1 size=362631 2024-09-05T00:56:09.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.637+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=6AI6F9N08GYZ tag=N8EVKQ5ABOUY type=write size=2459783 2024-09-05T00:56:09.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.641+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=0AA59O3D0LN7 type=write size=305711: (22) Invalid argument 2024-09-05T00:56:09.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.641+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=4P6M7Y1VBHI6 type=del size=1016484 2024-09-05T00:56:09.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.645+0000 7f325adab8c0 1 < suggested update operation key=ZYT3WYNFIIZN tag=DL5SDIJJZDG0 type=del size=3844379 2024-09-05T00:56:09.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.649+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.0 size=1048576 2024-09-05T00:56:09.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.649+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.1 size=1048576 2024-09-05T00:56:09.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.649+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.2 size=708186 2024-09-05T00:56:09.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.649+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=5ONE6VLE0VX2 tag=DG09322FSTXS type=write size=3853914 2024-09-05T00:56:09.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.653+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=K4DDIU11GNGE type=del 2024-09-05T00:56:09.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.657+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BE524PD4XRFK.0 size=1048576 2024-09-05T00:56:09.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.657+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BE524PD4XRFK.1 size=568266 2024-09-05T00:56:09.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.657+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=BE524PD4XRFK tag=HHVIK85N7ZBR type=write size=2665418 2024-09-05T00:56:09.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.657+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=4X4GSAXWOCNU type=write size=557457 2024-09-05T00:56:09.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.661+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=9J1HLTBSFVK3 type=del size=3083410 2024-09-05T00:56:09.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.661+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=Z2F4RQ0T4VLP type=write size=289035 2024-09-05T00:56:09.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.665+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=MQIBS6AQ9J8Y type=write size=742565 2024-09-05T00:56:09.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.665+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=37813OM4UQD3 type=del 2024-09-05T00:56:09.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.665+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=YS82RR8G5OM5 type=del size=2130678 2024-09-05T00:56:09.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.673+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=0LQUTQI25QOH type=del size=549124 2024-09-05T00:56:09.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.677+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=QAS8FYISH248 type=del size=3876568 2024-09-05T00:56:09.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.677+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=ZAGYFIJMOOPD type=del 2024-09-05T00:56:09.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.677+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=DUK663OIVRP0 type=del size=1885856 2024-09-05T00:56:09.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.681+0000 7f325adab8c0 1 < canceled part key=_multipart_06YHJGLZQLK6.2~KMSGV1FJU6XP.0 size=57670 2024-09-05T00:56:09.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.681+0000 7f325adab8c0 1 < canceled multipart upload key=06YHJGLZQLK6 upload=KMSGV1FJU6XP tag=VLCJBC01KGZ3 type=write size=1106246 2024-09-05T00:56:09.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.685+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=Y2FZ10A5QN2P type=del size=722403 2024-09-05T00:56:09.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.685+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=BV5ZWBR9W8GQ type=del size=590485 2024-09-05T00:56:09.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.689+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~CI9VQHG4OFLH.0 size=451690 2024-09-05T00:56:09.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.689+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=CI9VQHG4OFLH tag=XSH6C3TOHSAE type=write size=1500266 2024-09-05T00:56:09.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.693+0000 7f325adab8c0 1 < completed write operation key=GF6OC9O60D5E tag=4N0G91QCDLSW type=write size=607298 2024-09-05T00:56:09.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.693+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=WSDAG2L58CHT type=del size=2535612 2024-09-05T00:56:09.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.697+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=0KG88YH4WPV2 type=del 2024-09-05T00:56:09.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.701+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~50YU1QI7Q72F.0 size=89476 2024-09-05T00:56:09.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.701+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=50YU1QI7Q72F tag=JZB0ITT14GQD type=write size=1138052 2024-09-05T00:56:09.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.701+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.0 size=1048576 2024-09-05T00:56:09.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.705+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.1 size=1048576 2024-09-05T00:56:09.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.705+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~NEC3KZ6MCGOI.2 size=276743 2024-09-05T00:56:09.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.709+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=NEC3KZ6MCGOI tag=LY96XRSS06AA type=write size=3422471 2024-09-05T00:56:09.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.709+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=RZEQ4WT3V9XY type=del size=14513 2024-09-05T00:56:09.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.713+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.0 size=1048576 2024-09-05T00:56:09.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.713+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.1 size=1048576 2024-09-05T00:56:09.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.713+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~YT1YYP55UXY8.2 size=699179 2024-09-05T00:56:09.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.717+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=YT1YYP55UXY8 tag=QWPO62KOT6BL type=write size=3844907 2024-09-05T00:56:09.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.721+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=NT7DX0MYKQOQ type=del size=2479966 2024-09-05T00:56:09.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.721+0000 7f325adab8c0 1 < canceled part key=_multipart_6N7BLJ1WLDGN.2~9ER1TNPB2IR1.0 size=639147 2024-09-05T00:56:09.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.725+0000 7f325adab8c0 1 < canceled multipart upload key=6N7BLJ1WLDGN upload=9ER1TNPB2IR1 tag=4224I9ECN131 type=write size=1687723 2024-09-05T00:56:09.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.729+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.0 size=1048576 2024-09-05T00:56:09.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.729+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.1 size=1048576 2024-09-05T00:56:09.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.733+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.2 size=242223 2024-09-05T00:56:09.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.733+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=941D2O2DXD5Z tag=IB8CMOFW8UMO type=write size=3387951 2024-09-05T00:56:09.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.733+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~6AI6F9N08GYZ.0 size=1048576 2024-09-05T00:56:09.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.737+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~6AI6F9N08GYZ.1 size=362631 2024-09-05T00:56:09.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.741+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=6AI6F9N08GYZ tag=N8EVKQ5ABOUY type=write size=2459783 2024-09-05T00:56:09.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.741+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=U0IGAL8JVUDC type=del size=651801 2024-09-05T00:56:09.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.745+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=4P6M7Y1VBHI6 type=del 2024-09-05T00:56:09.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.749+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~JGF4ZZ5KVKXV.0 size=671641 2024-09-05T00:56:09.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.749+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=JGF4ZZ5KVKXV tag=GL7MN70VKU25 type=write size=1720217 2024-09-05T00:56:09.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.749+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.0 size=1048576 2024-09-05T00:56:09.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.753+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.1 size=1048576 2024-09-05T00:56:09.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.753+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~5ONE6VLE0VX2.2 size=708186 2024-09-05T00:56:09.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.757+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=5ONE6VLE0VX2 tag=DG09322FSTXS type=write size=3853914 2024-09-05T00:56:09.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.757+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=MS6R3OQRS3M4 type=del size=506376 2024-09-05T00:56:09.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.761+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BE524PD4XRFK.0 size=1048576 2024-09-05T00:56:09.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.761+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BE524PD4XRFK.1 size=568266 2024-09-05T00:56:09.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.765+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=BE524PD4XRFK tag=HHVIK85N7ZBR type=write size=2665418 2024-09-05T00:56:09.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.769+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=0H3DC2ZTCKOE type=del size=2739883 2024-09-05T00:56:09.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.769+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=9J1HLTBSFVK3 type=del 2024-09-05T00:56:09.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.773+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.0 size=1048576 2024-09-05T00:56:09.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.777+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.1 size=1048576 2024-09-05T00:56:09.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.777+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.2 size=1010685 2024-09-05T00:56:09.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.777+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=ULVT6M2OHCSU tag=AOTWA16IYO93 type=write size=4156413 2024-09-05T00:56:09.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.781+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=MQIBS6AQ9J8Y type=write size=742565 2024-09-05T00:56:09.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.785+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.0 size=1048576 2024-09-05T00:56:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.789+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.1 size=1048576 2024-09-05T00:56:09.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.789+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.2 size=613698 2024-09-05T00:56:09.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.789+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=6LMQJGUTKYIL tag=2BDSBJUIHTXT type=write size=3759426 2024-09-05T00:56:09.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.793+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=YS82RR8G5OM5 type=del 2024-09-05T00:56:09.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.797+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~7W73N533DO7P.0 size=363430 2024-09-05T00:56:09.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.797+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=7W73N533DO7P tag=OWVTHHTEW6CC type=write size=1412006 2024-09-05T00:56:09.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.801+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=QAS8FYISH248 type=del 2024-09-05T00:56:09.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.801+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=PQNM8ZHLFL9I type=del size=2607200 2024-09-05T00:56:09.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.805+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=DUK663OIVRP0 type=del 2024-09-05T00:56:09.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.809+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PATISHKW979H.0 size=1048576 2024-09-05T00:56:09.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.813+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PATISHKW979H.1 size=571379 2024-09-05T00:56:09.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.813+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=PATISHKW979H tag=W6ACPZ7XULG1 type=write size=2668531 2024-09-05T00:56:09.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.817+0000 7f325adab8c0 1 < suggested update operation key=YMIGZMLJSI4D tag=Y2FZ10A5QN2P type=del size=722403 2024-09-05T00:56:09.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.817+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=UTXD0ILCHPGT type=del size=3615153 2024-09-05T00:56:09.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.821+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~CI9VQHG4OFLH.0 size=451690 2024-09-05T00:56:09.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.825+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=CI9VQHG4OFLH tag=XSH6C3TOHSAE type=write size=1500266 2024-09-05T00:56:09.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.829+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=EP0JRZFBNOTL type=del size=1306646 2024-09-05T00:56:09.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.829+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=WSDAG2L58CHT type=del 2024-09-05T00:56:09.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.833+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.0 size=1048576 2024-09-05T00:56:09.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.837+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.1 size=1048576 2024-09-05T00:56:09.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.837+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.2 size=725070 2024-09-05T00:56:09.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.837+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=0E6S8ZN2RQ3Z tag=P3HU19RT82W0 type=write size=3870798 2024-09-05T00:56:09.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.841+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~50YU1QI7Q72F.0 size=89476 2024-09-05T00:56:09.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.845+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=50YU1QI7Q72F tag=JZB0ITT14GQD type=write size=1138052 2024-09-05T00:56:09.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.849+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=GA76K0XN6LBQ type=del size=351841 2024-09-05T00:56:09.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.853+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=RZEQ4WT3V9XY type=del size=14513 2024-09-05T00:56:09.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.853+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=HD3WA7KW67G8 type=del size=706443 2024-09-05T00:56:09.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.861+0000 7f325adab8c0 1 < suggested remove operation key=079QFDETDGGC tag=NT7DX0MYKQOQ type=del 2024-09-05T00:56:09.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.861+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=9D10FDOB2JZ0 type=write size=548540 2024-09-05T00:56:09.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.865+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.0 size=1048576 2024-09-05T00:56:09.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.869+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.1 size=1048576 2024-09-05T00:56:09.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.869+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~941D2O2DXD5Z.2 size=242223 2024-09-05T00:56:09.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.873+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=941D2O2DXD5Z tag=IB8CMOFW8UMO type=write size=3387951 2024-09-05T00:56:09.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.877+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~EOMX4TJL16UT.0 size=1048576 2024-09-05T00:56:09.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.881+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~EOMX4TJL16UT.1 size=139265 2024-09-05T00:56:09.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.881+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=EOMX4TJL16UT tag=PFTY49AE0WNQ type=write size=2236417 2024-09-05T00:56:09.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.885+0000 7f325adab8c0 1 < canceled operation key=GF6OC9O60D5E tag=U0IGAL8JVUDC type=del size=651801 2024-09-05T00:56:09.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.885+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=CW773VNMG4AQ type=del size=3146671 2024-09-05T00:56:09.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.889+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~JGF4ZZ5KVKXV.0 size=671641 2024-09-05T00:56:09.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.893+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=JGF4ZZ5KVKXV tag=GL7MN70VKU25 type=write size=1720217 2024-09-05T00:56:09.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.897+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~UMICQZ2FOGXZ.0 size=1048576 2024-09-05T00:56:09.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.897+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~UMICQZ2FOGXZ.1 size=517241 2024-09-05T00:56:09.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.897+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=UMICQZ2FOGXZ tag=J53DHW634V9H type=write size=2614393 2024-09-05T00:56:09.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.901+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=MS6R3OQRS3M4 type=del 2024-09-05T00:56:09.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.905+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.0 size=1048576 2024-09-05T00:56:09.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.909+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.1 size=1048576 2024-09-05T00:56:09.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.909+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.2 size=583360 2024-09-05T00:56:09.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.909+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=6ZFPWF4XBFTZ tag=BHUYW0MFFTDP type=write size=3729088 2024-09-05T00:56:09.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.913+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=0H3DC2ZTCKOE type=del 2024-09-05T00:56:09.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.917+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~EMNW5F4JQFZN.0 size=1048576 2024-09-05T00:56:09.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.917+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~EMNW5F4JQFZN.1 size=950805 2024-09-05T00:56:09.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.917+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=EMNW5F4JQFZN tag=GRK0IKNP4G9B type=write size=3047957 2024-09-05T00:56:09.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.921+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.0 size=1048576 2024-09-05T00:56:09.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.925+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.1 size=1048576 2024-09-05T00:56:09.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.925+0000 7f325adab8c0 1 < canceled part key=_multipart_YMIGZMLJSI4D.2~ULVT6M2OHCSU.2 size=1010685 2024-09-05T00:56:09.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.929+0000 7f325adab8c0 1 < canceled multipart upload key=YMIGZMLJSI4D upload=ULVT6M2OHCSU tag=AOTWA16IYO93 type=write size=4156413 2024-09-05T00:56:09.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.929+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=AQ850GMJIWME type=del size=1275402 2024-09-05T00:56:09.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.933+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.0 size=1048576 2024-09-05T00:56:09.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.933+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.1 size=1048576 2024-09-05T00:56:09.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.933+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~6LMQJGUTKYIL.2 size=613698 2024-09-05T00:56:09.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.937+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=6LMQJGUTKYIL tag=2BDSBJUIHTXT type=write size=3759426 2024-09-05T00:56:09.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.941+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=TK0LWQTWNVRF type=del size=4055919 2024-09-05T00:56:09.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.941+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~7W73N533DO7P.0 size=363430 2024-09-05T00:56:09.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.945+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=7W73N533DO7P tag=OWVTHHTEW6CC type=write size=1412006 2024-09-05T00:56:09.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.949+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~52Q3M4S9A677.0 size=1048576 2024-09-05T00:56:09.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.949+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~52Q3M4S9A677.1 size=791847 2024-09-05T00:56:09.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.949+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=52Q3M4S9A677 tag=9EIH541067M0 type=write size=2888999 2024-09-05T00:56:09.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.953+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=PQNM8ZHLFL9I type=del 2024-09-05T00:56:09.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.953+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=9TUE7BTF3N1T type=del size=2358430 2024-09-05T00:56:09.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.953+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~PATISHKW979H.0 size=1048576 2024-09-05T00:56:09.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.953+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~PATISHKW979H.1 size=571379 2024-09-05T00:56:09.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.957+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=PATISHKW979H tag=W6ACPZ7XULG1 type=write size=2668531 2024-09-05T00:56:09.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.961+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.0 size=1048576 2024-09-05T00:56:09.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.965+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.1 size=1048576 2024-09-05T00:56:09.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.965+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.2 size=915624 2024-09-05T00:56:09.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.965+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=G0LFNYUF2FDC tag=GK22ULSLHA3L type=write size=4061352 2024-09-05T00:56:09.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.969+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=UTXD0ILCHPGT type=del 2024-09-05T00:56:09.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.969+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~Q4YSN07BM3QR.0 size=614127 2024-09-05T00:56:09.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.969+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=Q4YSN07BM3QR tag=MY3SHC78D07B type=write size=1662703 2024-09-05T00:56:09.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.973+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=EP0JRZFBNOTL type=del 2024-09-05T00:56:09.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.977+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~3VYP12XOKRN8.0 size=662855 2024-09-05T00:56:09.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.977+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=3VYP12XOKRN8 tag=GI3KDY60PM7Z type=write size=1711431 2024-09-05T00:56:09.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.977+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.0 size=1048576 2024-09-05T00:56:09.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.981+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.1 size=1048576 2024-09-05T00:56:09.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.981+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0E6S8ZN2RQ3Z.2 size=725070 2024-09-05T00:56:09.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.985+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=0E6S8ZN2RQ3Z tag=P3HU19RT82W0 type=write size=3870798 2024-09-05T00:56:09.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.989+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~OB38LJS9BD8D.0 size=1048576 2024-09-05T00:56:09.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.989+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~OB38LJS9BD8D.1 size=389723 2024-09-05T00:56:09.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.989+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=OB38LJS9BD8D tag=NB5UOQQROKF9 type=write size=2486875 2024-09-05T00:56:09.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.993+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=GA76K0XN6LBQ type=del 2024-09-05T00:56:09.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.993+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=8MFLH5D583O7 type=del size=1829482 2024-09-05T00:56:09.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:09.997+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=HD3WA7KW67G8 type=del 2024-09-05T00:56:10.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.001+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~YY7VL087SOOX.0 size=1048576 2024-09-05T00:56:10.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.005+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~YY7VL087SOOX.1 size=912140 2024-09-05T00:56:10.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.005+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=YY7VL087SOOX tag=IU6A337VGMRC type=write size=3009292 2024-09-05T00:56:10.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.005+0000 7f325adab8c0 1 < completed write operation key=JKRZR0KRE93F tag=9D10FDOB2JZ0 type=write size=548540 2024-09-05T00:56:10.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.005+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=J0K1G01AN06P type=del size=3940430 2024-09-05T00:56:10.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.009+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~EOMX4TJL16UT.0 size=1048576 2024-09-05T00:56:10.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.009+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~EOMX4TJL16UT.1 size=139265 2024-09-05T00:56:10.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.013+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=EOMX4TJL16UT tag=PFTY49AE0WNQ type=write size=2236417 2024-09-05T00:56:10.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.013+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=V1E7GFIDRPH4 type=del size=3005608 2024-09-05T00:56:10.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.017+0000 7f325adab8c0 1 < suggested remove operation key=NIAW4BKW21LG tag=CW773VNMG4AQ type=del 2024-09-05T00:56:10.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.021+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=AY3QCB652TOR type=del size=392098 2024-09-05T00:56:10.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.021+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~UMICQZ2FOGXZ.0 size=1048576 2024-09-05T00:56:10.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.021+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~UMICQZ2FOGXZ.1 size=517241 2024-09-05T00:56:10.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.025+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=UMICQZ2FOGXZ tag=J53DHW634V9H type=write size=2614393 2024-09-05T00:56:10.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.029+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~GL9TH5XKENH1.0 size=650898 2024-09-05T00:56:10.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.029+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=GL9TH5XKENH1 tag=RWWLTRCJNYKL type=write size=1699474 2024-09-05T00:56:10.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.029+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.0 size=1048576 2024-09-05T00:56:10.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.033+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.1 size=1048576 2024-09-05T00:56:10.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.033+0000 7f325adab8c0 1 < canceled part key=_multipart_MYR9H12B5YYV.2~6ZFPWF4XBFTZ.2 size=583360 2024-09-05T00:56:10.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.037+0000 7f325adab8c0 1 < canceled multipart upload key=MYR9H12B5YYV upload=6ZFPWF4XBFTZ tag=BHUYW0MFFTDP type=write size=3729088 2024-09-05T00:56:10.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.037+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=WHSEB5WTZ82Q type=del size=1129823 2024-09-05T00:56:10.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.041+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~EMNW5F4JQFZN.0 size=1048576 2024-09-05T00:56:10.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.041+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~EMNW5F4JQFZN.1 size=950805 2024-09-05T00:56:10.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.045+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=EMNW5F4JQFZN tag=GRK0IKNP4G9B type=write size=3047957 2024-09-05T00:56:10.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.045+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=FLMX4EZ2YY2C type=del size=2449238 2024-09-05T00:56:10.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.049+0000 7f325adab8c0 1 < suggested update operation key=GQB4HOYII01G tag=AQ850GMJIWME type=del size=1275402 2024-09-05T00:56:10.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.049+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=4C0XB8UP4K7D type=del size=2711720 2024-09-05T00:56:10.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.053+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=TK0LWQTWNVRF type=del 2024-09-05T00:56:10.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.057+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.0 size=1048576 2024-09-05T00:56:10.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.057+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.1 size=1048576 2024-09-05T00:56:10.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.057+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.2 size=800925 2024-09-05T00:56:10.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.057+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=OOJ0JQ5K53Q3 tag=BR39ZYG2KG8W type=write size=3946653 2024-09-05T00:56:10.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.061+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~52Q3M4S9A677.0 size=1048576 2024-09-05T00:56:10.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.061+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~52Q3M4S9A677.1 size=791847 2024-09-05T00:56:10.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.065+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=52Q3M4S9A677 tag=9EIH541067M0 type=write size=2888999 2024-09-05T00:56:10.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.069+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=DORBZ2NT43YH type=del size=1518921 2024-09-05T00:56:10.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.069+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=9TUE7BTF3N1T type=del 2024-09-05T00:56:10.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.073+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=LRNPZ538SG1V type=write size=611815 2024-09-05T00:56:10.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.073+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.0 size=1048576 2024-09-05T00:56:10.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.073+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.1 size=1048576 2024-09-05T00:56:10.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.077+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~G0LFNYUF2FDC.2 size=915624 2024-09-05T00:56:10.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.081+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=G0LFNYUF2FDC tag=GK22ULSLHA3L type=write size=4061352 2024-09-05T00:56:10.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.081+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=YJCZJWIPUTB7 type=del size=1727895 2024-09-05T00:56:10.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.081+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~Q4YSN07BM3QR.0 size=614127 2024-09-05T00:56:10.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.085+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=Q4YSN07BM3QR tag=MY3SHC78D07B type=write size=1662703 2024-09-05T00:56:10.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.089+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=MWFL6FEB2OXW type=del size=300060 2024-09-05T00:56:10.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.089+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~3VYP12XOKRN8.0 size=662855 2024-09-05T00:56:10.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.093+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=3VYP12XOKRN8 tag=GI3KDY60PM7Z type=write size=1711431 2024-09-05T00:56:10.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.093+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=Q79OWATGMNB9 type=del size=284205 2024-09-05T00:56:10.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.097+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~OB38LJS9BD8D.0 size=1048576 2024-09-05T00:56:10.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.097+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~OB38LJS9BD8D.1 size=389723 2024-09-05T00:56:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.101+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=OB38LJS9BD8D tag=NB5UOQQROKF9 type=write size=2486875 2024-09-05T00:56:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.101+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=4H5DX7538XBF type=del size=3424780 2024-09-05T00:56:10.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.105+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=8MFLH5D583O7 type=del 2024-09-05T00:56:10.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.105+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=BT59G5DQ7X98 type=del size=1555046 2024-09-05T00:56:10.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.109+0000 7f325adab8c0 1 < canceled part key=_multipart_SP188HM5LG2D.2~YY7VL087SOOX.0 size=1048576 2024-09-05T00:56:10.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.109+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~YY7VL087SOOX.1 size=912140 2024-09-05T00:56:10.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.113+0000 7f325adab8c0 1 < canceled multipart upload key=SP188HM5LG2D upload=YY7VL087SOOX tag=IU6A337VGMRC type=write size=3009292 2024-09-05T00:56:10.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.113+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=LZHBFB91C71Y type=del size=363528 2024-09-05T00:56:10.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.117+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=J0K1G01AN06P type=del 2024-09-05T00:56:10.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.117+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=NJNS1E3NJOMR type=del size=4189529 2024-09-05T00:56:10.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.121+0000 7f325adab8c0 1 < canceled operation key=ZVKLK751KO5T tag=V1E7GFIDRPH4 type=del size=3005608 2024-09-05T00:56:10.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.121+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=ENH1XP10KCJU type=write size=599826 2024-09-05T00:56:10.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.125+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=AY3QCB652TOR type=del 2024-09-05T00:56:10.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.129+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.0 size=1048576 2024-09-05T00:56:10.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.129+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.1 size=1048576 2024-09-05T00:56:10.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.133+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.2 size=385593 2024-09-05T00:56:10.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.133+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=BIQVR6HFQPCJ tag=LE1CTMFFIPMD type=write size=3531321 2024-09-05T00:56:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.133+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~GL9TH5XKENH1.0 size=650898 2024-09-05T00:56:10.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.137+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=GL9TH5XKENH1 tag=RWWLTRCJNYKL type=write size=1699474 2024-09-05T00:56:10.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.141+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~NWXB50XBV05L.0 size=1048576 2024-09-05T00:56:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.141+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~NWXB50XBV05L.1 size=359503 2024-09-05T00:56:10.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.141+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=NWXB50XBV05L tag=M71MVBN7ZZN1 type=write size=2456655 2024-09-05T00:56:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.145+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=WHSEB5WTZ82Q type=del 2024-09-05T00:56:10.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.149+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~C8339LXK25FN.0 size=1048576 2024-09-05T00:56:10.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.149+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~C8339LXK25FN.1 size=934049 2024-09-05T00:56:10.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.149+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=C8339LXK25FN tag=1AIJRX756D21 type=write size=3031201 2024-09-05T00:56:10.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.153+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=FLMX4EZ2YY2C type=del 2024-09-05T00:56:10.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.153+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=XJ2NNKBVON9O type=del size=603399 2024-09-05T00:56:10.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.157+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=4C0XB8UP4K7D type=del size=2711720 2024-09-05T00:56:10.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.161+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~F8B9FQYSPV12.0 size=1048576 2024-09-05T00:56:10.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.165+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~F8B9FQYSPV12.1 size=412417 2024-09-05T00:56:10.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.165+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=F8B9FQYSPV12 tag=4Q88N59A2K31 type=write size=2509569 2024-09-05T00:56:10.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.165+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.0 size=1048576 2024-09-05T00:56:10.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.169+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.1 size=1048576 2024-09-05T00:56:10.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.169+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OOJ0JQ5K53Q3.2 size=800925 2024-09-05T00:56:10.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.173+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=OOJ0JQ5K53Q3 tag=BR39ZYG2KG8W type=write size=3946653 2024-09-05T00:56:10.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.177+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.0 size=1048576 2024-09-05T00:56:10.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.177+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.1 size=1048576 2024-09-05T00:56:10.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.181+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.2 size=161020 2024-09-05T00:56:10.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.181+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=6LVJ403BMC9X tag=60NU535TMWMG type=write size=3306748 2024-09-05T00:56:10.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.181+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=DORBZ2NT43YH type=del 2024-09-05T00:56:10.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.185+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=3069N9RMZ65X type=write size=589168 2024-09-05T00:56:10.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.189+0000 7f325adab8c0 1 < suggested remove operation key=A9WMRV5QZ2FP tag=LRNPZ538SG1V type=write 2024-09-05T00:56:10.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.189+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=GKM23SYHZJRZ type=del size=2004884 2024-09-05T00:56:10.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.193+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=YJCZJWIPUTB7 type=del size=1727895: (22) Invalid argument 2024-09-05T00:56:10.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.197+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~0M1TCO68NJZ4.0 size=73751 2024-09-05T00:56:10.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.197+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=0M1TCO68NJZ4 tag=S07YB3KJ7JM4 type=write size=1122327 2024-09-05T00:56:10.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.197+0000 7f325adab8c0 -1 < failed to complete operation key=A9WMRV5QZ2FP tag=MWFL6FEB2OXW type=del size=300060: (22) Invalid argument 2024-09-05T00:56:10.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.201+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=0PAHM7N6LJJK type=del size=1790767 2024-09-05T00:56:10.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.201+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=Q79OWATGMNB9 type=del 2024-09-05T00:56:10.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.205+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=5BNH2UWO34SA type=del size=4098100 2024-09-05T00:56:10.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.205+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=4H5DX7538XBF type=del 2024-09-05T00:56:10.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.209+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=CU2BVS22JJR4 type=del size=356272 2024-09-05T00:56:10.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.209+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=BT59G5DQ7X98 type=del 2024-09-05T00:56:10.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.213+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=F6R03FQN707Q type=del size=3314650 2024-09-05T00:56:10.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.217+0000 7f325adab8c0 1 < suggested update operation key=NIAW4BKW21LG tag=LZHBFB91C71Y type=del size=363528 2024-09-05T00:56:10.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.221+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=4QPXXO45YI5Y type=write size=171040 2024-09-05T00:56:10.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.221+0000 7f325adab8c0 1 < canceled operation key=UW0SSQ8VFY1G tag=NJNS1E3NJOMR type=del size=4189529 2024-09-05T00:56:10.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.225+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.0 size=1048576 2024-09-05T00:56:10.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.225+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.1 size=1048576 2024-09-05T00:56:10.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.229+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.2 size=80448 2024-09-05T00:56:10.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.229+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=IFHUEO1AJYU3 tag=0XWGVL79U7OE type=write size=3226176 2024-09-05T00:56:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.229+0000 7f325adab8c0 1 < completed write operation key=6N7BLJ1WLDGN tag=ENH1XP10KCJU type=write size=599826 2024-09-05T00:56:10.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.233+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~B9VQ476FHN19.0 size=992458 2024-09-05T00:56:10.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.233+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=B9VQ476FHN19 tag=N971AKGVVLI5 type=write size=2041034 2024-09-05T00:56:10.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.237+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.0 size=1048576 2024-09-05T00:56:10.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.237+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.1 size=1048576 2024-09-05T00:56:10.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.241+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~BIQVR6HFQPCJ.2 size=385593 2024-09-05T00:56:10.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.245+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=BIQVR6HFQPCJ tag=LE1CTMFFIPMD type=write size=3531321 2024-09-05T00:56:10.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.245+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=2QIIH92KOPZJ type=del size=2412718 2024-09-05T00:56:10.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.249+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~NWXB50XBV05L.0 size=1048576 2024-09-05T00:56:10.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.249+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~NWXB50XBV05L.1 size=359503 2024-09-05T00:56:10.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.253+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=NWXB50XBV05L tag=M71MVBN7ZZN1 type=write size=2456655 2024-09-05T00:56:10.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.257+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=F8ZB1IKIGP2T type=write size=480550 2024-09-05T00:56:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.257+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~C8339LXK25FN.0 size=1048576 2024-09-05T00:56:10.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.261+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~C8339LXK25FN.1 size=934049 2024-09-05T00:56:10.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.265+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=C8339LXK25FN tag=1AIJRX756D21 type=write size=3031201 2024-09-05T00:56:10.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.269+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.0 size=1048576 2024-09-05T00:56:10.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.269+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.1 size=1048576 2024-09-05T00:56:10.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.273+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.2 size=536425 2024-09-05T00:56:10.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.273+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=4D3TLDXJFH6B tag=0XMCQHWER8OE type=write size=3682153 2024-09-05T00:56:10.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.273+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=XJ2NNKBVON9O type=del 2024-09-05T00:56:10.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.277+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=6QCQ0UB7ZBH3 type=del size=2964939 2024-09-05T00:56:10.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.277+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~F8B9FQYSPV12.0 size=1048576 2024-09-05T00:56:10.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.281+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~F8B9FQYSPV12.1 size=412417 2024-09-05T00:56:10.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.285+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=F8B9FQYSPV12 tag=4Q88N59A2K31 type=write size=2509569 2024-09-05T00:56:10.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.289+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~YUXGPDEM9J8Y.0 size=1048576 2024-09-05T00:56:10.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.289+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~YUXGPDEM9J8Y.1 size=156523 2024-09-05T00:56:10.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.289+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=YUXGPDEM9J8Y tag=XE991V5012ND type=write size=2253675 2024-09-05T00:56:10.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.289+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.0 size=1048576 2024-09-05T00:56:10.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.293+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.1 size=1048576 2024-09-05T00:56:10.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.297+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~6LVJ403BMC9X.2 size=161020 2024-09-05T00:56:10.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.301+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=6LVJ403BMC9X tag=60NU535TMWMG type=write size=3306748 2024-09-05T00:56:10.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.301+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=9XZPHR8HW0XA type=del size=249544 2024-09-05T00:56:10.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.305+0000 7f325adab8c0 1 < completed write operation key=YMIGZMLJSI4D tag=3069N9RMZ65X type=write size=589168 2024-09-05T00:56:10.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.309+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=78XI2O902A7W type=del size=598674 2024-09-05T00:56:10.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.313+0000 7f325adab8c0 1 < suggested remove operation key=A9WMRV5QZ2FP tag=GKM23SYHZJRZ type=del 2024-09-05T00:56:10.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.317+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=KI8F2YS6JAHO type=del size=1378231 2024-09-05T00:56:10.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.317+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~0M1TCO68NJZ4.0 size=73751 2024-09-05T00:56:10.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.321+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=0M1TCO68NJZ4 tag=S07YB3KJ7JM4 type=write size=1122327 2024-09-05T00:56:10.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.325+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=321DFN43Q0AM type=del size=2663195 2024-09-05T00:56:10.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.325+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=0PAHM7N6LJJK type=del 2024-09-05T00:56:10.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.329+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=9HF3MRG7RVAM type=del size=2578163 2024-09-05T00:56:10.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.333+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=5BNH2UWO34SA type=del 2024-09-05T00:56:10.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.333+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=JJOT3WQVQZ9T type=del size=980055 2024-09-05T00:56:10.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.337+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=CU2BVS22JJR4 type=del 2024-09-05T00:56:10.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.337+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=VN39SLQ2JH4L type=del size=1726850 2024-09-05T00:56:10.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.345+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=F6R03FQN707Q type=del size=3314650 2024-09-05T00:56:10.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.345+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=U1QZJZL7AAZC type=del size=2234353 2024-09-05T00:56:10.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.349+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=4QPXXO45YI5Y type=write size=171040 2024-09-05T00:56:10.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.353+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.0 size=1048576 2024-09-05T00:56:10.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.357+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.1 size=1048576 2024-09-05T00:56:10.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.357+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.2 size=1002000 2024-09-05T00:56:10.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.357+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=ARKLQ8PZ2H0L tag=PDFBSG1PMKF5 type=write size=4147728 2024-09-05T00:56:10.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.361+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.0 size=1048576 2024-09-05T00:56:10.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.361+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.1 size=1048576 2024-09-05T00:56:10.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.365+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~IFHUEO1AJYU3.2 size=80448 2024-09-05T00:56:10.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.369+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=IFHUEO1AJYU3 tag=0XWGVL79U7OE type=write size=3226176 2024-09-05T00:56:10.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.373+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=REEOMY6PX9OC type=del size=2752521 2024-09-05T00:56:10.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.373+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~B9VQ476FHN19.0 size=992458 2024-09-05T00:56:10.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.377+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=B9VQ476FHN19 tag=N971AKGVVLI5 type=write size=2041034 2024-09-05T00:56:10.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.381+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~GLF8Y2UA8TCY.0 size=368130 2024-09-05T00:56:10.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.381+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=GLF8Y2UA8TCY tag=BODW27V8VVBU type=write size=1416706 2024-09-05T00:56:10.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.385+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=2QIIH92KOPZJ type=del 2024-09-05T00:56:10.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.385+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=3N6PPHZX15GT type=del size=835407 2024-09-05T00:56:10.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.389+0000 7f325adab8c0 1 < canceled operation key=MYR9H12B5YYV tag=F8ZB1IKIGP2T type=write size=480550 2024-09-05T00:56:10.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.393+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.0 size=1048576 2024-09-05T00:56:10.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.397+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.1 size=1048576 2024-09-05T00:56:10.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.397+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.2 size=771556 2024-09-05T00:56:10.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.397+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=ZJ5KL3ZO1OKL tag=80E1DY0FKSS6 type=write size=3917284 2024-09-05T00:56:10.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.401+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.0 size=1048576 2024-09-05T00:56:10.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.401+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.1 size=1048576 2024-09-05T00:56:10.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.405+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~4D3TLDXJFH6B.2 size=536425 2024-09-05T00:56:10.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.409+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=4D3TLDXJFH6B tag=0XMCQHWER8OE type=write size=3682153 2024-09-05T00:56:10.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.409+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=WVBLY6BFOPFG type=del size=1571492 2024-09-05T00:56:10.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.413+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=6QCQ0UB7ZBH3 type=del 2024-09-05T00:56:10.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.417+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=Y56CX1ABNQ45 type=del size=1021297 2024-09-05T00:56:10.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.417+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~YUXGPDEM9J8Y.0 size=1048576 2024-09-05T00:56:10.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.417+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~YUXGPDEM9J8Y.1 size=156523 2024-09-05T00:56:10.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.421+0000 7f325adab8c0 1 < canceled multipart upload key=O0RSK2S88XHP upload=YUXGPDEM9J8Y tag=XE991V5012ND type=write size=2253675 2024-09-05T00:56:10.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.425+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=I0L6SP23H13N type=del size=3655199 2024-09-05T00:56:10.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.429+0000 7f325adab8c0 1 < suggested update operation key=06YHJGLZQLK6 tag=9XZPHR8HW0XA type=del size=249544 2024-09-05T00:56:10.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.433+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~NV9KUN995EXL.0 size=251179 2024-09-05T00:56:10.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.433+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=NV9KUN995EXL tag=FHOTQA02YI0M type=write size=1299755 2024-09-05T00:56:10.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.437+0000 7f325adab8c0 1 < canceled operation key=GQB4HOYII01G tag=78XI2O902A7W type=del size=598674 2024-09-05T00:56:10.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.441+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~VXDPPEYQF231.0 size=1048576 2024-09-05T00:56:10.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.441+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~VXDPPEYQF231.1 size=50234 2024-09-05T00:56:10.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.441+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=VXDPPEYQF231 tag=4734KWUE0H4T type=write size=2147386 2024-09-05T00:56:10.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.445+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=KI8F2YS6JAHO type=del 2024-09-05T00:56:10.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.449+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~L6U62MHQBNG3.0 size=1048576 2024-09-05T00:56:10.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.453+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~L6U62MHQBNG3.1 size=324621 2024-09-05T00:56:10.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.453+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=L6U62MHQBNG3 tag=R6UJ8MKYLGPF type=write size=2421773 2024-09-05T00:56:10.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.453+0000 7f325adab8c0 -1 < failed to complete operation key=06YHJGLZQLK6 tag=321DFN43Q0AM type=del size=2663195: (22) Invalid argument 2024-09-05T00:56:10.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.457+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=E1WLPOM2MMR9 type=write size=475218 2024-09-05T00:56:10.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.457+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=9HF3MRG7RVAM type=del 2024-09-05T00:56:10.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.461+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=J4A8RKZF3YRF type=del size=3574926 2024-09-05T00:56:10.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.465+0000 7f325adab8c0 1 < suggested update operation key=06YHJGLZQLK6 tag=JJOT3WQVQZ9T type=del size=980055 2024-09-05T00:56:10.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.469+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=7O1OAOWUD4VO type=del size=1949167 2024-09-05T00:56:10.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.473+0000 7f325adab8c0 1 < suggested remove operation key=YG43HSBBCRKH tag=VN39SLQ2JH4L type=del 2024-09-05T00:56:10.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.473+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=XOVTRK99SM7Y type=del size=758397 2024-09-05T00:56:10.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.477+0000 7f325adab8c0 1 < canceled operation key=MYR9H12B5YYV tag=U1QZJZL7AAZC type=del size=2234353 2024-09-05T00:56:10.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.477+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=603IDFW1T7O4 type=write size=849382 2024-09-05T00:56:10.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.481+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.0 size=1048576 2024-09-05T00:56:10.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.485+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.1 size=1048576 2024-09-05T00:56:10.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.489+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~ARKLQ8PZ2H0L.2 size=1002000 2024-09-05T00:56:10.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.493+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=ARKLQ8PZ2H0L tag=PDFBSG1PMKF5 type=write size=4147728 2024-09-05T00:56:10.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.497+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~D21KTLHK5448.0 size=1048576 2024-09-05T00:56:10.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.501+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~D21KTLHK5448.1 size=144294 2024-09-05T00:56:10.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.501+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=D21KTLHK5448 tag=OBM824BCB5ZP type=write size=2241446 2024-09-05T00:56:10.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.505+0000 7f325adab8c0 1 < suggested update operation key=MBJLOE5XFPYN tag=REEOMY6PX9OC type=del size=2752521 2024-09-05T00:56:10.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.509+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~P13L8JVHI82T.0 size=1048576 2024-09-05T00:56:10.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.509+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~P13L8JVHI82T.1 size=463059 2024-09-05T00:56:10.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.509+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=P13L8JVHI82T tag=5A8BTJCE0PDC type=write size=2560211 2024-09-05T00:56:10.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.513+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~GLF8Y2UA8TCY.0 size=368130 2024-09-05T00:56:10.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.517+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=GLF8Y2UA8TCY tag=BODW27V8VVBU type=write size=1416706 2024-09-05T00:56:10.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.521+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=OBY592WWXOML type=del size=4016306 2024-09-05T00:56:10.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.521+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=3N6PPHZX15GT type=del 2024-09-05T00:56:10.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.525+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=W387I616V9TU type=write size=480803 2024-09-05T00:56:10.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.529+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.0 size=1048576 2024-09-05T00:56:10.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.529+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.1 size=1048576 2024-09-05T00:56:10.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.533+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~ZJ5KL3ZO1OKL.2 size=771556 2024-09-05T00:56:10.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.537+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=ZJ5KL3ZO1OKL tag=80E1DY0FKSS6 type=write size=3917284 2024-09-05T00:56:10.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.541+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MNU5RP1JEXNI.0 size=1048576 2024-09-05T00:56:10.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.541+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MNU5RP1JEXNI.1 size=260756 2024-09-05T00:56:10.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.541+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=MNU5RP1JEXNI tag=TWLBQKPBPRDL type=write size=2357908 2024-09-05T00:56:10.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.545+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=WVBLY6BFOPFG type=del 2024-09-05T00:56:10.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.549+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~2QQQFKRVMWZA.0 size=1048576 2024-09-05T00:56:10.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.549+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~2QQQFKRVMWZA.1 size=422570 2024-09-05T00:56:10.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.549+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=2QQQFKRVMWZA tag=45AA1M5OV54V type=write size=2519722 2024-09-05T00:56:10.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.553+0000 7f325adab8c0 -1 < failed to complete operation key=MBJLOE5XFPYN tag=Y56CX1ABNQ45 type=del size=1021297: (22) Invalid argument 2024-09-05T00:56:10.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.557+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~XJLQEP4WQCO5.0 size=740892 2024-09-05T00:56:10.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.557+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=XJLQEP4WQCO5 tag=01XYIXKE7IVS type=write size=1789468 2024-09-05T00:56:10.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.557+0000 7f325adab8c0 -1 < failed to complete operation key=06YHJGLZQLK6 tag=I0L6SP23H13N type=del size=3655199: (22) Invalid argument 2024-09-05T00:56:10.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.565+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~ZRL1VCNPPJLY.0 size=1048576 2024-09-05T00:56:10.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.565+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~ZRL1VCNPPJLY.1 size=946868 2024-09-05T00:56:10.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.565+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=ZRL1VCNPPJLY tag=HFK96QAO0BMS type=write size=3044020 2024-09-05T00:56:10.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.569+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~NV9KUN995EXL.0 size=251179 2024-09-05T00:56:10.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.573+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=NV9KUN995EXL tag=FHOTQA02YI0M type=write size=1299755 2024-09-05T00:56:10.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.577+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~MB0ELZQ1MWW8.0 size=176016 2024-09-05T00:56:10.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.577+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=MB0ELZQ1MWW8 tag=AAP3A889YLW7 type=write size=1224592 2024-09-05T00:56:10.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.581+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~VXDPPEYQF231.0 size=1048576 2024-09-05T00:56:10.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.581+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~VXDPPEYQF231.1 size=50234 2024-09-05T00:56:10.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.585+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=VXDPPEYQF231 tag=4734KWUE0H4T type=write size=2147386 2024-09-05T00:56:10.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.589+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=KZCHJR6Z1QPU type=del size=1011166 2024-09-05T00:56:10.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.589+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~L6U62MHQBNG3.0 size=1048576 2024-09-05T00:56:10.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.593+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~L6U62MHQBNG3.1 size=324621 2024-09-05T00:56:10.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.597+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=L6U62MHQBNG3 tag=R6UJ8MKYLGPF type=write size=2421773 2024-09-05T00:56:10.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.597+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=ETYFJ1SELL9Z type=del size=1813101 2024-09-05T00:56:10.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.601+0000 7f325adab8c0 1 < canceled operation key=6N7BLJ1WLDGN tag=E1WLPOM2MMR9 type=write size=475218 2024-09-05T00:56:10.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.605+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=14JEUGI4I3NW type=write size=490301 2024-09-05T00:56:10.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.605+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=J4A8RKZF3YRF type=del 2024-09-05T00:56:10.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.609+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=ANUREZ1M9ZI3 type=del size=3429914 2024-09-05T00:56:10.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.613+0000 7f325adab8c0 1 < suggested update operation key=O0RSK2S88XHP tag=7O1OAOWUD4VO type=del size=1949167 2024-09-05T00:56:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.617+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.0 size=1048576 2024-09-05T00:56:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.621+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.1 size=1048576 2024-09-05T00:56:10.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.621+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.2 size=12745 2024-09-05T00:56:10.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.621+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=KJJACELJV7XK tag=IGCQ8JGD59PY type=write size=3158473 2024-09-05T00:56:10.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.625+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=XOVTRK99SM7Y type=del 2024-09-05T00:56:10.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.625+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=41IMWKKGLHVK type=del size=488409 2024-09-05T00:56:10.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.633+0000 7f325adab8c0 1 < suggested remove operation key=NIAW4BKW21LG tag=603IDFW1T7O4 type=write 2024-09-05T00:56:10.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.637+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~WTXCXHZQL9BE.0 size=294805 2024-09-05T00:56:10.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.637+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=WTXCXHZQL9BE tag=SEIZ56P2PYHH type=write size=1343381 2024-09-05T00:56:10.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.641+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~D21KTLHK5448.0 size=1048576 2024-09-05T00:56:10.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.641+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~D21KTLHK5448.1 size=144294 2024-09-05T00:56:10.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.645+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=D21KTLHK5448 tag=OBM824BCB5ZP type=write size=2241446 2024-09-05T00:56:10.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.649+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=8VLINRDMA00O type=del size=891246 2024-09-05T00:56:10.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.653+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~P13L8JVHI82T.0 size=1048576 2024-09-05T00:56:10.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.653+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~P13L8JVHI82T.1 size=463059 2024-09-05T00:56:10.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.657+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=P13L8JVHI82T tag=5A8BTJCE0PDC type=write size=2560211 2024-09-05T00:56:10.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.661+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=KG7W2QNI1RHV type=del size=914991 2024-09-05T00:56:10.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.665+0000 7f325adab8c0 1 < suggested remove operation key=EGPVSV2PFILM tag=OBY592WWXOML type=del 2024-09-05T00:56:10.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.669+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=ZWPWAQ1NCVSV type=del size=1917904 2024-09-05T00:56:10.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.673+0000 7f325adab8c0 1 < suggested remove operation key=GU25IIQWQNR2 tag=W387I616V9TU type=write 2024-09-05T00:56:10.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.681+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2V12TVBDTWHF.0 size=1048576 2024-09-05T00:56:10.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.681+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2V12TVBDTWHF.1 size=766406 2024-09-05T00:56:10.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.681+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=2V12TVBDTWHF tag=W0IKSO80G6ZR type=write size=2863558 2024-09-05T00:56:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.685+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MNU5RP1JEXNI.0 size=1048576 2024-09-05T00:56:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.685+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~MNU5RP1JEXNI.1 size=260756 2024-09-05T00:56:10.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.689+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=MNU5RP1JEXNI tag=TWLBQKPBPRDL type=write size=2357908 2024-09-05T00:56:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.693+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~EK94TRYSJG93.0 size=1048576 2024-09-05T00:56:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.697+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~EK94TRYSJG93.1 size=110023 2024-09-05T00:56:10.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.697+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=EK94TRYSJG93 tag=BJROQKLYJUFW type=write size=2207175 2024-09-05T00:56:10.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.697+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~2QQQFKRVMWZA.0 size=1048576 2024-09-05T00:56:10.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.697+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~2QQQFKRVMWZA.1 size=422570 2024-09-05T00:56:10.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.701+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=2QQQFKRVMWZA tag=45AA1M5OV54V type=write size=2519722 2024-09-05T00:56:10.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.709+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~YSO25G6E0M96.0 size=1048576 2024-09-05T00:56:10.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.709+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~YSO25G6E0M96.1 size=94391 2024-09-05T00:56:10.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.709+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=YSO25G6E0M96 tag=Z9Z8VYWFMSA3 type=write size=2191543 2024-09-05T00:56:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.713+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~XJLQEP4WQCO5.0 size=740892 2024-09-05T00:56:10.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.717+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=XJLQEP4WQCO5 tag=01XYIXKE7IVS type=write size=1789468 2024-09-05T00:56:10.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.725+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~J3KWTDW9A9UP.0 size=1048576 2024-09-05T00:56:10.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.725+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~J3KWTDW9A9UP.1 size=503255 2024-09-05T00:56:10.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.725+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=J3KWTDW9A9UP tag=4HC9N1EJ99TP type=write size=2600407 2024-09-05T00:56:10.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.729+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~ZRL1VCNPPJLY.0 size=1048576 2024-09-05T00:56:10.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.733+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~ZRL1VCNPPJLY.1 size=946868 2024-09-05T00:56:10.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.737+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=ZRL1VCNPPJLY tag=HFK96QAO0BMS type=write size=3044020 2024-09-05T00:56:10.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.741+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~X0DX8MEM2TL4.0 size=63138 2024-09-05T00:56:10.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.741+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=X0DX8MEM2TL4 tag=TIC7LFNH12QG type=write size=1111714 2024-09-05T00:56:10.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.741+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~MB0ELZQ1MWW8.0 size=176016 2024-09-05T00:56:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.745+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=MB0ELZQ1MWW8 tag=AAP3A889YLW7 type=write size=1224592 2024-09-05T00:56:10.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.749+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=XS6Y968BPUMU type=del size=1832711 2024-09-05T00:56:10.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.749+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=KZCHJR6Z1QPU type=del 2024-09-05T00:56:10.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.753+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~8TVN2N12GIK8.0 size=935963 2024-09-05T00:56:10.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.753+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=8TVN2N12GIK8 tag=6VIR4WQILXWT type=write size=1984539 2024-09-05T00:56:10.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.757+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=ETYFJ1SELL9Z type=del 2024-09-05T00:56:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.761+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~8WN8DCV232K9.0 size=940233 2024-09-05T00:56:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.761+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=8WN8DCV232K9 tag=Q7HBSSLOGN09 type=write size=1988809 2024-09-05T00:56:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.765+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=14JEUGI4I3NW type=write size=490301 2024-09-05T00:56:10.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.765+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=IDHSDKMNV1N2 type=del size=1009876 2024-09-05T00:56:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.769+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=ANUREZ1M9ZI3 type=del 2024-09-05T00:56:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.769+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=MEX8M5G8F60K type=write size=233387 2024-09-05T00:56:10.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.773+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.0 size=1048576 2024-09-05T00:56:10.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.773+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.1 size=1048576 2024-09-05T00:56:10.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.777+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~KJJACELJV7XK.2 size=12745 2024-09-05T00:56:10.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.781+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=KJJACELJV7XK tag=IGCQ8JGD59PY type=write size=3158473 2024-09-05T00:56:10.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.781+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=819PA91PPBG9 type=del size=560135 2024-09-05T00:56:10.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.789+0000 7f325adab8c0 1 < suggested update operation key=YMIGZMLJSI4D tag=41IMWKKGLHVK type=del size=488409 2024-09-05T00:56:10.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.793+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.0 size=1048576 2024-09-05T00:56:10.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.793+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.1 size=1048576 2024-09-05T00:56:10.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.797+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.2 size=395907 2024-09-05T00:56:10.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.797+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=QAK4UK3F9HN9 tag=MB2MUZOYNTL3 type=write size=3541635 2024-09-05T00:56:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.801+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~WTXCXHZQL9BE.0 size=294805 2024-09-05T00:56:10.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.805+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=WTXCXHZQL9BE tag=SEIZ56P2PYHH type=write size=1343381 2024-09-05T00:56:10.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.805+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=NJR4GE2CS18Y type=del size=406804 2024-09-05T00:56:10.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.809+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=8VLINRDMA00O type=del 2024-09-05T00:56:10.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.813+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~XPQLBH6QIH7P.0 size=1048576 2024-09-05T00:56:10.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.817+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~XPQLBH6QIH7P.1 size=549494 2024-09-05T00:56:10.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.817+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=XPQLBH6QIH7P tag=92AA9RM4OT1D type=write size=2646646 2024-09-05T00:56:10.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.817+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=KG7W2QNI1RHV type=del 2024-09-05T00:56:10.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.821+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~5P6B2X8QDMEN.0 size=1048576 2024-09-05T00:56:10.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.825+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~5P6B2X8QDMEN.1 size=357931 2024-09-05T00:56:10.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.825+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=5P6B2X8QDMEN tag=ODLR789VXOL5 type=write size=2455083 2024-09-05T00:56:10.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.829+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=ZWPWAQ1NCVSV type=del 2024-09-05T00:56:10.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.829+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=MPQDJK1L2T9H type=del size=1274210 2024-09-05T00:56:10.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.833+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2V12TVBDTWHF.0 size=1048576 2024-09-05T00:56:10.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.833+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2V12TVBDTWHF.1 size=766406 2024-09-05T00:56:10.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.837+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=2V12TVBDTWHF tag=W0IKSO80G6ZR type=write size=2863558 2024-09-05T00:56:10.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.841+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~ZWA5GJ2YM4I8.0 size=1048576 2024-09-05T00:56:10.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.845+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~ZWA5GJ2YM4I8.1 size=719245 2024-09-05T00:56:10.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.845+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=ZWA5GJ2YM4I8 tag=2R7J3YQ00YC6 type=write size=2816397 2024-09-05T00:56:10.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.845+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~EK94TRYSJG93.0 size=1048576 2024-09-05T00:56:10.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.849+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~EK94TRYSJG93.1 size=110023 2024-09-05T00:56:10.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.853+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=EK94TRYSJG93 tag=BJROQKLYJUFW type=write size=2207175 2024-09-05T00:56:10.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.857+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~LY01VIWB9D10.0 size=1048576 2024-09-05T00:56:10.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.861+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~LY01VIWB9D10.1 size=149696 2024-09-05T00:56:10.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.861+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=LY01VIWB9D10 tag=YE8NEO33D1HN type=write size=2246848 2024-09-05T00:56:10.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.861+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~YSO25G6E0M96.0 size=1048576 2024-09-05T00:56:10.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.865+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~YSO25G6E0M96.1 size=94391 2024-09-05T00:56:10.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.869+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=YSO25G6E0M96 tag=Z9Z8VYWFMSA3 type=write size=2191543 2024-09-05T00:56:10.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.869+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=R0HWRFMQV0VX type=write size=402056 2024-09-05T00:56:10.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.873+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~J3KWTDW9A9UP.0 size=1048576 2024-09-05T00:56:10.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.877+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~J3KWTDW9A9UP.1 size=503255 2024-09-05T00:56:10.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.881+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=J3KWTDW9A9UP tag=4HC9N1EJ99TP type=write size=2600407 2024-09-05T00:56:10.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.881+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=2ID3SFWGZVV4 type=del size=272297 2024-09-05T00:56:10.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.885+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~X0DX8MEM2TL4.0 size=63138 2024-09-05T00:56:10.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.889+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=X0DX8MEM2TL4 tag=TIC7LFNH12QG type=write size=1111714 2024-09-05T00:56:10.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.893+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=5GZPZFHCNMWN type=del size=1740141 2024-09-05T00:56:10.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.897+0000 7f325adab8c0 1 < suggested remove operation key=MAS6EB753KO9 tag=XS6Y968BPUMU type=del 2024-09-05T00:56:10.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.901+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=WDB0TNJGRUIE type=del size=1112722 2024-09-05T00:56:10.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.901+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~8TVN2N12GIK8.0 size=935963 2024-09-05T00:56:10.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.905+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=8TVN2N12GIK8 tag=6VIR4WQILXWT type=write size=1984539 2024-09-05T00:56:10.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.909+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=A6GL4V4FIW3V type=write size=124752 2024-09-05T00:56:10.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.913+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~8WN8DCV232K9.0 size=940233 2024-09-05T00:56:10.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.917+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=8WN8DCV232K9 tag=Q7HBSSLOGN09 type=write size=1988809 2024-09-05T00:56:10.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.917+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=2W042YQQ4X15 type=del size=1390514 2024-09-05T00:56:10.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.921+0000 7f325adab8c0 1 < canceled operation key=71FWV15GD1QZ tag=IDHSDKMNV1N2 type=del size=1009876 2024-09-05T00:56:10.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.925+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=KPBQB05VSH14 type=del size=2454645 2024-09-05T00:56:10.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.925+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=MEX8M5G8F60K type=write size=233387 2024-09-05T00:56:10.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.929+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=6WLFAKND62W5 type=del size=238438 2024-09-05T00:56:10.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.933+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=819PA91PPBG9 type=del 2024-09-05T00:56:10.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.937+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.0 size=1048576 2024-09-05T00:56:10.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.941+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.1 size=1048576 2024-09-05T00:56:10.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.941+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.2 size=222951 2024-09-05T00:56:10.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.941+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=UTLPPXS41Q62 tag=9IIT3POT3ZA5 type=write size=3368679 2024-09-05T00:56:10.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.945+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.0 size=1048576 2024-09-05T00:56:10.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.945+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.1 size=1048576 2024-09-05T00:56:10.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.949+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~QAK4UK3F9HN9.2 size=395907 2024-09-05T00:56:10.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.953+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=QAK4UK3F9HN9 tag=MB2MUZOYNTL3 type=write size=3541635 2024-09-05T00:56:10.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.953+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=D2OB1JVQA81Q type=del size=3014219 2024-09-05T00:56:10.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.961+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=NJR4GE2CS18Y type=del 2024-09-05T00:56:10.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.961+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=Q7JWCFDEHF6G type=write size=875996 2024-09-05T00:56:10.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.965+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~XPQLBH6QIH7P.0 size=1048576 2024-09-05T00:56:10.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.969+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~XPQLBH6QIH7P.1 size=549494 2024-09-05T00:56:10.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.973+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=XPQLBH6QIH7P tag=92AA9RM4OT1D type=write size=2646646 2024-09-05T00:56:10.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.977+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=U9MW2VLSZBT3 type=del size=1262895 2024-09-05T00:56:10.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.977+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~5P6B2X8QDMEN.0 size=1048576 2024-09-05T00:56:10.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.981+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~5P6B2X8QDMEN.1 size=357931 2024-09-05T00:56:10.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.985+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=5P6B2X8QDMEN tag=ODLR789VXOL5 type=write size=2455083 2024-09-05T00:56:10.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.989+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=9TDPP53IARPU type=del size=1055279 2024-09-05T00:56:10.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.989+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=MPQDJK1L2T9H type=del 2024-09-05T00:56:10.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.993+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=PLY0WRTYRNJO type=write size=466032 2024-09-05T00:56:10.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.997+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~ZWA5GJ2YM4I8.0 size=1048576 2024-09-05T00:56:11.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:10.997+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~ZWA5GJ2YM4I8.1 size=719245 2024-09-05T00:56:11.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.001+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=ZWA5GJ2YM4I8 tag=2R7J3YQ00YC6 type=write size=2816397 2024-09-05T00:56:11.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.005+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=DVM48VNZRH30 type=del size=3423986 2024-09-05T00:56:11.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.005+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~LY01VIWB9D10.0 size=1048576 2024-09-05T00:56:11.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.009+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~LY01VIWB9D10.1 size=149696 2024-09-05T00:56:11.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.013+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=LY01VIWB9D10 tag=YE8NEO33D1HN type=write size=2246848 2024-09-05T00:56:11.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.017+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.0 size=1048576 2024-09-05T00:56:11.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.021+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.1 size=1048576 2024-09-05T00:56:11.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.021+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.2 size=921053 2024-09-05T00:56:11.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.021+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=I40RMIFPJBEI tag=P5GCTGK74RH0 type=write size=4066781 2024-09-05T00:56:11.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.025+0000 7f325adab8c0 1 < suggested update operation key=6N7BLJ1WLDGN tag=R0HWRFMQV0VX type=write size=402056 2024-09-05T00:56:11.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.029+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=0BLG02JPQ9KW type=del size=3998422 2024-09-05T00:56:11.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.033+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=2ID3SFWGZVV4 type=del 2024-09-05T00:56:11.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.033+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=5V50NAJ0GYEP type=del size=3268921 2024-09-05T00:56:11.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.037+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=5GZPZFHCNMWN type=del 2024-09-05T00:56:11.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.041+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=D2HYGB26U8RV type=del size=4141743 2024-09-05T00:56:11.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.045+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=WDB0TNJGRUIE type=del 2024-09-05T00:56:11.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.049+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~VWZW47G870VK.0 size=1048576 2024-09-05T00:56:11.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.053+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~VWZW47G870VK.1 size=245697 2024-09-05T00:56:11.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.053+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=VWZW47G870VK tag=TE7O1UUPMG3X type=write size=2342849 2024-09-05T00:56:11.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.053+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=A6GL4V4FIW3V type=write size=124752 2024-09-05T00:56:11.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.061+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~QPGTQKU332V3.0 size=1048576 2024-09-05T00:56:11.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.061+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~QPGTQKU332V3.1 size=426861 2024-09-05T00:56:11.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.061+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=QPGTQKU332V3 tag=RQLDQXSZ4ZWJ type=write size=2524013 2024-09-05T00:56:11.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.069+0000 7f325adab8c0 1 < suggested remove operation key=9O7DVR04PCDB tag=2W042YQQ4X15 type=del 2024-09-05T00:56:11.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.069+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=1LUSQYVSAYCX type=del size=2144069 2024-09-05T00:56:11.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.073+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=KPBQB05VSH14 type=del 2024-09-05T00:56:11.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.081+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~DN70XK8YODUA.0 size=1048576 2024-09-05T00:56:11.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.081+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~DN70XK8YODUA.1 size=529417 2024-09-05T00:56:11.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.081+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=DN70XK8YODUA tag=J69R5FUEWPJF type=write size=2626569 2024-09-05T00:56:11.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.085+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=6WLFAKND62W5 type=del 2024-09-05T00:56:11.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.089+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=64J0WHRR5N8X type=del size=30427 2024-09-05T00:56:11.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.089+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.0 size=1048576 2024-09-05T00:56:11.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.089+0000 7f325adab8c0 1 < canceled part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.1 size=1048576 2024-09-05T00:56:11.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.093+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~UTLPPXS41Q62.2 size=222951 2024-09-05T00:56:11.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.097+0000 7f325adab8c0 1 < canceled multipart upload key=IGOUBVL3XVS3 upload=UTLPPXS41Q62 tag=9IIT3POT3ZA5 type=write size=3368679 2024-09-05T00:56:11.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.101+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~0RTOX4DPO451.0 size=254408 2024-09-05T00:56:11.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.101+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=0RTOX4DPO451 tag=L1VVB1BO919E type=write size=1302984 2024-09-05T00:56:11.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.105+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=D2OB1JVQA81Q type=del 2024-09-05T00:56:11.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.109+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.0 size=1048576 2024-09-05T00:56:11.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.113+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.1 size=1048576 2024-09-05T00:56:11.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.113+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.2 size=128055 2024-09-05T00:56:11.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.113+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=4229FPEF2O8Q tag=OI1VFUA320BW type=write size=3273783 2024-09-05T00:56:11.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.117+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=Q7JWCFDEHF6G type=write size=875996 2024-09-05T00:56:11.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.121+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=QL7BOCFNWGU2 type=del size=3530157 2024-09-05T00:56:11.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.121+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=U9MW2VLSZBT3 type=del size=1262895 2024-09-05T00:56:11.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.129+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~KSKSBKE6S17J.0 size=299173 2024-09-05T00:56:11.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.129+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=KSKSBKE6S17J tag=IQ2PMQXR2HID type=write size=1347749 2024-09-05T00:56:11.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.129+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=9TDPP53IARPU type=del size=1055279 2024-09-05T00:56:11.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.137+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~82U4XHF28YOL.0 size=1048576 2024-09-05T00:56:11.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.137+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~82U4XHF28YOL.1 size=857839 2024-09-05T00:56:11.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.137+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=82U4XHF28YOL tag=NLI1O5ACLQ9Z type=write size=2954991 2024-09-05T00:56:11.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.141+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=PLY0WRTYRNJO type=write size=466032 2024-09-05T00:56:11.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.145+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~FWGW368TQVVN.0 size=477524 2024-09-05T00:56:11.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.145+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=FWGW368TQVVN tag=GMC7KP4U9SW1 type=write size=1526100 2024-09-05T00:56:11.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.153+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=DVM48VNZRH30 type=del 2024-09-05T00:56:11.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.153+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=13XY0JDCMHFP type=del size=172153 2024-09-05T00:56:11.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.157+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.0 size=1048576 2024-09-05T00:56:11.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.157+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.1 size=1048576 2024-09-05T00:56:11.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.161+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~I40RMIFPJBEI.2 size=921053 2024-09-05T00:56:11.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.165+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=I40RMIFPJBEI tag=P5GCTGK74RH0 type=write size=4066781 2024-09-05T00:56:11.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.169+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=PRAP20UWF4HL type=write size=523756 2024-09-05T00:56:11.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.169+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=0BLG02JPQ9KW type=del 2024-09-05T00:56:11.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.173+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=X9TM6ZGHJ5JY type=del size=46232 2024-09-05T00:56:11.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.177+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=5V50NAJ0GYEP type=del 2024-09-05T00:56:11.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.181+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=E60E798YLJAG type=del size=488562 2024-09-05T00:56:11.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.181+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=D2HYGB26U8RV type=del 2024-09-05T00:56:11.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.185+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~EQA8RCO4NJ0L.0 size=1048576 2024-09-05T00:56:11.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.189+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~EQA8RCO4NJ0L.1 size=273761 2024-09-05T00:56:11.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.189+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=EQA8RCO4NJ0L tag=36P394UTMLG7 type=write size=2370913 2024-09-05T00:56:11.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.193+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~VWZW47G870VK.0 size=1048576 2024-09-05T00:56:11.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.193+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~VWZW47G870VK.1 size=245697 2024-09-05T00:56:11.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.197+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=VWZW47G870VK tag=TE7O1UUPMG3X type=write size=2342849 2024-09-05T00:56:11.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.201+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~FYC4IYN62UFP.0 size=1048576 2024-09-05T00:56:11.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.205+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~FYC4IYN62UFP.1 size=826711 2024-09-05T00:56:11.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.205+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=FYC4IYN62UFP tag=CJRRAN4UQENM type=write size=2923863 2024-09-05T00:56:11.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.205+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~QPGTQKU332V3.0 size=1048576 2024-09-05T00:56:11.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.209+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~QPGTQKU332V3.1 size=426861 2024-09-05T00:56:11.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.217+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=QPGTQKU332V3 tag=RQLDQXSZ4ZWJ type=write size=2524013 2024-09-05T00:56:11.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.217+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=PKBC6H6ETMGU type=del size=2421209 2024-09-05T00:56:11.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.221+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=1LUSQYVSAYCX type=del size=2144069 2024-09-05T00:56:11.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.225+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~A0T23UIPIXEP.0 size=1048576 2024-09-05T00:56:11.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.229+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~A0T23UIPIXEP.1 size=1039180 2024-09-05T00:56:11.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.229+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=A0T23UIPIXEP tag=LYHLR1DRUHGQ type=write size=3136332 2024-09-05T00:56:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.229+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~DN70XK8YODUA.0 size=1048576 2024-09-05T00:56:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.229+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~DN70XK8YODUA.1 size=529417 2024-09-05T00:56:11.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.233+0000 7f325adab8c0 1 < canceled multipart upload key=XKOECM0CCOKX upload=DN70XK8YODUA tag=J69R5FUEWPJF type=write size=2626569 2024-09-05T00:56:11.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.237+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.0 size=1048576 2024-09-05T00:56:11.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.241+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.1 size=1048576 2024-09-05T00:56:11.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.245+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.2 size=801626 2024-09-05T00:56:11.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.245+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=IIYPN1W24Y75 tag=1QE525RMSGU1 type=write size=3947354 2024-09-05T00:56:11.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.245+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=64J0WHRR5N8X type=del 2024-09-05T00:56:11.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.249+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=69TSHQBWMI40 type=del size=3021148 2024-09-05T00:56:11.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.253+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~0RTOX4DPO451.0 size=254408 2024-09-05T00:56:11.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.257+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=0RTOX4DPO451 tag=L1VVB1BO919E type=write size=1302984 2024-09-05T00:56:11.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.261+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=4X5N9P2Y889I type=del size=1871661 2024-09-05T00:56:11.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.265+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.0 size=1048576 2024-09-05T00:56:11.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.265+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.1 size=1048576 2024-09-05T00:56:11.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.269+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~4229FPEF2O8Q.2 size=128055 2024-09-05T00:56:11.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.273+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=4229FPEF2O8Q tag=OI1VFUA320BW type=write size=3273783 2024-09-05T00:56:11.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.277+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.0 size=1048576 2024-09-05T00:56:11.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.281+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.1 size=1048576 2024-09-05T00:56:11.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.281+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.2 size=525941 2024-09-05T00:56:11.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.281+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=TUYFJ08A2BYQ tag=C5R0GJZFIMLN type=write size=3671669 2024-09-05T00:56:11.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.285+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=QL7BOCFNWGU2 type=del size=3530157 2024-09-05T00:56:11.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.289+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.0 size=1048576 2024-09-05T00:56:11.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.293+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.1 size=1048576 2024-09-05T00:56:11.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.293+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.2 size=963539 2024-09-05T00:56:11.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.293+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=1VOWT6MXTX51 tag=919CZ8A5G12H type=write size=4109267 2024-09-05T00:56:11.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.293+0000 7f325adab8c0 1 < canceled part key=_multipart_9O7DVR04PCDB.2~KSKSBKE6S17J.0 size=299173 2024-09-05T00:56:11.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.297+0000 7f325adab8c0 1 < canceled multipart upload key=9O7DVR04PCDB upload=KSKSBKE6S17J tag=IQ2PMQXR2HID type=write size=1347749 2024-09-05T00:56:11.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.301+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=C0M0LL40YJCN type=del size=1046156 2024-09-05T00:56:11.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.305+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~82U4XHF28YOL.0 size=1048576 2024-09-05T00:56:11.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.305+0000 7f325adab8c0 1 < canceled part key=_multipart_JKRZR0KRE93F.2~82U4XHF28YOL.1 size=857839 2024-09-05T00:56:11.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.309+0000 7f325adab8c0 1 < canceled multipart upload key=JKRZR0KRE93F upload=82U4XHF28YOL tag=NLI1O5ACLQ9Z type=write size=2954991 2024-09-05T00:56:11.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.313+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.0 size=1048576 2024-09-05T00:56:11.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.317+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.1 size=1048576 2024-09-05T00:56:11.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.321+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.2 size=798583 2024-09-05T00:56:11.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.321+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=2CRORFI5D9E6 tag=AMFP029FI3E5 type=write size=3944311 2024-09-05T00:56:11.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.325+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~FWGW368TQVVN.0 size=477524 2024-09-05T00:56:11.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.329+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=FWGW368TQVVN tag=GMC7KP4U9SW1 type=write size=1526100 2024-09-05T00:56:11.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.329+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=HC6B3U7KK24Q type=del size=900722 2024-09-05T00:56:11.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.337+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=13XY0JDCMHFP type=del 2024-09-05T00:56:11.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.341+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.0 size=1048576 2024-09-05T00:56:11.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.341+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.1 size=1048576 2024-09-05T00:56:11.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.345+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.2 size=669065 2024-09-05T00:56:11.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.345+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=KVHS2FE7IM72 tag=YOT7K9WGBHZK type=write size=3814793 2024-09-05T00:56:11.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.345+0000 7f325adab8c0 -1 < failed to complete operation key=HW4QK67332RW tag=PRAP20UWF4HL type=write size=523756: (22) Invalid argument 2024-09-05T00:56:11.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.349+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=FNHHDL816VCY type=del size=2740396 2024-09-05T00:56:11.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.353+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=X9TM6ZGHJ5JY type=del 2024-09-05T00:56:11.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.353+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=PWXQX5T7M2DP type=del size=1266017 2024-09-05T00:56:11.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.357+0000 7f325adab8c0 1 < suggested update operation key=MYR9H12B5YYV tag=E60E798YLJAG type=del size=488562 2024-09-05T00:56:11.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.361+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=60EZ50V1EO7U type=del size=3618925 2024-09-05T00:56:11.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.361+0000 7f325adab8c0 1 < canceled part key=_multipart_NIAW4BKW21LG.2~EQA8RCO4NJ0L.0 size=1048576 2024-09-05T00:56:11.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.361+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~EQA8RCO4NJ0L.1 size=273761 2024-09-05T00:56:11.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.365+0000 7f325adab8c0 1 < canceled multipart upload key=NIAW4BKW21LG upload=EQA8RCO4NJ0L tag=36P394UTMLG7 type=write size=2370913 2024-09-05T00:56:11.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.369+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~OX1ZR2MTUM88.0 size=1048576 2024-09-05T00:56:11.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.373+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~OX1ZR2MTUM88.1 size=450524 2024-09-05T00:56:11.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.373+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=OX1ZR2MTUM88 tag=HXE4D24H12P3 type=write size=2547676 2024-09-05T00:56:11.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.373+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~FYC4IYN62UFP.0 size=1048576 2024-09-05T00:56:11.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.377+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~FYC4IYN62UFP.1 size=826711 2024-09-05T00:56:11.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.381+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=FYC4IYN62UFP tag=CJRRAN4UQENM type=write size=2923863 2024-09-05T00:56:11.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.385+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=LLLMODXYM901 type=del size=3356187 2024-09-05T00:56:11.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.385+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=PKBC6H6ETMGU type=del 2024-09-05T00:56:11.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.389+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=HUZNN41AL64O type=del size=1751505 2024-09-05T00:56:11.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.389+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~A0T23UIPIXEP.0 size=1048576 2024-09-05T00:56:11.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.393+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~A0T23UIPIXEP.1 size=1039180 2024-09-05T00:56:11.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.397+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=A0T23UIPIXEP tag=LYHLR1DRUHGQ type=write size=3136332 2024-09-05T00:56:11.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.401+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.0 size=1048576 2024-09-05T00:56:11.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.405+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.1 size=1048576 2024-09-05T00:56:11.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.405+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.2 size=702712 2024-09-05T00:56:11.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.405+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=0G763370KVQA tag=DINZIKYR8O5L type=write size=3848440 2024-09-05T00:56:11.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.409+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.0 size=1048576 2024-09-05T00:56:11.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.409+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.1 size=1048576 2024-09-05T00:56:11.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.413+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~IIYPN1W24Y75.2 size=801626 2024-09-05T00:56:11.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.417+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=IIYPN1W24Y75 tag=1QE525RMSGU1 type=write size=3947354 2024-09-05T00:56:11.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.421+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=3A5FNXFT0XD1 type=write size=322321 2024-09-05T00:56:11.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.425+0000 7f325adab8c0 1 < canceled operation key=GU25IIQWQNR2 tag=69TSHQBWMI40 type=del size=3021148 2024-09-05T00:56:11.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.425+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=OHZ654PM7C6Q type=write size=15125 2024-09-05T00:56:11.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.429+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=4X5N9P2Y889I type=del 2024-09-05T00:56:11.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.437+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~UDXIB57TA6DS.0 size=1048576 2024-09-05T00:56:11.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.437+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~UDXIB57TA6DS.1 size=67532 2024-09-05T00:56:11.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.437+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=UDXIB57TA6DS tag=M2D6IT2OMOAU type=write size=2164684 2024-09-05T00:56:11.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.441+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.0 size=1048576 2024-09-05T00:56:11.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.445+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.1 size=1048576 2024-09-05T00:56:11.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.445+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~TUYFJ08A2BYQ.2 size=525941 2024-09-05T00:56:11.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.453+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=TUYFJ08A2BYQ tag=C5R0GJZFIMLN type=write size=3671669 2024-09-05T00:56:11.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.457+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=OF4FR5GVR9JZ type=del size=3967470 2024-09-05T00:56:11.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.457+0000 7f325adab8c0 1 < canceled part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.0 size=1048576 2024-09-05T00:56:11.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.457+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.1 size=1048576 2024-09-05T00:56:11.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.461+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~1VOWT6MXTX51.2 size=963539 2024-09-05T00:56:11.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.465+0000 7f325adab8c0 1 < canceled multipart upload key=VYMRZPO6VKGS upload=1VOWT6MXTX51 tag=919CZ8A5G12H type=write size=4109267 2024-09-05T00:56:11.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.473+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.0 size=1048576 2024-09-05T00:56:11.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.473+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.1 size=1048576 2024-09-05T00:56:11.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.473+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.2 size=1028307 2024-09-05T00:56:11.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.473+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=G94PZ4YSPBTZ tag=KAFYKFDYY4D9 type=write size=4174035 2024-09-05T00:56:11.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.481+0000 7f325adab8c0 1 < suggested update operation key=A9WMRV5QZ2FP tag=C0M0LL40YJCN type=del size=1046156 2024-09-05T00:56:11.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.485+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~T48A2PMG5O56.0 size=1048576 2024-09-05T00:56:11.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.485+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~T48A2PMG5O56.1 size=406884 2024-09-05T00:56:11.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.485+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=T48A2PMG5O56 tag=IBWTHY6Y7538 type=write size=2504036 2024-09-05T00:56:11.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.489+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.0 size=1048576 2024-09-05T00:56:11.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.489+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.1 size=1048576 2024-09-05T00:56:11.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.493+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2CRORFI5D9E6.2 size=798583 2024-09-05T00:56:11.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.497+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=2CRORFI5D9E6 tag=AMFP029FI3E5 type=write size=3944311 2024-09-05T00:56:11.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.497+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=61Q2DIBYM5IX type=del size=2670558 2024-09-05T00:56:11.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.505+0000 7f325adab8c0 1 < suggested remove operation key=XKOECM0CCOKX tag=HC6B3U7KK24Q type=del 2024-09-05T00:56:11.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.505+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=GWPPU6CP0XZ4 type=del size=2990366 2024-09-05T00:56:11.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.509+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.0 size=1048576 2024-09-05T00:56:11.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.509+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.1 size=1048576 2024-09-05T00:56:11.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.513+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~KVHS2FE7IM72.2 size=669065 2024-09-05T00:56:11.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.513+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=KVHS2FE7IM72 tag=YOT7K9WGBHZK type=write size=3814793 2024-09-05T00:56:11.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.517+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=8PT94DMM0IJD type=del size=69193 2024-09-05T00:56:11.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.521+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=FNHHDL816VCY type=del 2024-09-05T00:56:11.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.521+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=U3NPLF5FPALI type=del size=102025 2024-09-05T00:56:11.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.525+0000 7f325adab8c0 1 < canceled operation key=6N7BLJ1WLDGN tag=PWXQX5T7M2DP type=del size=1266017 2024-09-05T00:56:11.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.525+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=XZQEKD1XL12C type=del size=2694505 2024-09-05T00:56:11.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.529+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=60EZ50V1EO7U type=del size=3618925 2024-09-05T00:56:11.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.533+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HTB25XAZZ5S3.0 size=814847 2024-09-05T00:56:11.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.533+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=HTB25XAZZ5S3 tag=TZM4245B6M1S type=write size=1863423 2024-09-05T00:56:11.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.533+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~OX1ZR2MTUM88.0 size=1048576 2024-09-05T00:56:11.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.537+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~OX1ZR2MTUM88.1 size=450524 2024-09-05T00:56:11.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.541+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=OX1ZR2MTUM88 tag=HXE4D24H12P3 type=write size=2547676 2024-09-05T00:56:11.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.541+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=FXEF1YXDISE0 type=write size=556164 2024-09-05T00:56:11.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.545+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=LLLMODXYM901 type=del 2024-09-05T00:56:11.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.553+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~IB6SK7HY5QF2.0 size=222958 2024-09-05T00:56:11.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.553+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=IB6SK7HY5QF2 tag=OD1RBBGHWLP9 type=write size=1271534 2024-09-05T00:56:11.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.553+0000 7f325adab8c0 -1 < no bi entry to suggest for operation key=J9UIQE3CKYHM tag=HUZNN41AL64O type=del size=1751505: (2) No such file or directory 2024-09-05T00:56:11.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.553+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=8H6QIYYVQQND type=del size=904155 2024-09-05T00:56:11.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.557+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.0 size=1048576 2024-09-05T00:56:11.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.557+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.1 size=1048576 2024-09-05T00:56:11.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.561+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~0G763370KVQA.2 size=702712 2024-09-05T00:56:11.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.565+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=0G763370KVQA tag=DINZIKYR8O5L type=write size=3848440 2024-09-05T00:56:11.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.569+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=VRF4XUCUAJ2S type=del size=288453 2024-09-05T00:56:11.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.569+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=3A5FNXFT0XD1 type=write size=322321 2024-09-05T00:56:11.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.573+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.0 size=1048576 2024-09-05T00:56:11.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.577+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.1 size=1048576 2024-09-05T00:56:11.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.577+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.2 size=646184 2024-09-05T00:56:11.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.577+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=EGO8NTJWX8UM tag=217R1MM1AAII type=write size=3791912 2024-09-05T00:56:11.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.581+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=OHZ654PM7C6Q type=write size=15125 2024-09-05T00:56:11.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.585+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.0 size=1048576 2024-09-05T00:56:11.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.589+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.1 size=1048576 2024-09-05T00:56:11.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.589+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.2 size=171002 2024-09-05T00:56:11.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.589+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=67XQJE9C9JGO tag=O3D8SMT4EKQU type=write size=3316730 2024-09-05T00:56:11.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.593+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~UDXIB57TA6DS.0 size=1048576 2024-09-05T00:56:11.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.593+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~UDXIB57TA6DS.1 size=67532 2024-09-05T00:56:11.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.601+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=UDXIB57TA6DS tag=M2D6IT2OMOAU type=write size=2164684 2024-09-05T00:56:11.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.605+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.0 size=1048576 2024-09-05T00:56:11.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.605+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.1 size=1048576 2024-09-05T00:56:11.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.609+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.2 size=108546 2024-09-05T00:56:11.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.609+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=DHVO783GQBBA tag=ZF087DXZ9S4E type=write size=3254274 2024-09-05T00:56:11.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.609+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=OF4FR5GVR9JZ type=del 2024-09-05T00:56:11.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.613+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.0 size=1048576 2024-09-05T00:56:11.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.617+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.1 size=1048576 2024-09-05T00:56:11.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.617+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.2 size=353547 2024-09-05T00:56:11.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.617+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=193O1QDLCN1U tag=93LH86236QEG type=write size=3499275 2024-09-05T00:56:11.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.621+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.0 size=1048576 2024-09-05T00:56:11.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.621+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.1 size=1048576 2024-09-05T00:56:11.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.625+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G94PZ4YSPBTZ.2 size=1028307 2024-09-05T00:56:11.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.629+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=G94PZ4YSPBTZ tag=KAFYKFDYY4D9 type=write size=4174035 2024-09-05T00:56:11.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.633+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~Q3CT8EX17WTT.0 size=676553 2024-09-05T00:56:11.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.633+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=Q3CT8EX17WTT tag=X552GNISWXM6 type=write size=1725129 2024-09-05T00:56:11.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.633+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~T48A2PMG5O56.0 size=1048576 2024-09-05T00:56:11.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.637+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~T48A2PMG5O56.1 size=406884 2024-09-05T00:56:11.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.641+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=T48A2PMG5O56 tag=IBWTHY6Y7538 type=write size=2504036 2024-09-05T00:56:11.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.645+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.0 size=1048576 2024-09-05T00:56:11.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.645+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.1 size=1048576 2024-09-05T00:56:11.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.649+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.2 size=266217 2024-09-05T00:56:11.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.649+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=IJX3VORDQTJ4 tag=8CQ31XYVZ3CR type=write size=3411945 2024-09-05T00:56:11.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.653+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=61Q2DIBYM5IX type=del 2024-09-05T00:56:11.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.657+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~H5NVARTONI1A.0 size=306646 2024-09-05T00:56:11.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.657+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=H5NVARTONI1A tag=UIZOC96Q3XU0 type=write size=1355222 2024-09-05T00:56:11.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.661+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=GWPPU6CP0XZ4 type=del 2024-09-05T00:56:11.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.661+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=D15AS058ANNH type=del size=2686231 2024-09-05T00:56:11.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.665+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=8PT94DMM0IJD type=del 2024-09-05T00:56:11.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.669+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=DADS6DGSORWA type=write size=294694 2024-09-05T00:56:11.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.669+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=U3NPLF5FPALI type=del 2024-09-05T00:56:11.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.673+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=961UN8OOWPA9 type=write size=187775 2024-09-05T00:56:11.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.677+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=XZQEKD1XL12C type=del 2024-09-05T00:56:11.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.681+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.0 size=1048576 2024-09-05T00:56:11.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.685+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.1 size=1048576 2024-09-05T00:56:11.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.689+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.2 size=941337 2024-09-05T00:56:11.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.689+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=B0PSVPIVMSHI tag=4XORNOMJE9SN type=write size=4087065 2024-09-05T00:56:11.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.689+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HTB25XAZZ5S3.0 size=814847 2024-09-05T00:56:11.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.693+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=HTB25XAZZ5S3 tag=TZM4245B6M1S type=write size=1863423 2024-09-05T00:56:11.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.701+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~ELL45FJTJ5F2.0 size=994361 2024-09-05T00:56:11.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.701+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=ELL45FJTJ5F2 tag=Y9XD0OBM1FAH type=write size=2042937 2024-09-05T00:56:11.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.705+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=FXEF1YXDISE0 type=write 2024-09-05T00:56:11.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.709+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.0 size=1048576 2024-09-05T00:56:11.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.713+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.1 size=1048576 2024-09-05T00:56:11.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.717+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.2 size=745457 2024-09-05T00:56:11.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.717+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=MF97GID00AA3 tag=THXY4LI11EST type=write size=3891185 2024-09-05T00:56:11.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.717+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~IB6SK7HY5QF2.0 size=222958 2024-09-05T00:56:11.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.721+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=IB6SK7HY5QF2 tag=OD1RBBGHWLP9 type=write size=1271534 2024-09-05T00:56:11.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.729+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~J7WJ1QVTULOL.0 size=1048576 2024-09-05T00:56:11.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.729+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~J7WJ1QVTULOL.1 size=932258 2024-09-05T00:56:11.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.729+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=J7WJ1QVTULOL tag=9ZNXP306G0GA type=write size=3029410 2024-09-05T00:56:11.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.733+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=8H6QIYYVQQND type=del 2024-09-05T00:56:11.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.733+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=99OPBUNFXXYP type=write size=507694 2024-09-05T00:56:11.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.737+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=VRF4XUCUAJ2S type=del 2024-09-05T00:56:11.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.741+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~4OC6E3VHA5EG.0 size=1048576 2024-09-05T00:56:11.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.745+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~4OC6E3VHA5EG.1 size=114045 2024-09-05T00:56:11.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.745+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=4OC6E3VHA5EG tag=EI6NWRJIPCH1 type=write size=2211197 2024-09-05T00:56:11.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.749+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.0 size=1048576 2024-09-05T00:56:11.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.749+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.1 size=1048576 2024-09-05T00:56:11.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.753+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~EGO8NTJWX8UM.2 size=646184 2024-09-05T00:56:11.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.757+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=EGO8NTJWX8UM tag=217R1MM1AAII type=write size=3791912 2024-09-05T00:56:11.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.761+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~FM7QQ8S6XGTT.0 size=1048576 2024-09-05T00:56:11.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.765+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~FM7QQ8S6XGTT.1 size=891274 2024-09-05T00:56:11.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.765+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=FM7QQ8S6XGTT tag=3YGWPBYYY4RM type=write size=2988426 2024-09-05T00:56:11.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.769+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.0 size=1048576 2024-09-05T00:56:11.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.769+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.1 size=1048576 2024-09-05T00:56:11.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.773+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~67XQJE9C9JGO.2 size=171002 2024-09-05T00:56:11.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.777+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=67XQJE9C9JGO tag=O3D8SMT4EKQU type=write size=3316730 2024-09-05T00:56:11.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.781+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=UBQ1AMMVE8CU type=del size=895034 2024-09-05T00:56:11.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.785+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.0 size=1048576 2024-09-05T00:56:11.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.785+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.1 size=1048576 2024-09-05T00:56:11.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.789+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~DHVO783GQBBA.2 size=108546 2024-09-05T00:56:11.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.793+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=DHVO783GQBBA tag=ZF087DXZ9S4E type=write size=3254274 2024-09-05T00:56:11.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.797+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~R7NANY8HG6QG.0 size=1048576 2024-09-05T00:56:11.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.801+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~R7NANY8HG6QG.1 size=45105 2024-09-05T00:56:11.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.801+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=R7NANY8HG6QG tag=R0TPSU80K77J type=write size=2142257 2024-09-05T00:56:11.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.805+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.0 size=1048576 2024-09-05T00:56:11.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.805+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.1 size=1048576 2024-09-05T00:56:11.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.809+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~193O1QDLCN1U.2 size=353547 2024-09-05T00:56:11.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.813+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=193O1QDLCN1U tag=93LH86236QEG type=write size=3499275 2024-09-05T00:56:11.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.817+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=MWHKYOY26SUA type=write size=1037231 2024-09-05T00:56:11.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.821+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~Q3CT8EX17WTT.0 size=676553 2024-09-05T00:56:11.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.825+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=Q3CT8EX17WTT tag=X552GNISWXM6 type=write size=1725129 2024-09-05T00:56:11.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.829+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~143JSS0F4HXM.0 size=1048576 2024-09-05T00:56:11.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.833+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~143JSS0F4HXM.1 size=1029607 2024-09-05T00:56:11.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.833+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=143JSS0F4HXM tag=0IN8K7GFJ5F7 type=write size=3126759 2024-09-05T00:56:11.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.833+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.0 size=1048576 2024-09-05T00:56:11.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.837+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.1 size=1048576 2024-09-05T00:56:11.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.837+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~IJX3VORDQTJ4.2 size=266217 2024-09-05T00:56:11.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.841+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=IJX3VORDQTJ4 tag=8CQ31XYVZ3CR type=write size=3411945 2024-09-05T00:56:11.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.845+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=XJOXX7601BPP type=del size=2743010 2024-09-05T00:56:11.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.845+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~H5NVARTONI1A.0 size=306646 2024-09-05T00:56:11.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.849+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=H5NVARTONI1A tag=UIZOC96Q3XU0 type=write size=1355222 2024-09-05T00:56:11.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.853+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=MKP1SVGQ0VAA type=del size=2389455 2024-09-05T00:56:11.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.857+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=D15AS058ANNH type=del size=2686231 2024-09-05T00:56:11.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.861+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=4VTMLEQ7OQN1 type=del size=3589082 2024-09-05T00:56:11.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.861+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=DADS6DGSORWA type=write size=294694 2024-09-05T00:56:11.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.865+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=S0GU8J3099GI type=del size=3242276 2024-09-05T00:56:11.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.869+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=961UN8OOWPA9 type=write size=187775 2024-09-05T00:56:11.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.869+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=OU9QEF8AR5BU type=del size=1331424 2024-09-05T00:56:11.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.873+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.0 size=1048576 2024-09-05T00:56:11.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.877+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.1 size=1048576 2024-09-05T00:56:11.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.877+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~B0PSVPIVMSHI.2 size=941337 2024-09-05T00:56:11.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.885+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=B0PSVPIVMSHI tag=4XORNOMJE9SN type=write size=4087065 2024-09-05T00:56:11.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.885+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=KG1DN515XN5K type=del size=87265 2024-09-05T00:56:11.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.889+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~ELL45FJTJ5F2.0 size=994361 2024-09-05T00:56:11.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.897+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=ELL45FJTJ5F2 tag=Y9XD0OBM1FAH type=write size=2042937 2024-09-05T00:56:11.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.897+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=QWVPS35L8P3D type=del size=973653 2024-09-05T00:56:11.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.901+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.0 size=1048576 2024-09-05T00:56:11.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.901+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.1 size=1048576 2024-09-05T00:56:11.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.905+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~MF97GID00AA3.2 size=745457 2024-09-05T00:56:11.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.909+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=MF97GID00AA3 tag=THXY4LI11EST type=write size=3891185 2024-09-05T00:56:11.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.913+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=KLRKXWCCCJAK type=del size=477952 2024-09-05T00:56:11.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.917+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~J7WJ1QVTULOL.0 size=1048576 2024-09-05T00:56:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.917+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~J7WJ1QVTULOL.1 size=932258 2024-09-05T00:56:11.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.921+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=J7WJ1QVTULOL tag=9ZNXP306G0GA type=write size=3029410 2024-09-05T00:56:11.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.929+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~C8M01BG1KZ7Y.0 size=882576 2024-09-05T00:56:11.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.929+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=C8M01BG1KZ7Y tag=UV44ZC4EBI5K type=write size=1931152 2024-09-05T00:56:11.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.933+0000 7f325adab8c0 1 < suggested remove operation key=D6HSFIRN2X4Q tag=99OPBUNFXXYP type=write 2024-09-05T00:56:11.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.937+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=AW1BTJWZ5M37 type=del size=2172793 2024-09-05T00:56:11.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.937+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~4OC6E3VHA5EG.0 size=1048576 2024-09-05T00:56:11.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.941+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~4OC6E3VHA5EG.1 size=114045 2024-09-05T00:56:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.949+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=4OC6E3VHA5EG tag=EI6NWRJIPCH1 type=write size=2211197 2024-09-05T00:56:11.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.953+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~L5J26D1FN9XA.0 size=1048576 2024-09-05T00:56:11.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.953+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~L5J26D1FN9XA.1 size=310646 2024-09-05T00:56:11.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.953+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=L5J26D1FN9XA tag=KZ48W5JR6HCO type=write size=2407798 2024-09-05T00:56:11.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.957+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~FM7QQ8S6XGTT.0 size=1048576 2024-09-05T00:56:11.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.961+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~FM7QQ8S6XGTT.1 size=891274 2024-09-05T00:56:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.965+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=FM7QQ8S6XGTT tag=3YGWPBYYY4RM type=write size=2988426 2024-09-05T00:56:11.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.969+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.0 size=1048576 2024-09-05T00:56:11.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.969+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.1 size=1048576 2024-09-05T00:56:11.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.973+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.2 size=588978 2024-09-05T00:56:11.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.973+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=CB5C4NND4QG5 tag=NB3ZBW3AYPN5 type=write size=3734706 2024-09-05T00:56:11.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.977+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=UBQ1AMMVE8CU type=del size=895034 2024-09-05T00:56:11.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.981+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=GJUEO2N4OHRC type=del size=3907881 2024-09-05T00:56:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.981+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~R7NANY8HG6QG.0 size=1048576 2024-09-05T00:56:11.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.985+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~R7NANY8HG6QG.1 size=45105 2024-09-05T00:56:11.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.989+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=R7NANY8HG6QG tag=R0TPSU80K77J type=write size=2142257 2024-09-05T00:56:11.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.989+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=YIWVNHUYFOG5 type=del size=3307323 2024-09-05T00:56:11.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.993+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=MWHKYOY26SUA type=write size=1037231 2024-09-05T00:56:12.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:11.997+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=O9QPDPFGJFMF type=del size=4040786 2024-09-05T00:56:12.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.001+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~143JSS0F4HXM.0 size=1048576 2024-09-05T00:56:12.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.001+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~143JSS0F4HXM.1 size=1029607 2024-09-05T00:56:12.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.005+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=143JSS0F4HXM tag=0IN8K7GFJ5F7 type=write size=3126759 2024-09-05T00:56:12.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.009+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=X7QBTPTWGQCP type=del size=3686325 2024-09-05T00:56:12.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.009+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=XJOXX7601BPP type=del 2024-09-05T00:56:12.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.013+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.0 size=1048576 2024-09-05T00:56:12.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.017+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.1 size=1048576 2024-09-05T00:56:12.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.017+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.2 size=66818 2024-09-05T00:56:12.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.017+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=GIFXX8L80XAE tag=XXZ8019S0N0B type=write size=3212546 2024-09-05T00:56:12.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.021+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=MKP1SVGQ0VAA type=del 2024-09-05T00:56:12.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.021+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=B69TXVUD3HV5 type=write size=925896 2024-09-05T00:56:12.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.025+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=4VTMLEQ7OQN1 type=del 2024-09-05T00:56:12.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.029+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=QCY2OGU1HW09 type=del size=2438664 2024-09-05T00:56:12.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.029+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=S0GU8J3099GI type=del 2024-09-05T00:56:12.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.033+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=MUOH2EZDH85V type=del size=493653 2024-09-05T00:56:12.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.037+0000 7f325adab8c0 1 < suggested remove operation key=71FWV15GD1QZ tag=OU9QEF8AR5BU type=del 2024-09-05T00:56:12.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.041+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=SRI916YENMGP type=del size=4149587 2024-09-05T00:56:12.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.041+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=KG1DN515XN5K type=del 2024-09-05T00:56:12.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.045+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~YD6B39N1VHU8.0 size=158268 2024-09-05T00:56:12.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.045+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=YD6B39N1VHU8 tag=MH0P8SWNU0JO type=write size=1206844 2024-09-05T00:56:12.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.049+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=QWVPS35L8P3D type=del 2024-09-05T00:56:12.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.053+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.0 size=1048576 2024-09-05T00:56:12.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.057+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.1 size=1048576 2024-09-05T00:56:12.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.057+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.2 size=904734 2024-09-05T00:56:12.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.057+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=R63MOU4SED1W tag=XAAJIGU4P9NO type=write size=4050462 2024-09-05T00:56:12.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.061+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=KLRKXWCCCJAK type=del 2024-09-05T00:56:12.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.065+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~NX86O86HNOMH.0 size=1028267 2024-09-05T00:56:12.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.065+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=NX86O86HNOMH tag=GAPQV0YM75NA type=write size=2076843 2024-09-05T00:56:12.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.069+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~C8M01BG1KZ7Y.0 size=882576 2024-09-05T00:56:12.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.073+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=C8M01BG1KZ7Y tag=UV44ZC4EBI5K type=write size=1931152 2024-09-05T00:56:12.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.077+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=4HKDS41XQQWS type=del size=3782843 2024-09-05T00:56:12.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.077+0000 7f325adab8c0 -1 < failed to complete operation key=71FWV15GD1QZ tag=AW1BTJWZ5M37 type=del size=2172793: (22) Invalid argument 2024-09-05T00:56:12.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.081+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=TH8J1BV3FBZ0 type=del size=1997242 2024-09-05T00:56:12.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.085+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~L5J26D1FN9XA.0 size=1048576 2024-09-05T00:56:12.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.085+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~L5J26D1FN9XA.1 size=310646 2024-09-05T00:56:12.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.093+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=L5J26D1FN9XA tag=KZ48W5JR6HCO type=write size=2407798 2024-09-05T00:56:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.093+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=C2A2B30SAXYM type=write size=578609 2024-09-05T00:56:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.097+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.0 size=1048576 2024-09-05T00:56:12.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.097+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.1 size=1048576 2024-09-05T00:56:12.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.101+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~CB5C4NND4QG5.2 size=588978 2024-09-05T00:56:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.105+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=CB5C4NND4QG5 tag=NB3ZBW3AYPN5 type=write size=3734706 2024-09-05T00:56:12.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.109+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.0 size=1048576 2024-09-05T00:56:12.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.113+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.1 size=1048576 2024-09-05T00:56:12.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.117+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.2 size=170873 2024-09-05T00:56:12.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.117+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=7D7M10HVKVQ4 tag=BPROE2Z0LFAK type=write size=3316601 2024-09-05T00:56:12.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.117+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=GJUEO2N4OHRC type=del 2024-09-05T00:56:12.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.121+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=AM680M38B9H6 type=write size=244714 2024-09-05T00:56:12.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.125+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=YIWVNHUYFOG5 type=del 2024-09-05T00:56:12.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.129+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=QF72EL4WIW9A type=del size=1987269 2024-09-05T00:56:12.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.133+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=O9QPDPFGJFMF type=del 2024-09-05T00:56:12.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.133+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=F36FKAFLFUJ8 type=del size=3922707 2024-09-05T00:56:12.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.137+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=X7QBTPTWGQCP type=del 2024-09-05T00:56:12.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.141+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=U03HPZ9KAC0V type=del size=1075688 2024-09-05T00:56:12.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.145+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.0 size=1048576 2024-09-05T00:56:12.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.145+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.1 size=1048576 2024-09-05T00:56:12.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.145+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~GIFXX8L80XAE.2 size=66818 2024-09-05T00:56:12.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.153+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=GIFXX8L80XAE tag=XXZ8019S0N0B type=write size=3212546 2024-09-05T00:56:12.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.157+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~YYT8Z303NAO6.0 size=890322 2024-09-05T00:56:12.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.157+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=YYT8Z303NAO6 tag=R0MPOL02PIP3 type=write size=1938898 2024-09-05T00:56:12.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.161+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=B69TXVUD3HV5 type=write size=925896 2024-09-05T00:56:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.169+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~6BG3J1JRLTQ1.0 size=1048576 2024-09-05T00:56:12.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.169+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~6BG3J1JRLTQ1.1 size=953196 2024-09-05T00:56:12.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.169+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=6BG3J1JRLTQ1 tag=I2IYHB22KFA3 type=write size=3050348 2024-09-05T00:56:12.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.177+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=QCY2OGU1HW09 type=del size=2438664 2024-09-05T00:56:12.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.181+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=QED7UQE80URO type=del size=523727 2024-09-05T00:56:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.181+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=MUOH2EZDH85V type=del 2024-09-05T00:56:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.189+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.0 size=1048576 2024-09-05T00:56:12.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.193+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.1 size=1048576 2024-09-05T00:56:12.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.193+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.2 size=729084 2024-09-05T00:56:12.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.193+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=LY19NP2KSB13 tag=1D9W3GJSSERA type=write size=3874812 2024-09-05T00:56:12.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.197+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=SRI916YENMGP type=del 2024-09-05T00:56:12.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.205+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=NOI2AX0KA8TW type=write size=633269 2024-09-05T00:56:12.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.205+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~YD6B39N1VHU8.0 size=158268 2024-09-05T00:56:12.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.213+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=YD6B39N1VHU8 tag=MH0P8SWNU0JO type=write size=1206844 2024-09-05T00:56:12.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.217+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~MEXTKLBZX40M.0 size=23297 2024-09-05T00:56:12.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.217+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=MEXTKLBZX40M tag=9B5WR6AOQ3DD type=write size=1071873 2024-09-05T00:56:12.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.221+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.0 size=1048576 2024-09-05T00:56:12.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.221+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.1 size=1048576 2024-09-05T00:56:12.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.225+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~R63MOU4SED1W.2 size=904734 2024-09-05T00:56:12.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.229+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=R63MOU4SED1W tag=XAAJIGU4P9NO type=write size=4050462 2024-09-05T00:56:12.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.233+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=MXN6ETZXVF0G type=del size=3377991 2024-09-05T00:56:12.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.237+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~NX86O86HNOMH.0 size=1028267 2024-09-05T00:56:12.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.241+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=NX86O86HNOMH tag=GAPQV0YM75NA type=write size=2076843 2024-09-05T00:56:12.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.245+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=8QYMRXYXEUCQ type=del size=81517 2024-09-05T00:56:12.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.249+0000 7f325adab8c0 1 < canceled operation key=06YHJGLZQLK6 tag=4HKDS41XQQWS type=del size=3782843 2024-09-05T00:56:12.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.249+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=D8O921IPAJ0R type=del size=2640680 2024-09-05T00:56:12.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.253+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=TH8J1BV3FBZ0 type=del 2024-09-05T00:56:12.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.257+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=XDTVKZBVXZFM type=del size=3452321 2024-09-05T00:56:12.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.261+0000 7f325adab8c0 1 < completed write operation key=9O7DVR04PCDB tag=C2A2B30SAXYM type=write size=578609 2024-09-05T00:56:12.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.265+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.0 size=1048576 2024-09-05T00:56:12.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.269+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.1 size=1048576 2024-09-05T00:56:12.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.269+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.2 size=722076 2024-09-05T00:56:12.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.269+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=GW4CC8N0VIW9 tag=9CRM59YUZF15 type=write size=3867804 2024-09-05T00:56:12.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.273+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.0 size=1048576 2024-09-05T00:56:12.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.277+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.1 size=1048576 2024-09-05T00:56:12.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.277+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~7D7M10HVKVQ4.2 size=170873 2024-09-05T00:56:12.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.281+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=7D7M10HVKVQ4 tag=BPROE2Z0LFAK type=write size=3316601 2024-09-05T00:56:12.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.285+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=L334AG7HJV5J type=write size=548923 2024-09-05T00:56:12.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.293+0000 7f325adab8c0 1 < suggested remove operation key=CB079FGXKNRO tag=AM680M38B9H6 type=write 2024-09-05T00:56:12.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.297+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~8F1GD391RBKI.0 size=1048576 2024-09-05T00:56:12.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.301+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~8F1GD391RBKI.1 size=153163 2024-09-05T00:56:12.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.301+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=8F1GD391RBKI tag=4L2O71W8I1DU type=write size=2250315 2024-09-05T00:56:12.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.301+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=QF72EL4WIW9A type=del 2024-09-05T00:56:12.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.309+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~GPQTCZ0DYXHX.0 size=531155 2024-09-05T00:56:12.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.309+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=GPQTCZ0DYXHX tag=SRBA4Y5GAWN1 type=write size=1579731 2024-09-05T00:56:12.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.309+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=F36FKAFLFUJ8 type=del 2024-09-05T00:56:12.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.317+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.0 size=1048576 2024-09-05T00:56:12.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.317+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.1 size=1048576 2024-09-05T00:56:12.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.321+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.2 size=575122 2024-09-05T00:56:12.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.321+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=KDVDI0VNN5RD tag=RP9ZE5GPR8PI type=write size=3720850 2024-09-05T00:56:12.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.325+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=U03HPZ9KAC0V type=del 2024-09-05T00:56:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.329+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=W5DWNHMY88RW type=del size=1207189 2024-09-05T00:56:12.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.329+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~YYT8Z303NAO6.0 size=890322 2024-09-05T00:56:12.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.333+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=YYT8Z303NAO6 tag=R0MPOL02PIP3 type=write size=1938898 2024-09-05T00:56:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.341+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~HDBN3OHOEWTY.0 size=1048576 2024-09-05T00:56:12.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.341+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~HDBN3OHOEWTY.1 size=478127 2024-09-05T00:56:12.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.341+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=HDBN3OHOEWTY tag=16D4VNB8GPQV type=write size=2575279 2024-09-05T00:56:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.345+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~6BG3J1JRLTQ1.0 size=1048576 2024-09-05T00:56:12.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.349+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~6BG3J1JRLTQ1.1 size=953196 2024-09-05T00:56:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.353+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=6BG3J1JRLTQ1 tag=I2IYHB22KFA3 type=write size=3050348 2024-09-05T00:56:12.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.357+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~RZAYUS6ECP3Y.0 size=600086 2024-09-05T00:56:12.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.357+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=RZAYUS6ECP3Y tag=B6GWLDUS5MPS type=write size=1648662 2024-09-05T00:56:12.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.361+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=QED7UQE80URO type=del 2024-09-05T00:56:12.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.365+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=1JA5PETDJVJW type=del size=963341 2024-09-05T00:56:12.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.365+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.0 size=1048576 2024-09-05T00:56:12.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.369+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.1 size=1048576 2024-09-05T00:56:12.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.369+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~LY19NP2KSB13.2 size=729084 2024-09-05T00:56:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.373+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=LY19NP2KSB13 tag=1D9W3GJSSERA type=write size=3874812 2024-09-05T00:56:12.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.381+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.0 size=1048576 2024-09-05T00:56:12.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.381+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.1 size=1048576 2024-09-05T00:56:12.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.385+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.2 size=345729 2024-09-05T00:56:12.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.385+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=BEK42GG4E3H9 tag=7TBD523DFF1S type=write size=3491457 2024-09-05T00:56:12.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.389+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=NOI2AX0KA8TW type=write 2024-09-05T00:56:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.393+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=VI0SO7YMANKN type=del size=77881 2024-09-05T00:56:12.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.397+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~MEXTKLBZX40M.0 size=23297 2024-09-05T00:56:12.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.401+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=MEXTKLBZX40M tag=9B5WR6AOQ3DD type=write size=1071873 2024-09-05T00:56:12.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.405+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=P2YJP5UTQNB1 type=del size=2807435 2024-09-05T00:56:12.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.405+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=MXN6ETZXVF0G type=del 2024-09-05T00:56:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.413+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MQ7MBXOJWBQX.0 size=1048576 2024-09-05T00:56:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.413+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MQ7MBXOJWBQX.1 size=390913 2024-09-05T00:56:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.413+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=MQ7MBXOJWBQX tag=AM5H2AJ8707P type=write size=2488065 2024-09-05T00:56:12.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.417+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=8QYMRXYXEUCQ type=del 2024-09-05T00:56:12.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.421+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~CHLKZ6EDLP81.0 size=502433 2024-09-05T00:56:12.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.421+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=CHLKZ6EDLP81 tag=A700PLA91BQ1 type=write size=1551009 2024-09-05T00:56:12.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.425+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=D8O921IPAJ0R type=del 2024-09-05T00:56:12.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.429+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=L49JSLSMKPGN type=write size=85436 2024-09-05T00:56:12.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.433+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=XDTVKZBVXZFM type=del 2024-09-05T00:56:12.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.433+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=402P2S2BZHL1 type=del size=978436 2024-09-05T00:56:12.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.437+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.0 size=1048576 2024-09-05T00:56:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.437+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.1 size=1048576 2024-09-05T00:56:12.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.441+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~GW4CC8N0VIW9.2 size=722076 2024-09-05T00:56:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.445+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=GW4CC8N0VIW9 tag=9CRM59YUZF15 type=write size=3867804 2024-09-05T00:56:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.453+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~QJ9OI0Z480Z8.0 size=693639 2024-09-05T00:56:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.453+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=QJ9OI0Z480Z8 tag=6QR2P0SXSK0K type=write size=1742215 2024-09-05T00:56:12.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.457+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=L334AG7HJV5J type=write size=548923 2024-09-05T00:56:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.457+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=H3104KT272V0 type=write size=436055 2024-09-05T00:56:12.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.461+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~8F1GD391RBKI.0 size=1048576 2024-09-05T00:56:12.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.461+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~8F1GD391RBKI.1 size=153163 2024-09-05T00:56:12.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.465+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=8F1GD391RBKI tag=4L2O71W8I1DU type=write size=2250315 2024-09-05T00:56:12.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.469+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=T42C295TWMQQ type=del size=1698796 2024-09-05T00:56:12.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.473+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~GPQTCZ0DYXHX.0 size=531155 2024-09-05T00:56:12.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.481+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=GPQTCZ0DYXHX tag=SRBA4Y5GAWN1 type=write size=1579731 2024-09-05T00:56:12.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.485+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=5J8Z5Y1QIIV5 type=del size=892366 2024-09-05T00:56:12.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.485+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.0 size=1048576 2024-09-05T00:56:12.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.489+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.1 size=1048576 2024-09-05T00:56:12.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.493+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~KDVDI0VNN5RD.2 size=575122 2024-09-05T00:56:12.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.497+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=KDVDI0VNN5RD tag=RP9ZE5GPR8PI type=write size=3720850 2024-09-05T00:56:12.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.505+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~8XY4AZBNWLL7.0 size=571941 2024-09-05T00:56:12.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.505+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=8XY4AZBNWLL7 tag=QUZ5F4CXJR59 type=write size=1620517 2024-09-05T00:56:12.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.505+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=W5DWNHMY88RW type=del 2024-09-05T00:56:12.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.513+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~R0IMZ2JY9BV6.0 size=1048576 2024-09-05T00:56:12.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.517+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~R0IMZ2JY9BV6.1 size=214143 2024-09-05T00:56:12.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.517+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=R0IMZ2JY9BV6 tag=TS5JXABRJFPF type=write size=2311295 2024-09-05T00:56:12.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.521+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~HDBN3OHOEWTY.0 size=1048576 2024-09-05T00:56:12.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.521+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~HDBN3OHOEWTY.1 size=478127 2024-09-05T00:56:12.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.529+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=HDBN3OHOEWTY tag=16D4VNB8GPQV type=write size=2575279 2024-09-05T00:56:12.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.533+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=OLZYYYX9OD7J type=del size=789657 2024-09-05T00:56:12.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.533+0000 7f325adab8c0 1 < canceled part key=_multipart_9O7DVR04PCDB.2~RZAYUS6ECP3Y.0 size=600086 2024-09-05T00:56:12.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.537+0000 7f325adab8c0 1 < canceled multipart upload key=9O7DVR04PCDB upload=RZAYUS6ECP3Y tag=B6GWLDUS5MPS type=write size=1648662 2024-09-05T00:56:12.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.545+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.0 size=1048576 2024-09-05T00:56:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.545+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.1 size=1048576 2024-09-05T00:56:12.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.549+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.2 size=1043733 2024-09-05T00:56:12.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.549+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=7GSEDOMXAJGF tag=MIEI2U2L58FD type=write size=4189461 2024-09-05T00:56:12.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.553+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=1JA5PETDJVJW type=del 2024-09-05T00:56:12.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.557+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=BBWN7Q870ZWS type=del size=3973913 2024-09-05T00:56:12.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.561+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.0 size=1048576 2024-09-05T00:56:12.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.561+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.1 size=1048576 2024-09-05T00:56:12.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.565+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~BEK42GG4E3H9.2 size=345729 2024-09-05T00:56:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.569+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=BEK42GG4E3H9 tag=7TBD523DFF1S type=write size=3491457 2024-09-05T00:56:12.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.573+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=TTX85WC3XCD6 type=del size=187760 2024-09-05T00:56:12.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.577+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=VI0SO7YMANKN type=del 2024-09-05T00:56:12.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.581+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.0 size=1048576 2024-09-05T00:56:12.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.585+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.1 size=1048576 2024-09-05T00:56:12.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.585+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.2 size=665647 2024-09-05T00:56:12.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.585+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=99FTOJLQTK5M tag=L4GVXZ3YTKPN type=write size=3811375 2024-09-05T00:56:12.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.589+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=P2YJP5UTQNB1 type=del 2024-09-05T00:56:12.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.597+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.0 size=1048576 2024-09-05T00:56:12.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.597+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.1 size=1048576 2024-09-05T00:56:12.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.601+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.2 size=934590 2024-09-05T00:56:12.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.601+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=1LL6CSDGYGCM tag=COZ8UH5WOHXG type=write size=4080318 2024-09-05T00:56:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.605+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MQ7MBXOJWBQX.0 size=1048576 2024-09-05T00:56:12.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.605+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MQ7MBXOJWBQX.1 size=390913 2024-09-05T00:56:12.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.609+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=MQ7MBXOJWBQX tag=AM5H2AJ8707P type=write size=2488065 2024-09-05T00:56:12.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.613+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=DHD4HJGCJ5EJ type=del size=2581855 2024-09-05T00:56:12.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.617+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~CHLKZ6EDLP81.0 size=502433 2024-09-05T00:56:12.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.621+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=CHLKZ6EDLP81 tag=A700PLA91BQ1 type=write size=1551009 2024-09-05T00:56:12.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.625+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=8HVGSJG8AX1V type=del size=1649163 2024-09-05T00:56:12.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.629+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=L49JSLSMKPGN type=write size=85436 2024-09-05T00:56:12.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.633+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=848EKPBVN0BQ type=del size=1234361 2024-09-05T00:56:12.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.637+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=402P2S2BZHL1 type=del 2024-09-05T00:56:12.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.641+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=ZWSAEGNYXD1G type=del size=3234458 2024-09-05T00:56:12.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.645+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~QJ9OI0Z480Z8.0 size=693639 2024-09-05T00:56:12.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.649+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=QJ9OI0Z480Z8 tag=6QR2P0SXSK0K type=write size=1742215 2024-09-05T00:56:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.653+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=KFL6RS5MFKVW type=del size=4056067 2024-09-05T00:56:12.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.657+0000 7f325adab8c0 1 < completed write operation key=079QFDETDGGC tag=H3104KT272V0 type=write size=436055 2024-09-05T00:56:12.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.661+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=OOYNGQO1LLF7 type=del size=2399049 2024-09-05T00:56:12.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.665+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=T42C295TWMQQ type=del 2024-09-05T00:56:12.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.669+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~BKVVOFE3ABSV.0 size=23237 2024-09-05T00:56:12.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.669+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=BKVVOFE3ABSV tag=C4QS2TLEZA8E type=write size=1071813 2024-09-05T00:56:12.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.673+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=5J8Z5Y1QIIV5 type=del 2024-09-05T00:56:12.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.677+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=08OOGLVUA3F7 type=write size=95651 2024-09-05T00:56:12.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.681+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~8XY4AZBNWLL7.0 size=571941 2024-09-05T00:56:12.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.685+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=8XY4AZBNWLL7 tag=QUZ5F4CXJR59 type=write size=1620517 2024-09-05T00:56:12.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.689+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=E9WAQE9EDW80 type=write size=11596 2024-09-05T00:56:12.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.693+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~R0IMZ2JY9BV6.0 size=1048576 2024-09-05T00:56:12.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.693+0000 7f325adab8c0 1 < canceled part key=_multipart_YG43HSBBCRKH.2~R0IMZ2JY9BV6.1 size=214143 2024-09-05T00:56:12.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.697+0000 7f325adab8c0 1 < canceled multipart upload key=YG43HSBBCRKH upload=R0IMZ2JY9BV6 tag=TS5JXABRJFPF type=write size=2311295 2024-09-05T00:56:12.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.701+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~L7MVCFDICLIE.0 size=96512 2024-09-05T00:56:12.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.701+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=L7MVCFDICLIE tag=8FPOMIEV5NCS type=write size=1145088 2024-09-05T00:56:12.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.705+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=OLZYYYX9OD7J type=del 2024-09-05T00:56:12.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.709+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=Q6WEKVTFUNE0 type=write size=967840 2024-09-05T00:56:12.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.713+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.0 size=1048576 2024-09-05T00:56:12.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.713+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.1 size=1048576 2024-09-05T00:56:12.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.717+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~7GSEDOMXAJGF.2 size=1043733 2024-09-05T00:56:12.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.721+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=7GSEDOMXAJGF tag=MIEI2U2L58FD type=write size=4189461 2024-09-05T00:56:12.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.729+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~UM2NY8ZRF35I.0 size=428599 2024-09-05T00:56:12.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.729+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=UM2NY8ZRF35I tag=OGIX2GNYN4SX type=write size=1477175 2024-09-05T00:56:12.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.729+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=BBWN7Q870ZWS type=del 2024-09-05T00:56:12.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.733+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=TNNQL7Z8N9ZB type=del size=455637 2024-09-05T00:56:12.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.741+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=TTX85WC3XCD6 type=del 2024-09-05T00:56:12.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.745+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~AFLRX2IUOSFK.0 size=1048576 2024-09-05T00:56:12.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.749+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~AFLRX2IUOSFK.1 size=137731 2024-09-05T00:56:12.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.749+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=AFLRX2IUOSFK tag=PH3SG8GBWL6B type=write size=2234883 2024-09-05T00:56:12.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.749+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.0 size=1048576 2024-09-05T00:56:12.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.753+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.1 size=1048576 2024-09-05T00:56:12.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.757+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~99FTOJLQTK5M.2 size=665647 2024-09-05T00:56:12.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.761+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=99FTOJLQTK5M tag=L4GVXZ3YTKPN type=write size=3811375 2024-09-05T00:56:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.769+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.0 size=1048576 2024-09-05T00:56:12.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.769+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.1 size=1048576 2024-09-05T00:56:12.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.777+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.2 size=776292 2024-09-05T00:56:12.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.777+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=F3D3IL1TGYOE tag=TX6JT22ZPM05 type=write size=3922020 2024-09-05T00:56:12.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.781+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.0 size=1048576 2024-09-05T00:56:12.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.781+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.1 size=1048576 2024-09-05T00:56:12.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.785+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1LL6CSDGYGCM.2 size=934590 2024-09-05T00:56:12.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.789+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=1LL6CSDGYGCM tag=COZ8UH5WOHXG type=write size=4080318 2024-09-05T00:56:12.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.793+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=23D9TYX2R4UU type=del size=3366804 2024-09-05T00:56:12.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.797+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=DHD4HJGCJ5EJ type=del 2024-09-05T00:56:12.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.805+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~W7ZJSKJSKNL9.0 size=247054 2024-09-05T00:56:12.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.805+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=W7ZJSKJSKNL9 tag=NXC505391W5T type=write size=1295630 2024-09-05T00:56:12.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.805+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=8HVGSJG8AX1V type=del 2024-09-05T00:56:12.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.813+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~HFV4PQNMX6W0.0 size=1048576 2024-09-05T00:56:12.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.813+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~HFV4PQNMX6W0.1 size=891208 2024-09-05T00:56:12.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.813+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=HFV4PQNMX6W0 tag=6BFS9MIQ5SHN type=write size=2988360 2024-09-05T00:56:12.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.821+0000 7f325adab8c0 1 < suggested remove operation key=YG43HSBBCRKH tag=848EKPBVN0BQ type=del 2024-09-05T00:56:12.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.825+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=3IW277C5BT2K type=del size=1444834 2024-09-05T00:56:12.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.833+0000 7f325adab8c0 1 < suggested remove operation key=GU25IIQWQNR2 tag=ZWSAEGNYXD1G type=del 2024-09-05T00:56:12.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.837+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VOR6WFT2S3V8.0 size=82811 2024-09-05T00:56:12.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.837+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=VOR6WFT2S3V8 tag=AQYSFSCDFFV4 type=write size=1131387 2024-09-05T00:56:12.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.841+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=KFL6RS5MFKVW type=del 2024-09-05T00:56:12.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.845+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=IX1B9QZLI6JU type=del size=604729 2024-09-05T00:56:12.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.849+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=OOYNGQO1LLF7 type=del 2024-09-05T00:56:12.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.853+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=70AJOWS4GXQB type=del size=3513827 2024-09-05T00:56:12.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.857+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~BKVVOFE3ABSV.0 size=23237 2024-09-05T00:56:12.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.861+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=BKVVOFE3ABSV tag=C4QS2TLEZA8E type=write size=1071813 2024-09-05T00:56:12.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.865+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=YV4UUH6EG40X type=del size=284534 2024-09-05T00:56:12.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.869+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=08OOGLVUA3F7 type=write size=95651 2024-09-05T00:56:12.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.873+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.0 size=1048576 2024-09-05T00:56:12.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.877+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.1 size=1048576 2024-09-05T00:56:12.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.881+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.2 size=504825 2024-09-05T00:56:12.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.881+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=9P1JKDP8OU0S tag=DNWNVMPE5M7Q type=write size=3650553 2024-09-05T00:56:12.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.881+0000 7f325adab8c0 -1 < failed to complete operation key=JKRZR0KRE93F tag=E9WAQE9EDW80 type=write size=11596: (22) Invalid argument 2024-09-05T00:56:12.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.889+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~F6SK3Q7NJ8SK.0 size=1048576 2024-09-05T00:56:12.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.893+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~F6SK3Q7NJ8SK.1 size=556255 2024-09-05T00:56:12.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.893+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=F6SK3Q7NJ8SK tag=2KF9S0W62LTG type=write size=2653407 2024-09-05T00:56:12.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.893+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~L7MVCFDICLIE.0 size=96512 2024-09-05T00:56:12.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.901+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=L7MVCFDICLIE tag=8FPOMIEV5NCS type=write size=1145088 2024-09-05T00:56:12.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.905+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=BXRN7Q4CHY1N type=del size=1234662 2024-09-05T00:56:12.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.909+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=Q6WEKVTFUNE0 type=write size=967840 2024-09-05T00:56:12.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.909+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=BFPK8S802066 type=write size=194823 2024-09-05T00:56:12.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.913+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~UM2NY8ZRF35I.0 size=428599 2024-09-05T00:56:12.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.917+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=UM2NY8ZRF35I tag=OGIX2GNYN4SX type=write size=1477175 2024-09-05T00:56:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.921+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=7O4QLE8JEC3Y type=del size=1077174 2024-09-05T00:56:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.925+0000 7f325adab8c0 -1 < failed to complete operation key=JKRZR0KRE93F tag=TNNQL7Z8N9ZB type=del size=455637: (22) Invalid argument 2024-09-05T00:56:12.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.933+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.0 size=1048576 2024-09-05T00:56:12.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.933+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.1 size=1048576 2024-09-05T00:56:12.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.937+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.2 size=642283 2024-09-05T00:56:12.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.937+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=HEGK2Y75F33W tag=VC163YFQDP4D type=write size=3788011 2024-09-05T00:56:12.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.941+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~AFLRX2IUOSFK.0 size=1048576 2024-09-05T00:56:12.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.945+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~AFLRX2IUOSFK.1 size=137731 2024-09-05T00:56:12.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.949+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=AFLRX2IUOSFK tag=PH3SG8GBWL6B type=write size=2234883 2024-09-05T00:56:12.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.953+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=98YYAV5EK1H6 type=del size=3767029 2024-09-05T00:56:12.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.957+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.0 size=1048576 2024-09-05T00:56:12.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.957+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.1 size=1048576 2024-09-05T00:56:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.961+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~F3D3IL1TGYOE.2 size=776292 2024-09-05T00:56:12.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.969+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=F3D3IL1TGYOE tag=TX6JT22ZPM05 type=write size=3922020 2024-09-05T00:56:12.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.969+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=XG4RW1OPCLOA type=del size=1265712 2024-09-05T00:56:12.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.973+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=23D9TYX2R4UU type=del 2024-09-05T00:56:12.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.977+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=NFHJSKUVDJ79 type=write size=459281 2024-09-05T00:56:12.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.981+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~W7ZJSKJSKNL9.0 size=247054 2024-09-05T00:56:12.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.985+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=W7ZJSKJSKNL9 tag=NXC505391W5T type=write size=1295630 2024-09-05T00:56:12.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.993+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~F3T5A01V3IAM.0 size=447309 2024-09-05T00:56:12.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.993+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=F3T5A01V3IAM tag=F3K93DL3V3FY type=write size=1495885 2024-09-05T00:56:12.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.997+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~HFV4PQNMX6W0.0 size=1048576 2024-09-05T00:56:13.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:12.997+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~HFV4PQNMX6W0.1 size=891208 2024-09-05T00:56:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.005+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=HFV4PQNMX6W0 tag=6BFS9MIQ5SHN type=write size=2988360 2024-09-05T00:56:13.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.009+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=S28H6SEYYMMT type=del size=2189955 2024-09-05T00:56:13.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.013+0000 7f325adab8c0 1 < suggested remove operation key=6N7BLJ1WLDGN tag=3IW277C5BT2K type=del 2024-09-05T00:56:13.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.017+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=HFEQHC1Y6NX7 type=del size=3282230 2024-09-05T00:56:13.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.021+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VOR6WFT2S3V8.0 size=82811 2024-09-05T00:56:13.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.025+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=VOR6WFT2S3V8 tag=AQYSFSCDFFV4 type=write size=1131387 2024-09-05T00:56:13.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.033+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~L0H6BQ25WMRE.0 size=337427 2024-09-05T00:56:13.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.033+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=L0H6BQ25WMRE tag=L1H124G3VHXS type=write size=1386003 2024-09-05T00:56:13.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.033+0000 7f325adab8c0 1 < canceled operation key=J9UIQE3CKYHM tag=IX1B9QZLI6JU type=del size=604729 2024-09-05T00:56:13.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.037+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=GMKZ972S4CH0 type=del size=158054 2024-09-05T00:56:13.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.045+0000 7f325adab8c0 1 < suggested update operation key=GF6OC9O60D5E tag=70AJOWS4GXQB type=del size=3513827 2024-09-05T00:56:13.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.045+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=48UCL0790IPG type=write size=744302 2024-09-05T00:56:13.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.049+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=YV4UUH6EG40X type=del 2024-09-05T00:56:13.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.057+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~9V0LZOQVLQLC.0 size=1048576 2024-09-05T00:56:13.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.057+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~9V0LZOQVLQLC.1 size=130025 2024-09-05T00:56:13.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.057+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=9V0LZOQVLQLC tag=LKY9UAKBXVEV type=write size=2227177 2024-09-05T00:56:13.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.057+0000 7f325adab8c0 1 < canceled part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.0 size=1048576 2024-09-05T00:56:13.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.061+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.1 size=1048576 2024-09-05T00:56:13.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.061+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~9P1JKDP8OU0S.2 size=504825 2024-09-05T00:56:13.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.069+0000 7f325adab8c0 1 < canceled multipart upload key=VYMRZPO6VKGS upload=9P1JKDP8OU0S tag=DNWNVMPE5M7Q type=write size=3650553 2024-09-05T00:56:13.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.069+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=FI4ZFGE1RG0O type=del size=2449148 2024-09-05T00:56:13.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.073+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~F6SK3Q7NJ8SK.0 size=1048576 2024-09-05T00:56:13.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.077+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~F6SK3Q7NJ8SK.1 size=556255 2024-09-05T00:56:13.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.085+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=F6SK3Q7NJ8SK tag=2KF9S0W62LTG type=write size=2653407 2024-09-05T00:56:13.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.089+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=X55ZL24R3PH0 type=del size=1351094 2024-09-05T00:56:13.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.093+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=BXRN7Q4CHY1N type=del 2024-09-05T00:56:13.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.097+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~QGH6ECH8GKP9.0 size=777293 2024-09-05T00:56:13.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.097+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=QGH6ECH8GKP9 tag=6PQ98FIMGTKU type=write size=1825869 2024-09-05T00:56:13.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.105+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=BFPK8S802066 type=write size=194823 2024-09-05T00:56:13.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.109+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=3I44KRY0ACTV type=del size=696392 2024-09-05T00:56:13.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.113+0000 7f325adab8c0 1 < canceled operation key=MAS6EB753KO9 tag=7O4QLE8JEC3Y type=del size=1077174 2024-09-05T00:56:13.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.117+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=VFUX44R1KQHC type=write size=729907 2024-09-05T00:56:13.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.117+0000 7f325adab8c0 1 < canceled part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.0 size=1048576 2024-09-05T00:56:13.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.117+0000 7f325adab8c0 1 < canceled part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.1 size=1048576 2024-09-05T00:56:13.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.121+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~HEGK2Y75F33W.2 size=642283 2024-09-05T00:56:13.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.125+0000 7f325adab8c0 1 < canceled multipart upload key=YG43HSBBCRKH upload=HEGK2Y75F33W tag=VC163YFQDP4D type=write size=3788011 2024-09-05T00:56:13.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.129+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=E2BWDQJRX5WR type=del size=472243 2024-09-05T00:56:13.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.133+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=98YYAV5EK1H6 type=del 2024-09-05T00:56:13.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.133+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=IDRDPINAYBTU type=del size=1969296 2024-09-05T00:56:13.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.137+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=XG4RW1OPCLOA type=del 2024-09-05T00:56:13.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.145+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5K17R0MTRAWN.0 size=1048576 2024-09-05T00:56:13.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.149+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5K17R0MTRAWN.1 size=618125 2024-09-05T00:56:13.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.149+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=5K17R0MTRAWN tag=1U0HU8I0O0BI type=write size=2715277 2024-09-05T00:56:13.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.153+0000 7f325adab8c0 1 < suggested update operation key=71FWV15GD1QZ tag=NFHJSKUVDJ79 type=write size=459281 2024-09-05T00:56:13.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.157+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=SSDX6RZBGI3S type=del size=1159238 2024-09-05T00:56:13.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.161+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~F3T5A01V3IAM.0 size=447309 2024-09-05T00:56:13.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.165+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=F3T5A01V3IAM tag=F3K93DL3V3FY type=write size=1495885 2024-09-05T00:56:13.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.173+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~VAYDCAGSBPKV.0 size=1048576 2024-09-05T00:56:13.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.173+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~VAYDCAGSBPKV.1 size=849580 2024-09-05T00:56:13.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.173+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=VAYDCAGSBPKV tag=YLZJW0L2Y2VD type=write size=2946732 2024-09-05T00:56:13.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.177+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=S28H6SEYYMMT type=del 2024-09-05T00:56:13.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.185+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~ITNHR5NLVA31.0 size=1048576 2024-09-05T00:56:13.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.185+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~ITNHR5NLVA31.1 size=716707 2024-09-05T00:56:13.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.185+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=ITNHR5NLVA31 tag=WXPVV01QK461 type=write size=2813859 2024-09-05T00:56:13.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.189+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=HFEQHC1Y6NX7 type=del 2024-09-05T00:56:13.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.193+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~WAZL61DF23FD.0 size=1048576 2024-09-05T00:56:13.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.197+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~WAZL61DF23FD.1 size=702655 2024-09-05T00:56:13.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.197+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=WAZL61DF23FD tag=4327MIC2UJ5S type=write size=2799807 2024-09-05T00:56:13.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.201+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~L0H6BQ25WMRE.0 size=337427 2024-09-05T00:56:13.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.205+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=L0H6BQ25WMRE tag=L1H124G3VHXS type=write size=1386003 2024-09-05T00:56:13.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.209+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=A0F6CSS0R8IS type=del size=4058402 2024-09-05T00:56:13.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.213+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=GMKZ972S4CH0 type=del 2024-09-05T00:56:13.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.217+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~A08E0F44O7EQ.0 size=457536 2024-09-05T00:56:13.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.217+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=A08E0F44O7EQ tag=IIRRQUGP1DIV type=write size=1506112 2024-09-05T00:56:13.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.221+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=48UCL0790IPG type=write size=744302 2024-09-05T00:56:13.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.229+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~I0S9UVDN05E6.0 size=814419 2024-09-05T00:56:13.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.229+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=I0S9UVDN05E6 tag=QEN6DYMT4Y2X type=write size=1862995 2024-09-05T00:56:13.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.229+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~9V0LZOQVLQLC.0 size=1048576 2024-09-05T00:56:13.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.233+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~9V0LZOQVLQLC.1 size=130025 2024-09-05T00:56:13.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.237+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=9V0LZOQVLQLC tag=LKY9UAKBXVEV type=write size=2227177 2024-09-05T00:56:13.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.241+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=SQU0IB1BM6Q6 type=del size=981801 2024-09-05T00:56:13.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.245+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=FI4ZFGE1RG0O type=del 2024-09-05T00:56:13.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.249+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.0 size=1048576 2024-09-05T00:56:13.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.253+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.1 size=1048576 2024-09-05T00:56:13.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.257+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.2 size=448242 2024-09-05T00:56:13.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.257+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=9J1EA49AMO7S tag=5VMZXV7VAXEZ type=write size=3593970 2024-09-05T00:56:13.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.261+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=X55ZL24R3PH0 type=del 2024-09-05T00:56:13.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.269+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.0 size=1048576 2024-09-05T00:56:13.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.273+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.1 size=1048576 2024-09-05T00:56:13.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.273+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.2 size=568257 2024-09-05T00:56:13.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.273+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=LNBT5TK5G2QO tag=MSEUDPAOMIUG type=write size=3713985 2024-09-05T00:56:13.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.277+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~QGH6ECH8GKP9.0 size=777293 2024-09-05T00:56:13.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.285+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=QGH6ECH8GKP9 tag=6PQ98FIMGTKU type=write size=1825869 2024-09-05T00:56:13.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.285+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=OSIO01CTZO0V type=write size=91715 2024-09-05T00:56:13.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.289+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=3I44KRY0ACTV type=del 2024-09-05T00:56:13.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.293+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=O5924PZCKC99 type=del size=982769 2024-09-05T00:56:13.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.297+0000 7f325adab8c0 1 < completed write operation key=NIAW4BKW21LG tag=VFUX44R1KQHC type=write size=729907 2024-09-05T00:56:13.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.297+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=NG2UICVXTP2H type=write size=411006 2024-09-05T00:56:13.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.301+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=E2BWDQJRX5WR type=del 2024-09-05T00:56:13.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.305+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.0 size=1048576 2024-09-05T00:56:13.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.309+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.1 size=1048576 2024-09-05T00:56:13.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.313+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.2 size=419853 2024-09-05T00:56:13.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.313+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=E3JKHD0JLS8B tag=9EJUTVO7EWU9 type=write size=3565581 2024-09-05T00:56:13.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.317+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=IDRDPINAYBTU type=del 2024-09-05T00:56:13.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.321+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~OKMRX29VKINW.0 size=1048576 2024-09-05T00:56:13.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.325+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~OKMRX29VKINW.1 size=494483 2024-09-05T00:56:13.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.325+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=OKMRX29VKINW tag=7DC4M3U4UD3Q type=write size=2591635 2024-09-05T00:56:13.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.329+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5K17R0MTRAWN.0 size=1048576 2024-09-05T00:56:13.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.329+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5K17R0MTRAWN.1 size=618125 2024-09-05T00:56:13.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.337+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=5K17R0MTRAWN tag=1U0HU8I0O0BI type=write size=2715277 2024-09-05T00:56:13.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.337+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=HXBCH74LCTVR type=del size=87993 2024-09-05T00:56:13.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.341+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=SSDX6RZBGI3S type=del 2024-09-05T00:56:13.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.345+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=8TOKRNVX93JG type=del size=2396648 2024-09-05T00:56:13.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.345+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~VAYDCAGSBPKV.0 size=1048576 2024-09-05T00:56:13.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.349+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~VAYDCAGSBPKV.1 size=849580 2024-09-05T00:56:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.353+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=VAYDCAGSBPKV tag=YLZJW0L2Y2VD type=write size=2946732 2024-09-05T00:56:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.357+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=X5HS2W5QPOEM type=del size=1908059 2024-09-05T00:56:13.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.361+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~ITNHR5NLVA31.0 size=1048576 2024-09-05T00:56:13.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.361+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~ITNHR5NLVA31.1 size=716707 2024-09-05T00:56:13.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.365+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=ITNHR5NLVA31 tag=WXPVV01QK461 type=write size=2813859 2024-09-05T00:56:13.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.369+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=UOF4KI3R3A5N type=write size=523216 2024-09-05T00:56:13.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.373+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~WAZL61DF23FD.0 size=1048576 2024-09-05T00:56:13.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.373+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~WAZL61DF23FD.1 size=702655 2024-09-05T00:56:13.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.381+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=WAZL61DF23FD tag=4327MIC2UJ5S type=write size=2799807 2024-09-05T00:56:13.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.385+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~DAD9WQPHTGIW.0 size=315992 2024-09-05T00:56:13.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.385+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=DAD9WQPHTGIW tag=L11RJNTF4OQ9 type=write size=1364568 2024-09-05T00:56:13.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.389+0000 7f325adab8c0 1 < suggested remove operation key=EGPVSV2PFILM tag=A0F6CSS0R8IS type=del 2024-09-05T00:56:13.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.393+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=APH1FM0D8MFG type=del size=3280083 2024-09-05T00:56:13.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.393+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~A08E0F44O7EQ.0 size=457536 2024-09-05T00:56:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.397+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=A08E0F44O7EQ tag=IIRRQUGP1DIV type=write size=1506112 2024-09-05T00:56:13.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.401+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=4HZ2TICX8TV0 type=del size=2585135 2024-09-05T00:56:13.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.405+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~I0S9UVDN05E6.0 size=814419 2024-09-05T00:56:13.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.409+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=I0S9UVDN05E6 tag=QEN6DYMT4Y2X type=write size=1862995 2024-09-05T00:56:13.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.409+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=P52N8BFCX120 type=write size=560225 2024-09-05T00:56:13.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.413+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=SQU0IB1BM6Q6 type=del 2024-09-05T00:56:13.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.417+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=AFTMNNTH2R5V type=write size=366514 2024-09-05T00:56:13.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.417+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.0 size=1048576 2024-09-05T00:56:13.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.421+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.1 size=1048576 2024-09-05T00:56:13.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.421+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~9J1EA49AMO7S.2 size=448242 2024-09-05T00:56:13.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.425+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=9J1EA49AMO7S tag=5VMZXV7VAXEZ type=write size=3593970 2024-09-05T00:56:13.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.433+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.0 size=1048576 2024-09-05T00:56:13.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.433+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.1 size=1048576 2024-09-05T00:56:13.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.437+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.2 size=859162 2024-09-05T00:56:13.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.437+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=VZ6N3FDAOBS6 tag=214EI0KMBBVH type=write size=4004890 2024-09-05T00:56:13.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.437+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.0 size=1048576 2024-09-05T00:56:13.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.437+0000 7f325adab8c0 1 < canceled part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.1 size=1048576 2024-09-05T00:56:13.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.441+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~LNBT5TK5G2QO.2 size=568257 2024-09-05T00:56:13.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.445+0000 7f325adab8c0 1 < canceled multipart upload key=MYR9H12B5YYV upload=LNBT5TK5G2QO tag=MSEUDPAOMIUG type=write size=3713985 2024-09-05T00:56:13.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.449+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1A8IW9FXCYJO.0 size=78919 2024-09-05T00:56:13.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.449+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=1A8IW9FXCYJO tag=SSTD63MD1ICS type=write size=1127495 2024-09-05T00:56:13.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.453+0000 7f325adab8c0 1 < suggested update operation key=5WOUI4SHYTSS tag=OSIO01CTZO0V type=write size=91715 2024-09-05T00:56:13.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.457+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=HFLR87KG844V type=del size=485826 2024-09-05T00:56:13.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.457+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=O5924PZCKC99 type=del 2024-09-05T00:56:13.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.461+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=9VM571EC8NRE type=del size=1780045 2024-09-05T00:56:13.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.461+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=NG2UICVXTP2H type=write size=411006 2024-09-05T00:56:13.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.465+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=M50RRXQRNSE1 type=write size=470522 2024-09-05T00:56:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.469+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.0 size=1048576 2024-09-05T00:56:13.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.469+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.1 size=1048576 2024-09-05T00:56:13.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.469+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~E3JKHD0JLS8B.2 size=419853 2024-09-05T00:56:13.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.473+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=E3JKHD0JLS8B tag=9EJUTVO7EWU9 type=write size=3565581 2024-09-05T00:56:13.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.477+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=EC9XID3DZSMY type=del size=2291326 2024-09-05T00:56:13.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.477+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~OKMRX29VKINW.0 size=1048576 2024-09-05T00:56:13.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.481+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~OKMRX29VKINW.1 size=494483 2024-09-05T00:56:13.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.485+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=OKMRX29VKINW tag=7DC4M3U4UD3Q type=write size=2591635 2024-09-05T00:56:13.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.489+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=C037VG5P3O3F type=del size=320931 2024-09-05T00:56:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.489+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=HXBCH74LCTVR type=del 2024-09-05T00:56:13.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.493+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~N7MQ36NERA5V.0 size=1048576 2024-09-05T00:56:13.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.497+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~N7MQ36NERA5V.1 size=664308 2024-09-05T00:56:13.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.497+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=N7MQ36NERA5V tag=SPGDV4V9XZAY type=write size=2761460 2024-09-05T00:56:13.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.497+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=8TOKRNVX93JG type=del 2024-09-05T00:56:13.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.501+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=4SZK3JAZTEUI type=del size=3844935 2024-09-05T00:56:13.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.501+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=X5HS2W5QPOEM type=del 2024-09-05T00:56:13.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.505+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=0H7AJ2HKF0EK type=del size=1957939 2024-09-05T00:56:13.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.509+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=UOF4KI3R3A5N type=write size=523216 2024-09-05T00:56:13.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.509+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=F4JTFHZ1624X type=del size=2170976 2024-09-05T00:56:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.513+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~DAD9WQPHTGIW.0 size=315992 2024-09-05T00:56:13.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.517+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=DAD9WQPHTGIW tag=L11RJNTF4OQ9 type=write size=1364568 2024-09-05T00:56:13.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.517+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=IVJU9GUXSAF8 type=del size=3460756 2024-09-05T00:56:13.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.521+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=APH1FM0D8MFG type=del 2024-09-05T00:56:13.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.525+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~B0JT1ROZQF5K.0 size=1048576 2024-09-05T00:56:13.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.525+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~B0JT1ROZQF5K.1 size=448979 2024-09-05T00:56:13.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.525+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=B0JT1ROZQF5K tag=4RP91OLVZ6BV type=write size=2546131 2024-09-05T00:56:13.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.529+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=4HZ2TICX8TV0 type=del 2024-09-05T00:56:13.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.533+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~VP8LEK35LQC2.0 size=189141 2024-09-05T00:56:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.533+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=VP8LEK35LQC2 tag=P7XCOFSNJL9W type=write size=1237717 2024-09-05T00:56:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.537+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=P52N8BFCX120 type=write size=560225 2024-09-05T00:56:13.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.537+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=13O4B6SBZHSM type=del size=3951651 2024-09-05T00:56:13.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.541+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=AFTMNNTH2R5V type=write size=366514 2024-09-05T00:56:13.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.545+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=IDYPR7XY1CZ8 type=del size=2282444 2024-09-05T00:56:13.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.545+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.0 size=1048576 2024-09-05T00:56:13.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.549+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.1 size=1048576 2024-09-05T00:56:13.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.549+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~VZ6N3FDAOBS6.2 size=859162 2024-09-05T00:56:13.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.553+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=VZ6N3FDAOBS6 tag=214EI0KMBBVH type=write size=4004890 2024-09-05T00:56:13.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.557+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=YMUPPRF16WQM type=del size=309172 2024-09-05T00:56:13.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.561+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1A8IW9FXCYJO.0 size=78919 2024-09-05T00:56:13.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.561+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=1A8IW9FXCYJO tag=SSTD63MD1ICS type=write size=1127495 2024-09-05T00:56:13.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.565+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=08W0LPLMMOZW type=del size=727459 2024-09-05T00:56:13.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.569+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=HFLR87KG844V type=del 2024-09-05T00:56:13.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.569+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=I0QN2G8PIH4L type=del size=1685436 2024-09-05T00:56:13.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.573+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=9VM571EC8NRE type=del 2024-09-05T00:56:13.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.577+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=XHX83BK6PDN5 type=del size=450667 2024-09-05T00:56:13.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.577+0000 7f325adab8c0 1 < completed write operation key=GF6OC9O60D5E tag=M50RRXQRNSE1 type=write size=470522 2024-09-05T00:56:13.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.581+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=K24BC4Q5Z5ON type=write size=518947 2024-09-05T00:56:13.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.585+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=EC9XID3DZSMY type=del 2024-09-05T00:56:13.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.585+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=2RF8WP1HFW82 type=del size=3053968 2024-09-05T00:56:13.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.589+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=C037VG5P3O3F type=del 2024-09-05T00:56:13.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.589+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=RJ2V9B1UG37E type=del size=642672 2024-09-05T00:56:13.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.593+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~N7MQ36NERA5V.0 size=1048576 2024-09-05T00:56:13.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.597+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~N7MQ36NERA5V.1 size=664308 2024-09-05T00:56:13.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.601+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=N7MQ36NERA5V tag=SPGDV4V9XZAY type=write size=2761460 2024-09-05T00:56:13.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.601+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=V5DFTYMSEE8D type=del size=3525938 2024-09-05T00:56:13.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.609+0000 7f325adab8c0 1 < suggested update operation key=9O7DVR04PCDB tag=4SZK3JAZTEUI type=del size=3844935 2024-09-05T00:56:13.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.613+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=PR4YIC0AM0O1 type=write size=678631 2024-09-05T00:56:13.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.617+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=0H7AJ2HKF0EK type=del size=1957939 2024-09-05T00:56:13.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.621+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~7N1X2UB806JG.0 size=1048576 2024-09-05T00:56:13.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.625+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~7N1X2UB806JG.1 size=135201 2024-09-05T00:56:13.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.625+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=7N1X2UB806JG tag=03XNOGA2JFG1 type=write size=2232353 2024-09-05T00:56:13.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.625+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=F4JTFHZ1624X type=del 2024-09-05T00:56:13.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.629+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=V74208PG8RDZ type=write size=205100 2024-09-05T00:56:13.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.633+0000 7f325adab8c0 1 < suggested remove operation key=SP188HM5LG2D tag=IVJU9GUXSAF8 type=del 2024-09-05T00:56:13.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.637+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=BVH1GFAGY5P7 type=del size=2389434 2024-09-05T00:56:13.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.637+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~B0JT1ROZQF5K.0 size=1048576 2024-09-05T00:56:13.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.641+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~B0JT1ROZQF5K.1 size=448979 2024-09-05T00:56:13.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.645+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=B0JT1ROZQF5K tag=4RP91OLVZ6BV type=write size=2546131 2024-09-05T00:56:13.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.645+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=0UOSRGA6ERKF type=del size=548056 2024-09-05T00:56:13.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.649+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~VP8LEK35LQC2.0 size=189141 2024-09-05T00:56:13.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.653+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=VP8LEK35LQC2 tag=P7XCOFSNJL9W type=write size=1237717 2024-09-05T00:56:13.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.657+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=O5WNL6YPD1KI type=del size=1393899 2024-09-05T00:56:13.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.657+0000 7f325adab8c0 -1 < failed to complete operation key=9O7DVR04PCDB tag=13O4B6SBZHSM type=del size=3951651: (22) Invalid argument 2024-09-05T00:56:13.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.661+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=PUPYG2FRGBO4 type=write size=587437 2024-09-05T00:56:13.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.661+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=IDYPR7XY1CZ8 type=del 2024-09-05T00:56:13.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.669+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~8WSL5C68X9FH.0 size=1048576 2024-09-05T00:56:13.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.669+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~8WSL5C68X9FH.1 size=964934 2024-09-05T00:56:13.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.669+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=8WSL5C68X9FH tag=UBD6TLL2B995 type=write size=3062086 2024-09-05T00:56:13.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.673+0000 7f325adab8c0 1 < suggested update operation key=IGOUBVL3XVS3 tag=YMUPPRF16WQM type=del size=309172 2024-09-05T00:56:13.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.677+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.0 size=1048576 2024-09-05T00:56:13.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.681+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.1 size=1048576 2024-09-05T00:56:13.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.681+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.2 size=297451 2024-09-05T00:56:13.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.681+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=BDD2QEIZWW79 tag=7M80V8ZQMVQT type=write size=3443179 2024-09-05T00:56:13.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.689+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=08W0LPLMMOZW type=del 2024-09-05T00:56:13.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.689+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=33Q6ZE3112Z8 type=write size=1017454 2024-09-05T00:56:13.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.693+0000 7f325adab8c0 1 < canceled operation key=A9WMRV5QZ2FP tag=I0QN2G8PIH4L type=del size=1685436 2024-09-05T00:56:13.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.697+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.0 size=1048576 2024-09-05T00:56:13.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.697+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.1 size=1048576 2024-09-05T00:56:13.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.701+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.2 size=227422 2024-09-05T00:56:13.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.701+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=74BQKN6XT5H3 tag=GMBDRM6J0U0L type=write size=3373150 2024-09-05T00:56:13.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.705+0000 7f325adab8c0 1 < suggested update operation key=A9WMRV5QZ2FP tag=XHX83BK6PDN5 type=del size=450667 2024-09-05T00:56:13.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.709+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~3JF225JJONNA.0 size=884167 2024-09-05T00:56:13.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.709+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=3JF225JJONNA tag=NZXTLZXWYPRW type=write size=1932743 2024-09-05T00:56:13.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.709+0000 7f325adab8c0 1 < completed write operation key=71FWV15GD1QZ tag=K24BC4Q5Z5ON type=write size=518947 2024-09-05T00:56:13.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.713+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=R03DHV21LNIM type=del size=1518478 2024-09-05T00:56:13.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.717+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=2RF8WP1HFW82 type=del 2024-09-05T00:56:13.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.717+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=QEAG773A0OVF type=del size=4152674 2024-09-05T00:56:13.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.721+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=RJ2V9B1UG37E type=del 2024-09-05T00:56:13.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.725+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~AWF5ZNQJRG66.0 size=685239 2024-09-05T00:56:13.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.725+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=AWF5ZNQJRG66 tag=3NADX698A1IJ type=write size=1733815 2024-09-05T00:56:13.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.729+0000 7f325adab8c0 1 < canceled operation key=XKOECM0CCOKX tag=V5DFTYMSEE8D type=del size=3525938 2024-09-05T00:56:13.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.729+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=8ESAWHCM8PHT type=del size=4008478 2024-09-05T00:56:13.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.733+0000 7f325adab8c0 1 < canceled operation key=GU25IIQWQNR2 tag=PR4YIC0AM0O1 type=write size=678631 2024-09-05T00:56:13.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.737+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~312RQMLREINI.0 size=911756 2024-09-05T00:56:13.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.737+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=312RQMLREINI tag=2O6CUM47QJFO type=write size=1960332 2024-09-05T00:56:13.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.741+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~7N1X2UB806JG.0 size=1048576 2024-09-05T00:56:13.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.741+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~7N1X2UB806JG.1 size=135201 2024-09-05T00:56:13.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.745+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=7N1X2UB806JG tag=03XNOGA2JFG1 type=write size=2232353 2024-09-05T00:56:13.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.749+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~NII34VRIRTPN.0 size=1048576 2024-09-05T00:56:13.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.749+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~NII34VRIRTPN.1 size=563830 2024-09-05T00:56:13.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.749+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=NII34VRIRTPN tag=YCXWOQLN0BL7 type=write size=2660982 2024-09-05T00:56:13.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.753+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=V74208PG8RDZ type=write size=205100 2024-09-05T00:56:13.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.757+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=4ALVJ7SKV7O8 type=del size=1166881 2024-09-05T00:56:13.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.757+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=BVH1GFAGY5P7 type=del 2024-09-05T00:56:13.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.761+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=H393QWLV8YUI type=del size=2696689 2024-09-05T00:56:13.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.761+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=0UOSRGA6ERKF type=del 2024-09-05T00:56:13.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.765+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=A76ADWDIAC2Y type=del size=1728358 2024-09-05T00:56:13.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.769+0000 7f325adab8c0 1 < suggested update operation key=NIAW4BKW21LG tag=O5WNL6YPD1KI type=del size=1393899 2024-09-05T00:56:13.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.773+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~SFJ0RPU1NIJ5.0 size=629750 2024-09-05T00:56:13.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.773+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=SFJ0RPU1NIJ5 tag=I2VOOZJ2W4KP type=write size=1678326 2024-09-05T00:56:13.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.777+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=PUPYG2FRGBO4 type=write size=587437 2024-09-05T00:56:13.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.777+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=TNX22VTUKYDK type=write size=274486 2024-09-05T00:56:13.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.781+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~8WSL5C68X9FH.0 size=1048576 2024-09-05T00:56:13.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.781+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~8WSL5C68X9FH.1 size=964934 2024-09-05T00:56:13.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.785+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=8WSL5C68X9FH tag=UBD6TLL2B995 type=write size=3062086 2024-09-05T00:56:13.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.789+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=DSBXOVIPNRWC type=write size=256352 2024-09-05T00:56:13.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.789+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.0 size=1048576 2024-09-05T00:56:13.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.793+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.1 size=1048576 2024-09-05T00:56:13.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.793+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~BDD2QEIZWW79.2 size=297451 2024-09-05T00:56:13.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.797+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=BDD2QEIZWW79 tag=7M80V8ZQMVQT type=write size=3443179 2024-09-05T00:56:13.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.805+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.0 size=1048576 2024-09-05T00:56:13.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.805+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.1 size=1048576 2024-09-05T00:56:13.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.809+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.2 size=694721 2024-09-05T00:56:13.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.809+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=V037Y6Q3YNA3 tag=S4KUZFAD4UGO type=write size=3840449 2024-09-05T00:56:13.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.809+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=33Q6ZE3112Z8 type=write size=1017454 2024-09-05T00:56:13.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.813+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.0 size=1048576 2024-09-05T00:56:13.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.817+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.1 size=1048576 2024-09-05T00:56:13.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.817+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.2 size=117774 2024-09-05T00:56:13.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.817+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=QLA9LLMU3M9S tag=EM9R3IPWT8E2 type=write size=3263502 2024-09-05T00:56:13.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.821+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.0 size=1048576 2024-09-05T00:56:13.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.825+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.1 size=1048576 2024-09-05T00:56:13.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.825+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~74BQKN6XT5H3.2 size=227422 2024-09-05T00:56:13.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.829+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=74BQKN6XT5H3 tag=GMBDRM6J0U0L type=write size=3373150 2024-09-05T00:56:13.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.833+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=C1IAEHZLQQK0 type=del size=3566980 2024-09-05T00:56:13.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.833+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~3JF225JJONNA.0 size=884167 2024-09-05T00:56:13.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.841+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=3JF225JJONNA tag=NZXTLZXWYPRW type=write size=1932743 2024-09-05T00:56:13.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.841+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=RNUGZR1GH04A type=write size=385497 2024-09-05T00:56:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.845+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=R03DHV21LNIM type=del 2024-09-05T00:56:13.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.849+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~NT0S27TF78LL.0 size=1048576 2024-09-05T00:56:13.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.853+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~NT0S27TF78LL.1 size=249905 2024-09-05T00:56:13.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.853+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=NT0S27TF78LL tag=GA802ZXTJUMV type=write size=2347057 2024-09-05T00:56:13.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.853+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=QEAG773A0OVF type=del 2024-09-05T00:56:13.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.861+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~WUTW8LRUETOW.0 size=314473 2024-09-05T00:56:13.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.861+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=WUTW8LRUETOW tag=RJHDJJB0S53D type=write size=1363049 2024-09-05T00:56:13.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.861+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~AWF5ZNQJRG66.0 size=685239 2024-09-05T00:56:13.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.865+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=AWF5ZNQJRG66 tag=3NADX698A1IJ type=write size=1733815 2024-09-05T00:56:13.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.869+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.0 size=1048576 2024-09-05T00:56:13.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.873+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.1 size=1048576 2024-09-05T00:56:13.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.877+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.2 size=583764 2024-09-05T00:56:13.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.877+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=RWDVGZEE2JUA tag=9J0V1CAGIERE type=write size=3729492 2024-09-05T00:56:13.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.881+0000 7f325adab8c0 1 < suggested remove operation key=O0RSK2S88XHP tag=8ESAWHCM8PHT type=del 2024-09-05T00:56:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.885+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~6D3XF10SN9LB.0 size=51462 2024-09-05T00:56:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.885+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=6D3XF10SN9LB tag=7KFCZK2ESB2Q type=write size=1100038 2024-09-05T00:56:13.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.889+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~312RQMLREINI.0 size=911756 2024-09-05T00:56:13.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.893+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=312RQMLREINI tag=2O6CUM47QJFO type=write size=1960332 2024-09-05T00:56:13.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.901+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~JA1BS2MC7PXM.0 size=1048576 2024-09-05T00:56:13.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.901+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~JA1BS2MC7PXM.1 size=511452 2024-09-05T00:56:13.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.901+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=JA1BS2MC7PXM tag=39T02UJAF9XT type=write size=2608604 2024-09-05T00:56:13.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.905+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~NII34VRIRTPN.0 size=1048576 2024-09-05T00:56:13.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.905+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~NII34VRIRTPN.1 size=563830 2024-09-05T00:56:13.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.913+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=NII34VRIRTPN tag=YCXWOQLN0BL7 type=write size=2660982 2024-09-05T00:56:13.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.917+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.0 size=1048576 2024-09-05T00:56:13.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.917+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.1 size=1048576 2024-09-05T00:56:13.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.921+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.2 size=633073 2024-09-05T00:56:13.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.921+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=52GD0AJQGFRN tag=0Q0O075PTR1H type=write size=3778801 2024-09-05T00:56:13.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.921+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=4ALVJ7SKV7O8 type=del 2024-09-05T00:56:13.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.925+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=JEF3BAOCH26B type=del size=2264572 2024-09-05T00:56:13.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.929+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=H393QWLV8YUI type=del 2024-09-05T00:56:13.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.933+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=EMFL2UUGSM6M type=del size=1016561 2024-09-05T00:56:13.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.933+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=A76ADWDIAC2Y type=del 2024-09-05T00:56:13.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.937+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=YD5EVHVOMWPE type=del size=3240973 2024-09-05T00:56:13.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.941+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~SFJ0RPU1NIJ5.0 size=629750 2024-09-05T00:56:13.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.945+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=SFJ0RPU1NIJ5 tag=I2VOOZJ2W4KP type=write size=1678326 2024-09-05T00:56:13.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.945+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=I1NFMEXHJ7NC type=del size=3975027 2024-09-05T00:56:13.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.953+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=TNX22VTUKYDK type=write 2024-09-05T00:56:13.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.953+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=LDXP2V1Z4K1J type=del size=981225 2024-09-05T00:56:13.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.961+0000 7f325adab8c0 1 < suggested update operation key=IGOUBVL3XVS3 tag=DSBXOVIPNRWC type=write size=256352 2024-09-05T00:56:13.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.965+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.0 size=1048576 2024-09-05T00:56:13.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.965+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.1 size=1048576 2024-09-05T00:56:13.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.969+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.2 size=336421 2024-09-05T00:56:13.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.969+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=43XPAWBLSLTL tag=IGLHKE61TJCZ type=write size=3482149 2024-09-05T00:56:13.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.969+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.0 size=1048576 2024-09-05T00:56:13.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.969+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.1 size=1048576 2024-09-05T00:56:13.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.973+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~V037Y6Q3YNA3.2 size=694721 2024-09-05T00:56:13.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.977+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=V037Y6Q3YNA3 tag=S4KUZFAD4UGO type=write size=3840449 2024-09-05T00:56:13.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.981+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.0 size=1048576 2024-09-05T00:56:13.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.985+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.1 size=1048576 2024-09-05T00:56:13.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.985+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.2 size=604895 2024-09-05T00:56:13.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.985+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=BHZL891SBGYY tag=49V5SRG6BAHV type=write size=3750623 2024-09-05T00:56:13.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.989+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.0 size=1048576 2024-09-05T00:56:13.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.993+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.1 size=1048576 2024-09-05T00:56:13.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.993+0000 7f325adab8c0 1 < canceled part key=_multipart_GU25IIQWQNR2.2~QLA9LLMU3M9S.2 size=117774 2024-09-05T00:56:13.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.997+0000 7f325adab8c0 1 < canceled multipart upload key=GU25IIQWQNR2 upload=QLA9LLMU3M9S tag=EM9R3IPWT8E2 type=write size=3263502 2024-09-05T00:56:14.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:13.997+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=MQN8TL6QNIOF type=del size=1128706 2024-09-05T00:56:14.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.001+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=C1IAEHZLQQK0 type=del size=3566980 2024-09-05T00:56:14.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.001+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=VWVA5V5YL30X type=del size=4131510 2024-09-05T00:56:14.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.005+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=RNUGZR1GH04A type=write size=385497 2024-09-05T00:56:14.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.005+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=2Q7RGONMO0WF type=del size=2033652 2024-09-05T00:56:14.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.009+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~NT0S27TF78LL.0 size=1048576 2024-09-05T00:56:14.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.009+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~NT0S27TF78LL.1 size=249905 2024-09-05T00:56:14.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.013+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=NT0S27TF78LL tag=GA802ZXTJUMV type=write size=2347057 2024-09-05T00:56:14.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.017+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=076SA357XP9W type=del size=1249528 2024-09-05T00:56:14.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.021+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~WUTW8LRUETOW.0 size=314473 2024-09-05T00:56:14.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.021+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=WUTW8LRUETOW tag=RJHDJJB0S53D type=write size=1363049 2024-09-05T00:56:14.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.025+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~0U7HB4LEL7CS.0 size=1048576 2024-09-05T00:56:14.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.029+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~0U7HB4LEL7CS.1 size=839925 2024-09-05T00:56:14.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.029+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=0U7HB4LEL7CS tag=24A4JHO2P5LS type=write size=2937077 2024-09-05T00:56:14.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.029+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.0 size=1048576 2024-09-05T00:56:14.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.033+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.1 size=1048576 2024-09-05T00:56:14.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.033+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~RWDVGZEE2JUA.2 size=583764 2024-09-05T00:56:14.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.037+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=RWDVGZEE2JUA tag=9J0V1CAGIERE type=write size=3729492 2024-09-05T00:56:14.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.041+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.0 size=1048576 2024-09-05T00:56:14.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.041+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.1 size=1048576 2024-09-05T00:56:14.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.045+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.2 size=220287 2024-09-05T00:56:14.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.045+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=1KIQD5CNJ1YG tag=DAVLZ2S87A2V type=write size=3366015 2024-09-05T00:56:14.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.045+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~6D3XF10SN9LB.0 size=51462 2024-09-05T00:56:14.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.049+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=6D3XF10SN9LB tag=7KFCZK2ESB2Q type=write size=1100038 2024-09-05T00:56:14.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.053+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=MEW0ZE2EQHO9 type=del size=1659863 2024-09-05T00:56:14.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.057+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~JA1BS2MC7PXM.0 size=1048576 2024-09-05T00:56:14.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.057+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~JA1BS2MC7PXM.1 size=511452 2024-09-05T00:56:14.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.061+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=JA1BS2MC7PXM tag=39T02UJAF9XT type=write size=2608604 2024-09-05T00:56:14.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.065+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=WA7CHUG3YC10 type=del size=1758787 2024-09-05T00:56:14.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.069+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.0 size=1048576 2024-09-05T00:56:14.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.069+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.1 size=1048576 2024-09-05T00:56:14.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.073+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~52GD0AJQGFRN.2 size=633073 2024-09-05T00:56:14.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.073+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=52GD0AJQGFRN tag=0Q0O075PTR1H type=write size=3778801 2024-09-05T00:56:14.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.077+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=3PBQ27WYOUKW type=del size=354888 2024-09-05T00:56:14.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.081+0000 7f325adab8c0 1 < suggested remove operation key=5WOUI4SHYTSS tag=JEF3BAOCH26B type=del 2024-09-05T00:56:14.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.085+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.0 size=1048576 2024-09-05T00:56:14.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.089+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.1 size=1048576 2024-09-05T00:56:14.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.089+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.2 size=215958 2024-09-05T00:56:14.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.089+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=3428ULEO1XOE tag=SQK2GXK24K2O type=write size=3361686 2024-09-05T00:56:14.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.089+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=EMFL2UUGSM6M type=del 2024-09-05T00:56:14.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.093+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.0 size=1048576 2024-09-05T00:56:14.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.097+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.1 size=1048576 2024-09-05T00:56:14.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.097+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.2 size=301560 2024-09-05T00:56:14.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.097+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=74GV7Y3YNCVC tag=ZPW75QEU09XU type=write size=3447288 2024-09-05T00:56:14.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.101+0000 7f325adab8c0 -1 < failed to complete operation key=IGOUBVL3XVS3 tag=YD5EVHVOMWPE type=del size=3240973: (22) Invalid argument 2024-09-05T00:56:14.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.105+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~D3A06L058KC0.0 size=1048576 2024-09-05T00:56:14.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.105+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~D3A06L058KC0.1 size=837666 2024-09-05T00:56:14.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.105+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=D3A06L058KC0 tag=3QWLA1VKCIQD type=write size=2934818 2024-09-05T00:56:14.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.109+0000 7f325adab8c0 1 < suggested update operation key=MYR9H12B5YYV tag=I1NFMEXHJ7NC type=del size=3975027 2024-09-05T00:56:14.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.113+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~2HEOZTCQ4GWI.0 size=1048576 2024-09-05T00:56:14.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.117+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~2HEOZTCQ4GWI.1 size=891254 2024-09-05T00:56:14.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.117+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=2HEOZTCQ4GWI tag=HAQ2P2BSQGJN type=write size=2988406 2024-09-05T00:56:14.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.117+0000 7f325adab8c0 -1 < failed to complete operation key=MYR9H12B5YYV tag=LDXP2V1Z4K1J type=del size=981225: (22) Invalid argument 2024-09-05T00:56:14.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.121+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=0W0B57SVA6TO type=del size=1884543 2024-09-05T00:56:14.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.125+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.0 size=1048576 2024-09-05T00:56:14.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.125+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.1 size=1048576 2024-09-05T00:56:14.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.125+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~43XPAWBLSLTL.2 size=336421 2024-09-05T00:56:14.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.129+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=43XPAWBLSLTL tag=IGLHKE61TJCZ type=write size=3482149 2024-09-05T00:56:14.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.133+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~ERXYCD597PIP.0 size=1048576 2024-09-05T00:56:14.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.137+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~ERXYCD597PIP.1 size=661221 2024-09-05T00:56:14.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.137+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=ERXYCD597PIP tag=NLEDLP72XOLU type=write size=2758373 2024-09-05T00:56:14.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.137+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.0 size=1048576 2024-09-05T00:56:14.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.141+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.1 size=1048576 2024-09-05T00:56:14.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.141+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~BHZL891SBGYY.2 size=604895 2024-09-05T00:56:14.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.145+0000 7f325adab8c0 1 < canceled multipart upload key=XKOECM0CCOKX upload=BHZL891SBGYY tag=49V5SRG6BAHV type=write size=3750623 2024-09-05T00:56:14.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.145+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=ZRKBPFJWV0PD type=del size=3137340 2024-09-05T00:56:14.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.149+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=MQN8TL6QNIOF type=del size=1128706 2024-09-05T00:56:14.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.153+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~PI1ZB3A3UJ2V.0 size=1048576 2024-09-05T00:56:14.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.153+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~PI1ZB3A3UJ2V.1 size=564824 2024-09-05T00:56:14.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.153+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=PI1ZB3A3UJ2V tag=ECK5UPU3B82T type=write size=2661976 2024-09-05T00:56:14.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.157+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=VWVA5V5YL30X type=del 2024-09-05T00:56:14.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.161+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=D3DEJ89V4VFM type=del size=3233842 2024-09-05T00:56:14.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.161+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=2Q7RGONMO0WF type=del size=2033652 2024-09-05T00:56:14.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.165+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PEDF1WXJNC7E.0 size=1048576 2024-09-05T00:56:14.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.169+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PEDF1WXJNC7E.1 size=749624 2024-09-05T00:56:14.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.169+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=PEDF1WXJNC7E tag=B44RMXRKGR9T type=write size=2846776 2024-09-05T00:56:14.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.169+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=076SA357XP9W type=del size=1249528 2024-09-05T00:56:14.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.173+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~ZPT77GPDIBFN.0 size=344237 2024-09-05T00:56:14.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.173+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=ZPT77GPDIBFN tag=1PVVBSSWVT7N type=write size=1392813 2024-09-05T00:56:14.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.177+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~0U7HB4LEL7CS.0 size=1048576 2024-09-05T00:56:14.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.177+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~0U7HB4LEL7CS.1 size=839925 2024-09-05T00:56:14.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.181+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=0U7HB4LEL7CS tag=24A4JHO2P5LS type=write size=2937077 2024-09-05T00:56:14.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.185+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~XWKSF6RUDZWL.0 size=462535 2024-09-05T00:56:14.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.185+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=XWKSF6RUDZWL tag=3K2C3YIJ6I8K type=write size=1511111 2024-09-05T00:56:14.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.189+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.0 size=1048576 2024-09-05T00:56:14.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.189+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.1 size=1048576 2024-09-05T00:56:14.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.193+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~1KIQD5CNJ1YG.2 size=220287 2024-09-05T00:56:14.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.197+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=1KIQD5CNJ1YG tag=DAVLZ2S87A2V type=write size=3366015 2024-09-05T00:56:14.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.197+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=4S0FSTKAIB9G type=write size=261423 2024-09-05T00:56:14.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.201+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=MEW0ZE2EQHO9 type=del 2024-09-05T00:56:14.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.205+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=CPWO25H1RQVC type=del size=883951 2024-09-05T00:56:14.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.209+0000 7f325adab8c0 1 < suggested update operation key=XKOECM0CCOKX tag=WA7CHUG3YC10 type=del size=1758787 2024-09-05T00:56:14.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.213+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.0 size=1048576 2024-09-05T00:56:14.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.213+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.1 size=1048576 2024-09-05T00:56:14.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.217+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.2 size=292093 2024-09-05T00:56:14.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.217+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=57E926OMVMKU tag=2EVLPG9JN0JH type=write size=3437821 2024-09-05T00:56:14.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.217+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=3PBQ27WYOUKW type=del 2024-09-05T00:56:14.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.221+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=OCNSVR0UN3SR type=write size=254889 2024-09-05T00:56:14.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.225+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.0 size=1048576 2024-09-05T00:56:14.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.225+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.1 size=1048576 2024-09-05T00:56:14.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.229+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~3428ULEO1XOE.2 size=215958 2024-09-05T00:56:14.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.229+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=3428ULEO1XOE tag=SQK2GXK24K2O type=write size=3361686 2024-09-05T00:56:14.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.233+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=4HHRO5GIDIVS type=del size=2006504 2024-09-05T00:56:14.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.237+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.0 size=1048576 2024-09-05T00:56:14.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.237+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.1 size=1048576 2024-09-05T00:56:14.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.237+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~74GV7Y3YNCVC.2 size=301560 2024-09-05T00:56:14.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.241+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=74GV7Y3YNCVC tag=ZPW75QEU09XU type=write size=3447288 2024-09-05T00:56:14.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.245+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=OS8LFSXOLPO0 type=del size=745851 2024-09-05T00:56:14.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.249+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~D3A06L058KC0.0 size=1048576 2024-09-05T00:56:14.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.249+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~D3A06L058KC0.1 size=837666 2024-09-05T00:56:14.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.253+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=D3A06L058KC0 tag=3QWLA1VKCIQD type=write size=2934818 2024-09-05T00:56:14.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.257+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=78ZVENOSS1BR type=del size=1461407 2024-09-05T00:56:14.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.257+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~2HEOZTCQ4GWI.0 size=1048576 2024-09-05T00:56:14.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.261+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~2HEOZTCQ4GWI.1 size=891254 2024-09-05T00:56:14.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.261+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=2HEOZTCQ4GWI tag=HAQ2P2BSQGJN type=write size=2988406 2024-09-05T00:56:14.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.265+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=W2XOTTK7NP7X type=del size=264110 2024-09-05T00:56:14.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.269+0000 7f325adab8c0 1 < suggested remove operation key=6N7BLJ1WLDGN tag=0W0B57SVA6TO type=del 2024-09-05T00:56:14.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.273+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=5IW7WQPD5XYR type=write size=633998 2024-09-05T00:56:14.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.277+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~ERXYCD597PIP.0 size=1048576 2024-09-05T00:56:14.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.277+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~ERXYCD597PIP.1 size=661221 2024-09-05T00:56:14.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.281+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=ERXYCD597PIP tag=NLEDLP72XOLU type=write size=2758373 2024-09-05T00:56:14.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.285+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=J2W6VJ1TV0HI type=del size=1891078 2024-09-05T00:56:14.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.285+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=ZRKBPFJWV0PD type=del 2024-09-05T00:56:14.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.289+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.0 size=1048576 2024-09-05T00:56:14.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.293+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.1 size=1048576 2024-09-05T00:56:14.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.293+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.2 size=503439 2024-09-05T00:56:14.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.293+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=KUGZD9T012XB tag=XL5374WZJQES type=write size=3649167 2024-09-05T00:56:14.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.293+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~PI1ZB3A3UJ2V.0 size=1048576 2024-09-05T00:56:14.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.293+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~PI1ZB3A3UJ2V.1 size=564824 2024-09-05T00:56:14.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.297+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=PI1ZB3A3UJ2V tag=ECK5UPU3B82T type=write size=2661976 2024-09-05T00:56:14.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.301+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=4JDUQI1NSJWD type=del size=2281303 2024-09-05T00:56:14.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.301+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=D3DEJ89V4VFM type=del 2024-09-05T00:56:14.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.305+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=QWJR2GASGOJZ type=write size=301958 2024-09-05T00:56:14.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.305+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~PEDF1WXJNC7E.0 size=1048576 2024-09-05T00:56:14.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.309+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~PEDF1WXJNC7E.1 size=749624 2024-09-05T00:56:14.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.313+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=PEDF1WXJNC7E tag=B44RMXRKGR9T type=write size=2846776 2024-09-05T00:56:14.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.313+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=QNCH9M02FR6H type=del size=2381002 2024-09-05T00:56:14.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.317+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~ZPT77GPDIBFN.0 size=344237 2024-09-05T00:56:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.321+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=ZPT77GPDIBFN tag=1PVVBSSWVT7N type=write size=1392813 2024-09-05T00:56:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.321+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=BIJIWPBTN9M1 type=del size=3229160 2024-09-05T00:56:14.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.325+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~XWKSF6RUDZWL.0 size=462535 2024-09-05T00:56:14.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.329+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=XWKSF6RUDZWL tag=3K2C3YIJ6I8K type=write size=1511111 2024-09-05T00:56:14.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.333+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=51S9GFHRH98K type=del size=2041606 2024-09-05T00:56:14.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.333+0000 7f325adab8c0 1 < completed write operation key=EGPVSV2PFILM tag=4S0FSTKAIB9G type=write size=261423 2024-09-05T00:56:14.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.337+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=EGZRYQN8FBBY type=write size=4803 2024-09-05T00:56:14.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.341+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=CPWO25H1RQVC type=del 2024-09-05T00:56:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.341+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=631MNOR5ODDF type=del size=2979246 2024-09-05T00:56:14.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.345+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.0 size=1048576 2024-09-05T00:56:14.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.345+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.1 size=1048576 2024-09-05T00:56:14.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.349+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~57E926OMVMKU.2 size=292093 2024-09-05T00:56:14.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.353+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=57E926OMVMKU tag=2EVLPG9JN0JH type=write size=3437821 2024-09-05T00:56:14.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.353+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~IVBQVM8VF3S2.0 size=184099 2024-09-05T00:56:14.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.353+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=IVBQVM8VF3S2 tag=7FNI5RKZDGHM type=write size=1232675 2024-09-05T00:56:14.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.357+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=OCNSVR0UN3SR type=write size=254889 2024-09-05T00:56:14.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.357+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=NM2T0HCSQW12 type=del size=2959719 2024-09-05T00:56:14.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.361+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=4HHRO5GIDIVS type=del 2024-09-05T00:56:14.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.365+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=ANKF6M8AQKTF type=del size=751569 2024-09-05T00:56:14.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.365+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=OS8LFSXOLPO0 type=del 2024-09-05T00:56:14.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.369+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.0 size=1048576 2024-09-05T00:56:14.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.369+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.1 size=1048576 2024-09-05T00:56:14.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.373+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.2 size=412457 2024-09-05T00:56:14.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.373+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=2RTFIW8V88HX tag=8Q24OYS040KU type=write size=3558185 2024-09-05T00:56:14.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.377+0000 7f325adab8c0 1 < suggested update operation key=MAS6EB753KO9 tag=78ZVENOSS1BR type=del size=1461407 2024-09-05T00:56:14.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.377+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=X9RWMZZDIC9E type=del size=533813 2024-09-05T00:56:14.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.381+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=W2XOTTK7NP7X type=del 2024-09-05T00:56:14.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.385+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=PWRMC7ZRZQR3 type=write size=579093 2024-09-05T00:56:14.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.385+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=5IW7WQPD5XYR type=write size=633998 2024-09-05T00:56:14.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.389+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=XIUPPZ8FT38Z type=del size=2950301 2024-09-05T00:56:14.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.389+0000 7f325adab8c0 1 < canceled operation key=MYR9H12B5YYV tag=J2W6VJ1TV0HI type=del size=1891078 2024-09-05T00:56:14.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.393+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=NC6VQDLJY61R type=del size=1505050 2024-09-05T00:56:14.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.397+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.0 size=1048576 2024-09-05T00:56:14.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.397+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.1 size=1048576 2024-09-05T00:56:14.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.401+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~KUGZD9T012XB.2 size=503439 2024-09-05T00:56:14.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.405+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=KUGZD9T012XB tag=XL5374WZJQES type=write size=3649167 2024-09-05T00:56:14.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.405+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=46GIFTXZX1R1 type=del size=2979429 2024-09-05T00:56:14.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.409+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=4JDUQI1NSJWD type=del 2024-09-05T00:56:14.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.413+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=I0EJO8DGXZGC type=del size=3437826 2024-09-05T00:56:14.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.413+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=QWJR2GASGOJZ type=write size=301958 2024-09-05T00:56:14.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.417+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=VMSN613UCU23 type=del size=571934 2024-09-05T00:56:14.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.417+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=QNCH9M02FR6H type=del 2024-09-05T00:56:14.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.421+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=K0CAS83Q5HZS type=del size=1515952 2024-09-05T00:56:14.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.421+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=BIJIWPBTN9M1 type=del 2024-09-05T00:56:14.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.425+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~9ONQ35RYXFHX.0 size=1048576 2024-09-05T00:56:14.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.429+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~9ONQ35RYXFHX.1 size=651392 2024-09-05T00:56:14.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.429+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=9ONQ35RYXFHX tag=RFYSRP1GI6NM type=write size=2748544 2024-09-05T00:56:14.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.433+0000 7f325adab8c0 1 < suggested update operation key=MAS6EB753KO9 tag=51S9GFHRH98K type=del size=2041606 2024-09-05T00:56:14.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.437+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~45KUNW28TI0G.0 size=399630 2024-09-05T00:56:14.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.437+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=45KUNW28TI0G tag=ZB76XWVLKUMZ type=write size=1448206 2024-09-05T00:56:14.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.437+0000 7f325adab8c0 1 < completed write operation key=9O7DVR04PCDB tag=EGZRYQN8FBBY type=write size=4803 2024-09-05T00:56:14.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.441+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~OV5YF4PTP0T7.0 size=1048576 2024-09-05T00:56:14.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.445+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~OV5YF4PTP0T7.1 size=981759 2024-09-05T00:56:14.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.445+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=OV5YF4PTP0T7 tag=L1W9WJNUK794 type=write size=3078911 2024-09-05T00:56:14.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.445+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=631MNOR5ODDF type=del 2024-09-05T00:56:14.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.449+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~DPG010JWPE5S.0 size=807416 2024-09-05T00:56:14.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.449+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=DPG010JWPE5S tag=9RM6C7PBI2EL type=write size=1855992 2024-09-05T00:56:14.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.453+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~IVBQVM8VF3S2.0 size=184099 2024-09-05T00:56:14.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.457+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=IVBQVM8VF3S2 tag=7FNI5RKZDGHM type=write size=1232675 2024-09-05T00:56:14.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.457+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=TA39S4PXTW8D type=del size=1927544 2024-09-05T00:56:14.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.461+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=NM2T0HCSQW12 type=del 2024-09-05T00:56:14.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.465+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.0 size=1048576 2024-09-05T00:56:14.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.465+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.1 size=1048576 2024-09-05T00:56:14.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.469+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.2 size=580405 2024-09-05T00:56:14.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.469+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=K719FUKESYTZ tag=G390AF73TFIN type=write size=3726133 2024-09-05T00:56:14.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.473+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=ANKF6M8AQKTF type=del 2024-09-05T00:56:14.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.473+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=GV9V72SFV01D type=del size=2790128 2024-09-05T00:56:14.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.477+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.0 size=1048576 2024-09-05T00:56:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.477+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.1 size=1048576 2024-09-05T00:56:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.477+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~2RTFIW8V88HX.2 size=412457 2024-09-05T00:56:14.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.485+0000 7f325adab8c0 1 < canceled multipart upload key=GF6OC9O60D5E upload=2RTFIW8V88HX tag=8Q24OYS040KU type=write size=3558185 2024-09-05T00:56:14.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.485+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=QU9AF5QSXWFV type=del size=627561 2024-09-05T00:56:14.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.489+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=X9RWMZZDIC9E type=del 2024-09-05T00:56:14.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.493+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~C55K181AYHX2.0 size=1048576 2024-09-05T00:56:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.493+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~C55K181AYHX2.1 size=624813 2024-09-05T00:56:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.493+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=C55K181AYHX2 tag=8MMIW85OYTB7 type=write size=2721965 2024-09-05T00:56:14.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.497+0000 7f325adab8c0 1 < completed write operation key=VYMRZPO6VKGS tag=PWRMC7ZRZQR3 type=write size=579093 2024-09-05T00:56:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.501+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=4ZZDNNO03G45 type=del size=838815 2024-09-05T00:56:14.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.501+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=XIUPPZ8FT38Z type=del 2024-09-05T00:56:14.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.505+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=1YGEZU8JDCAI type=write size=415452 2024-09-05T00:56:14.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.505+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=NC6VQDLJY61R type=del 2024-09-05T00:56:14.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.509+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=2ZWXENDHOJX1 type=write size=59933 2024-09-05T00:56:14.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.509+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=46GIFTXZX1R1 type=del 2024-09-05T00:56:14.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.513+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=PAJLHCJ7SDZY type=del size=1862361 2024-09-05T00:56:14.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.513+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=I0EJO8DGXZGC type=del size=3437826 2024-09-05T00:56:14.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.521+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~BG7P6VPOBUXF.0 size=578516 2024-09-05T00:56:14.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.521+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=BG7P6VPOBUXF tag=ACKQ84LOX0MA type=write size=1627092 2024-09-05T00:56:14.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.525+0000 7f325adab8c0 1 < suggested update operation key=CB079FGXKNRO tag=VMSN613UCU23 type=del size=571934 2024-09-05T00:56:14.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.529+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.0 size=1048576 2024-09-05T00:56:14.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.529+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.1 size=1048576 2024-09-05T00:56:14.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.533+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.2 size=549099 2024-09-05T00:56:14.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.533+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=H5X20FA9V16U tag=D7A7W0WGYVI6 type=write size=3694827 2024-09-05T00:56:14.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.533+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=K0CAS83Q5HZS type=del 2024-09-05T00:56:14.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.537+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~NST7GJOG2J03.0 size=1048576 2024-09-05T00:56:14.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.541+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~NST7GJOG2J03.1 size=328680 2024-09-05T00:56:14.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.541+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=NST7GJOG2J03 tag=6XTQKVUX4D6L type=write size=2425832 2024-09-05T00:56:14.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.541+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~9ONQ35RYXFHX.0 size=1048576 2024-09-05T00:56:14.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.545+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~9ONQ35RYXFHX.1 size=651392 2024-09-05T00:56:14.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.549+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=9ONQ35RYXFHX tag=RFYSRP1GI6NM type=write size=2748544 2024-09-05T00:56:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.553+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~8Z1AYL3JUFO1.0 size=684151 2024-09-05T00:56:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.553+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=8Z1AYL3JUFO1 tag=W6A3GPN9G6I3 type=write size=1732727 2024-09-05T00:56:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.557+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~45KUNW28TI0G.0 size=399630 2024-09-05T00:56:14.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.561+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=45KUNW28TI0G tag=ZB76XWVLKUMZ type=write size=1448206 2024-09-05T00:56:14.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.561+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=GYIYTCAC5NNV type=del size=1102426 2024-09-05T00:56:14.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.565+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~OV5YF4PTP0T7.0 size=1048576 2024-09-05T00:56:14.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.569+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~OV5YF4PTP0T7.1 size=981759 2024-09-05T00:56:14.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.573+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=OV5YF4PTP0T7 tag=L1W9WJNUK794 type=write size=3078911 2024-09-05T00:56:14.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.573+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=B5121HXAWE24 type=del size=180917 2024-09-05T00:56:14.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.577+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~DPG010JWPE5S.0 size=807416 2024-09-05T00:56:14.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.581+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=DPG010JWPE5S tag=9RM6C7PBI2EL type=write size=1855992 2024-09-05T00:56:14.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.585+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=HDO5VW54WPFC type=del size=591816 2024-09-05T00:56:14.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.585+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=TA39S4PXTW8D type=del 2024-09-05T00:56:14.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.589+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~J122GO24UAOJ.0 size=693302 2024-09-05T00:56:14.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.589+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=J122GO24UAOJ tag=28AJ2OK1OSHQ type=write size=1741878 2024-09-05T00:56:14.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.593+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.0 size=1048576 2024-09-05T00:56:14.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.597+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.1 size=1048576 2024-09-05T00:56:14.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.597+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~K719FUKESYTZ.2 size=580405 2024-09-05T00:56:14.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.601+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=K719FUKESYTZ tag=G390AF73TFIN type=write size=3726133 2024-09-05T00:56:14.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.605+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=67LCLLTQJG82 type=del size=1890439 2024-09-05T00:56:14.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.609+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=GV9V72SFV01D type=del 2024-09-05T00:56:14.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.613+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.0 size=1048576 2024-09-05T00:56:14.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.613+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.1 size=1048576 2024-09-05T00:56:14.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.617+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.2 size=233679 2024-09-05T00:56:14.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.617+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=4AM25QBM2MT3 tag=5Q41PV2EXU7J type=write size=3379407 2024-09-05T00:56:14.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.621+0000 7f325adab8c0 1 < suggested update operation key=D6HSFIRN2X4Q tag=QU9AF5QSXWFV type=del size=627561 2024-09-05T00:56:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.625+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~HHMB1EN1HVFE.0 size=1048576 2024-09-05T00:56:14.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.629+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~HHMB1EN1HVFE.1 size=807478 2024-09-05T00:56:14.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.629+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=HHMB1EN1HVFE tag=SNCQVFOC6D0B type=write size=2904630 2024-09-05T00:56:14.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.633+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~C55K181AYHX2.0 size=1048576 2024-09-05T00:56:14.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.633+0000 7f325adab8c0 1 < canceled part key=_multipart_IGOUBVL3XVS3.2~C55K181AYHX2.1 size=624813 2024-09-05T00:56:14.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.637+0000 7f325adab8c0 1 < canceled multipart upload key=IGOUBVL3XVS3 upload=C55K181AYHX2 tag=8MMIW85OYTB7 type=write size=2721965 2024-09-05T00:56:14.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.641+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.0 size=1048576 2024-09-05T00:56:14.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.645+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.1 size=1048576 2024-09-05T00:56:14.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.645+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.2 size=202486 2024-09-05T00:56:14.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.645+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=8SPKXQ8KVMZR tag=XXLRUP042LBW type=write size=3348214 2024-09-05T00:56:14.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.649+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=4ZZDNNO03G45 type=del 2024-09-05T00:56:14.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.653+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=3VGAS1AP80T5 type=del size=3462885 2024-09-05T00:56:14.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.657+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=1YGEZU8JDCAI type=write size=415452 2024-09-05T00:56:14.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.657+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=L1OREP9OH3UG type=del size=3007167 2024-09-05T00:56:14.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.661+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=2ZWXENDHOJX1 type=write size=59933 2024-09-05T00:56:14.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.665+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=53ZU5Q1DHSYG type=del size=786504 2024-09-05T00:56:14.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.665+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=PAJLHCJ7SDZY type=del 2024-09-05T00:56:14.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.669+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=3QV3U92WGE84 type=del size=3516855 2024-09-05T00:56:14.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.673+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~BG7P6VPOBUXF.0 size=578516 2024-09-05T00:56:14.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.677+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=BG7P6VPOBUXF tag=ACKQ84LOX0MA type=write size=1627092 2024-09-05T00:56:14.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.677+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=4K5BFG672SV7 type=del size=239635 2024-09-05T00:56:14.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.681+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.0 size=1048576 2024-09-05T00:56:14.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.685+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.1 size=1048576 2024-09-05T00:56:14.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.689+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~H5X20FA9V16U.2 size=549099 2024-09-05T00:56:14.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.693+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=H5X20FA9V16U tag=D7A7W0WGYVI6 type=write size=3694827 2024-09-05T00:56:14.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.697+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=808VB5IEYR6W type=write size=793441 2024-09-05T00:56:14.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.701+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~NST7GJOG2J03.0 size=1048576 2024-09-05T00:56:14.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.701+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~NST7GJOG2J03.1 size=328680 2024-09-05T00:56:14.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.705+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=NST7GJOG2J03 tag=6XTQKVUX4D6L type=write size=2425832 2024-09-05T00:56:14.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.709+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=EWCYCBXFJM67 type=del size=2562500 2024-09-05T00:56:14.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.713+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~8Z1AYL3JUFO1.0 size=684151 2024-09-05T00:56:14.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.717+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=8Z1AYL3JUFO1 tag=W6A3GPN9G6I3 type=write size=1732727 2024-09-05T00:56:14.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.725+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~YDEPXXCPUS2O.0 size=1048576 2024-09-05T00:56:14.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.729+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~YDEPXXCPUS2O.1 size=396758 2024-09-05T00:56:14.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.729+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=YDEPXXCPUS2O tag=D65LST1H0UXA type=write size=2493910 2024-09-05T00:56:14.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.733+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=GYIYTCAC5NNV type=del 2024-09-05T00:56:14.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.737+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~EMOL8ZT8L4CJ.0 size=550967 2024-09-05T00:56:14.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.737+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=EMOL8ZT8L4CJ tag=QOR6JEBAK7US type=write size=1599543 2024-09-05T00:56:14.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.741+0000 7f325adab8c0 1 < canceled operation key=JKRZR0KRE93F tag=B5121HXAWE24 type=del size=180917 2024-09-05T00:56:14.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.745+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.0 size=1048576 2024-09-05T00:56:14.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.749+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.1 size=1048576 2024-09-05T00:56:14.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.749+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.2 size=999544 2024-09-05T00:56:14.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.749+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=CW5MMZN1656J tag=XNU2BGRUFJTG type=write size=4145272 2024-09-05T00:56:14.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.753+0000 7f325adab8c0 1 < canceled operation key=9O7DVR04PCDB tag=HDO5VW54WPFC type=del size=591816 2024-09-05T00:56:14.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.757+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.0 size=1048576 2024-09-05T00:56:14.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.761+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.1 size=1048576 2024-09-05T00:56:14.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.761+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.2 size=911251 2024-09-05T00:56:14.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.761+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=C1NLWXHGJF5E tag=VN70Y3Y4KSNO type=write size=4056979 2024-09-05T00:56:14.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.765+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~J122GO24UAOJ.0 size=693302 2024-09-05T00:56:14.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.769+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=J122GO24UAOJ tag=28AJ2OK1OSHQ type=write size=1741878 2024-09-05T00:56:14.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.773+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=ZFFHQZIYS5MT type=del size=3723197 2024-09-05T00:56:14.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.777+0000 7f325adab8c0 1 < canceled operation key=NIAW4BKW21LG tag=67LCLLTQJG82 type=del size=1890439 2024-09-05T00:56:14.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.777+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=QGWEDA794NS3 type=del size=2775522 2024-09-05T00:56:14.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.781+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.0 size=1048576 2024-09-05T00:56:14.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.781+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.1 size=1048576 2024-09-05T00:56:14.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.785+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~4AM25QBM2MT3.2 size=233679 2024-09-05T00:56:14.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.789+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=4AM25QBM2MT3 tag=5Q41PV2EXU7J type=write size=3379407 2024-09-05T00:56:14.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.793+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=2DHHEBTYK21F type=del size=3591885 2024-09-05T00:56:14.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.797+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~HHMB1EN1HVFE.0 size=1048576 2024-09-05T00:56:14.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.797+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~HHMB1EN1HVFE.1 size=807478 2024-09-05T00:56:14.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.805+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=HHMB1EN1HVFE tag=SNCQVFOC6D0B type=write size=2904630 2024-09-05T00:56:14.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.809+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=JMRJBDY3S5HS type=del size=71326 2024-09-05T00:56:14.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.809+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.0 size=1048576 2024-09-05T00:56:14.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.813+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.1 size=1048576 2024-09-05T00:56:14.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.817+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~8SPKXQ8KVMZR.2 size=202486 2024-09-05T00:56:14.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.821+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=8SPKXQ8KVMZR tag=XXLRUP042LBW type=write size=3348214 2024-09-05T00:56:14.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.825+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=RU17MPAW33LA type=write size=655417 2024-09-05T00:56:14.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.829+0000 7f325adab8c0 1 < suggested update operation key=J9UIQE3CKYHM tag=3VGAS1AP80T5 type=del size=3462885 2024-09-05T00:56:14.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.833+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=POA418LGTGP3 type=del size=1468037 2024-09-05T00:56:14.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.833+0000 7f325adab8c0 1 < canceled operation key=MYR9H12B5YYV tag=L1OREP9OH3UG type=del size=3007167 2024-09-05T00:56:14.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.837+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=2XRQKS0WB2L1 type=del size=3894528 2024-09-05T00:56:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.845+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=53ZU5Q1DHSYG type=del 2024-09-05T00:56:14.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.849+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~FPWUM8GK9T23.0 size=646243 2024-09-05T00:56:14.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.849+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=FPWUM8GK9T23 tag=SCXYBT798QKZ type=write size=1694819 2024-09-05T00:56:14.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.853+0000 7f325adab8c0 1 < canceled operation key=ZYT3WYNFIIZN tag=3QV3U92WGE84 type=del size=3516855 2024-09-05T00:56:14.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.853+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=FGPZFBZNMTIZ type=write size=604343 2024-09-05T00:56:14.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.857+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=4K5BFG672SV7 type=del 2024-09-05T00:56:14.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.861+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=O0WA0WTWLE35 type=del size=1203095 2024-09-05T00:56:14.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.865+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=808VB5IEYR6W type=write size=793441 2024-09-05T00:56:14.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.865+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=2MI2QV397Q9T type=del size=1908409 2024-09-05T00:56:14.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.873+0000 7f325adab8c0 1 < suggested remove operation key=D6HSFIRN2X4Q tag=EWCYCBXFJM67 type=del 2024-09-05T00:56:14.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.877+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~GVUOTDB54TI1.0 size=598641 2024-09-05T00:56:14.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.877+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=GVUOTDB54TI1 tag=I9NQQMC8YQIA type=write size=1647217 2024-09-05T00:56:14.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.881+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~YDEPXXCPUS2O.0 size=1048576 2024-09-05T00:56:14.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.881+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~YDEPXXCPUS2O.1 size=396758 2024-09-05T00:56:14.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.889+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=YDEPXXCPUS2O tag=D65LST1H0UXA type=write size=2493910 2024-09-05T00:56:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.889+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=XS7C4BQYB9Z3 type=del size=1626764 2024-09-05T00:56:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.893+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~EMOL8ZT8L4CJ.0 size=550967 2024-09-05T00:56:14.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.897+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=EMOL8ZT8L4CJ tag=QOR6JEBAK7US type=write size=1599543 2024-09-05T00:56:14.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.905+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~FH024ZYO3PDI.0 size=1048576 2024-09-05T00:56:14.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.905+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~FH024ZYO3PDI.1 size=234382 2024-09-05T00:56:14.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.905+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=FH024ZYO3PDI tag=T33TQDB0IJ32 type=write size=2331534 2024-09-05T00:56:14.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.909+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.0 size=1048576 2024-09-05T00:56:14.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.909+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.1 size=1048576 2024-09-05T00:56:14.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.913+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~CW5MMZN1656J.2 size=999544 2024-09-05T00:56:14.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.917+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=CW5MMZN1656J tag=XNU2BGRUFJTG type=write size=4145272 2024-09-05T00:56:14.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.921+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=RFTC6QXPR7C2 type=del size=250591 2024-09-05T00:56:14.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.925+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.0 size=1048576 2024-09-05T00:56:14.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.925+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.1 size=1048576 2024-09-05T00:56:14.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.929+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~C1NLWXHGJF5E.2 size=911251 2024-09-05T00:56:14.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.933+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=C1NLWXHGJF5E tag=VN70Y3Y4KSNO type=write size=4056979 2024-09-05T00:56:14.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.937+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=7Y32DJKLNMV6 type=del size=823906 2024-09-05T00:56:14.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.941+0000 7f325adab8c0 1 < canceled operation key=JKRZR0KRE93F tag=ZFFHQZIYS5MT type=del size=3723197 2024-09-05T00:56:14.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.945+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=F3I6JO1NMY70 type=del size=416939 2024-09-05T00:56:14.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.945+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=QGWEDA794NS3 type=del 2024-09-05T00:56:14.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.949+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=1II03WKXIKR5 type=del size=1428068 2024-09-05T00:56:14.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.953+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=2DHHEBTYK21F type=del 2024-09-05T00:56:14.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.957+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=QL720C02AJL1 type=del size=2843109 2024-09-05T00:56:14.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.961+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=JMRJBDY3S5HS type=del 2024-09-05T00:56:14.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.965+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~R8XUA1UBT2BW.0 size=277173 2024-09-05T00:56:14.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.965+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=R8XUA1UBT2BW tag=K4WDWPRZ08OZ type=write size=1325749 2024-09-05T00:56:14.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.969+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=RU17MPAW33LA type=write size=655417 2024-09-05T00:56:14.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.973+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=VH7I7D1YZJE4 type=del size=2981743 2024-09-05T00:56:14.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.973+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=POA418LGTGP3 type=del 2024-09-05T00:56:14.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.981+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~3P5T2HQUTQ99.0 size=901613 2024-09-05T00:56:14.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.981+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=3P5T2HQUTQ99 tag=K5UMTP9JHBDG type=write size=1950189 2024-09-05T00:56:14.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.981+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=2XRQKS0WB2L1 type=del 2024-09-05T00:56:14.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.985+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=4MY135YPYLCP type=del size=2312482 2024-09-05T00:56:14.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.989+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~FPWUM8GK9T23.0 size=646243 2024-09-05T00:56:14.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.993+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=FPWUM8GK9T23 tag=SCXYBT798QKZ type=write size=1694819 2024-09-05T00:56:15.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:14.997+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=YKB9OFYIPRJH type=write size=682206 2024-09-05T00:56:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.001+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=FGPZFBZNMTIZ type=write size=604343 2024-09-05T00:56:15.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.005+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=20EJEEYULDH6 type=write size=431439 2024-09-05T00:56:15.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.009+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=O0WA0WTWLE35 type=del size=1203095: (22) Invalid argument 2024-09-05T00:56:15.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.013+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.0 size=1048576 2024-09-05T00:56:15.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.017+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.1 size=1048576 2024-09-05T00:56:15.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.017+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.2 size=950437 2024-09-05T00:56:15.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.017+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=7UV8VK7RP2TJ tag=C3BS0122T87Q type=write size=4096165 2024-09-05T00:56:15.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.021+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=2MI2QV397Q9T type=del 2024-09-05T00:56:15.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.025+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=J49R4NT1KSQ2 type=del size=3913804 2024-09-05T00:56:15.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.025+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~GVUOTDB54TI1.0 size=598641 2024-09-05T00:56:15.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.033+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=GVUOTDB54TI1 tag=I9NQQMC8YQIA type=write size=1647217 2024-09-05T00:56:15.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.033+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=WREOW7A602R7 type=del size=27121 2024-09-05T00:56:15.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.037+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=XS7C4BQYB9Z3 type=del 2024-09-05T00:56:15.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.041+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=TAMW5WLPWCQH type=del size=3615828 2024-09-05T00:56:15.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.041+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~FH024ZYO3PDI.0 size=1048576 2024-09-05T00:56:15.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.041+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~FH024ZYO3PDI.1 size=234382 2024-09-05T00:56:15.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.049+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=FH024ZYO3PDI tag=T33TQDB0IJ32 type=write size=2331534 2024-09-05T00:56:15.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.049+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=RJTN41KSESRW type=del size=827805 2024-09-05T00:56:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.053+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=RFTC6QXPR7C2 type=del 2024-09-05T00:56:15.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.057+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~E34AGAM98SN4.0 size=1048576 2024-09-05T00:56:15.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.061+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~E34AGAM98SN4.1 size=734818 2024-09-05T00:56:15.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.061+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=E34AGAM98SN4 tag=INTFGMY16ICI type=write size=2831970 2024-09-05T00:56:15.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.065+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=7Y32DJKLNMV6 type=del size=823906: (22) Invalid argument 2024-09-05T00:56:15.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.069+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~CQK4XP3VQKRP.0 size=1048576 2024-09-05T00:56:15.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.073+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~CQK4XP3VQKRP.1 size=356912 2024-09-05T00:56:15.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.073+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=CQK4XP3VQKRP tag=6A1GNOARMXY0 type=write size=2454064 2024-09-05T00:56:15.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.073+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=F3I6JO1NMY70 type=del 2024-09-05T00:56:15.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.077+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=7NFMFSRWQYUZ type=del size=3660608 2024-09-05T00:56:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.081+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=1II03WKXIKR5 type=del 2024-09-05T00:56:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.085+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=0RPRIAJ67PYV type=del size=2605230 2024-09-05T00:56:15.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.085+0000 7f325adab8c0 1 < canceled operation key=D6HSFIRN2X4Q tag=QL720C02AJL1 type=del size=2843109 2024-09-05T00:56:15.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.089+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=11ABLLN9VWVN type=del size=3122423 2024-09-05T00:56:15.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.089+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~R8XUA1UBT2BW.0 size=277173 2024-09-05T00:56:15.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.093+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=R8XUA1UBT2BW tag=K4WDWPRZ08OZ type=write size=1325749 2024-09-05T00:56:15.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.097+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=HJ9ABT5H2W9O type=write size=862854 2024-09-05T00:56:15.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.101+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=VH7I7D1YZJE4 type=del 2024-09-05T00:56:15.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.105+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~XKA0CRDJ4S0C.0 size=1048576 2024-09-05T00:56:15.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.109+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~XKA0CRDJ4S0C.1 size=573400 2024-09-05T00:56:15.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.109+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=XKA0CRDJ4S0C tag=FM8VV17Q4NUG type=write size=2670552 2024-09-05T00:56:15.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.109+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~3P5T2HQUTQ99.0 size=901613 2024-09-05T00:56:15.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.117+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=3P5T2HQUTQ99 tag=K5UMTP9JHBDG type=write size=1950189 2024-09-05T00:56:15.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.121+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~2TRFAZAMVSHL.0 size=921793 2024-09-05T00:56:15.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.121+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=2TRFAZAMVSHL tag=U2N2ZD1HZS7F type=write size=1970369 2024-09-05T00:56:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.125+0000 7f325adab8c0 1 < canceled operation key=J9UIQE3CKYHM tag=4MY135YPYLCP type=del size=2312482 2024-09-05T00:56:15.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.125+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=YNSHW9CA2R8F type=del size=641713 2024-09-05T00:56:15.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.129+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=YKB9OFYIPRJH type=write size=682206 2024-09-05T00:56:15.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.133+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~JG82K2JSI3DU.0 size=418165 2024-09-05T00:56:15.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.133+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=JG82K2JSI3DU tag=6W7KD4K9XR8F type=write size=1466741 2024-09-05T00:56:15.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.137+0000 7f325adab8c0 1 < completed write operation key=JKRZR0KRE93F tag=20EJEEYULDH6 type=write size=431439 2024-09-05T00:56:15.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.141+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=MI8FS8VUUL9G type=del size=301426 2024-09-05T00:56:15.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.141+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.0 size=1048576 2024-09-05T00:56:15.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.145+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.1 size=1048576 2024-09-05T00:56:15.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.145+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~7UV8VK7RP2TJ.2 size=950437 2024-09-05T00:56:15.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.153+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=7UV8VK7RP2TJ tag=C3BS0122T87Q type=write size=4096165 2024-09-05T00:56:15.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.153+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=V7KEFH2RTANJ type=del size=1567318 2024-09-05T00:56:15.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.161+0000 7f325adab8c0 1 < suggested update operation key=G600UT533GTT tag=J49R4NT1KSQ2 type=del size=3913804 2024-09-05T00:56:15.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.161+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=LU3PFL2P65AU type=del size=3791998 2024-09-05T00:56:15.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.169+0000 7f325adab8c0 1 < suggested remove operation key=LVZALGRNP5TU tag=WREOW7A602R7 type=del 2024-09-05T00:56:15.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.173+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~4WDIPWEVM9PI.0 size=1048576 2024-09-05T00:56:15.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.177+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~4WDIPWEVM9PI.1 size=607572 2024-09-05T00:56:15.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.177+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=4WDIPWEVM9PI tag=74G1Q9TL1KA5 type=write size=2704724 2024-09-05T00:56:15.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.181+0000 7f325adab8c0 -1 < failed to complete operation key=G600UT533GTT tag=TAMW5WLPWCQH type=del size=3615828: (22) Invalid argument 2024-09-05T00:56:15.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.181+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=DJ92X8NJX7YG type=del size=2925303 2024-09-05T00:56:15.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.185+0000 7f325adab8c0 1 < canceled operation key=GU25IIQWQNR2 tag=RJTN41KSESRW type=del size=827805 2024-09-05T00:56:15.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.189+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~NOALHLI18JSR.0 size=1048576 2024-09-05T00:56:15.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.193+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~NOALHLI18JSR.1 size=58950 2024-09-05T00:56:15.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.193+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=NOALHLI18JSR tag=U9FJSIZ3DNVB type=write size=2156102 2024-09-05T00:56:15.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.197+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~E34AGAM98SN4.0 size=1048576 2024-09-05T00:56:15.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.197+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~E34AGAM98SN4.1 size=734818 2024-09-05T00:56:15.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.205+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=E34AGAM98SN4 tag=INTFGMY16ICI type=write size=2831970 2024-09-05T00:56:15.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.209+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.0 size=1048576 2024-09-05T00:56:15.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.209+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.1 size=1048576 2024-09-05T00:56:15.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.213+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.2 size=43557 2024-09-05T00:56:15.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.213+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=V85VW316BO92 tag=PGQ2KDJ6QDGO type=write size=3189285 2024-09-05T00:56:15.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.217+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~CQK4XP3VQKRP.0 size=1048576 2024-09-05T00:56:15.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.217+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~CQK4XP3VQKRP.1 size=356912 2024-09-05T00:56:15.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.225+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=CQK4XP3VQKRP tag=6A1GNOARMXY0 type=write size=2454064 2024-09-05T00:56:15.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.225+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=7706UPRXDFN2 type=del size=993890 2024-09-05T00:56:15.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.229+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=7NFMFSRWQYUZ type=del 2024-09-05T00:56:15.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.233+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=SVOQPN00PAFL type=write size=315600 2024-09-05T00:56:15.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.241+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=0RPRIAJ67PYV type=del size=2605230 2024-09-05T00:56:15.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.241+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=Z1TM0HFLY64E type=del size=2329087 2024-09-05T00:56:15.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.245+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=11ABLLN9VWVN type=del 2024-09-05T00:56:15.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.253+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~QLQ79J9OESX5.0 size=808379 2024-09-05T00:56:15.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.253+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=QLQ79J9OESX5 tag=W8BSRNHPTV2Q type=write size=1856955 2024-09-05T00:56:15.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.253+0000 7f325adab8c0 1 < completed write operation key=UW0SSQ8VFY1G tag=HJ9ABT5H2W9O type=write size=862854 2024-09-05T00:56:15.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.257+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~7ZL8ROND1F3F.0 size=1048576 2024-09-05T00:56:15.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.261+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~7ZL8ROND1F3F.1 size=337252 2024-09-05T00:56:15.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.261+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=7ZL8ROND1F3F tag=CP45C5O6W38C type=write size=2434404 2024-09-05T00:56:15.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.265+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~XKA0CRDJ4S0C.0 size=1048576 2024-09-05T00:56:15.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.265+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~XKA0CRDJ4S0C.1 size=573400 2024-09-05T00:56:15.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.277+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=XKA0CRDJ4S0C tag=FM8VV17Q4NUG type=write size=2670552 2024-09-05T00:56:15.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.277+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=POR0LLV170AH type=del size=3721752 2024-09-05T00:56:15.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.281+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~2TRFAZAMVSHL.0 size=921793 2024-09-05T00:56:15.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.285+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=2TRFAZAMVSHL tag=U2N2ZD1HZS7F type=write size=1970369 2024-09-05T00:56:15.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.289+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=QM3N2ML8GBP0 type=del size=1661791 2024-09-05T00:56:15.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.293+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=YNSHW9CA2R8F type=del 2024-09-05T00:56:15.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.297+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=09FG9O0JXSSR type=del size=1240174 2024-09-05T00:56:15.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.297+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~JG82K2JSI3DU.0 size=418165 2024-09-05T00:56:15.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.305+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=JG82K2JSI3DU tag=6W7KD4K9XR8F type=write size=1466741 2024-09-05T00:56:15.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.305+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=D4LVEEOEOAK3 type=del size=2851564 2024-09-05T00:56:15.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.313+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=MI8FS8VUUL9G type=del size=301426 2024-09-05T00:56:15.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.317+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=TVDFS83R0HDY type=del size=3848609 2024-09-05T00:56:15.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.321+0000 7f325adab8c0 -1 < failed to complete operation key=G600UT533GTT tag=V7KEFH2RTANJ type=del size=1567318: (22) Invalid argument 2024-09-05T00:56:15.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.325+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~0RDN4DY7P3TG.0 size=873646 2024-09-05T00:56:15.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.325+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=0RDN4DY7P3TG tag=6E4TS4N7KDK8 type=write size=1922222 2024-09-05T00:56:15.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.329+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=LU3PFL2P65AU type=del 2024-09-05T00:56:15.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.329+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=CNC23UFD1C9V type=write size=232645 2024-09-05T00:56:15.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.333+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~4WDIPWEVM9PI.0 size=1048576 2024-09-05T00:56:15.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.337+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~4WDIPWEVM9PI.1 size=607572 2024-09-05T00:56:15.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.341+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=4WDIPWEVM9PI tag=74G1Q9TL1KA5 type=write size=2704724 2024-09-05T00:56:15.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.341+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=7GW6YXBL5HWY type=write size=74095 2024-09-05T00:56:15.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.345+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=DJ92X8NJX7YG type=del 2024-09-05T00:56:15.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.349+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.0 size=1048576 2024-09-05T00:56:15.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.353+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.1 size=1048576 2024-09-05T00:56:15.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.353+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.2 size=274670 2024-09-05T00:56:15.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.353+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=KVKQ7VG3BYK6 tag=TO0O6RAK5AU4 type=write size=3420398 2024-09-05T00:56:15.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.357+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~NOALHLI18JSR.0 size=1048576 2024-09-05T00:56:15.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.357+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~NOALHLI18JSR.1 size=58950 2024-09-05T00:56:15.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.361+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=NOALHLI18JSR tag=U9FJSIZ3DNVB type=write size=2156102 2024-09-05T00:56:15.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.365+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=PRL92E3222JP type=del size=1158087 2024-09-05T00:56:15.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.369+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.0 size=1048576 2024-09-05T00:56:15.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.369+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.1 size=1048576 2024-09-05T00:56:15.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.373+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~V85VW316BO92.2 size=43557 2024-09-05T00:56:15.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.377+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=V85VW316BO92 tag=PGQ2KDJ6QDGO type=write size=3189285 2024-09-05T00:56:15.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.385+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~BPU1L3H72GPZ.0 size=1048576 2024-09-05T00:56:15.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.385+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~BPU1L3H72GPZ.1 size=566207 2024-09-05T00:56:15.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.385+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=BPU1L3H72GPZ tag=4UUEQIT166D8 type=write size=2663359 2024-09-05T00:56:15.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.389+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=7706UPRXDFN2 type=del 2024-09-05T00:56:15.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.393+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~RAW81P7HXLLV.0 size=522411 2024-09-05T00:56:15.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.393+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=RAW81P7HXLLV tag=HYXZCLLKO44A type=write size=1570987 2024-09-05T00:56:15.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.397+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=SVOQPN00PAFL type=write size=315600 2024-09-05T00:56:15.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.401+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=L93N0HKIGK77 type=del size=4162353 2024-09-05T00:56:15.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.405+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=Z1TM0HFLY64E type=del 2024-09-05T00:56:15.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.409+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=FZ98QCRMP65M type=del size=889908 2024-09-05T00:56:15.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.413+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~QLQ79J9OESX5.0 size=808379 2024-09-05T00:56:15.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.417+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=QLQ79J9OESX5 tag=W8BSRNHPTV2Q type=write size=1856955 2024-09-05T00:56:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.421+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.0 size=1048576 2024-09-05T00:56:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.425+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.1 size=1048576 2024-09-05T00:56:15.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.425+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.2 size=650188 2024-09-05T00:56:15.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.425+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=VFTEJ6JW02QI tag=MSZDTMQSJT8G type=write size=3795916 2024-09-05T00:56:15.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.429+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~7ZL8ROND1F3F.0 size=1048576 2024-09-05T00:56:15.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.433+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~7ZL8ROND1F3F.1 size=337252 2024-09-05T00:56:15.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.437+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=7ZL8ROND1F3F tag=CP45C5O6W38C type=write size=2434404 2024-09-05T00:56:15.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.441+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.0 size=1048576 2024-09-05T00:56:15.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.445+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.1 size=1048576 2024-09-05T00:56:15.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.445+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.2 size=904611 2024-09-05T00:56:15.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.445+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=WSO5W5HGF6V5 tag=S4OPAY4F16QQ type=write size=4050339 2024-09-05T00:56:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.449+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=POR0LLV170AH type=del 2024-09-05T00:56:15.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.453+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=AW8C3HS9QATU type=del size=2821289 2024-09-05T00:56:15.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.457+0000 7f325adab8c0 1 < suggested update operation key=6N7BLJ1WLDGN tag=QM3N2ML8GBP0 type=del size=1661791 2024-09-05T00:56:15.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.465+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.0 size=1048576 2024-09-05T00:56:15.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.465+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.1 size=1048576 2024-09-05T00:56:15.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.469+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.2 size=323494 2024-09-05T00:56:15.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.469+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=S0ARZJ0AC5ZO tag=RB4YRMA58LQU type=write size=3469222 2024-09-05T00:56:15.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.473+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=09FG9O0JXSSR type=del 2024-09-05T00:56:15.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.473+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=4MS3EURDYWMX type=del size=1616075 2024-09-05T00:56:15.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.481+0000 7f325adab8c0 1 < suggested update operation key=IGOUBVL3XVS3 tag=D4LVEEOEOAK3 type=del size=2851564 2024-09-05T00:56:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.485+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.0 size=1048576 2024-09-05T00:56:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.489+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.1 size=1048576 2024-09-05T00:56:15.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.489+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.2 size=8313 2024-09-05T00:56:15.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.489+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=A4T7G6GBLIGS tag=XRTLL9FA2A7W type=write size=3154041 2024-09-05T00:56:15.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.493+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=TVDFS83R0HDY type=del 2024-09-05T00:56:15.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.497+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~HCTIXK7R0NL7.0 size=1048576 2024-09-05T00:56:15.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.501+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~HCTIXK7R0NL7.1 size=477152 2024-09-05T00:56:15.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.501+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=HCTIXK7R0NL7 tag=LIBQN2T3LWM3 type=write size=2574304 2024-09-05T00:56:15.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.501+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~0RDN4DY7P3TG.0 size=873646 2024-09-05T00:56:15.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.505+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=0RDN4DY7P3TG tag=6E4TS4N7KDK8 type=write size=1922222 2024-09-05T00:56:15.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.509+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=BCGHLL7012MM type=del size=855071 2024-09-05T00:56:15.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.513+0000 7f325adab8c0 1 < completed write operation key=VYMRZPO6VKGS tag=CNC23UFD1C9V type=write size=232645 2024-09-05T00:56:15.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.517+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~KRS1IUQXIISI.0 size=465410 2024-09-05T00:56:15.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.517+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=KRS1IUQXIISI tag=9IVSCXH8QJ2E type=write size=1513986 2024-09-05T00:56:15.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.517+0000 7f325adab8c0 1 < completed write operation key=JKRZR0KRE93F tag=7GW6YXBL5HWY type=write size=74095 2024-09-05T00:56:15.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.525+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~KZFL4P594JH1.0 size=253885 2024-09-05T00:56:15.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.525+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=KZFL4P594JH1 tag=T0RBL81ZGMD7 type=write size=1302461 2024-09-05T00:56:15.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.525+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.0 size=1048576 2024-09-05T00:56:15.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.529+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.1 size=1048576 2024-09-05T00:56:15.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.529+0000 7f325adab8c0 1 < canceled part key=_multipart_SP188HM5LG2D.2~KVKQ7VG3BYK6.2 size=274670 2024-09-05T00:56:15.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.533+0000 7f325adab8c0 1 < canceled multipart upload key=SP188HM5LG2D upload=KVKQ7VG3BYK6 tag=TO0O6RAK5AU4 type=write size=3420398 2024-09-05T00:56:15.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.537+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=YZ5CZAZF332X type=del size=3435025 2024-09-05T00:56:15.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.541+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=PRL92E3222JP type=del 2024-09-05T00:56:15.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.545+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.0 size=1048576 2024-09-05T00:56:15.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.549+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.1 size=1048576 2024-09-05T00:56:15.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.549+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.2 size=201051 2024-09-05T00:56:15.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.549+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=THUSPC6R1J5B tag=K4YZ0FIRG1OF type=write size=3346779 2024-09-05T00:56:15.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.553+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~BPU1L3H72GPZ.0 size=1048576 2024-09-05T00:56:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.557+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~BPU1L3H72GPZ.1 size=566207 2024-09-05T00:56:15.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.561+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=BPU1L3H72GPZ tag=4UUEQIT166D8 type=write size=2663359 2024-09-05T00:56:15.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.565+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.0 size=1048576 2024-09-05T00:56:15.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.565+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.1 size=1048576 2024-09-05T00:56:15.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.569+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.2 size=458656 2024-09-05T00:56:15.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.569+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=HHIONT1KVH6B tag=QFL9S7RV1QS5 type=write size=3604384 2024-09-05T00:56:15.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.569+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~RAW81P7HXLLV.0 size=522411 2024-09-05T00:56:15.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.573+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=RAW81P7HXLLV tag=HYXZCLLKO44A type=write size=1570987 2024-09-05T00:56:15.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.577+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=1Z8QIZKW7HR2 type=del size=3085712 2024-09-05T00:56:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.581+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=L93N0HKIGK77 type=del 2024-09-05T00:56:15.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.585+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~6N7ETXH7BJDY.0 size=964177 2024-09-05T00:56:15.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.585+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=6N7ETXH7BJDY tag=25L5SZAZ24IB type=write size=2012753 2024-09-05T00:56:15.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.585+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=FZ98QCRMP65M type=del 2024-09-05T00:56:15.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.589+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=B1M8XGFNXZLO type=del size=3902105 2024-09-05T00:56:15.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.593+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.0 size=1048576 2024-09-05T00:56:15.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.593+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.1 size=1048576 2024-09-05T00:56:15.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.597+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~VFTEJ6JW02QI.2 size=650188 2024-09-05T00:56:15.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.601+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=VFTEJ6JW02QI tag=MSZDTMQSJT8G type=write size=3795916 2024-09-05T00:56:15.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.601+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=EDY4D8F9ZAM2 type=del size=1517896 2024-09-05T00:56:15.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.605+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.0 size=1048576 2024-09-05T00:56:15.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.605+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.1 size=1048576 2024-09-05T00:56:15.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.609+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~WSO5W5HGF6V5.2 size=904611 2024-09-05T00:56:15.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.609+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=WSO5W5HGF6V5 tag=S4OPAY4F16QQ type=write size=4050339 2024-09-05T00:56:15.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.613+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=0GEZW82P1YN9 type=del size=3278653 2024-09-05T00:56:15.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.617+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=AW8C3HS9QATU type=del 2024-09-05T00:56:15.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.621+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~PME3E5P041MZ.0 size=696553 2024-09-05T00:56:15.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.621+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=PME3E5P041MZ tag=WQELOU46OKER type=write size=1745129 2024-09-05T00:56:15.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.625+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.0 size=1048576 2024-09-05T00:56:15.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.625+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.1 size=1048576 2024-09-05T00:56:15.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.629+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~S0ARZJ0AC5ZO.2 size=323494 2024-09-05T00:56:15.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.633+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=S0ARZJ0AC5ZO tag=RB4YRMA58LQU type=write size=3469222 2024-09-05T00:56:15.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.637+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~0P2C5KJ4W7JP.0 size=1048576 2024-09-05T00:56:15.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.637+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~0P2C5KJ4W7JP.1 size=108653 2024-09-05T00:56:15.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.637+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=0P2C5KJ4W7JP tag=WPYFY5BV0Q8E type=write size=2205805 2024-09-05T00:56:15.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.641+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=4MS3EURDYWMX type=del 2024-09-05T00:56:15.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.641+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=2UZUIU17NFB5 type=del size=2461928 2024-09-05T00:56:15.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.645+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.0 size=1048576 2024-09-05T00:56:15.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.645+0000 7f325adab8c0 1 < canceled part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.1 size=1048576 2024-09-05T00:56:15.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.645+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~A4T7G6GBLIGS.2 size=8313 2024-09-05T00:56:15.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.649+0000 7f325adab8c0 1 < canceled multipart upload key=GQB4HOYII01G upload=A4T7G6GBLIGS tag=XRTLL9FA2A7W type=write size=3154041 2024-09-05T00:56:15.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.653+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.0 size=1048576 2024-09-05T00:56:15.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.657+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.1 size=1048576 2024-09-05T00:56:15.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.657+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.2 size=313971 2024-09-05T00:56:15.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.657+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=SV686RZ8GXGM tag=9W35YJ2FL870 type=write size=3459699 2024-09-05T00:56:15.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.661+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~HCTIXK7R0NL7.0 size=1048576 2024-09-05T00:56:15.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.661+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~HCTIXK7R0NL7.1 size=477152 2024-09-05T00:56:15.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.665+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=HCTIXK7R0NL7 tag=LIBQN2T3LWM3 type=write size=2574304 2024-09-05T00:56:15.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.669+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=8PD91E1AE3X4 type=del size=385082 2024-09-05T00:56:15.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.673+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=BCGHLL7012MM type=del size=855071 2024-09-05T00:56:15.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.677+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.0 size=1048576 2024-09-05T00:56:15.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.677+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.1 size=1048576 2024-09-05T00:56:15.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.681+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.2 size=963007 2024-09-05T00:56:15.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.681+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=U44OK0D6JCMG tag=5SZ0LGSO444Q type=write size=4108735 2024-09-05T00:56:15.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.681+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~KRS1IUQXIISI.0 size=465410 2024-09-05T00:56:15.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.689+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=KRS1IUQXIISI tag=9IVSCXH8QJ2E type=write size=1513986 2024-09-05T00:56:15.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.693+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~9D0D5DH87OC7.0 size=435594 2024-09-05T00:56:15.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.693+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=9D0D5DH87OC7 tag=0XQGLTORXRWL type=write size=1484170 2024-09-05T00:56:15.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.693+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~KZFL4P594JH1.0 size=253885 2024-09-05T00:56:15.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.697+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=KZFL4P594JH1 tag=T0RBL81ZGMD7 type=write size=1302461 2024-09-05T00:56:15.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.705+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~OQO8X3L3AVUU.0 size=360576 2024-09-05T00:56:15.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.705+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=OQO8X3L3AVUU tag=W2328RPRH66N type=write size=1409152 2024-09-05T00:56:15.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.705+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=YZ5CZAZF332X type=del 2024-09-05T00:56:15.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.709+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=K6QOZDG8DXKK type=del size=3119599 2024-09-05T00:56:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.713+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.0 size=1048576 2024-09-05T00:56:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.713+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.1 size=1048576 2024-09-05T00:56:15.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.717+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~THUSPC6R1J5B.2 size=201051 2024-09-05T00:56:15.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.721+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=THUSPC6R1J5B tag=K4YZ0FIRG1OF type=write size=3346779 2024-09-05T00:56:15.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.725+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=0AM22YEOIZSN type=del size=284379 2024-09-05T00:56:15.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.725+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.0 size=1048576 2024-09-05T00:56:15.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.729+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.1 size=1048576 2024-09-05T00:56:15.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.729+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~HHIONT1KVH6B.2 size=458656 2024-09-05T00:56:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.737+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=HHIONT1KVH6B tag=QFL9S7RV1QS5 type=write size=3604384 2024-09-05T00:56:15.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.737+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=YDD6LQXL0VVY type=del size=4010859 2024-09-05T00:56:15.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.741+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=1Z8QIZKW7HR2 type=del 2024-09-05T00:56:15.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.745+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~Y2ZZF4AQNDVW.0 size=494409 2024-09-05T00:56:15.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.745+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=Y2ZZF4AQNDVW tag=26J05Q6IL1V9 type=write size=1542985 2024-09-05T00:56:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.749+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~6N7ETXH7BJDY.0 size=964177 2024-09-05T00:56:15.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.753+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=6N7ETXH7BJDY tag=25L5SZAZ24IB type=write size=2012753 2024-09-05T00:56:15.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.757+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=9RLVZV7EB79W type=del size=3526969 2024-09-05T00:56:15.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.757+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=B1M8XGFNXZLO type=del 2024-09-05T00:56:15.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.761+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.0 size=1048576 2024-09-05T00:56:15.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.765+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.1 size=1048576 2024-09-05T00:56:15.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.769+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.2 size=76484 2024-09-05T00:56:15.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.769+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=HH2C9X1S10JS tag=8H4XN0CGB4GU type=write size=3222212 2024-09-05T00:56:15.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.773+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=EDY4D8F9ZAM2 type=del 2024-09-05T00:56:15.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.777+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=Y6ECB7MNZ02L type=del size=964446 2024-09-05T00:56:15.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.777+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=0GEZW82P1YN9 type=del size=3278653 2024-09-05T00:56:15.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.785+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~EJ2VBIA1DWYD.0 size=1048576 2024-09-05T00:56:15.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.785+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~EJ2VBIA1DWYD.1 size=885174 2024-09-05T00:56:15.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.785+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=EJ2VBIA1DWYD tag=A6IFV6ZM305L type=write size=2982326 2024-09-05T00:56:15.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.789+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~PME3E5P041MZ.0 size=696553 2024-09-05T00:56:15.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.793+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=PME3E5P041MZ tag=WQELOU46OKER type=write size=1745129 2024-09-05T00:56:15.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.793+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=WGT43SB08ZQY type=write size=189544 2024-09-05T00:56:15.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.797+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~0P2C5KJ4W7JP.0 size=1048576 2024-09-05T00:56:15.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.797+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~0P2C5KJ4W7JP.1 size=108653 2024-09-05T00:56:15.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.801+0000 7f325adab8c0 1 < canceled multipart upload key=5WOUI4SHYTSS upload=0P2C5KJ4W7JP tag=WPYFY5BV0Q8E type=write size=2205805 2024-09-05T00:56:15.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.805+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=AFGR865EESK8 type=del size=1054381 2024-09-05T00:56:15.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.805+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=2UZUIU17NFB5 type=del 2024-09-05T00:56:15.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.809+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=PCVU8DT2HDEX type=del size=3140800 2024-09-05T00:56:15.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.813+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.0 size=1048576 2024-09-05T00:56:15.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.813+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.1 size=1048576 2024-09-05T00:56:15.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.817+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~SV686RZ8GXGM.2 size=313971 2024-09-05T00:56:15.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.821+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=SV686RZ8GXGM tag=9W35YJ2FL870 type=write size=3459699 2024-09-05T00:56:15.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.825+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=S1NKTZLE3XRL type=del size=4018715 2024-09-05T00:56:15.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.825+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=8PD91E1AE3X4 type=del 2024-09-05T00:56:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.829+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=L3DMAH61E01B type=write size=595186 2024-09-05T00:56:15.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.833+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.0 size=1048576 2024-09-05T00:56:15.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.833+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.1 size=1048576 2024-09-05T00:56:15.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.837+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~U44OK0D6JCMG.2 size=963007 2024-09-05T00:56:15.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.841+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=U44OK0D6JCMG tag=5SZ0LGSO444Q type=write size=4108735 2024-09-05T00:56:15.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.849+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~PCD15AX7AUA0.0 size=1048576 2024-09-05T00:56:15.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.849+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~PCD15AX7AUA0.1 size=379365 2024-09-05T00:56:15.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.849+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=PCD15AX7AUA0 tag=3K1CMVAHUP8V type=write size=2476517 2024-09-05T00:56:15.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.853+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~9D0D5DH87OC7.0 size=435594 2024-09-05T00:56:15.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.857+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=9D0D5DH87OC7 tag=0XQGLTORXRWL type=write size=1484170 2024-09-05T00:56:15.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.861+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=UP9WMI7P46IY type=del size=515209 2024-09-05T00:56:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.865+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~OQO8X3L3AVUU.0 size=360576 2024-09-05T00:56:15.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.869+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=OQO8X3L3AVUU tag=W2328RPRH66N type=write size=1409152 2024-09-05T00:56:15.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.869+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=3BC0GFI82TK7 type=write size=265428 2024-09-05T00:56:15.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.873+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=K6QOZDG8DXKK type=del 2024-09-05T00:56:15.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.877+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=3K9RYXJM662W type=del size=1356157 2024-09-05T00:56:15.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.881+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=0AM22YEOIZSN type=del 2024-09-05T00:56:15.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.885+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~H8N1YA8H52ZF.0 size=1048576 2024-09-05T00:56:15.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.889+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~H8N1YA8H52ZF.1 size=885698 2024-09-05T00:56:15.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.889+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=H8N1YA8H52ZF tag=66T9GV2J3DBH type=write size=2982850 2024-09-05T00:56:15.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.893+0000 7f325adab8c0 1 < suggested remove operation key=079QFDETDGGC tag=YDD6LQXL0VVY type=del 2024-09-05T00:56:15.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.897+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=BUD0AEUZ23WP type=del size=3389753 2024-09-05T00:56:15.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.901+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~Y2ZZF4AQNDVW.0 size=494409 2024-09-05T00:56:15.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.909+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=Y2ZZF4AQNDVW tag=26J05Q6IL1V9 type=write size=1542985 2024-09-05T00:56:15.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.909+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=XVJGSOIOI4VT type=del size=1827432 2024-09-05T00:56:15.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.913+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=9RLVZV7EB79W type=del 2024-09-05T00:56:15.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.921+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.0 size=1048576 2024-09-05T00:56:15.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.925+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.1 size=1048576 2024-09-05T00:56:15.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.925+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.2 size=379347 2024-09-05T00:56:15.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.925+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=58YKUTWX4WXU tag=81XXY4JTHH4T type=write size=3525075 2024-09-05T00:56:15.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.929+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.0 size=1048576 2024-09-05T00:56:15.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.933+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.1 size=1048576 2024-09-05T00:56:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.937+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~HH2C9X1S10JS.2 size=76484 2024-09-05T00:56:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.941+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=HH2C9X1S10JS tag=8H4XN0CGB4GU type=write size=3222212 2024-09-05T00:56:15.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.945+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=1TEPCM8MLRNS type=del size=1509165 2024-09-05T00:56:15.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.949+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=Y6ECB7MNZ02L type=del 2024-09-05T00:56:15.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.953+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~3B70DCHIGG1R.0 size=1048576 2024-09-05T00:56:15.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.957+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~3B70DCHIGG1R.1 size=854389 2024-09-05T00:56:15.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.957+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=3B70DCHIGG1R tag=JXSKVNFCNF42 type=write size=2951541 2024-09-05T00:56:15.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.957+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~EJ2VBIA1DWYD.0 size=1048576 2024-09-05T00:56:15.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.961+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~EJ2VBIA1DWYD.1 size=885174 2024-09-05T00:56:15.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.965+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=EJ2VBIA1DWYD tag=A6IFV6ZM305L type=write size=2982326 2024-09-05T00:56:15.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.965+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=S6D01YGZ5R9J type=del size=3145680 2024-09-05T00:56:15.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.969+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=WGT43SB08ZQY type=write size=189544 2024-09-05T00:56:15.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.973+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=7IQ6ZEIR4W3L type=del size=1669696 2024-09-05T00:56:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.977+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=AFGR865EESK8 type=del 2024-09-05T00:56:15.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.977+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=OWCXT5LDQXVA type=del size=2840942 2024-09-05T00:56:15.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.981+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=PCVU8DT2HDEX type=del 2024-09-05T00:56:15.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.989+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~19QILTYAJ29C.0 size=126538 2024-09-05T00:56:15.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.989+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=19QILTYAJ29C tag=IGZY3BL6GQCT type=write size=1175114 2024-09-05T00:56:15.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.989+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=S1NKTZLE3XRL type=del 2024-09-05T00:56:15.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.993+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=TXUHQMP93C11 type=del size=3106008 2024-09-05T00:56:16.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:15.997+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=L3DMAH61E01B type=write size=595186 2024-09-05T00:56:16.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.001+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.0 size=1048576 2024-09-05T00:56:16.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.005+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.1 size=1048576 2024-09-05T00:56:16.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.005+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.2 size=982734 2024-09-05T00:56:16.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.005+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=SNM12IQBQD21 tag=DR7YZEPIA4LZ type=write size=4128462 2024-09-05T00:56:16.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.009+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~PCD15AX7AUA0.0 size=1048576 2024-09-05T00:56:16.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.013+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~PCD15AX7AUA0.1 size=379365 2024-09-05T00:56:16.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.017+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=PCD15AX7AUA0 tag=3K1CMVAHUP8V type=write size=2476517 2024-09-05T00:56:16.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.021+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=CH39GQHQNJHH type=del size=1483102 2024-09-05T00:56:16.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.021+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=UP9WMI7P46IY type=del 2024-09-05T00:56:16.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.025+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=9S2YMJQP7L0P type=write size=399988 2024-09-05T00:56:16.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.029+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=3BC0GFI82TK7 type=write size=265428 2024-09-05T00:56:16.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.033+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=8BZTWEAJ40H0 type=del size=2252044 2024-09-05T00:56:16.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.033+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=3K9RYXJM662W type=del 2024-09-05T00:56:16.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.041+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.0 size=1048576 2024-09-05T00:56:16.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.041+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.1 size=1048576 2024-09-05T00:56:16.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.049+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.2 size=43633 2024-09-05T00:56:16.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.049+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=HGQ9N1G467FL tag=XVOTKZX7WR0J type=write size=3189361 2024-09-05T00:56:16.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.053+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~H8N1YA8H52ZF.0 size=1048576 2024-09-05T00:56:16.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.053+0000 7f325adab8c0 1 < canceled part key=_multipart_MBJLOE5XFPYN.2~H8N1YA8H52ZF.1 size=885698 2024-09-05T00:56:16.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.057+0000 7f325adab8c0 1 < canceled multipart upload key=MBJLOE5XFPYN upload=H8N1YA8H52ZF tag=66T9GV2J3DBH type=write size=2982850 2024-09-05T00:56:16.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.057+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=V7GF1HT3FBWH type=del size=330476 2024-09-05T00:56:16.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.061+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=BUD0AEUZ23WP type=del 2024-09-05T00:56:16.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.069+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.0 size=1048576 2024-09-05T00:56:16.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.069+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.1 size=1048576 2024-09-05T00:56:16.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.073+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.2 size=136700 2024-09-05T00:56:16.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.073+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=LPEXAC03M92K tag=SSCNR9ETVXG2 type=write size=3282428 2024-09-05T00:56:16.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.073+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=XVJGSOIOI4VT type=del 2024-09-05T00:56:16.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.077+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=65R26I0YK8MO type=write size=386500 2024-09-05T00:56:16.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.081+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.0 size=1048576 2024-09-05T00:56:16.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.085+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.1 size=1048576 2024-09-05T00:56:16.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.085+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~58YKUTWX4WXU.2 size=379347 2024-09-05T00:56:16.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.089+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=58YKUTWX4WXU tag=81XXY4JTHH4T type=write size=3525075 2024-09-05T00:56:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.093+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=CXKN0ZIAHJIE type=del size=971318 2024-09-05T00:56:16.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.097+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=1TEPCM8MLRNS type=del 2024-09-05T00:56:16.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.097+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=FGQ8HM3TFLGC type=write size=291956 2024-09-05T00:56:16.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.101+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~3B70DCHIGG1R.0 size=1048576 2024-09-05T00:56:16.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.105+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~3B70DCHIGG1R.1 size=854389 2024-09-05T00:56:16.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.109+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=3B70DCHIGG1R tag=JXSKVNFCNF42 type=write size=2951541 2024-09-05T00:56:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.109+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=1TS8FFDVE2CC type=write size=938606 2024-09-05T00:56:16.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.113+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=S6D01YGZ5R9J type=del 2024-09-05T00:56:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.117+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=68OO3TST8QWL type=del size=906367 2024-09-05T00:56:16.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.117+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=7IQ6ZEIR4W3L type=del 2024-09-05T00:56:16.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.121+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=QYZI1RHL3UIY type=del size=1968916 2024-09-05T00:56:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.125+0000 7f325adab8c0 1 < suggested remove operation key=GU25IIQWQNR2 tag=OWCXT5LDQXVA type=del 2024-09-05T00:56:16.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.129+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.0 size=1048576 2024-09-05T00:56:16.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.133+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.1 size=1048576 2024-09-05T00:56:16.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.133+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.2 size=461916 2024-09-05T00:56:16.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.133+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=JU7P4SP10QSX tag=4URW25I1NJQK type=write size=3607644 2024-09-05T00:56:16.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.137+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~19QILTYAJ29C.0 size=126538 2024-09-05T00:56:16.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.141+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=19QILTYAJ29C tag=IGZY3BL6GQCT type=write size=1175114 2024-09-05T00:56:16.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.145+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=4TW03YA8A9XI type=write size=393354 2024-09-05T00:56:16.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.149+0000 7f325adab8c0 1 < suggested update operation key=SP188HM5LG2D tag=TXUHQMP93C11 type=del size=3106008 2024-09-05T00:56:16.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.153+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=LOAERNL04822 type=del size=644189 2024-09-05T00:56:16.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.157+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.0 size=1048576 2024-09-05T00:56:16.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.157+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.1 size=1048576 2024-09-05T00:56:16.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.157+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~SNM12IQBQD21.2 size=982734 2024-09-05T00:56:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.161+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=SNM12IQBQD21 tag=DR7YZEPIA4LZ type=write size=4128462 2024-09-05T00:56:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.165+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=MY8E8RDJX2AW type=del size=3203227 2024-09-05T00:56:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.169+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=CH39GQHQNJHH type=del 2024-09-05T00:56:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.173+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~E80R82QPPRUE.0 size=47239 2024-09-05T00:56:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.173+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=E80R82QPPRUE tag=PGROZLB97CQ6 type=write size=1095815 2024-09-05T00:56:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.177+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=9S2YMJQP7L0P type=write size=399988 2024-09-05T00:56:16.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.177+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=OHV2G1C63WL2 type=write size=208163 2024-09-05T00:56:16.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.181+0000 7f325adab8c0 -1 < failed to complete operation key=SP188HM5LG2D tag=8BZTWEAJ40H0 type=del size=2252044: (22) Invalid argument 2024-09-05T00:56:16.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.181+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=PE1289T15C0D type=del size=1365614 2024-09-05T00:56:16.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.185+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.0 size=1048576 2024-09-05T00:56:16.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.189+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.1 size=1048576 2024-09-05T00:56:16.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.189+0000 7f325adab8c0 1 < canceled part key=_multipart_JKRZR0KRE93F.2~HGQ9N1G467FL.2 size=43633 2024-09-05T00:56:16.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.193+0000 7f325adab8c0 1 < canceled multipart upload key=JKRZR0KRE93F upload=HGQ9N1G467FL tag=XVOTKZX7WR0J type=write size=3189361 2024-09-05T00:56:16.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.197+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~EGFA3BKK15D4.0 size=1048576 2024-09-05T00:56:16.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.201+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~EGFA3BKK15D4.1 size=774452 2024-09-05T00:56:16.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.201+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=EGFA3BKK15D4 tag=R0XB0HZSLLD1 type=write size=2871604 2024-09-05T00:56:16.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.205+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=V7GF1HT3FBWH type=del 2024-09-05T00:56:16.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.209+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~X0L7990CAF3O.0 size=1048576 2024-09-05T00:56:16.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.209+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~X0L7990CAF3O.1 size=1026767 2024-09-05T00:56:16.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.209+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=X0L7990CAF3O tag=YI1NYW9MJKSJ type=write size=3123919 2024-09-05T00:56:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.213+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.0 size=1048576 2024-09-05T00:56:16.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.213+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.1 size=1048576 2024-09-05T00:56:16.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.217+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~LPEXAC03M92K.2 size=136700 2024-09-05T00:56:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.221+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=LPEXAC03M92K tag=SSCNR9ETVXG2 type=write size=3282428 2024-09-05T00:56:16.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.225+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~9GEBYO0Z0WBK.0 size=1048576 2024-09-05T00:56:16.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.229+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~9GEBYO0Z0WBK.1 size=748198 2024-09-05T00:56:16.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.229+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=9GEBYO0Z0WBK tag=AWHNYPEJU0TL type=write size=2845350 2024-09-05T00:56:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.233+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=65R26I0YK8MO type=write size=386500 2024-09-05T00:56:16.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.237+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.0 size=1048576 2024-09-05T00:56:16.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.237+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.1 size=1048576 2024-09-05T00:56:16.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.241+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.2 size=718339 2024-09-05T00:56:16.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.241+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=35CQ2WKLEP59 tag=WORNJMICAFWN type=write size=3864067 2024-09-05T00:56:16.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.245+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=CXKN0ZIAHJIE type=del 2024-09-05T00:56:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.249+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~ESMGA1NYQH1F.0 size=84541 2024-09-05T00:56:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.249+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=ESMGA1NYQH1F tag=H3XAMDKSO8HZ type=write size=1133117 2024-09-05T00:56:16.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.253+0000 7f325adab8c0 1 < completed write operation key=ZYT3WYNFIIZN tag=FGQ8HM3TFLGC type=write size=291956 2024-09-05T00:56:16.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.257+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=7CGGVLU5TD8W type=del size=1596924 2024-09-05T00:56:16.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.257+0000 7f325adab8c0 1 < completed write operation key=9O7DVR04PCDB tag=1TS8FFDVE2CC type=write size=938606 2024-09-05T00:56:16.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.265+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~17GJ0FRME0KI.0 size=72349 2024-09-05T00:56:16.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.265+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=17GJ0FRME0KI tag=P5SN1VKDEY25 type=write size=1120925 2024-09-05T00:56:16.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.265+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=68OO3TST8QWL type=del 2024-09-05T00:56:16.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.269+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=BQ9QXOATY02D type=del size=1630463 2024-09-05T00:56:16.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.273+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=QYZI1RHL3UIY type=del 2024-09-05T00:56:16.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.277+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=HKEWDRPI7DI2 type=write size=301342 2024-09-05T00:56:16.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.277+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.0 size=1048576 2024-09-05T00:56:16.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.281+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.1 size=1048576 2024-09-05T00:56:16.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.285+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~JU7P4SP10QSX.2 size=461916 2024-09-05T00:56:16.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.289+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=JU7P4SP10QSX tag=4URW25I1NJQK type=write size=3607644 2024-09-05T00:56:16.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.289+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=C6GT19KZGUYM type=del size=1767276 2024-09-05T00:56:16.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.293+0000 7f325adab8c0 1 < completed write operation key=UW0SSQ8VFY1G tag=4TW03YA8A9XI type=write size=393354 2024-09-05T00:56:16.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.297+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=3D76B14MGPPY type=del size=228549 2024-09-05T00:56:16.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.297+0000 7f325adab8c0 1 < canceled operation key=5WOUI4SHYTSS tag=LOAERNL04822 type=del size=644189 2024-09-05T00:56:16.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.301+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=OMEK44O6F08A type=del size=1037177 2024-09-05T00:56:16.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.309+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=MY8E8RDJX2AW type=del 2024-09-05T00:56:16.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.313+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~1G1X05ELQB4G.0 size=596863 2024-09-05T00:56:16.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.313+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=1G1X05ELQB4G tag=2X08DHZ1CXSO type=write size=1645439 2024-09-05T00:56:16.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.317+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~E80R82QPPRUE.0 size=47239 2024-09-05T00:56:16.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.321+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=E80R82QPPRUE tag=PGROZLB97CQ6 type=write size=1095815 2024-09-05T00:56:16.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.321+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=CWRKQCD3Q4HL type=del size=3013985 2024-09-05T00:56:16.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.325+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=OHV2G1C63WL2 type=write size=208163 2024-09-05T00:56:16.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.325+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=ACTJDFX6T3PG type=del size=1957789 2024-09-05T00:56:16.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.329+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=PE1289T15C0D type=del 2024-09-05T00:56:16.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.333+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=7H6M9HSA3YKP type=write size=559926 2024-09-05T00:56:16.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.337+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~EGFA3BKK15D4.0 size=1048576 2024-09-05T00:56:16.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.337+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~EGFA3BKK15D4.1 size=774452 2024-09-05T00:56:16.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.345+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=EGFA3BKK15D4 tag=R0XB0HZSLLD1 type=write size=2871604 2024-09-05T00:56:16.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.345+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=LUMKLWJZEP17 type=del size=1792043 2024-09-05T00:56:16.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.349+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~X0L7990CAF3O.0 size=1048576 2024-09-05T00:56:16.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.349+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~X0L7990CAF3O.1 size=1026767 2024-09-05T00:56:16.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.353+0000 7f325adab8c0 1 < canceled multipart upload key=5WOUI4SHYTSS upload=X0L7990CAF3O tag=YI1NYW9MJKSJ type=write size=3123919 2024-09-05T00:56:16.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.357+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=DL9C5266JYYI type=del size=4017276 2024-09-05T00:56:16.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.361+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~9GEBYO0Z0WBK.0 size=1048576 2024-09-05T00:56:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.361+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~9GEBYO0Z0WBK.1 size=748198 2024-09-05T00:56:16.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.369+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=9GEBYO0Z0WBK tag=AWHNYPEJU0TL type=write size=2845350 2024-09-05T00:56:16.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.369+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=5CDG1W6PI0QU type=write size=670429 2024-09-05T00:56:16.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.373+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.0 size=1048576 2024-09-05T00:56:16.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.377+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.1 size=1048576 2024-09-05T00:56:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.377+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~35CQ2WKLEP59.2 size=718339 2024-09-05T00:56:16.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.385+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=35CQ2WKLEP59 tag=WORNJMICAFWN type=write size=3864067 2024-09-05T00:56:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.385+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=QAWHLGD3XK6H type=del size=1447443 2024-09-05T00:56:16.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.389+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~ESMGA1NYQH1F.0 size=84541 2024-09-05T00:56:16.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.393+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=ESMGA1NYQH1F tag=H3XAMDKSO8HZ type=write size=1133117 2024-09-05T00:56:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.397+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~MC0YOEXZHD32.0 size=122346 2024-09-05T00:56:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.397+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=MC0YOEXZHD32 tag=DAWEYQEDMJFO type=write size=1170922 2024-09-05T00:56:16.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.401+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=7CGGVLU5TD8W type=del 2024-09-05T00:56:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.405+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=A017XDWIR3DI type=del size=591839 2024-09-05T00:56:16.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.405+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~17GJ0FRME0KI.0 size=72349 2024-09-05T00:56:16.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.409+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=17GJ0FRME0KI tag=P5SN1VKDEY25 type=write size=1120925 2024-09-05T00:56:16.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.417+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.0 size=1048576 2024-09-05T00:56:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.417+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.1 size=1048576 2024-09-05T00:56:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.421+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.2 size=570696 2024-09-05T00:56:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.421+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=UEL0G05R4YEM tag=JAD9GP6CJPGS type=write size=3716424 2024-09-05T00:56:16.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.421+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=BQ9QXOATY02D type=del 2024-09-05T00:56:16.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.425+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=J1MTD4VO40P2 type=del size=3056599 2024-09-05T00:56:16.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.433+0000 7f325adab8c0 1 < suggested update operation key=O0RSK2S88XHP tag=HKEWDRPI7DI2 type=write size=301342 2024-09-05T00:56:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.437+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~QI21VPM8JVD6.0 size=531620 2024-09-05T00:56:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.437+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=QI21VPM8JVD6 tag=UZY6BDJI0IKO type=write size=1580196 2024-09-05T00:56:16.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.441+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=C6GT19KZGUYM type=del 2024-09-05T00:56:16.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.441+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=G40LP32ZMS4K type=del size=2524212 2024-09-05T00:56:16.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.445+0000 7f325adab8c0 1 < canceled operation key=VYMRZPO6VKGS tag=3D76B14MGPPY type=del size=228549 2024-09-05T00:56:16.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.453+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.0 size=1048576 2024-09-05T00:56:16.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.453+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.1 size=1048576 2024-09-05T00:56:16.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.457+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.2 size=747259 2024-09-05T00:56:16.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.457+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=JW2UMOWPT71X tag=2TESHUB8JL7Y type=write size=3892987 2024-09-05T00:56:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.461+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=OMEK44O6F08A type=del size=1037177 2024-09-05T00:56:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.465+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=5BYRZZXNUC87 type=del size=2574486 2024-09-05T00:56:16.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.465+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~1G1X05ELQB4G.0 size=596863 2024-09-05T00:56:16.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.469+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=1G1X05ELQB4G tag=2X08DHZ1CXSO type=write size=1645439 2024-09-05T00:56:16.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.473+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=RFOAKI93QUTE type=del size=1437562 2024-09-05T00:56:16.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.477+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=CWRKQCD3Q4HL type=del 2024-09-05T00:56:16.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.481+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=DX87N4LZ8L9B type=del size=897613 2024-09-05T00:56:16.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.485+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=ACTJDFX6T3PG type=del 2024-09-05T00:56:16.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.489+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~95KAQTS9I7O4.0 size=1048576 2024-09-05T00:56:16.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.493+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~95KAQTS9I7O4.1 size=304471 2024-09-05T00:56:16.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.493+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=95KAQTS9I7O4 tag=0F6XUW3VZ3R5 type=write size=2401623 2024-09-05T00:56:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.497+0000 7f325adab8c0 -1 < failed to complete operation key=O0RSK2S88XHP tag=7H6M9HSA3YKP type=write size=559926: (22) Invalid argument 2024-09-05T00:56:16.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.501+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=68OSLOZKI97T type=del size=2837479 2024-09-05T00:56:16.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.505+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=LUMKLWJZEP17 type=del 2024-09-05T00:56:16.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.505+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=63LKV46BBWGG type=del size=1126580 2024-09-05T00:56:16.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.509+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=DL9C5266JYYI type=del 2024-09-05T00:56:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.513+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~G424225FB525.0 size=554302 2024-09-05T00:56:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.513+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=G424225FB525 tag=R3MER9VQRCEM type=write size=1602878 2024-09-05T00:56:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.517+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=5CDG1W6PI0QU type=write size=670429 2024-09-05T00:56:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.521+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KG2MR4NEXXF4.0 size=374913 2024-09-05T00:56:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.521+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=KG2MR4NEXXF4 tag=HDTHW37J4BBI type=write size=1423489 2024-09-05T00:56:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.525+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=QAWHLGD3XK6H type=del 2024-09-05T00:56:16.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.525+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=ZB23HIIO3Y0U type=del size=191486 2024-09-05T00:56:16.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.529+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~MC0YOEXZHD32.0 size=122346 2024-09-05T00:56:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.533+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=MC0YOEXZHD32 tag=DAWEYQEDMJFO type=write size=1170922 2024-09-05T00:56:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.537+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=5DJ29NXGFQ9G type=del size=755105 2024-09-05T00:56:16.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.541+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=A017XDWIR3DI type=del 2024-09-05T00:56:16.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.541+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=6K0CUXOCA9CZ type=write size=777273 2024-09-05T00:56:16.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.545+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.0 size=1048576 2024-09-05T00:56:16.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.545+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.1 size=1048576 2024-09-05T00:56:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.549+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~UEL0G05R4YEM.2 size=570696 2024-09-05T00:56:16.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.553+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=UEL0G05R4YEM tag=JAD9GP6CJPGS type=write size=3716424 2024-09-05T00:56:16.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.557+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=53QPRM15Z2YC type=del size=3895776 2024-09-05T00:56:16.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.561+0000 7f325adab8c0 1 < suggested remove operation key=5WOUI4SHYTSS tag=J1MTD4VO40P2 type=del 2024-09-05T00:56:16.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.565+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.0 size=1048576 2024-09-05T00:56:16.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.565+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.1 size=1048576 2024-09-05T00:56:16.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.573+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.2 size=764076 2024-09-05T00:56:16.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.573+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=0CPN2LCY9133 tag=52OGFFP0UPJW type=write size=3909804 2024-09-05T00:56:16.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.573+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~QI21VPM8JVD6.0 size=531620 2024-09-05T00:56:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.581+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=QI21VPM8JVD6 tag=UZY6BDJI0IKO type=write size=1580196 2024-09-05T00:56:16.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.581+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=PRXWIY194PWO type=del size=3137513 2024-09-05T00:56:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.585+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=G40LP32ZMS4K type=del 2024-09-05T00:56:16.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.589+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=Y65CWNTUXDAY type=del size=1407977 2024-09-05T00:56:16.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.589+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.0 size=1048576 2024-09-05T00:56:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.593+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.1 size=1048576 2024-09-05T00:56:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.597+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~JW2UMOWPT71X.2 size=747259 2024-09-05T00:56:16.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.601+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=JW2UMOWPT71X tag=2TESHUB8JL7Y type=write size=3892987 2024-09-05T00:56:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.601+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=8GJUHNVXBTY7 type=del size=2756663 2024-09-05T00:56:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.605+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=5BYRZZXNUC87 type=del size=2574486: (22) Invalid argument 2024-09-05T00:56:16.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.609+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=EDSF326701NF type=del size=1630068 2024-09-05T00:56:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.613+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=RFOAKI93QUTE type=del size=1437562 2024-09-05T00:56:16.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.617+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~AAM43Z0CZB0J.0 size=1048576 2024-09-05T00:56:16.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.621+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~AAM43Z0CZB0J.1 size=872231 2024-09-05T00:56:16.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.621+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=AAM43Z0CZB0J tag=JCX39YVE8UYL type=write size=2969383 2024-09-05T00:56:16.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.625+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=DX87N4LZ8L9B type=del 2024-09-05T00:56:16.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.625+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=Y56SGQOI3EGL type=del size=2707777 2024-09-05T00:56:16.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.629+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~95KAQTS9I7O4.0 size=1048576 2024-09-05T00:56:16.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.633+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~95KAQTS9I7O4.1 size=304471 2024-09-05T00:56:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.637+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=95KAQTS9I7O4 tag=0F6XUW3VZ3R5 type=write size=2401623 2024-09-05T00:56:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.641+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~MW4ZL8Y6MIPN.0 size=446881 2024-09-05T00:56:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.641+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=MW4ZL8Y6MIPN tag=6095MTYXONRT type=write size=1495457 2024-09-05T00:56:16.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.645+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=68OSLOZKI97T type=del 2024-09-05T00:56:16.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.649+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.0 size=1048576 2024-09-05T00:56:16.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.653+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.1 size=1048576 2024-09-05T00:56:16.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.657+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.2 size=594017 2024-09-05T00:56:16.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.657+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=1FBNM9ZGG4G1 tag=N5VTREBM855Z type=write size=3739745 2024-09-05T00:56:16.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.661+0000 7f325adab8c0 1 < suggested remove operation key=LVZALGRNP5TU tag=63LKV46BBWGG type=del 2024-09-05T00:56:16.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.665+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=0OD1KXTXNENT type=write size=931307 2024-09-05T00:56:16.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.665+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~G424225FB525.0 size=554302 2024-09-05T00:56:16.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.669+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=G424225FB525 tag=R3MER9VQRCEM type=write size=1602878 2024-09-05T00:56:16.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.673+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=LEK01S11NOUN type=del size=408272 2024-09-05T00:56:16.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.677+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KG2MR4NEXXF4.0 size=374913 2024-09-05T00:56:16.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.681+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=KG2MR4NEXXF4 tag=HDTHW37J4BBI type=write size=1423489 2024-09-05T00:56:16.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.685+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=GO3YE3ZA92JK type=del size=3495776 2024-09-05T00:56:16.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.689+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=ZB23HIIO3Y0U type=del 2024-09-05T00:56:16.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.693+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~3ERKVH2LIRW9.0 size=477024 2024-09-05T00:56:16.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.693+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=3ERKVH2LIRW9 tag=5H4TRE8U20NL type=write size=1525600 2024-09-05T00:56:16.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.701+0000 7f325adab8c0 1 < suggested remove operation key=6N7BLJ1WLDGN tag=5DJ29NXGFQ9G type=del 2024-09-05T00:56:16.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.705+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.0 size=1048576 2024-09-05T00:56:16.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.709+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.1 size=1048576 2024-09-05T00:56:16.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.709+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.2 size=869919 2024-09-05T00:56:16.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.709+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=SUTEWVWJYRNO tag=WGZVWB6A5D01 type=write size=4015647 2024-09-05T00:56:16.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.713+0000 7f325adab8c0 1 < completed write operation key=NIAW4BKW21LG tag=6K0CUXOCA9CZ type=write size=777273 2024-09-05T00:56:16.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.717+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~WX0P9F3T3AE3.0 size=1048576 2024-09-05T00:56:16.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.721+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~WX0P9F3T3AE3.1 size=742969 2024-09-05T00:56:16.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.721+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=WX0P9F3T3AE3 tag=QLELK9628TU0 type=write size=2840121 2024-09-05T00:56:16.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.721+0000 7f325adab8c0 -1 < failed to complete operation key=6N7BLJ1WLDGN tag=53QPRM15Z2YC type=del size=3895776: (22) Invalid argument 2024-09-05T00:56:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.725+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~VEBWS4QHMHC2.0 size=1048576 2024-09-05T00:56:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.729+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~VEBWS4QHMHC2.1 size=432905 2024-09-05T00:56:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.729+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=VEBWS4QHMHC2 tag=QCC5E8T7A7XW type=write size=2530057 2024-09-05T00:56:16.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.729+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.0 size=1048576 2024-09-05T00:56:16.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.733+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.1 size=1048576 2024-09-05T00:56:16.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.733+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~0CPN2LCY9133.2 size=764076 2024-09-05T00:56:16.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.741+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=0CPN2LCY9133 tag=52OGFFP0UPJW type=write size=3909804 2024-09-05T00:56:16.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.741+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=6NXV56MMEIZN type=del size=3394814 2024-09-05T00:56:16.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.745+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=PRXWIY194PWO type=del 2024-09-05T00:56:16.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.749+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=LV3A391JKXI1 type=del size=3885490 2024-09-05T00:56:16.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.753+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=Y65CWNTUXDAY type=del size=1407977 2024-09-05T00:56:16.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.757+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=QAB72SJ85IU5 type=del size=892792 2024-09-05T00:56:16.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.757+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=8GJUHNVXBTY7 type=del 2024-09-05T00:56:16.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.765+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~GXOS2JDCA15K.0 size=1048576 2024-09-05T00:56:16.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.765+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~GXOS2JDCA15K.1 size=181900 2024-09-05T00:56:16.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.765+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=GXOS2JDCA15K tag=469GD2R4RVC4 type=write size=2279052 2024-09-05T00:56:16.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.769+0000 7f325adab8c0 -1 < failed to complete operation key=6N7BLJ1WLDGN tag=EDSF326701NF type=del size=1630068: (22) Invalid argument 2024-09-05T00:56:16.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.773+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~W3S8J4GBBLCE.0 size=461448 2024-09-05T00:56:16.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.773+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=W3S8J4GBBLCE tag=TSGV9MZ1GSYQ type=write size=1510024 2024-09-05T00:56:16.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.777+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~AAM43Z0CZB0J.0 size=1048576 2024-09-05T00:56:16.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.781+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~AAM43Z0CZB0J.1 size=872231 2024-09-05T00:56:16.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.785+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=AAM43Z0CZB0J tag=JCX39YVE8UYL type=write size=2969383 2024-09-05T00:56:16.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.793+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~0A5H5TY9NCWX.0 size=106881 2024-09-05T00:56:16.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.793+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=0A5H5TY9NCWX tag=MCK2VKZ1ICJV type=write size=1155457 2024-09-05T00:56:16.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.793+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=Y56SGQOI3EGL type=del 2024-09-05T00:56:16.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.797+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=6H20P0N40SVS type=write size=315240 2024-09-05T00:56:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.801+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~MW4ZL8Y6MIPN.0 size=446881 2024-09-05T00:56:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.805+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=MW4ZL8Y6MIPN tag=6095MTYXONRT type=write size=1495457 2024-09-05T00:56:16.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.813+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.0 size=1048576 2024-09-05T00:56:16.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.813+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.1 size=1048576 2024-09-05T00:56:16.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.817+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.2 size=356795 2024-09-05T00:56:16.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.817+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=1DHEJR1QEUDE tag=J09DIAXSS6K3 type=write size=3502523 2024-09-05T00:56:16.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.821+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.0 size=1048576 2024-09-05T00:56:16.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.821+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.1 size=1048576 2024-09-05T00:56:16.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.825+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~1FBNM9ZGG4G1.2 size=594017 2024-09-05T00:56:16.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.829+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=1FBNM9ZGG4G1 tag=N5VTREBM855Z type=write size=3739745 2024-09-05T00:56:16.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.833+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=NE6FA6GSF2XG type=del size=2166642 2024-09-05T00:56:16.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.837+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=0OD1KXTXNENT type=write size=931307 2024-09-05T00:56:16.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.845+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=AO542250S9UF type=del size=1175958 2024-09-05T00:56:16.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.845+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=LEK01S11NOUN type=del 2024-09-05T00:56:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.853+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~G1EK3XBA7ZKV.0 size=1048576 2024-09-05T00:56:16.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.857+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~G1EK3XBA7ZKV.1 size=242202 2024-09-05T00:56:16.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.857+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=G1EK3XBA7ZKV tag=0USVM1E81O2P type=write size=2339354 2024-09-05T00:56:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.857+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=GO3YE3ZA92JK type=del 2024-09-05T00:56:16.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.861+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=UVI99Q9TNK57 type=write size=879496 2024-09-05T00:56:16.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.865+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~3ERKVH2LIRW9.0 size=477024 2024-09-05T00:56:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.869+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=3ERKVH2LIRW9 tag=5H4TRE8U20NL type=write size=1525600 2024-09-05T00:56:16.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.873+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.0 size=1048576 2024-09-05T00:56:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.877+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.1 size=1048576 2024-09-05T00:56:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.877+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.2 size=662991 2024-09-05T00:56:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.877+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=7EIL16U9DATY tag=E6KRH4HQD21F type=write size=3808719 2024-09-05T00:56:16.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.881+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.0 size=1048576 2024-09-05T00:56:16.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.885+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.1 size=1048576 2024-09-05T00:56:16.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.885+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~SUTEWVWJYRNO.2 size=869919 2024-09-05T00:56:16.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.889+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=SUTEWVWJYRNO tag=WGZVWB6A5D01 type=write size=4015647 2024-09-05T00:56:16.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.897+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~2F552AAC025G.0 size=124690 2024-09-05T00:56:16.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.897+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=2F552AAC025G tag=XJFVWBR71JAO type=write size=1173266 2024-09-05T00:56:16.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.897+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~WX0P9F3T3AE3.0 size=1048576 2024-09-05T00:56:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.901+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~WX0P9F3T3AE3.1 size=742969 2024-09-05T00:56:16.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.905+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=WX0P9F3T3AE3 tag=QLELK9628TU0 type=write size=2840121 2024-09-05T00:56:16.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.909+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=CVHJ2RX2ZNQK type=del size=1186460 2024-09-05T00:56:16.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.913+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~VEBWS4QHMHC2.0 size=1048576 2024-09-05T00:56:16.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.913+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~VEBWS4QHMHC2.1 size=432905 2024-09-05T00:56:16.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.921+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=VEBWS4QHMHC2 tag=QCC5E8T7A7XW type=write size=2530057 2024-09-05T00:56:16.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.925+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.0 size=1048576 2024-09-05T00:56:16.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.929+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.1 size=1048576 2024-09-05T00:56:16.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.929+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.2 size=1043985 2024-09-05T00:56:16.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.929+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=10ZO339YMVXT tag=2FIB386MEAAH type=write size=4189713 2024-09-05T00:56:16.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.933+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=6NXV56MMEIZN type=del 2024-09-05T00:56:16.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.937+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=IA44YXD8UF3X type=del size=1988987 2024-09-05T00:56:16.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.941+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=LV3A391JKXI1 type=del 2024-09-05T00:56:16.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.945+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=WDHBG9E207SX type=del size=708040 2024-09-05T00:56:16.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.949+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=QAB72SJ85IU5 type=del 2024-09-05T00:56:16.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.949+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=U0U6GTDW3Q14 type=del size=3468964 2024-09-05T00:56:16.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.953+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~GXOS2JDCA15K.0 size=1048576 2024-09-05T00:56:16.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.957+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~GXOS2JDCA15K.1 size=181900 2024-09-05T00:56:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.961+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=GXOS2JDCA15K tag=469GD2R4RVC4 type=write size=2279052 2024-09-05T00:56:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.965+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=S2R6I7KBTNWO type=del size=1900312 2024-09-05T00:56:16.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.969+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~W3S8J4GBBLCE.0 size=461448 2024-09-05T00:56:16.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.977+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=W3S8J4GBBLCE tag=TSGV9MZ1GSYQ type=write size=1510024 2024-09-05T00:56:16.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.981+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.0 size=1048576 2024-09-05T00:56:16.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.985+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.1 size=1048576 2024-09-05T00:56:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.985+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.2 size=126552 2024-09-05T00:56:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.985+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=ZLX08UT62AQP tag=KNCKXSGIYYDZ type=write size=3272280 2024-09-05T00:56:16.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.989+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~0A5H5TY9NCWX.0 size=106881 2024-09-05T00:56:17.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:16.997+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=0A5H5TY9NCWX tag=MCK2VKZ1ICJV type=write size=1155457 2024-09-05T00:56:17.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.001+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~YZ3RE6836POT.0 size=522164 2024-09-05T00:56:17.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.001+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=YZ3RE6836POT tag=R41PE4UN8NL3 type=write size=1570740 2024-09-05T00:56:17.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.005+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=6H20P0N40SVS type=write size=315240 2024-09-05T00:56:17.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.009+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=A3GK1KPW5LY8 type=del size=935530 2024-09-05T00:56:17.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.013+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.0 size=1048576 2024-09-05T00:56:17.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.017+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.1 size=1048576 2024-09-05T00:56:17.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.017+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1DHEJR1QEUDE.2 size=356795 2024-09-05T00:56:17.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.025+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=1DHEJR1QEUDE tag=J09DIAXSS6K3 type=write size=3502523 2024-09-05T00:56:17.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.029+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.0 size=1048576 2024-09-05T00:56:17.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.033+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.1 size=1048576 2024-09-05T00:56:17.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.033+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.2 size=38384 2024-09-05T00:56:17.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.033+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=NCA8075VE54S tag=FRFJK0LKWI40 type=write size=3184112 2024-09-05T00:56:17.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.041+0000 7f325adab8c0 1 < suggested update operation key=LVZALGRNP5TU tag=NE6FA6GSF2XG type=del size=2166642 2024-09-05T00:56:17.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.045+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=AJP1FZ1GDWDY type=del size=1325238 2024-09-05T00:56:17.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.049+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=AO542250S9UF type=del 2024-09-05T00:56:17.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.053+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.0 size=1048576 2024-09-05T00:56:17.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.057+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.1 size=1048576 2024-09-05T00:56:17.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.057+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.2 size=940491 2024-09-05T00:56:17.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.057+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=A9BN773BXAOR tag=3AXGKG0HOWKH type=write size=4086219 2024-09-05T00:56:17.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.061+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~G1EK3XBA7ZKV.0 size=1048576 2024-09-05T00:56:17.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.065+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~G1EK3XBA7ZKV.1 size=242202 2024-09-05T00:56:17.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.069+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=G1EK3XBA7ZKV tag=0USVM1E81O2P type=write size=2339354 2024-09-05T00:56:17.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.073+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=W0KWCDR9HG50 type=write size=858113 2024-09-05T00:56:17.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.077+0000 7f325adab8c0 1 < completed write operation key=NIAW4BKW21LG tag=UVI99Q9TNK57 type=write size=879496 2024-09-05T00:56:17.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.081+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=JD9GU0EKSQ8H type=del size=878132 2024-09-05T00:56:17.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.085+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.0 size=1048576 2024-09-05T00:56:17.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.085+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.1 size=1048576 2024-09-05T00:56:17.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.089+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~7EIL16U9DATY.2 size=662991 2024-09-05T00:56:17.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.093+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=7EIL16U9DATY tag=E6KRH4HQD21F type=write size=3808719 2024-09-05T00:56:17.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.097+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=VXOQ2MYAB88J type=del size=1290219 2024-09-05T00:56:17.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.101+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~2F552AAC025G.0 size=124690 2024-09-05T00:56:17.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.105+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=2F552AAC025G tag=XJFVWBR71JAO type=write size=1173266 2024-09-05T00:56:17.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.109+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=8ATSXKD8IL3Y type=del size=3500756 2024-09-05T00:56:17.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.113+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=CVHJ2RX2ZNQK type=del 2024-09-05T00:56:17.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.117+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.0 size=1048576 2024-09-05T00:56:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.121+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.1 size=1048576 2024-09-05T00:56:17.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.121+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.2 size=591749 2024-09-05T00:56:17.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.121+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=NSTJ23R61TL1 tag=MYCDSXVWIY6O type=write size=3737477 2024-09-05T00:56:17.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.125+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.0 size=1048576 2024-09-05T00:56:17.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.129+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.1 size=1048576 2024-09-05T00:56:17.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.133+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~10ZO339YMVXT.2 size=1043985 2024-09-05T00:56:17.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.141+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=10ZO339YMVXT tag=2FIB386MEAAH type=write size=4189713 2024-09-05T00:56:17.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.141+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=ONQXHW3CZCX9 type=del size=183584 2024-09-05T00:56:17.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.149+0000 7f325adab8c0 1 < suggested remove operation key=NIAW4BKW21LG tag=IA44YXD8UF3X type=del 2024-09-05T00:56:17.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.157+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.0 size=1048576 2024-09-05T00:56:17.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.157+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.1 size=1048576 2024-09-05T00:56:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.161+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.2 size=550294 2024-09-05T00:56:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.161+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=EJQ38A7Q81WH tag=VO72YEV0JGS4 type=write size=3696022 2024-09-05T00:56:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.165+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=WDHBG9E207SX type=del 2024-09-05T00:56:17.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.165+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=INQXSYQITPJ7 type=del size=1687207 2024-09-05T00:56:17.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.169+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=U0U6GTDW3Q14 type=del 2024-09-05T00:56:17.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.173+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=1PYPF9F1KY8F type=del size=2196715 2024-09-05T00:56:17.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.177+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=S2R6I7KBTNWO type=del 2024-09-05T00:56:17.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.181+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=GPI70F2D0D5N type=del size=3100519 2024-09-05T00:56:17.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.185+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.0 size=1048576 2024-09-05T00:56:17.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.185+0000 7f325adab8c0 1 < canceled part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.1 size=1048576 2024-09-05T00:56:17.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.185+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~ZLX08UT62AQP.2 size=126552 2024-09-05T00:56:17.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.193+0000 7f325adab8c0 1 < canceled multipart upload key=D6HSFIRN2X4Q upload=ZLX08UT62AQP tag=KNCKXSGIYYDZ type=write size=3272280 2024-09-05T00:56:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.197+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.0 size=1048576 2024-09-05T00:56:17.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.201+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.1 size=1048576 2024-09-05T00:56:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.201+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.2 size=521822 2024-09-05T00:56:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.201+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=G5OQEVJ69ZI0 tag=02T6VSZQ91NM type=write size=3667550 2024-09-05T00:56:17.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.205+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~YZ3RE6836POT.0 size=522164 2024-09-05T00:56:17.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.209+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=YZ3RE6836POT tag=R41PE4UN8NL3 type=write size=1570740 2024-09-05T00:56:17.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~5E90ML92O433.0 size=117949 2024-09-05T00:56:17.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.217+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=5E90ML92O433 tag=IUNIDW3BZLJK type=write size=1166525 2024-09-05T00:56:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.221+0000 7f325adab8c0 1 < suggested remove operation key=YMIGZMLJSI4D tag=A3GK1KPW5LY8 type=del 2024-09-05T00:56:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.225+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~XMZMW70ZH7ET.0 size=1048576 2024-09-05T00:56:17.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.229+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~XMZMW70ZH7ET.1 size=977578 2024-09-05T00:56:17.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.229+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=XMZMW70ZH7ET tag=ZOIYJF6PHSUV type=write size=3074730 2024-09-05T00:56:17.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.233+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.0 size=1048576 2024-09-05T00:56:17.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.233+0000 7f325adab8c0 1 < canceled part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.1 size=1048576 2024-09-05T00:56:17.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.233+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~NCA8075VE54S.2 size=38384 2024-09-05T00:56:17.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.237+0000 7f325adab8c0 1 < canceled multipart upload key=06YHJGLZQLK6 upload=NCA8075VE54S tag=FRFJK0LKWI40 type=write size=3184112 2024-09-05T00:56:17.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.241+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=12PL7ZL88RN1 type=del size=4179304 2024-09-05T00:56:17.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.245+0000 7f325adab8c0 1 < suggested update operation key=MBJLOE5XFPYN tag=AJP1FZ1GDWDY type=del size=1325238 2024-09-05T00:56:17.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.249+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=67GCV8TF93BO type=del size=1769748 2024-09-05T00:56:17.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.253+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.0 size=1048576 2024-09-05T00:56:17.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.257+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.1 size=1048576 2024-09-05T00:56:17.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.257+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~A9BN773BXAOR.2 size=940491 2024-09-05T00:56:17.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.261+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=A9BN773BXAOR tag=3AXGKG0HOWKH type=write size=4086219 2024-09-05T00:56:17.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.265+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=FNA0KLHPDF5Y type=del size=72255 2024-09-05T00:56:17.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.269+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=W0KWCDR9HG50 type=write size=858113 2024-09-05T00:56:17.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.273+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~L196W3EQQ1HI.0 size=236823 2024-09-05T00:56:17.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.273+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=L196W3EQQ1HI tag=Y20EL7FK87TA type=write size=1285399 2024-09-05T00:56:17.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.277+0000 7f325adab8c0 -1 < failed to complete operation key=MBJLOE5XFPYN tag=JD9GU0EKSQ8H type=del size=878132: (22) Invalid argument 2024-09-05T00:56:17.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.281+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=PFVE8A18S22Q type=del size=797387 2024-09-05T00:56:17.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.281+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=VXOQ2MYAB88J type=del 2024-09-05T00:56:17.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.289+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~2GVI48FCC6A9.0 size=413293 2024-09-05T00:56:17.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.289+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=2GVI48FCC6A9 tag=ZSEDZYDPWPB9 type=write size=1461869 2024-09-05T00:56:17.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.289+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=8ATSXKD8IL3Y type=del 2024-09-05T00:56:17.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.297+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~7PKDV53CEXF0.0 size=1048576 2024-09-05T00:56:17.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.297+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~7PKDV53CEXF0.1 size=291143 2024-09-05T00:56:17.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.297+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=7PKDV53CEXF0 tag=LTCCGUEO8M4L type=write size=2388295 2024-09-05T00:56:17.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.301+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.0 size=1048576 2024-09-05T00:56:17.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.305+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.1 size=1048576 2024-09-05T00:56:17.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.305+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NSTJ23R61TL1.2 size=591749 2024-09-05T00:56:17.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.309+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=NSTJ23R61TL1 tag=MYCDSXVWIY6O type=write size=3737477 2024-09-05T00:56:17.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.317+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~MAWY2RR5H785.0 size=668163 2024-09-05T00:56:17.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.317+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=MAWY2RR5H785 tag=4Z3KIXRIQK6O type=write size=1716739 2024-09-05T00:56:17.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.321+0000 7f325adab8c0 -1 < failed to complete operation key=MBJLOE5XFPYN tag=ONQXHW3CZCX9 type=del size=183584: (22) Invalid argument 2024-09-05T00:56:17.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.325+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~K6B4TWHKXFUY.0 size=1048576 2024-09-05T00:56:17.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.329+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~K6B4TWHKXFUY.1 size=563706 2024-09-05T00:56:17.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.329+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=K6B4TWHKXFUY tag=JERRP41UFE8X type=write size=2660858 2024-09-05T00:56:17.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.329+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.0 size=1048576 2024-09-05T00:56:17.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.333+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.1 size=1048576 2024-09-05T00:56:17.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.337+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~EJQ38A7Q81WH.2 size=550294 2024-09-05T00:56:17.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.341+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=EJQ38A7Q81WH tag=VO72YEV0JGS4 type=write size=3696022 2024-09-05T00:56:17.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.341+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=V9MPDZIXOW5K type=del size=3368158 2024-09-05T00:56:17.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.349+0000 7f325adab8c0 1 < suggested update operation key=079QFDETDGGC tag=INQXSYQITPJ7 type=del size=1687207 2024-09-05T00:56:17.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.349+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=IE146VYCTRCT type=del size=1150444 2024-09-05T00:56:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.353+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=1PYPF9F1KY8F type=del 2024-09-05T00:56:17.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.357+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.0 size=1048576 2024-09-05T00:56:17.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.361+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.1 size=1048576 2024-09-05T00:56:17.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.361+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.2 size=496440 2024-09-05T00:56:17.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.361+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=LJTP7FJHSLG5 tag=05MV3GI14HL5 type=write size=3642168 2024-09-05T00:56:17.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.365+0000 7f325adab8c0 1 < canceled operation key=NIAW4BKW21LG tag=GPI70F2D0D5N type=del size=3100519 2024-09-05T00:56:17.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.369+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.0 size=1048576 2024-09-05T00:56:17.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.373+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.1 size=1048576 2024-09-05T00:56:17.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.373+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.2 size=231801 2024-09-05T00:56:17.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.373+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=SF4QGHT6608P tag=JK5F9UTYFBWM type=write size=3377529 2024-09-05T00:56:17.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.377+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.0 size=1048576 2024-09-05T00:56:17.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.381+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.1 size=1048576 2024-09-05T00:56:17.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.381+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~G5OQEVJ69ZI0.2 size=521822 2024-09-05T00:56:17.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.385+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=G5OQEVJ69ZI0 tag=02T6VSZQ91NM type=write size=3667550 2024-09-05T00:56:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.393+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OWZQREQW1MFB.0 size=121021 2024-09-05T00:56:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.393+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=OWZQREQW1MFB tag=553WP8GL6FJP type=write size=1169597 2024-09-05T00:56:17.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.393+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~5E90ML92O433.0 size=117949 2024-09-05T00:56:17.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.401+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=5E90ML92O433 tag=IUNIDW3BZLJK type=write size=1166525 2024-09-05T00:56:17.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.405+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=6VAIF1LA2TUG type=del size=3643571 2024-09-05T00:56:17.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.409+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~XMZMW70ZH7ET.0 size=1048576 2024-09-05T00:56:17.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.409+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~XMZMW70ZH7ET.1 size=977578 2024-09-05T00:56:17.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.413+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=XMZMW70ZH7ET tag=ZOIYJF6PHSUV type=write size=3074730 2024-09-05T00:56:17.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.417+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=X1XVLAM7COW9 type=del size=2555475 2024-09-05T00:56:17.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.421+0000 7f325adab8c0 1 < canceled operation key=MYR9H12B5YYV tag=12PL7ZL88RN1 type=del size=4179304 2024-09-05T00:56:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.421+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=U3OFKICQ66FV type=del size=1060780 2024-09-05T00:56:17.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.425+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=67GCV8TF93BO type=del 2024-09-05T00:56:17.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.429+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=NYIOXCJRVFDF type=del size=3703390 2024-09-05T00:56:17.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.429+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=FNA0KLHPDF5Y type=del 2024-09-05T00:56:17.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.433+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=KDGERRXMZLHN type=del size=1189960 2024-09-05T00:56:17.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.433+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~L196W3EQQ1HI.0 size=236823 2024-09-05T00:56:17.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.437+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=L196W3EQQ1HI tag=Y20EL7FK87TA type=write size=1285399 2024-09-05T00:56:17.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.445+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~GYGDISU6VENU.0 size=192226 2024-09-05T00:56:17.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.445+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=GYGDISU6VENU tag=6F411DPXMBF8 type=write size=1240802 2024-09-05T00:56:17.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.445+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=PFVE8A18S22Q type=del 2024-09-05T00:56:17.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.449+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=IE9MZHBQR954 type=del size=1836397 2024-09-05T00:56:17.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.449+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~2GVI48FCC6A9.0 size=413293 2024-09-05T00:56:17.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.453+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=2GVI48FCC6A9 tag=ZSEDZYDPWPB9 type=write size=1461869 2024-09-05T00:56:17.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.457+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=37WWLNG0W22Z type=del size=2856215 2024-09-05T00:56:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.461+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~7PKDV53CEXF0.0 size=1048576 2024-09-05T00:56:17.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.461+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~7PKDV53CEXF0.1 size=291143 2024-09-05T00:56:17.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.465+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=7PKDV53CEXF0 tag=LTCCGUEO8M4L type=write size=2388295 2024-09-05T00:56:17.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.469+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=AJJSH8Z7I3EP type=del size=1115418 2024-09-05T00:56:17.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.469+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~MAWY2RR5H785.0 size=668163 2024-09-05T00:56:17.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.473+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=MAWY2RR5H785 tag=4Z3KIXRIQK6O type=write size=1716739 2024-09-05T00:56:17.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.477+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=QZVU2U8RFIWF type=del size=65484 2024-09-05T00:56:17.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.477+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~K6B4TWHKXFUY.0 size=1048576 2024-09-05T00:56:17.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.481+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~K6B4TWHKXFUY.1 size=563706 2024-09-05T00:56:17.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.485+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=K6B4TWHKXFUY tag=JERRP41UFE8X type=write size=2660858 2024-09-05T00:56:17.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.485+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=DWKLVB13OSU7 type=del size=9172 2024-09-05T00:56:17.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.489+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=V9MPDZIXOW5K type=del 2024-09-05T00:56:17.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.493+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~CBXZ8D47IJ9B.0 size=1048576 2024-09-05T00:56:17.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.493+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~CBXZ8D47IJ9B.1 size=657670 2024-09-05T00:56:17.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.493+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=CBXZ8D47IJ9B tag=V7VEC2S0Q2HB type=write size=2754822 2024-09-05T00:56:17.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.497+0000 7f325adab8c0 1 < suggested remove operation key=UW0SSQ8VFY1G tag=IE146VYCTRCT type=del 2024-09-05T00:56:17.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.501+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=P8B7HOZAQ15L type=del size=2613164 2024-09-05T00:56:17.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.505+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.0 size=1048576 2024-09-05T00:56:17.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.505+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.1 size=1048576 2024-09-05T00:56:17.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.505+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~LJTP7FJHSLG5.2 size=496440 2024-09-05T00:56:17.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.509+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=LJTP7FJHSLG5 tag=05MV3GI14HL5 type=write size=3642168 2024-09-05T00:56:17.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.513+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~F7VKZ3VBDJ0N.0 size=813869 2024-09-05T00:56:17.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.513+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=F7VKZ3VBDJ0N tag=8LWUYXSK2G3E type=write size=1862445 2024-09-05T00:56:17.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.517+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.0 size=1048576 2024-09-05T00:56:17.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.517+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.1 size=1048576 2024-09-05T00:56:17.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.517+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~SF4QGHT6608P.2 size=231801 2024-09-05T00:56:17.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.521+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=SF4QGHT6608P tag=JK5F9UTYFBWM type=write size=3377529 2024-09-05T00:56:17.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.529+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~W25QCG7W8GT7.0 size=1014338 2024-09-05T00:56:17.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.529+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=W25QCG7W8GT7 tag=ZSP962S39KXH type=write size=2062914 2024-09-05T00:56:17.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.533+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OWZQREQW1MFB.0 size=121021 2024-09-05T00:56:17.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.537+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=OWZQREQW1MFB tag=553WP8GL6FJP type=write size=1169597 2024-09-05T00:56:17.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.537+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=0LBP9BF40LCB type=write size=466118 2024-09-05T00:56:17.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.541+0000 7f325adab8c0 1 < suggested update operation key=HW4QK67332RW tag=6VAIF1LA2TUG type=del size=3643571 2024-09-05T00:56:17.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.545+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~XUXSXICKO6Q9.0 size=1048576 2024-09-05T00:56:17.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.549+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~XUXSXICKO6Q9.1 size=935155 2024-09-05T00:56:17.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.549+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=XUXSXICKO6Q9 tag=VWYM94C51JPZ type=write size=3032307 2024-09-05T00:56:17.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.553+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=X1XVLAM7COW9 type=del size=2555475 2024-09-05T00:56:17.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.553+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=6PDIOTZUZ571 type=del size=2756254 2024-09-05T00:56:17.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.557+0000 7f325adab8c0 -1 < failed to complete operation key=UW0SSQ8VFY1G tag=U3OFKICQ66FV type=del size=1060780: (22) Invalid argument 2024-09-05T00:56:17.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.557+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=6QL3O2RRPDLB type=del size=151220 2024-09-05T00:56:17.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.561+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=NYIOXCJRVFDF type=del 2024-09-05T00:56:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.565+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~XBNEE1S6EDYV.0 size=747449 2024-09-05T00:56:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.565+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=XBNEE1S6EDYV tag=ZKKBX42AEU7A type=write size=1796025 2024-09-05T00:56:17.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.569+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=KDGERRXMZLHN type=del 2024-09-05T00:56:17.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.573+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=O5LLODIV51KV type=del size=373105 2024-09-05T00:56:17.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.577+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~GYGDISU6VENU.0 size=192226 2024-09-05T00:56:17.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.581+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=GYGDISU6VENU tag=6F411DPXMBF8 type=write size=1240802 2024-09-05T00:56:17.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.585+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~N07WULOYLJPE.0 size=901524 2024-09-05T00:56:17.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.585+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=N07WULOYLJPE tag=FGG9ALTNN2PC type=write size=1950100 2024-09-05T00:56:17.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.589+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=IE9MZHBQR954 type=del 2024-09-05T00:56:17.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.593+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=1YRPJNM615AZ type=del size=4073324 2024-09-05T00:56:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.593+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=37WWLNG0W22Z type=del 2024-09-05T00:56:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.597+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=EQGKDY51AB13 type=del size=3436458 2024-09-05T00:56:17.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.601+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=AJJSH8Z7I3EP type=del 2024-09-05T00:56:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.605+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=OUC1A59DBTN8 type=del size=2764132 2024-09-05T00:56:17.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.605+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=QZVU2U8RFIWF type=del 2024-09-05T00:56:17.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.609+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=3ALD6YHZDQEX type=del size=2588317 2024-09-05T00:56:17.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.613+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=DWKLVB13OSU7 type=del 2024-09-05T00:56:17.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.613+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=EWQC9IBNZ3YI type=del size=2561405 2024-09-05T00:56:17.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.617+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~CBXZ8D47IJ9B.0 size=1048576 2024-09-05T00:56:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.621+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~CBXZ8D47IJ9B.1 size=657670 2024-09-05T00:56:17.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.625+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=CBXZ8D47IJ9B tag=V7VEC2S0Q2HB type=write size=2754822 2024-09-05T00:56:17.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.629+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.0 size=1048576 2024-09-05T00:56:17.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.633+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.1 size=1048576 2024-09-05T00:56:17.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.637+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.2 size=499393 2024-09-05T00:56:17.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.637+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=8Q1ZRSV9HO43 tag=DSZTGP1F5AXX type=write size=3645121 2024-09-05T00:56:17.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.637+0000 7f325adab8c0 -1 < failed to complete operation key=HW4QK67332RW tag=P8B7HOZAQ15L type=del size=2613164: (22) Invalid argument 2024-09-05T00:56:17.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.641+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=PG9CS07LFPXM type=del size=3014508 2024-09-05T00:56:17.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.645+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~F7VKZ3VBDJ0N.0 size=813869 2024-09-05T00:56:17.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.649+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=F7VKZ3VBDJ0N tag=8LWUYXSK2G3E type=write size=1862445 2024-09-05T00:56:17.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.653+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=0C4T21D927BO type=del size=2461692 2024-09-05T00:56:17.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.653+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~W25QCG7W8GT7.0 size=1014338 2024-09-05T00:56:17.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.657+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=W25QCG7W8GT7 tag=ZSP962S39KXH type=write size=2062914 2024-09-05T00:56:17.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.661+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=B71SJ02KEXM2 type=del size=2601509 2024-09-05T00:56:17.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.665+0000 7f325adab8c0 1 < suggested update operation key=A9WMRV5QZ2FP tag=0LBP9BF40LCB type=write size=466118 2024-09-05T00:56:17.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.669+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~JTT0AG02CL23.0 size=273773 2024-09-05T00:56:17.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.669+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=JTT0AG02CL23 tag=5XPD8N9QRU3T type=write size=1322349 2024-09-05T00:56:17.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.673+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~XUXSXICKO6Q9.0 size=1048576 2024-09-05T00:56:17.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.673+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~XUXSXICKO6Q9.1 size=935155 2024-09-05T00:56:17.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.677+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=XUXSXICKO6Q9 tag=VWYM94C51JPZ type=write size=3032307 2024-09-05T00:56:17.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.681+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=D9UZPLNIWUF6 type=del size=2388490 2024-09-05T00:56:17.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.685+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=6PDIOTZUZ571 type=del 2024-09-05T00:56:17.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.693+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~RWX8RU7QFO34.0 size=254136 2024-09-05T00:56:17.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.693+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=RWX8RU7QFO34 tag=X853FW43AIFX type=write size=1302712 2024-09-05T00:56:17.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.693+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=6QL3O2RRPDLB type=del 2024-09-05T00:56:17.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.697+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=O9XD2ZTG3WBS type=write size=681236 2024-09-05T00:56:17.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.697+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~XBNEE1S6EDYV.0 size=747449 2024-09-05T00:56:17.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.701+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=XBNEE1S6EDYV tag=ZKKBX42AEU7A type=write size=1796025 2024-09-05T00:56:17.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.705+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=HO7O69QNGGLO type=del size=1800976 2024-09-05T00:56:17.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.709+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=O5LLODIV51KV type=del 2024-09-05T00:56:17.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.709+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=QYBPNN4CBVB5 type=del size=2013441 2024-09-05T00:56:17.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.713+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~N07WULOYLJPE.0 size=901524 2024-09-05T00:56:17.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.717+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=N07WULOYLJPE tag=FGG9ALTNN2PC type=write size=1950100 2024-09-05T00:56:17.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.717+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=4IFV0UZBTXE5 type=write size=438535 2024-09-05T00:56:17.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.721+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=1YRPJNM615AZ type=del 2024-09-05T00:56:17.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.725+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=TYAUT3GWP3A0 type=del size=3375292 2024-09-05T00:56:17.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.725+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=EQGKDY51AB13 type=del 2024-09-05T00:56:17.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.729+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=6IXR0B7MV8X3 type=write size=852111 2024-09-05T00:56:17.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.729+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=OUC1A59DBTN8 type=del 2024-09-05T00:56:17.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.733+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5HUBT4OEPBSM.0 size=1048576 2024-09-05T00:56:17.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.737+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5HUBT4OEPBSM.1 size=677516 2024-09-05T00:56:17.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.737+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=5HUBT4OEPBSM tag=DB4IHWOBGM3S type=write size=2774668 2024-09-05T00:56:17.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.737+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=3ALD6YHZDQEX type=del 2024-09-05T00:56:17.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.741+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~F1GL4A4S56PY.0 size=1048576 2024-09-05T00:56:17.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.745+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~F1GL4A4S56PY.1 size=752463 2024-09-05T00:56:17.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.745+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=F1GL4A4S56PY tag=258RZ9MDLZTE type=write size=2849615 2024-09-05T00:56:17.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.745+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=EWQC9IBNZ3YI type=del 2024-09-05T00:56:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.749+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~N3SAWXRHM3P9.0 size=289089 2024-09-05T00:56:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.749+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=N3SAWXRHM3P9 tag=BO2CI37U6DU1 type=write size=1337665 2024-09-05T00:56:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.753+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.0 size=1048576 2024-09-05T00:56:17.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.757+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.1 size=1048576 2024-09-05T00:56:17.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.757+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8Q1ZRSV9HO43.2 size=499393 2024-09-05T00:56:17.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.761+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=8Q1ZRSV9HO43 tag=DSZTGP1F5AXX type=write size=3645121 2024-09-05T00:56:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.765+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~ES2R6B9HMHKA.0 size=172235 2024-09-05T00:56:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.765+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=ES2R6B9HMHKA tag=Q5D58UEWJLIU type=write size=1220811 2024-09-05T00:56:17.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.769+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=PG9CS07LFPXM type=del 2024-09-05T00:56:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.773+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.0 size=1048576 2024-09-05T00:56:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.773+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.1 size=1048576 2024-09-05T00:56:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.777+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.2 size=745291 2024-09-05T00:56:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.777+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=XD0UN6BGNIYH tag=PWY3PC95QNIA type=write size=3891019 2024-09-05T00:56:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.781+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=0C4T21D927BO type=del 2024-09-05T00:56:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.781+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=DVOT7K1HU7Q5 type=del size=1619992 2024-09-05T00:56:17.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.785+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=B71SJ02KEXM2 type=del 2024-09-05T00:56:17.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.789+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.0 size=1048576 2024-09-05T00:56:17.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.793+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.1 size=1048576 2024-09-05T00:56:17.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.793+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.2 size=419560 2024-09-05T00:56:17.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.793+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=HS2EZ0XX9VCV tag=1ZKUXYNX1WZW type=write size=3565288 2024-09-05T00:56:17.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.797+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~JTT0AG02CL23.0 size=273773 2024-09-05T00:56:17.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.801+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=JTT0AG02CL23 tag=5XPD8N9QRU3T type=write size=1322349 2024-09-05T00:56:17.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.805+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.0 size=1048576 2024-09-05T00:56:17.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.809+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.1 size=1048576 2024-09-05T00:56:17.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.813+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.2 size=233577 2024-09-05T00:56:17.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.813+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=OG9EQQSRKAXC tag=Z2KGFJP3GY8K type=write size=3379305 2024-09-05T00:56:17.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.813+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=D9UZPLNIWUF6 type=del 2024-09-05T00:56:17.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.817+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.0 size=1048576 2024-09-05T00:56:17.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.821+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.1 size=1048576 2024-09-05T00:56:17.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.821+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.2 size=195006 2024-09-05T00:56:17.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.821+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=H6XCKRV70M1O tag=QHXCBTEGCU72 type=write size=3340734 2024-09-05T00:56:17.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.825+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~RWX8RU7QFO34.0 size=254136 2024-09-05T00:56:17.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.829+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=RWX8RU7QFO34 tag=X853FW43AIFX type=write size=1302712 2024-09-05T00:56:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.833+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.0 size=1048576 2024-09-05T00:56:17.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.833+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.1 size=1048576 2024-09-05T00:56:17.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.837+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.2 size=656745 2024-09-05T00:56:17.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.837+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=G0TBBUG5OUMG tag=9GN5S17XYLSY type=write size=3802473 2024-09-05T00:56:17.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.841+0000 7f325adab8c0 1 < suggested update operation key=6N7BLJ1WLDGN tag=O9XD2ZTG3WBS type=write size=681236 2024-09-05T00:56:17.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.845+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=O2NIVJB0QP51 type=del size=3355204 2024-09-05T00:56:17.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.845+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=HO7O69QNGGLO type=del 2024-09-05T00:56:17.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.849+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=JMGC6H1N4IT9 type=del size=2767179 2024-09-05T00:56:17.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.853+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=QYBPNN4CBVB5 type=del 2024-09-05T00:56:17.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.853+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=GS4LVIS0SRPB type=write size=443777 2024-09-05T00:56:17.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.857+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=4IFV0UZBTXE5 type=write size=438535 2024-09-05T00:56:17.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.861+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=N405E045HW20 type=write size=764795 2024-09-05T00:56:17.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.861+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=TYAUT3GWP3A0 type=del 2024-09-05T00:56:17.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.865+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~B0YSP289WEP9.0 size=1048576 2024-09-05T00:56:17.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.873+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~B0YSP289WEP9.1 size=575232 2024-09-05T00:56:17.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.873+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=B0YSP289WEP9 tag=K2MPDMW0NILL type=write size=2672384 2024-09-05T00:56:17.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.873+0000 7f325adab8c0 1 < completed write operation key=GQB4HOYII01G tag=6IXR0B7MV8X3 type=write size=852111 2024-09-05T00:56:17.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.877+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=N1QZT0IXBPFS type=del size=2081092 2024-09-05T00:56:17.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.877+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5HUBT4OEPBSM.0 size=1048576 2024-09-05T00:56:17.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.881+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5HUBT4OEPBSM.1 size=677516 2024-09-05T00:56:17.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.885+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=5HUBT4OEPBSM tag=DB4IHWOBGM3S type=write size=2774668 2024-09-05T00:56:17.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.889+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~J4EMFW2I40EN.0 size=130896 2024-09-05T00:56:17.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.889+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=J4EMFW2I40EN tag=7N24EZP4V46R type=write size=1179472 2024-09-05T00:56:17.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.889+0000 7f325adab8c0 1 < canceled part key=_multipart_9O7DVR04PCDB.2~F1GL4A4S56PY.0 size=1048576 2024-09-05T00:56:17.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.889+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~F1GL4A4S56PY.1 size=752463 2024-09-05T00:56:17.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.893+0000 7f325adab8c0 1 < canceled multipart upload key=9O7DVR04PCDB upload=F1GL4A4S56PY tag=258RZ9MDLZTE type=write size=2849615 2024-09-05T00:56:17.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.897+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=GZH2PQYKUEF1 type=write size=190811 2024-09-05T00:56:17.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.897+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~N3SAWXRHM3P9.0 size=289089 2024-09-05T00:56:17.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.901+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=N3SAWXRHM3P9 tag=BO2CI37U6DU1 type=write size=1337665 2024-09-05T00:56:17.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.905+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=DM1CB8T76DMM type=del size=431966 2024-09-05T00:56:17.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.909+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~ES2R6B9HMHKA.0 size=172235 2024-09-05T00:56:17.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.909+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=ES2R6B9HMHKA tag=Q5D58UEWJLIU type=write size=1220811 2024-09-05T00:56:17.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.913+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=WGBOC9H3VYCM type=del size=804564 2024-09-05T00:56:17.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.917+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.0 size=1048576 2024-09-05T00:56:17.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.917+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.1 size=1048576 2024-09-05T00:56:17.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.917+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~XD0UN6BGNIYH.2 size=745291 2024-09-05T00:56:17.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.921+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=XD0UN6BGNIYH tag=PWY3PC95QNIA type=write size=3891019 2024-09-05T00:56:17.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.925+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=M4ENQYGJQRIM type=write size=919112 2024-09-05T00:56:17.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.925+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=DVOT7K1HU7Q5 type=del 2024-09-05T00:56:17.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.933+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~2K7Q7RW53Z6A.0 size=290382 2024-09-05T00:56:17.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.933+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=2K7Q7RW53Z6A tag=4031T9DO9K0J type=write size=1338958 2024-09-05T00:56:17.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.933+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.0 size=1048576 2024-09-05T00:56:17.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.937+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.1 size=1048576 2024-09-05T00:56:17.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.937+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HS2EZ0XX9VCV.2 size=419560 2024-09-05T00:56:17.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.941+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=HS2EZ0XX9VCV tag=1ZKUXYNX1WZW type=write size=3565288 2024-09-05T00:56:17.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.945+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~E2PQTX49VYPL.0 size=1048576 2024-09-05T00:56:17.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.949+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~E2PQTX49VYPL.1 size=422833 2024-09-05T00:56:17.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.949+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=E2PQTX49VYPL tag=SHSS01SHFZR3 type=write size=2519985 2024-09-05T00:56:17.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.949+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.0 size=1048576 2024-09-05T00:56:17.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.953+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.1 size=1048576 2024-09-05T00:56:17.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.953+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~OG9EQQSRKAXC.2 size=233577 2024-09-05T00:56:17.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.957+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=OG9EQQSRKAXC tag=Z2KGFJP3GY8K type=write size=3379305 2024-09-05T00:56:17.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.961+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~0G6EYTKWKOP8.0 size=1048576 2024-09-05T00:56:17.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.961+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~0G6EYTKWKOP8.1 size=141328 2024-09-05T00:56:17.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.961+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=0G6EYTKWKOP8 tag=QSRN1MXZDKBC type=write size=2238480 2024-09-05T00:56:17.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.965+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.0 size=1048576 2024-09-05T00:56:17.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.965+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.1 size=1048576 2024-09-05T00:56:17.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.969+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~H6XCKRV70M1O.2 size=195006 2024-09-05T00:56:17.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.973+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=H6XCKRV70M1O tag=QHXCBTEGCU72 type=write size=3340734 2024-09-05T00:56:17.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.977+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~N72YRNKE0TAU.0 size=675620 2024-09-05T00:56:17.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.977+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=N72YRNKE0TAU tag=MG0R8O1TTV0J type=write size=1724196 2024-09-05T00:56:17.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.981+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.0 size=1048576 2024-09-05T00:56:17.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.981+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.1 size=1048576 2024-09-05T00:56:17.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.981+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~G0TBBUG5OUMG.2 size=656745 2024-09-05T00:56:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.985+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=G0TBBUG5OUMG tag=9GN5S17XYLSY type=write size=3802473 2024-09-05T00:56:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.989+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=2LX2NZJCSD3A type=write size=4089 2024-09-05T00:56:17.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.993+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=O2NIVJB0QP51 type=del 2024-09-05T00:56:18.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.997+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~NA3JYJY70M4C.0 size=82376 2024-09-05T00:56:18.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.997+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=NA3JYJY70M4C tag=6RHP7PWLGREY type=write size=1130952 2024-09-05T00:56:18.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:17.997+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=JMGC6H1N4IT9 type=del 2024-09-05T00:56:18.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.001+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~R46JDWPAKRGM.0 size=539277 2024-09-05T00:56:18.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.001+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=R46JDWPAKRGM tag=ZSMEGDUEAAZA type=write size=1587853 2024-09-05T00:56:18.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.005+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=GS4LVIS0SRPB type=write 2024-09-05T00:56:18.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.009+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=QX1GCFN0LBTW type=del size=2060747 2024-09-05T00:56:18.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.009+0000 7f325adab8c0 1 < completed write operation key=GQB4HOYII01G tag=N405E045HW20 type=write size=764795 2024-09-05T00:56:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.013+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=58V97VPKBZJU type=del size=1457910 2024-09-05T00:56:18.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.017+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~B0YSP289WEP9.0 size=1048576 2024-09-05T00:56:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.017+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~B0YSP289WEP9.1 size=575232 2024-09-05T00:56:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.021+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=B0YSP289WEP9 tag=K2MPDMW0NILL type=write size=2672384 2024-09-05T00:56:18.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.025+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OQO5RXN7892M.0 size=1048576 2024-09-05T00:56:18.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.029+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OQO5RXN7892M.1 size=100668 2024-09-05T00:56:18.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.029+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=OQO5RXN7892M tag=UXN8C4J0YWY4 type=write size=2197820 2024-09-05T00:56:18.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.029+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=N1QZT0IXBPFS type=del 2024-09-05T00:56:18.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.033+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=T45GWEWWBEP0 type=del size=1706143 2024-09-05T00:56:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.037+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~J4EMFW2I40EN.0 size=130896 2024-09-05T00:56:18.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.041+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=J4EMFW2I40EN tag=7N24EZP4V46R type=write size=1179472 2024-09-05T00:56:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.041+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=Q4D97EWQGDI4 type=del size=2926376 2024-09-05T00:56:18.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.045+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=GZH2PQYKUEF1 type=write size=190811 2024-09-05T00:56:18.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.045+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=CJNV62Q4DEPM type=del size=713727 2024-09-05T00:56:18.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.049+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=DM1CB8T76DMM type=del 2024-09-05T00:56:18.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.049+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=09KAJSUNUN3X type=del size=712936 2024-09-05T00:56:18.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.053+0000 7f325adab8c0 1 < suggested remove operation key=NIAW4BKW21LG tag=WGBOC9H3VYCM type=del 2024-09-05T00:56:18.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.057+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=Q0YKQ005XJKE type=del size=711938 2024-09-05T00:56:18.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.061+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=M4ENQYGJQRIM type=write 2024-09-05T00:56:18.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.065+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=7348QPAZ58JA type=write size=383225 2024-09-05T00:56:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.065+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~2K7Q7RW53Z6A.0 size=290382 2024-09-05T00:56:18.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.069+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=2K7Q7RW53Z6A tag=4031T9DO9K0J type=write size=1338958 2024-09-05T00:56:18.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.073+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.0 size=1048576 2024-09-05T00:56:18.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.073+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.1 size=1048576 2024-09-05T00:56:18.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.077+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.2 size=785571 2024-09-05T00:56:18.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.077+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=LCAAZIB71B16 tag=BDTQI0RUDWFA type=write size=3931299 2024-09-05T00:56:18.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.077+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~E2PQTX49VYPL.0 size=1048576 2024-09-05T00:56:18.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.081+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~E2PQTX49VYPL.1 size=422833 2024-09-05T00:56:18.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.085+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=E2PQTX49VYPL tag=SHSS01SHFZR3 type=write size=2519985 2024-09-05T00:56:18.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.089+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=33TUV7QXXWZV type=del size=2612675 2024-09-05T00:56:18.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.089+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~0G6EYTKWKOP8.0 size=1048576 2024-09-05T00:56:18.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.093+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~0G6EYTKWKOP8.1 size=141328 2024-09-05T00:56:18.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.093+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=0G6EYTKWKOP8 tag=QSRN1MXZDKBC type=write size=2238480 2024-09-05T00:56:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.097+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=CUXVFZPKZ1MQ type=del size=1991458 2024-09-05T00:56:18.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.097+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~N72YRNKE0TAU.0 size=675620 2024-09-05T00:56:18.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.101+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=N72YRNKE0TAU tag=MG0R8O1TTV0J type=write size=1724196 2024-09-05T00:56:18.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.105+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=AMV60F8HRVDB type=write size=31614 2024-09-05T00:56:18.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.105+0000 7f325adab8c0 1 < completed write operation key=71FWV15GD1QZ tag=2LX2NZJCSD3A type=write size=4089 2024-09-05T00:56:18.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.109+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~MQY41N4KYIT6.0 size=813326 2024-09-05T00:56:18.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.109+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=MQY41N4KYIT6 tag=LYQ0XI1CZNU3 type=write size=1861902 2024-09-05T00:56:18.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.113+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~NA3JYJY70M4C.0 size=82376 2024-09-05T00:56:18.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.117+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=NA3JYJY70M4C tag=6RHP7PWLGREY type=write size=1130952 2024-09-05T00:56:18.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.117+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=M5Z7C0PCFBBI type=del size=1073179 2024-09-05T00:56:18.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.121+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~R46JDWPAKRGM.0 size=539277 2024-09-05T00:56:18.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.125+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=R46JDWPAKRGM tag=ZSMEGDUEAAZA type=write size=1587853 2024-09-05T00:56:18.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.129+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.0 size=1048576 2024-09-05T00:56:18.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.129+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.1 size=1048576 2024-09-05T00:56:18.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.129+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.2 size=877895 2024-09-05T00:56:18.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.129+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=O3A4T37J7IMZ tag=OAHQAJBOKZJQ type=write size=4023623 2024-09-05T00:56:18.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.133+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=QX1GCFN0LBTW type=del 2024-09-05T00:56:18.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.133+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=1AX1QE8ZCJHF type=del size=4124408 2024-09-05T00:56:18.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.137+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=58V97VPKBZJU type=del 2024-09-05T00:56:18.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.141+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~9TPEESDL8XP7.0 size=1048576 2024-09-05T00:56:18.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.141+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~9TPEESDL8XP7.1 size=604321 2024-09-05T00:56:18.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.141+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=9TPEESDL8XP7 tag=MFIDP84AX199 type=write size=2701473 2024-09-05T00:56:18.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.145+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OQO5RXN7892M.0 size=1048576 2024-09-05T00:56:18.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.145+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OQO5RXN7892M.1 size=100668 2024-09-05T00:56:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.149+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=OQO5RXN7892M tag=UXN8C4J0YWY4 type=write size=2197820 2024-09-05T00:56:18.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.153+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=13YFFVDTMUGR type=del size=2071978 2024-09-05T00:56:18.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.153+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=T45GWEWWBEP0 type=del 2024-09-05T00:56:18.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.157+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~CTETE9HRXPJH.0 size=1048576 2024-09-05T00:56:18.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.157+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~CTETE9HRXPJH.1 size=30621 2024-09-05T00:56:18.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.157+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=CTETE9HRXPJH tag=NGLAFHUMBEXG type=write size=2127773 2024-09-05T00:56:18.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.161+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=Q4D97EWQGDI4 type=del 2024-09-05T00:56:18.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.165+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=IH217F70WL73 type=del size=905921 2024-09-05T00:56:18.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.165+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=CJNV62Q4DEPM type=del size=713727 2024-09-05T00:56:18.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.169+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=PSKXYER75RR0 type=del size=1163735 2024-09-05T00:56:18.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.169+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=09KAJSUNUN3X type=del size=712936 2024-09-05T00:56:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.173+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~YJOOC2M1ENJ8.0 size=866832 2024-09-05T00:56:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.173+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=YJOOC2M1ENJ8 tag=R7EUO6N169UX type=write size=1915408 2024-09-05T00:56:18.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.181+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=Q0YKQ005XJKE type=del 2024-09-05T00:56:18.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.185+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UCHSTOM7QBIT.0 size=1048576 2024-09-05T00:56:18.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.185+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UCHSTOM7QBIT.1 size=311351 2024-09-05T00:56:18.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.185+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=UCHSTOM7QBIT tag=9600E36BU1CF type=write size=2408503 2024-09-05T00:56:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.193+0000 7f325adab8c0 1 < suggested remove operation key=XKOECM0CCOKX tag=7348QPAZ58JA type=write 2024-09-05T00:56:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.197+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~CYCI1N49VO4O.0 size=1048576 2024-09-05T00:56:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.197+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~CYCI1N49VO4O.1 size=102255 2024-09-05T00:56:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.197+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=CYCI1N49VO4O tag=JWQY1ZPJD2IH type=write size=2199407 2024-09-05T00:56:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.197+0000 7f325adab8c0 1 < canceled part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.0 size=1048576 2024-09-05T00:56:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.201+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.1 size=1048576 2024-09-05T00:56:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.201+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~LCAAZIB71B16.2 size=785571 2024-09-05T00:56:18.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.205+0000 7f325adab8c0 1 < canceled multipart upload key=YMIGZMLJSI4D upload=LCAAZIB71B16 tag=BDTQI0RUDWFA type=write size=3931299 2024-09-05T00:56:18.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.209+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=6L6GG3IV218K type=del size=1417487 2024-09-05T00:56:18.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.209+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=33TUV7QXXWZV type=del 2024-09-05T00:56:18.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.213+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.0 size=1048576 2024-09-05T00:56:18.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.217+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.1 size=1048576 2024-09-05T00:56:18.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.217+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.2 size=268576 2024-09-05T00:56:18.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.217+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=YEJNZ771UVZP tag=8IDNGRAHNMXS type=write size=3414304 2024-09-05T00:56:18.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.221+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=CUXVFZPKZ1MQ type=del 2024-09-05T00:56:18.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.221+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=FH8UJ14SAV11 type=del size=4182424 2024-09-05T00:56:18.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.225+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=AMV60F8HRVDB type=write size=31614 2024-09-05T00:56:18.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.225+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=CQKVOYOUF4K3 type=del size=1783329 2024-09-05T00:56:18.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.225+0000 7f325adab8c0 1 < canceled part key=_multipart_GQB4HOYII01G.2~MQY41N4KYIT6.0 size=813326 2024-09-05T00:56:18.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.229+0000 7f325adab8c0 1 < canceled multipart upload key=GQB4HOYII01G upload=MQY41N4KYIT6 tag=LYQ0XI1CZNU3 type=write size=1861902 2024-09-05T00:56:18.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.233+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=2VNBXL2ESQ5T type=del size=2926336 2024-09-05T00:56:18.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.237+0000 7f325adab8c0 1 < suggested remove operation key=9O7DVR04PCDB tag=M5Z7C0PCFBBI type=del 2024-09-05T00:56:18.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.237+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=6ZDQ6PCN6U2X type=del size=1996968 2024-09-05T00:56:18.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.241+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.0 size=1048576 2024-09-05T00:56:18.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.241+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.1 size=1048576 2024-09-05T00:56:18.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.245+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~O3A4T37J7IMZ.2 size=877895 2024-09-05T00:56:18.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.249+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=O3A4T37J7IMZ tag=OAHQAJBOKZJQ type=write size=4023623 2024-09-05T00:56:18.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.249+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=13FEOHNGTYMQ type=del size=3202875 2024-09-05T00:56:18.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.257+0000 7f325adab8c0 1 < suggested update operation key=YMIGZMLJSI4D tag=1AX1QE8ZCJHF type=del size=4124408 2024-09-05T00:56:18.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.261+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~UPGOYVY3HFLP.0 size=1048576 2024-09-05T00:56:18.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.265+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~UPGOYVY3HFLP.1 size=738354 2024-09-05T00:56:18.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.265+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=UPGOYVY3HFLP tag=OPYICEVP4MQP type=write size=2835506 2024-09-05T00:56:18.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.265+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~9TPEESDL8XP7.0 size=1048576 2024-09-05T00:56:18.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.269+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~9TPEESDL8XP7.1 size=604321 2024-09-05T00:56:18.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.273+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=9TPEESDL8XP7 tag=MFIDP84AX199 type=write size=2701473 2024-09-05T00:56:18.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.277+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~A3NECRRNZ8JL.0 size=210839 2024-09-05T00:56:18.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.277+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=A3NECRRNZ8JL tag=QJN168QWTR9E type=write size=1259415 2024-09-05T00:56:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.277+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=13YFFVDTMUGR type=del 2024-09-05T00:56:18.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.281+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=DNSKR6VZVH6O type=del size=3257542 2024-09-05T00:56:18.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.285+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~CTETE9HRXPJH.0 size=1048576 2024-09-05T00:56:18.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.285+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~CTETE9HRXPJH.1 size=30621 2024-09-05T00:56:18.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.293+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=CTETE9HRXPJH tag=NGLAFHUMBEXG type=write size=2127773 2024-09-05T00:56:18.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.297+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=6PK4ROC2W9YH type=del size=2347744 2024-09-05T00:56:18.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.301+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=IH217F70WL73 type=del 2024-09-05T00:56:18.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.305+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~YD0ZV0EMXM1R.0 size=32903 2024-09-05T00:56:18.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.305+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=YD0ZV0EMXM1R tag=Z671FL17FQXF type=write size=1081479 2024-09-05T00:56:18.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.313+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=PSKXYER75RR0 type=del size=1163735 2024-09-05T00:56:18.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.313+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=OQ85KAS3FEKK type=del size=3743371 2024-09-05T00:56:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.317+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~YJOOC2M1ENJ8.0 size=866832 2024-09-05T00:56:18.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.321+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=YJOOC2M1ENJ8 tag=R7EUO6N169UX type=write size=1915408 2024-09-05T00:56:18.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.325+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~Y9SBUTX5K9HA.0 size=1048576 2024-09-05T00:56:18.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.325+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~Y9SBUTX5K9HA.1 size=394373 2024-09-05T00:56:18.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.325+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=Y9SBUTX5K9HA tag=L9OH7MN74T3M type=write size=2491525 2024-09-05T00:56:18.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.329+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UCHSTOM7QBIT.0 size=1048576 2024-09-05T00:56:18.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.333+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UCHSTOM7QBIT.1 size=311351 2024-09-05T00:56:18.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.337+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=UCHSTOM7QBIT tag=9600E36BU1CF type=write size=2408503 2024-09-05T00:56:18.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.341+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.0 size=1048576 2024-09-05T00:56:18.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.341+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.1 size=1048576 2024-09-05T00:56:18.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.345+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.2 size=84464 2024-09-05T00:56:18.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.345+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=2VTMN0LB7TW5 tag=KGS6D6P0TH28 type=write size=3230192 2024-09-05T00:56:18.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.345+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~CYCI1N49VO4O.0 size=1048576 2024-09-05T00:56:18.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.345+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~CYCI1N49VO4O.1 size=102255 2024-09-05T00:56:18.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.349+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=CYCI1N49VO4O tag=JWQY1ZPJD2IH type=write size=2199407 2024-09-05T00:56:18.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.353+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=7LDIR9462IOS type=del size=3531746 2024-09-05T00:56:18.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.353+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=6L6GG3IV218K type=del 2024-09-05T00:56:18.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.357+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=MWHP93TSDID8 type=del size=2157864 2024-09-05T00:56:18.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.361+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.0 size=1048576 2024-09-05T00:56:18.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.361+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.1 size=1048576 2024-09-05T00:56:18.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.361+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~YEJNZ771UVZP.2 size=268576 2024-09-05T00:56:18.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.365+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=YEJNZ771UVZP tag=8IDNGRAHNMXS type=write size=3414304 2024-09-05T00:56:18.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.369+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=RQPS30CKQ9K1 type=del size=1153647 2024-09-05T00:56:18.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.369+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=FH8UJ14SAV11 type=del 2024-09-05T00:56:18.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.373+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~17678VS8OYLJ.0 size=483580 2024-09-05T00:56:18.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.373+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=17678VS8OYLJ tag=HKBJOKCWUGQO type=write size=1532156 2024-09-05T00:56:18.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.377+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=CQKVOYOUF4K3 type=del 2024-09-05T00:56:18.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.381+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=AWFQBE15FEV0 type=write size=455960 2024-09-05T00:56:18.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.381+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=2VNBXL2ESQ5T type=del 2024-09-05T00:56:18.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.385+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~I7N6Q2J1G3G9.0 size=1048576 2024-09-05T00:56:18.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.385+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~I7N6Q2J1G3G9.1 size=81365 2024-09-05T00:56:18.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.385+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=I7N6Q2J1G3G9 tag=5PBXBXXWC78M type=write size=2178517 2024-09-05T00:56:18.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.389+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=6ZDQ6PCN6U2X type=del 2024-09-05T00:56:18.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.393+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=0ZLUAPT4DGTE type=write size=700787 2024-09-05T00:56:18.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.393+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=13FEOHNGTYMQ type=del 2024-09-05T00:56:18.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.397+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~JRB07OP86VC8.0 size=1048576 2024-09-05T00:56:18.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.401+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~JRB07OP86VC8.1 size=240800 2024-09-05T00:56:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.401+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=JRB07OP86VC8 tag=AEOUQZN1SXM9 type=write size=2337952 2024-09-05T00:56:18.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.401+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~UPGOYVY3HFLP.0 size=1048576 2024-09-05T00:56:18.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.405+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~UPGOYVY3HFLP.1 size=738354 2024-09-05T00:56:18.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.409+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=UPGOYVY3HFLP tag=OPYICEVP4MQP type=write size=2835506 2024-09-05T00:56:18.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.409+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=31KR2V3KXQJM type=del size=1833498 2024-09-05T00:56:18.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.413+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~A3NECRRNZ8JL.0 size=210839 2024-09-05T00:56:18.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.417+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=A3NECRRNZ8JL tag=QJN168QWTR9E type=write size=1259415 2024-09-05T00:56:18.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.417+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=Y1Q140UF3Z59 type=write size=937517 2024-09-05T00:56:18.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.421+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=DNSKR6VZVH6O type=del 2024-09-05T00:56:18.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.425+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~Q4VDE0LVWVU5.0 size=742799 2024-09-05T00:56:18.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.425+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=Q4VDE0LVWVU5 tag=QJ7BCSHCY08W type=write size=1791375 2024-09-05T00:56:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.429+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=6PK4ROC2W9YH type=del 2024-09-05T00:56:18.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.433+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~QXM0LFBBRGIR.0 size=688521 2024-09-05T00:56:18.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.433+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=QXM0LFBBRGIR tag=566Y0Q4EZMTT type=write size=1737097 2024-09-05T00:56:18.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.437+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~YD0ZV0EMXM1R.0 size=32903 2024-09-05T00:56:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.441+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=YD0ZV0EMXM1R tag=Z671FL17FQXF type=write size=1081479 2024-09-05T00:56:18.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.445+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=XLVIH1IMRBM0 type=del size=1515085 2024-09-05T00:56:18.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.449+0000 7f325adab8c0 1 < suggested remove operation key=YMIGZMLJSI4D tag=OQ85KAS3FEKK type=del 2024-09-05T00:56:18.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.449+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=D1O4AYVSR3CQ type=del size=1648447 2024-09-05T00:56:18.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.453+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~Y9SBUTX5K9HA.0 size=1048576 2024-09-05T00:56:18.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.457+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~Y9SBUTX5K9HA.1 size=394373 2024-09-05T00:56:18.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.461+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=Y9SBUTX5K9HA tag=L9OH7MN74T3M type=write size=2491525 2024-09-05T00:56:18.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.461+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=BMBTA9Z91Z3Z type=del size=2386756 2024-09-05T00:56:18.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.465+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.0 size=1048576 2024-09-05T00:56:18.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.465+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.1 size=1048576 2024-09-05T00:56:18.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.469+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~2VTMN0LB7TW5.2 size=84464 2024-09-05T00:56:18.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.473+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=2VTMN0LB7TW5 tag=KGS6D6P0TH28 type=write size=3230192 2024-09-05T00:56:18.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.477+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=2GWBF7DQ5WHD type=write size=658969 2024-09-05T00:56:18.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.477+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=7LDIR9462IOS type=del 2024-09-05T00:56:18.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.481+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=QNIGL8AVS0DF type=del size=2628030 2024-09-05T00:56:18.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.485+0000 7f325adab8c0 1 < suggested remove operation key=71FWV15GD1QZ tag=MWHP93TSDID8 type=del 2024-09-05T00:56:18.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.489+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=HIZ26EHM23V4 type=write size=283314 2024-09-05T00:56:18.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.489+0000 7f325adab8c0 1 < canceled operation key=A9WMRV5QZ2FP tag=RQPS30CKQ9K1 type=del size=1153647 2024-09-05T00:56:18.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.497+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~FGCQJHH4DOI0.0 size=693089 2024-09-05T00:56:18.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.497+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=FGCQJHH4DOI0 tag=N7WBGNAROYD4 type=write size=1741665 2024-09-05T00:56:18.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.497+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~17678VS8OYLJ.0 size=483580 2024-09-05T00:56:18.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.501+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=17678VS8OYLJ tag=HKBJOKCWUGQO type=write size=1532156 2024-09-05T00:56:18.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.505+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.0 size=1048576 2024-09-05T00:56:18.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.509+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.1 size=1048576 2024-09-05T00:56:18.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.509+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.2 size=345115 2024-09-05T00:56:18.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.509+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=S83PJ8EOK546 tag=KCO6OK0KMA0L type=write size=3490843 2024-09-05T00:56:18.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.517+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=AWFQBE15FEV0 type=write size=455960 2024-09-05T00:56:18.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.517+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=11YMHXYRANIS type=del size=1922266 2024-09-05T00:56:18.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.521+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~I7N6Q2J1G3G9.0 size=1048576 2024-09-05T00:56:18.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.525+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~I7N6Q2J1G3G9.1 size=81365 2024-09-05T00:56:18.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.529+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=I7N6Q2J1G3G9 tag=5PBXBXXWC78M type=write size=2178517 2024-09-05T00:56:18.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.529+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=KRWTB9PFTZVV type=del size=667448 2024-09-05T00:56:18.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.533+0000 7f325adab8c0 -1 < failed to complete operation key=71FWV15GD1QZ tag=0ZLUAPT4DGTE type=write size=700787: (22) Invalid argument 2024-09-05T00:56:18.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.537+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=MQXQGVT30OF1 type=del size=1069171 2024-09-05T00:56:18.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.537+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~JRB07OP86VC8.0 size=1048576 2024-09-05T00:56:18.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.541+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~JRB07OP86VC8.1 size=240800 2024-09-05T00:56:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.545+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=JRB07OP86VC8 tag=AEOUQZN1SXM9 type=write size=2337952 2024-09-05T00:56:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.553+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~AJ347CUJ2QWQ.0 size=1048576 2024-09-05T00:56:18.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.553+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~AJ347CUJ2QWQ.1 size=810515 2024-09-05T00:56:18.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.553+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=AJ347CUJ2QWQ tag=YXBYUB0894RW type=write size=2907667 2024-09-05T00:56:18.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.557+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=31KR2V3KXQJM type=del 2024-09-05T00:56:18.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.561+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=3C4JJRPW91MC type=del size=1289909 2024-09-05T00:56:18.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.565+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=Y1Q140UF3Z59 type=write size=937517 2024-09-05T00:56:18.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.569+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=54M9PVQZ56W8 type=write size=429624 2024-09-05T00:56:18.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.569+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~Q4VDE0LVWVU5.0 size=742799 2024-09-05T00:56:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.577+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=Q4VDE0LVWVU5 tag=QJ7BCSHCY08W type=write size=1791375 2024-09-05T00:56:18.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.577+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=A5M3KM4USXA8 type=del size=2211733 2024-09-05T00:56:18.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.581+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~QXM0LFBBRGIR.0 size=688521 2024-09-05T00:56:18.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.589+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=QXM0LFBBRGIR tag=566Y0Q4EZMTT type=write size=1737097 2024-09-05T00:56:18.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.593+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~L7OKJIOQKHGL.0 size=1048576 2024-09-05T00:56:18.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.597+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~L7OKJIOQKHGL.1 size=89390 2024-09-05T00:56:18.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.597+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=L7OKJIOQKHGL tag=8WPRXLOTQ912 type=write size=2186542 2024-09-05T00:56:18.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.597+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=XLVIH1IMRBM0 type=del 2024-09-05T00:56:18.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.605+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~ZH5ZT2MLTBOS.0 size=77432 2024-09-05T00:56:18.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.605+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=ZH5ZT2MLTBOS tag=HFTW439ITNVS type=write size=1126008 2024-09-05T00:56:18.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.609+0000 7f325adab8c0 1 < suggested remove operation key=CB079FGXKNRO tag=D1O4AYVSR3CQ type=del 2024-09-05T00:56:18.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.613+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=M27PQ3ZNCS3F type=del size=479855 2024-09-05T00:56:18.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.617+0000 7f325adab8c0 1 < canceled operation key=VYMRZPO6VKGS tag=BMBTA9Z91Z3Z type=del size=2386756 2024-09-05T00:56:18.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.621+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=WHGCF3HAWAWW type=write size=187174 2024-09-05T00:56:18.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.625+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=2GWBF7DQ5WHD type=write size=658969 2024-09-05T00:56:18.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.629+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~JOLLSI7G55CY.0 size=1048576 2024-09-05T00:56:18.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.633+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~JOLLSI7G55CY.1 size=958489 2024-09-05T00:56:18.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.633+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=JOLLSI7G55CY tag=4XYKCAL38A24 type=write size=3055641 2024-09-05T00:56:18.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.637+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=QNIGL8AVS0DF type=del 2024-09-05T00:56:18.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.637+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=7R0OV43JGET0 type=del size=2498891 2024-09-05T00:56:18.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.641+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=HIZ26EHM23V4 type=write size=283314 2024-09-05T00:56:18.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.649+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~EZ50J4MLWEL2.0 size=1048576 2024-09-05T00:56:18.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.649+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~EZ50J4MLWEL2.1 size=893330 2024-09-05T00:56:18.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.649+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=EZ50J4MLWEL2 tag=P6UQXEFLO8G3 type=write size=2990482 2024-09-05T00:56:18.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.653+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~FGCQJHH4DOI0.0 size=693089 2024-09-05T00:56:18.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.661+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=FGCQJHH4DOI0 tag=N7WBGNAROYD4 type=write size=1741665 2024-09-05T00:56:18.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.661+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=NEFUKZPPZYJP type=del size=207013 2024-09-05T00:56:18.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.665+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.0 size=1048576 2024-09-05T00:56:18.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.669+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.1 size=1048576 2024-09-05T00:56:18.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.669+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~S83PJ8EOK546.2 size=345115 2024-09-05T00:56:18.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.673+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=S83PJ8EOK546 tag=KCO6OK0KMA0L type=write size=3490843 2024-09-05T00:56:18.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.677+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=13FUHB6Y3VUA type=del size=2654008 2024-09-05T00:56:18.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.681+0000 7f325adab8c0 1 < suggested update operation key=MAS6EB753KO9 tag=11YMHXYRANIS type=del size=1922266 2024-09-05T00:56:18.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.685+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=99QN34KZSZQ1 type=del size=1281456 2024-09-05T00:56:18.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.689+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=KRWTB9PFTZVV type=del 2024-09-05T00:56:18.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.693+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~LHBTKBTENYVR.0 size=1048576 2024-09-05T00:56:18.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.697+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~LHBTKBTENYVR.1 size=968731 2024-09-05T00:56:18.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.697+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=LHBTKBTENYVR tag=4E0YUOARO21D type=write size=3065883 2024-09-05T00:56:18.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.697+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=MQXQGVT30OF1 type=del 2024-09-05T00:56:18.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.705+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~W1VKVPCR3KJJ.0 size=94479 2024-09-05T00:56:18.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.705+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=W1VKVPCR3KJJ tag=4CU8LFCB6D62 type=write size=1143055 2024-09-05T00:56:18.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.705+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~AJ347CUJ2QWQ.0 size=1048576 2024-09-05T00:56:18.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.709+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~AJ347CUJ2QWQ.1 size=810515 2024-09-05T00:56:18.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.713+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=AJ347CUJ2QWQ tag=YXBYUB0894RW type=write size=2907667 2024-09-05T00:56:18.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.717+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=4KYT10EEAC4V type=del size=1219293 2024-09-05T00:56:18.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.725+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=3C4JJRPW91MC type=del 2024-09-05T00:56:18.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.725+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=4V474T81K8UQ type=del size=1721782 2024-09-05T00:56:18.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.729+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=54M9PVQZ56W8 type=write size=429624 2024-09-05T00:56:18.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.733+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RZN3VFG3LFDW.0 size=1048576 2024-09-05T00:56:18.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.737+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RZN3VFG3LFDW.1 size=620645 2024-09-05T00:56:18.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.737+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=RZN3VFG3LFDW tag=7CA40ZVP25IF type=write size=2717797 2024-09-05T00:56:18.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.745+0000 7f325adab8c0 1 < suggested remove operation key=G600UT533GTT tag=A5M3KM4USXA8 type=del 2024-09-05T00:56:18.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.745+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=PX533DNQQHG3 type=write size=247076 2024-09-05T00:56:18.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.749+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~L7OKJIOQKHGL.0 size=1048576 2024-09-05T00:56:18.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.753+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~L7OKJIOQKHGL.1 size=89390 2024-09-05T00:56:18.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.757+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=L7OKJIOQKHGL tag=8WPRXLOTQ912 type=write size=2186542 2024-09-05T00:56:18.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.761+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~H96ORL3UF96B.0 size=716970 2024-09-05T00:56:18.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.761+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=H96ORL3UF96B tag=V2HYCZPMG5V6 type=write size=1765546 2024-09-05T00:56:18.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.765+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~ZH5ZT2MLTBOS.0 size=77432 2024-09-05T00:56:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.769+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=ZH5ZT2MLTBOS tag=HFTW439ITNVS type=write size=1126008 2024-09-05T00:56:18.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.773+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=NWOOCI3FIU1I type=del size=3914222 2024-09-05T00:56:18.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.777+0000 7f325adab8c0 1 < canceled operation key=CB079FGXKNRO tag=M27PQ3ZNCS3F type=del size=479855 2024-09-05T00:56:18.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.781+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=DEAS337ZDNH3 type=del size=2645401 2024-09-05T00:56:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.785+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=WHGCF3HAWAWW type=write size=187174 2024-09-05T00:56:18.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.789+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.0 size=1048576 2024-09-05T00:56:18.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.793+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.1 size=1048576 2024-09-05T00:56:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.793+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.2 size=621438 2024-09-05T00:56:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.793+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=OGXZ5XIAMH5P tag=LGER05Q94RM2 type=write size=3767166 2024-09-05T00:56:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.797+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~JOLLSI7G55CY.0 size=1048576 2024-09-05T00:56:18.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.801+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~JOLLSI7G55CY.1 size=958489 2024-09-05T00:56:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.809+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=JOLLSI7G55CY tag=4XYKCAL38A24 type=write size=3055641 2024-09-05T00:56:18.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.813+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~2JS1IXFSONX4.0 size=20078 2024-09-05T00:56:18.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.813+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=2JS1IXFSONX4 tag=1BU634BSXCUX type=write size=1068654 2024-09-05T00:56:18.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.817+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=7R0OV43JGET0 type=del 2024-09-05T00:56:18.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.821+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.0 size=1048576 2024-09-05T00:56:18.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.825+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.1 size=1048576 2024-09-05T00:56:18.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.825+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.2 size=214900 2024-09-05T00:56:18.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.825+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=J6NF8QSTT4ZT tag=XCMSQLX12GU4 type=write size=3360628 2024-09-05T00:56:18.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.829+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~EZ50J4MLWEL2.0 size=1048576 2024-09-05T00:56:18.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.829+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~EZ50J4MLWEL2.1 size=893330 2024-09-05T00:56:18.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.833+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=EZ50J4MLWEL2 tag=P6UQXEFLO8G3 type=write size=2990482 2024-09-05T00:56:18.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.837+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=6EUW2CD51OFH type=del size=2401170 2024-09-05T00:56:18.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.841+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=NEFUKZPPZYJP type=del 2024-09-05T00:56:18.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.845+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=7YF6MX8ETFOB type=del size=4062561 2024-09-05T00:56:18.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.849+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=13FUHB6Y3VUA type=del 2024-09-05T00:56:18.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.853+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=JH908ON89B3W type=del size=2634211 2024-09-05T00:56:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.857+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=99QN34KZSZQ1 type=del 2024-09-05T00:56:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.857+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=XQ6F14BPEHWZ type=del size=1350495 2024-09-05T00:56:18.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.861+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~LHBTKBTENYVR.0 size=1048576 2024-09-05T00:56:18.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.865+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~LHBTKBTENYVR.1 size=968731 2024-09-05T00:56:18.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.869+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=LHBTKBTENYVR tag=4E0YUOARO21D type=write size=3065883 2024-09-05T00:56:18.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.873+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=GQ4PC54BF61U type=del size=1045332 2024-09-05T00:56:18.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.873+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~W1VKVPCR3KJJ.0 size=94479 2024-09-05T00:56:18.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.881+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=W1VKVPCR3KJJ tag=4CU8LFCB6D62 type=write size=1143055 2024-09-05T00:56:18.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.885+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.0 size=1048576 2024-09-05T00:56:18.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.885+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.1 size=1048576 2024-09-05T00:56:18.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.889+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.2 size=622622 2024-09-05T00:56:18.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.889+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=9FY84OACQ3LK tag=2N0B7RQUZN4W type=write size=3768350 2024-09-05T00:56:18.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.893+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=4KYT10EEAC4V type=del 2024-09-05T00:56:18.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.897+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=LJBVKGU1KX6I type=del size=2613833 2024-09-05T00:56:18.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.897+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=4V474T81K8UQ type=del 2024-09-05T00:56:18.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.905+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~FY44J79XR7XE.0 size=1048576 2024-09-05T00:56:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.909+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~FY44J79XR7XE.1 size=1036806 2024-09-05T00:56:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.909+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=FY44J79XR7XE tag=ADYYY1IQBZT5 type=write size=3133958 2024-09-05T00:56:18.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.913+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RZN3VFG3LFDW.0 size=1048576 2024-09-05T00:56:18.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.913+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RZN3VFG3LFDW.1 size=620645 2024-09-05T00:56:18.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.921+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=RZN3VFG3LFDW tag=7CA40ZVP25IF type=write size=2717797 2024-09-05T00:56:18.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.925+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~4J88FVTIU9FB.0 size=1048576 2024-09-05T00:56:18.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.929+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~4J88FVTIU9FB.1 size=840339 2024-09-05T00:56:18.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.929+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=4J88FVTIU9FB tag=QUYP4761X97Z type=write size=2937491 2024-09-05T00:56:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.933+0000 7f325adab8c0 1 < completed write operation key=9O7DVR04PCDB tag=PX533DNQQHG3 type=write size=247076 2024-09-05T00:56:18.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.937+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.0 size=1048576 2024-09-05T00:56:18.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.941+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.1 size=1048576 2024-09-05T00:56:18.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.941+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.2 size=55871 2024-09-05T00:56:18.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.941+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=2K3ZOCTJTMOO tag=SC1LJK7LJ81P type=write size=3201599 2024-09-05T00:56:18.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.945+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~H96ORL3UF96B.0 size=716970 2024-09-05T00:56:18.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.949+0000 7f325adab8c0 1 < canceled multipart upload key=XKOECM0CCOKX upload=H96ORL3UF96B tag=V2HYCZPMG5V6 type=write size=1765546 2024-09-05T00:56:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.953+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=8RJMM4Q3Q4NF type=del size=246589 2024-09-05T00:56:18.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.957+0000 7f325adab8c0 1 < suggested update operation key=ZYT3WYNFIIZN tag=NWOOCI3FIU1I type=del size=3914222 2024-09-05T00:56:18.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.961+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.0 size=1048576 2024-09-05T00:56:18.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.965+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.1 size=1048576 2024-09-05T00:56:18.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.969+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.2 size=169170 2024-09-05T00:56:18.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.969+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=6XZHNG49FL15 tag=6BXMUNAD63ZO type=write size=3314898 2024-09-05T00:56:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.973+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=DEAS337ZDNH3 type=del size=2645401 2024-09-05T00:56:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.977+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~I4XN7AJW1Q4I.0 size=931078 2024-09-05T00:56:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.977+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=I4XN7AJW1Q4I tag=YZSMG26UXMCH type=write size=1979654 2024-09-05T00:56:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.981+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.0 size=1048576 2024-09-05T00:56:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.985+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.1 size=1048576 2024-09-05T00:56:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.985+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~OGXZ5XIAMH5P.2 size=621438 2024-09-05T00:56:18.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.993+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=OGXZ5XIAMH5P tag=LGER05Q94RM2 type=write size=3767166 2024-09-05T00:56:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.993+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=2R3E80492SOR type=del size=3368757 2024-09-05T00:56:19.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:18.997+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~2JS1IXFSONX4.0 size=20078 2024-09-05T00:56:19.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.001+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=2JS1IXFSONX4 tag=1BU634BSXCUX type=write size=1068654 2024-09-05T00:56:19.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.005+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=TFRTEHA9M6IL type=del size=396463 2024-09-05T00:56:19.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.009+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.0 size=1048576 2024-09-05T00:56:19.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.009+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.1 size=1048576 2024-09-05T00:56:19.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.013+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~J6NF8QSTT4ZT.2 size=214900 2024-09-05T00:56:19.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.017+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=J6NF8QSTT4ZT tag=XCMSQLX12GU4 type=write size=3360628 2024-09-05T00:56:19.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.025+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.0 size=1048576 2024-09-05T00:56:19.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.025+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.1 size=1048576 2024-09-05T00:56:19.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.029+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.2 size=103973 2024-09-05T00:56:19.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.029+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=BIS9RG621VYZ tag=QN9R4WWWJDBK type=write size=3249701 2024-09-05T00:56:19.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.033+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=6EUW2CD51OFH type=del 2024-09-05T00:56:19.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.033+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=KE4QL07D9KU7 type=write size=353582 2024-09-05T00:56:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.037+0000 7f325adab8c0 1 < canceled operation key=6N7BLJ1WLDGN tag=7YF6MX8ETFOB type=del size=4062561 2024-09-05T00:56:19.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.041+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=R6LHF1C53206 type=write size=263167 2024-09-05T00:56:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.045+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=JH908ON89B3W type=del 2024-09-05T00:56:19.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.049+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.0 size=1048576 2024-09-05T00:56:19.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.049+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.1 size=1048576 2024-09-05T00:56:19.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.053+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.2 size=885919 2024-09-05T00:56:19.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.053+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=V9MFJN4YF25M tag=5S19X2WLJ3CW type=write size=4031647 2024-09-05T00:56:19.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.057+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=XQ6F14BPEHWZ type=del 2024-09-05T00:56:19.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.061+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.0 size=1048576 2024-09-05T00:56:19.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.065+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.1 size=1048576 2024-09-05T00:56:19.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.065+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.2 size=375530 2024-09-05T00:56:19.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.065+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=22KM4YQ41KN4 tag=ZTCFVM7MN8O3 type=write size=3521258 2024-09-05T00:56:19.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.069+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=GQ4PC54BF61U type=del 2024-09-05T00:56:19.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.073+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.0 size=1048576 2024-09-05T00:56:19.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.081+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.1 size=1048576 2024-09-05T00:56:19.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.081+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.2 size=912047 2024-09-05T00:56:19.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.081+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=MJO15BW0NZS4 tag=3TBR49HK6AI0 type=write size=4057775 2024-09-05T00:56:19.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.085+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.0 size=1048576 2024-09-05T00:56:19.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.089+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.1 size=1048576 2024-09-05T00:56:19.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.089+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~9FY84OACQ3LK.2 size=622622 2024-09-05T00:56:19.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.093+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=9FY84OACQ3LK tag=2N0B7RQUZN4W type=write size=3768350 2024-09-05T00:56:19.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.097+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=J62Z201HVQRF type=del size=518318 2024-09-05T00:56:19.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.101+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=LJBVKGU1KX6I type=del 2024-09-05T00:56:19.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.105+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~SYIGQH5W2VFY.0 size=1048576 2024-09-05T00:56:19.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.105+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~SYIGQH5W2VFY.1 size=753861 2024-09-05T00:56:19.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.105+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=SYIGQH5W2VFY tag=2DKYZG8LNLWO type=write size=2851013 2024-09-05T00:56:19.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.109+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~FY44J79XR7XE.0 size=1048576 2024-09-05T00:56:19.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.109+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~FY44J79XR7XE.1 size=1036806 2024-09-05T00:56:19.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.113+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=FY44J79XR7XE tag=ADYYY1IQBZT5 type=write size=3133958 2024-09-05T00:56:19.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.117+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=L9FUOET4DKWG type=del size=3638779 2024-09-05T00:56:19.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.121+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~4J88FVTIU9FB.0 size=1048576 2024-09-05T00:56:19.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.121+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~4J88FVTIU9FB.1 size=840339 2024-09-05T00:56:19.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.125+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=4J88FVTIU9FB tag=QUYP4761X97Z type=write size=2937491 2024-09-05T00:56:19.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.133+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~T2T2D4KQUZ90.0 size=381815 2024-09-05T00:56:19.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.133+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=T2T2D4KQUZ90 tag=LLFDEW7NQWCT type=write size=1430391 2024-09-05T00:56:19.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.133+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.0 size=1048576 2024-09-05T00:56:19.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.137+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.1 size=1048576 2024-09-05T00:56:19.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.137+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~2K3ZOCTJTMOO.2 size=55871 2024-09-05T00:56:19.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.141+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=2K3ZOCTJTMOO tag=SC1LJK7LJ81P type=write size=3201599 2024-09-05T00:56:19.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.145+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=VNS6JV3D1UVN type=write size=469882 2024-09-05T00:56:19.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.149+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=8RJMM4Q3Q4NF type=del size=246589 2024-09-05T00:56:19.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.153+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~9PKW3VHR10RH.0 size=1048576 2024-09-05T00:56:19.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.157+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~9PKW3VHR10RH.1 size=690509 2024-09-05T00:56:19.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.157+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=9PKW3VHR10RH tag=8HAAT5C9I806 type=write size=2787661 2024-09-05T00:56:19.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.157+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.0 size=1048576 2024-09-05T00:56:19.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.161+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.1 size=1048576 2024-09-05T00:56:19.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.161+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~6XZHNG49FL15.2 size=169170 2024-09-05T00:56:19.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.165+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=6XZHNG49FL15 tag=6BXMUNAD63ZO type=write size=3314898 2024-09-05T00:56:19.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.169+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=1XADVO5BO3Z7 type=del size=2743999 2024-09-05T00:56:19.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.169+0000 7f325adab8c0 1 < canceled part key=_multipart_JKRZR0KRE93F.2~I4XN7AJW1Q4I.0 size=931078 2024-09-05T00:56:19.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.173+0000 7f325adab8c0 1 < canceled multipart upload key=JKRZR0KRE93F upload=I4XN7AJW1Q4I tag=YZSMG26UXMCH type=write size=1979654 2024-09-05T00:56:19.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.177+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=A6R62M54ZXXV type=del size=1764554 2024-09-05T00:56:19.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.181+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=2R3E80492SOR type=del 2024-09-05T00:56:19.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.181+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=3UQS7PGML6VE type=del size=598638 2024-09-05T00:56:19.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.189+0000 7f325adab8c0 1 < suggested update operation key=JKRZR0KRE93F tag=TFRTEHA9M6IL type=del size=396463 2024-09-05T00:56:19.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.189+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=RJS2RRWBXAJ5 type=del size=919295 2024-09-05T00:56:19.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.193+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.0 size=1048576 2024-09-05T00:56:19.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.193+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.1 size=1048576 2024-09-05T00:56:19.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.197+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~BIS9RG621VYZ.2 size=103973 2024-09-05T00:56:19.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.201+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=BIS9RG621VYZ tag=QN9R4WWWJDBK type=write size=3249701 2024-09-05T00:56:19.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.205+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=0ZNC2EUTU86U type=del size=2449348 2024-09-05T00:56:19.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.205+0000 7f325adab8c0 1 < completed write operation key=06YHJGLZQLK6 tag=KE4QL07D9KU7 type=write size=353582 2024-09-05T00:56:19.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.209+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=182T74GOF055 type=del size=3163360 2024-09-05T00:56:19.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.213+0000 7f325adab8c0 1 < suggested update operation key=D6HSFIRN2X4Q tag=R6LHF1C53206 type=write size=263167 2024-09-05T00:56:19.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.221+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~BAMB4XG8KXVN.0 size=19703 2024-09-05T00:56:19.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.221+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=BAMB4XG8KXVN tag=5ZYGPLK2GBWU type=write size=1068279 2024-09-05T00:56:19.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.225+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.0 size=1048576 2024-09-05T00:56:19.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.225+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.1 size=1048576 2024-09-05T00:56:19.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.229+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~V9MFJN4YF25M.2 size=885919 2024-09-05T00:56:19.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.233+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=V9MFJN4YF25M tag=5S19X2WLJ3CW type=write size=4031647 2024-09-05T00:56:19.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.237+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.0 size=1048576 2024-09-05T00:56:19.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.241+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.1 size=1048576 2024-09-05T00:56:19.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.245+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.2 size=273011 2024-09-05T00:56:19.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.245+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=5XGL0IGXJ2OI tag=YYF28TG0AP6P type=write size=3418739 2024-09-05T00:56:19.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.245+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.0 size=1048576 2024-09-05T00:56:19.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.249+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.1 size=1048576 2024-09-05T00:56:19.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.249+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~22KM4YQ41KN4.2 size=375530 2024-09-05T00:56:19.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.257+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=22KM4YQ41KN4 tag=ZTCFVM7MN8O3 type=write size=3521258 2024-09-05T00:56:19.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.261+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.0 size=1048576 2024-09-05T00:56:19.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.261+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.1 size=1048576 2024-09-05T00:56:19.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.265+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.2 size=193751 2024-09-05T00:56:19.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.265+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=D7EPLM8VDIPU tag=R3U8TW8CHHZY type=write size=3339479 2024-09-05T00:56:19.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.269+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.0 size=1048576 2024-09-05T00:56:19.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.269+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.1 size=1048576 2024-09-05T00:56:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.273+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~MJO15BW0NZS4.2 size=912047 2024-09-05T00:56:19.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.277+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=MJO15BW0NZS4 tag=3TBR49HK6AI0 type=write size=4057775 2024-09-05T00:56:19.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.281+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=PJFSRZLVJ7CC type=del size=3533366 2024-09-05T00:56:19.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.285+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=J62Z201HVQRF type=del 2024-09-05T00:56:19.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.289+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~3JVKHGBR31DW.0 size=984738 2024-09-05T00:56:19.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.289+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=3JVKHGBR31DW tag=8AA10GFZEYUG type=write size=2033314 2024-09-05T00:56:19.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.293+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~SYIGQH5W2VFY.0 size=1048576 2024-09-05T00:56:19.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.297+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~SYIGQH5W2VFY.1 size=753861 2024-09-05T00:56:19.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.301+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=SYIGQH5W2VFY tag=2DKYZG8LNLWO type=write size=2851013 2024-09-05T00:56:19.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.305+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=RDUJ0EECEP60 type=del size=3375543 2024-09-05T00:56:19.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.309+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=L9FUOET4DKWG type=del size=3638779: (22) Invalid argument 2024-09-05T00:56:19.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.313+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=KSNJC3VDO98I type=del size=3599133 2024-09-05T00:56:19.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.313+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~T2T2D4KQUZ90.0 size=381815 2024-09-05T00:56:19.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.321+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=T2T2D4KQUZ90 tag=LLFDEW7NQWCT type=write size=1430391 2024-09-05T00:56:19.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.325+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~WE7HZOOI7VC8.0 size=1048576 2024-09-05T00:56:19.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.329+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~WE7HZOOI7VC8.1 size=939664 2024-09-05T00:56:19.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.329+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=WE7HZOOI7VC8 tag=Y6TUEGC8XNDL type=write size=3036816 2024-09-05T00:56:19.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.333+0000 7f325adab8c0 1 < canceled operation key=ZYT3WYNFIIZN tag=VNS6JV3D1UVN type=write size=469882 2024-09-05T00:56:19.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.337+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~5BFZ9UMU3VI5.0 size=43621 2024-09-05T00:56:19.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.337+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=5BFZ9UMU3VI5 tag=L7NK3SQ1IUPV type=write size=1092197 2024-09-05T00:56:19.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.341+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~9PKW3VHR10RH.0 size=1048576 2024-09-05T00:56:19.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.345+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~9PKW3VHR10RH.1 size=690509 2024-09-05T00:56:19.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.349+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=9PKW3VHR10RH tag=8HAAT5C9I806 type=write size=2787661 2024-09-05T00:56:19.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.353+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~SWH80A1DYBXI.0 size=1048576 2024-09-05T00:56:19.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.353+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~SWH80A1DYBXI.1 size=769834 2024-09-05T00:56:19.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.353+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=SWH80A1DYBXI tag=VQQTB28YBGZ0 type=write size=2866986 2024-09-05T00:56:19.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.357+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=1XADVO5BO3Z7 type=del 2024-09-05T00:56:19.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.361+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=E0YXFAXHRE82 type=del size=3744959 2024-09-05T00:56:19.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.365+0000 7f325adab8c0 1 < suggested update operation key=O0RSK2S88XHP tag=A6R62M54ZXXV type=del size=1764554 2024-09-05T00:56:19.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.365+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=JXO4JMWSNDWD type=del size=1649940 2024-09-05T00:56:19.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.369+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=3UQS7PGML6VE type=del 2024-09-05T00:56:19.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.373+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=CD4G1SESXH5U type=del size=2583347 2024-09-05T00:56:19.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.373+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=RJS2RRWBXAJ5 type=del 2024-09-05T00:56:19.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.377+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~EH9V54IYBOHZ.0 size=615867 2024-09-05T00:56:19.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.377+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=EH9V54IYBOHZ tag=H5386CYZ0NWT type=write size=1664443 2024-09-05T00:56:19.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.381+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=0ZNC2EUTU86U type=del 2024-09-05T00:56:19.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.385+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~PN2SS9BXZYFW.0 size=838978 2024-09-05T00:56:19.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.385+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=PN2SS9BXZYFW tag=PLS3A73ZB618 type=write size=1887554 2024-09-05T00:56:19.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.389+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=182T74GOF055 type=del 2024-09-05T00:56:19.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.393+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=UV2NQHB0QA52 type=del size=1758527 2024-09-05T00:56:19.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.393+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~BAMB4XG8KXVN.0 size=19703 2024-09-05T00:56:19.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.397+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=BAMB4XG8KXVN tag=5ZYGPLK2GBWU type=write size=1068279 2024-09-05T00:56:19.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.401+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~C08CJX9J9QZF.0 size=1048576 2024-09-05T00:56:19.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.405+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~C08CJX9J9QZF.1 size=363263 2024-09-05T00:56:19.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.405+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=C08CJX9J9QZF tag=NVV2A5XH9VF8 type=write size=2460415 2024-09-05T00:56:19.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.405+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.0 size=1048576 2024-09-05T00:56:19.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.409+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.1 size=1048576 2024-09-05T00:56:19.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.409+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~5XGL0IGXJ2OI.2 size=273011 2024-09-05T00:56:19.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.413+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=5XGL0IGXJ2OI tag=YYF28TG0AP6P type=write size=3418739 2024-09-05T00:56:19.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.417+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=3M8ECOY867TW type=del size=754771 2024-09-05T00:56:19.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.421+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.0 size=1048576 2024-09-05T00:56:19.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.421+0000 7f325adab8c0 1 < canceled part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.1 size=1048576 2024-09-05T00:56:19.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.421+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~D7EPLM8VDIPU.2 size=193751 2024-09-05T00:56:19.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.425+0000 7f325adab8c0 1 < canceled multipart upload key=VYMRZPO6VKGS upload=D7EPLM8VDIPU tag=R3U8TW8CHHZY type=write size=3339479 2024-09-05T00:56:19.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.429+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=POK7Q1CY2WF8 type=write size=474875 2024-09-05T00:56:19.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.433+0000 7f325adab8c0 1 < suggested update operation key=ZYT3WYNFIIZN tag=PJFSRZLVJ7CC type=del size=3533366 2024-09-05T00:56:19.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.437+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=6OBMNEN69Q0D type=del size=981302 2024-09-05T00:56:19.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.437+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~3JVKHGBR31DW.0 size=984738 2024-09-05T00:56:19.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.441+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=3JVKHGBR31DW tag=8AA10GFZEYUG type=write size=2033314 2024-09-05T00:56:19.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.445+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=DYXB97BP8UYR type=del size=4093737 2024-09-05T00:56:19.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.445+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=RDUJ0EECEP60 type=del 2024-09-05T00:56:19.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.449+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~OUH7ZLZ6LQKI.0 size=809701 2024-09-05T00:56:19.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.449+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=OUH7ZLZ6LQKI tag=V3VWYSGWNKS2 type=write size=1858277 2024-09-05T00:56:19.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.453+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=KSNJC3VDO98I type=del 2024-09-05T00:56:19.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.457+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=HFYUWFRTHBYE type=del size=152009 2024-09-05T00:56:19.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.457+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~WE7HZOOI7VC8.0 size=1048576 2024-09-05T00:56:19.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.461+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~WE7HZOOI7VC8.1 size=939664 2024-09-05T00:56:19.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.465+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=WE7HZOOI7VC8 tag=Y6TUEGC8XNDL type=write size=3036816 2024-09-05T00:56:19.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.465+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=SPHULB0HOTQY type=del size=2764431 2024-09-05T00:56:19.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.469+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~5BFZ9UMU3VI5.0 size=43621 2024-09-05T00:56:19.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.473+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=5BFZ9UMU3VI5 tag=L7NK3SQ1IUPV type=write size=1092197 2024-09-05T00:56:19.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.473+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=OE802E2FRJTY type=write size=517593 2024-09-05T00:56:19.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.477+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~SWH80A1DYBXI.0 size=1048576 2024-09-05T00:56:19.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.481+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~SWH80A1DYBXI.1 size=769834 2024-09-05T00:56:19.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.485+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=SWH80A1DYBXI tag=VQQTB28YBGZ0 type=write size=2866986 2024-09-05T00:56:19.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.485+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=NC7DVDD98E51 type=del size=3929059 2024-09-05T00:56:19.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.489+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=E0YXFAXHRE82 type=del 2024-09-05T00:56:19.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.493+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=1LOPNKVO599F type=write size=1027018 2024-09-05T00:56:19.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.493+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=JXO4JMWSNDWD type=del 2024-09-05T00:56:19.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.501+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~QM3M4NJCAUSK.0 size=1048576 2024-09-05T00:56:19.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.501+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~QM3M4NJCAUSK.1 size=362430 2024-09-05T00:56:19.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.501+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=QM3M4NJCAUSK tag=8HHEF6HKZ34N type=write size=2459582 2024-09-05T00:56:19.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.505+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=CD4G1SESXH5U type=del 2024-09-05T00:56:19.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.505+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=IN3R7AFD6TN5 type=del size=4147487 2024-09-05T00:56:19.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.509+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~EH9V54IYBOHZ.0 size=615867 2024-09-05T00:56:19.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.513+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=EH9V54IYBOHZ tag=H5386CYZ0NWT type=write size=1664443 2024-09-05T00:56:19.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.521+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~QSXBIW7YEXQ1.0 size=1048576 2024-09-05T00:56:19.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.521+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~QSXBIW7YEXQ1.1 size=478645 2024-09-05T00:56:19.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.521+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=QSXBIW7YEXQ1 tag=P0VKNSFBCT1E type=write size=2575797 2024-09-05T00:56:19.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.525+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~PN2SS9BXZYFW.0 size=838978 2024-09-05T00:56:19.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.525+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=PN2SS9BXZYFW tag=PLS3A73ZB618 type=write size=1887554 2024-09-05T00:56:19.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.529+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=CIYZFKJ3AFEO type=del size=2018672 2024-09-05T00:56:19.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.533+0000 7f325adab8c0 1 < suggested remove operation key=D6HSFIRN2X4Q tag=UV2NQHB0QA52 type=del 2024-09-05T00:56:19.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.537+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.0 size=1048576 2024-09-05T00:56:19.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.541+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.1 size=1048576 2024-09-05T00:56:19.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.541+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.2 size=72533 2024-09-05T00:56:19.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.541+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=MI9DR7ZBPFFJ tag=AJBAM4IIDGYC type=write size=3218261 2024-09-05T00:56:19.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.545+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~C08CJX9J9QZF.0 size=1048576 2024-09-05T00:56:19.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.545+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~C08CJX9J9QZF.1 size=363263 2024-09-05T00:56:19.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.549+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=C08CJX9J9QZF tag=NVV2A5XH9VF8 type=write size=2460415 2024-09-05T00:56:19.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.553+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=P14B97BHC3GY type=del size=2851000 2024-09-05T00:56:19.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.557+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=3M8ECOY867TW type=del 2024-09-05T00:56:19.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.557+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=FXBCT66F405R type=del size=3797184 2024-09-05T00:56:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.561+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=POK7Q1CY2WF8 type=write size=474875 2024-09-05T00:56:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.565+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=GID2DKVFY2CX type=del size=3179199 2024-09-05T00:56:19.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.565+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=6OBMNEN69Q0D type=del 2024-09-05T00:56:19.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.569+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=8QTD19F46V6E type=del size=2975813 2024-09-05T00:56:19.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.573+0000 7f325adab8c0 1 < canceled operation key=GU25IIQWQNR2 tag=DYXB97BP8UYR type=del size=4093737 2024-09-05T00:56:19.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.577+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~Q36OA19CXGJA.0 size=1048576 2024-09-05T00:56:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.577+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~Q36OA19CXGJA.1 size=905620 2024-09-05T00:56:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.577+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=Q36OA19CXGJA tag=MK25XN67X5H2 type=write size=3002772 2024-09-05T00:56:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.581+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~OUH7ZLZ6LQKI.0 size=809701 2024-09-05T00:56:19.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.585+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=OUH7ZLZ6LQKI tag=V3VWYSGWNKS2 type=write size=1858277 2024-09-05T00:56:19.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.589+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=N3OE3QB282RZ type=write size=660574 2024-09-05T00:56:19.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.589+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=HFYUWFRTHBYE type=del 2024-09-05T00:56:19.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.593+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=N5RW2PI2GHND type=del size=2291695 2024-09-05T00:56:19.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.597+0000 7f325adab8c0 1 < suggested update operation key=GU25IIQWQNR2 tag=SPHULB0HOTQY type=del size=2764431 2024-09-05T00:56:19.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.601+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=XK4YJQ1WA2EH type=del size=4086719 2024-09-05T00:56:19.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.605+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=OE802E2FRJTY type=write size=517593 2024-09-05T00:56:19.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.609+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=FCARE0T4J8GJ type=del size=2182015 2024-09-05T00:56:19.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.609+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=NC7DVDD98E51 type=del 2024-09-05T00:56:19.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.613+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.0 size=1048576 2024-09-05T00:56:19.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.617+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.1 size=1048576 2024-09-05T00:56:19.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.617+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.2 size=928935 2024-09-05T00:56:19.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.617+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=422U8G3X3VDQ tag=2BMQZU4Y3FDD type=write size=4074663 2024-09-05T00:56:19.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.621+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=1LOPNKVO599F type=write size=1027018 2024-09-05T00:56:19.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.629+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PEKJNHYXXRC3.0 size=1048576 2024-09-05T00:56:19.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.629+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~PEKJNHYXXRC3.1 size=201210 2024-09-05T00:56:19.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.629+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=PEKJNHYXXRC3 tag=GSTK2E0K1WV2 type=write size=2298362 2024-09-05T00:56:19.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.633+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~QM3M4NJCAUSK.0 size=1048576 2024-09-05T00:56:19.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.633+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~QM3M4NJCAUSK.1 size=362430 2024-09-05T00:56:19.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.641+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=QM3M4NJCAUSK tag=8HHEF6HKZ34N type=write size=2459582 2024-09-05T00:56:19.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.645+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~9YH21MV7UK9S.0 size=925301 2024-09-05T00:56:19.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.645+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=9YH21MV7UK9S tag=P86P6LGOQQEY type=write size=1973877 2024-09-05T00:56:19.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.649+0000 7f325adab8c0 1 < canceled operation key=GF6OC9O60D5E tag=IN3R7AFD6TN5 type=del size=4147487 2024-09-05T00:56:19.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.649+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=ZMCU24WQBUB6 type=del size=1845213 2024-09-05T00:56:19.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.653+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~QSXBIW7YEXQ1.0 size=1048576 2024-09-05T00:56:19.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.657+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~QSXBIW7YEXQ1.1 size=478645 2024-09-05T00:56:19.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.661+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=QSXBIW7YEXQ1 tag=P0VKNSFBCT1E type=write size=2575797 2024-09-05T00:56:19.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.665+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~K0DD1BXJURQK.0 size=487615 2024-09-05T00:56:19.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.665+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=K0DD1BXJURQK tag=43ALKJS2GI9Q type=write size=1536191 2024-09-05T00:56:19.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.669+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=CIYZFKJ3AFEO type=del 2024-09-05T00:56:19.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.673+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~8LVZTA3E7LQ8.0 size=924523 2024-09-05T00:56:19.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.673+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=8LVZTA3E7LQ8 tag=72Y4X4USRO3D type=write size=1973099 2024-09-05T00:56:19.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.677+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.0 size=1048576 2024-09-05T00:56:19.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.677+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.1 size=1048576 2024-09-05T00:56:19.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.681+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~MI9DR7ZBPFFJ.2 size=72533 2024-09-05T00:56:19.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.685+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=MI9DR7ZBPFFJ tag=AJBAM4IIDGYC type=write size=3218261 2024-09-05T00:56:19.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.689+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=8G29V0VY9PE9 type=del size=2750930 2024-09-05T00:56:19.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.689+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=P14B97BHC3GY type=del 2024-09-05T00:56:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.693+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=0WRQ1JL8JY3A type=del size=782586 2024-09-05T00:56:19.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.697+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=FXBCT66F405R type=del 2024-09-05T00:56:19.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.701+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~LEU5H5EJ62AY.0 size=597046 2024-09-05T00:56:19.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.701+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=LEU5H5EJ62AY tag=8EZY2471ISES type=write size=1645622 2024-09-05T00:56:19.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.709+0000 7f325adab8c0 1 < suggested remove operation key=GQB4HOYII01G tag=GID2DKVFY2CX type=del 2024-09-05T00:56:19.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.713+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.0 size=1048576 2024-09-05T00:56:19.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.713+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.1 size=1048576 2024-09-05T00:56:19.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.717+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.2 size=400598 2024-09-05T00:56:19.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.717+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=LH0NLW1OHOSW tag=Y9VA8KYFY67I type=write size=3546326 2024-09-05T00:56:19.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.721+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=8QTD19F46V6E type=del 2024-09-05T00:56:19.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.725+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=RT32OFDX20L5 type=del size=3180204 2024-09-05T00:56:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.725+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~Q36OA19CXGJA.0 size=1048576 2024-09-05T00:56:19.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.729+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~Q36OA19CXGJA.1 size=905620 2024-09-05T00:56:19.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.733+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=Q36OA19CXGJA tag=MK25XN67X5H2 type=write size=3002772 2024-09-05T00:56:19.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.737+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.0 size=1048576 2024-09-05T00:56:19.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.741+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.1 size=1048576 2024-09-05T00:56:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.745+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.2 size=592705 2024-09-05T00:56:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.745+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=R4ECJWQPXQTD tag=Y6EPC2NGQIPJ type=write size=3738433 2024-09-05T00:56:19.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.745+0000 7f325adab8c0 -1 < failed to complete operation key=GU25IIQWQNR2 tag=N3OE3QB282RZ type=write size=660574: (22) Invalid argument 2024-09-05T00:56:19.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.749+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=3W8V4S2TEA45 type=write size=663826 2024-09-05T00:56:19.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.753+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=N5RW2PI2GHND type=del 2024-09-05T00:56:19.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.753+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=3G6T1O2IAIDR type=del size=2544430 2024-09-05T00:56:19.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.757+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=XK4YJQ1WA2EH type=del 2024-09-05T00:56:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.761+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=K6H2B75LCR4F type=del size=689253 2024-09-05T00:56:19.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.761+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=FCARE0T4J8GJ type=del 2024-09-05T00:56:19.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.769+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.0 size=1048576 2024-09-05T00:56:19.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.769+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.1 size=1048576 2024-09-05T00:56:19.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.773+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.2 size=753362 2024-09-05T00:56:19.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.773+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=SHPDTUAYHVF9 tag=8GV5Y0S3VOVN type=write size=3899090 2024-09-05T00:56:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.773+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.0 size=1048576 2024-09-05T00:56:19.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.777+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.1 size=1048576 2024-09-05T00:56:19.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.777+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~422U8G3X3VDQ.2 size=928935 2024-09-05T00:56:19.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.781+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=422U8G3X3VDQ tag=2BMQZU4Y3FDD type=write size=4074663 2024-09-05T00:56:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.785+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.0 size=1048576 2024-09-05T00:56:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.789+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.1 size=1048576 2024-09-05T00:56:19.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.789+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.2 size=8798 2024-09-05T00:56:19.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.789+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=GD5WJJHCJHCG tag=0SST7OZ93QQ5 type=write size=3154526 2024-09-05T00:56:19.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.793+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~PEKJNHYXXRC3.0 size=1048576 2024-09-05T00:56:19.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.797+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~PEKJNHYXXRC3.1 size=201210 2024-09-05T00:56:19.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.801+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=PEKJNHYXXRC3 tag=GSTK2E0K1WV2 type=write size=2298362 2024-09-05T00:56:19.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.805+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.0 size=1048576 2024-09-05T00:56:19.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.805+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.1 size=1048576 2024-09-05T00:56:19.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.809+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.2 size=221118 2024-09-05T00:56:19.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.809+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=DH28BBBMOL10 tag=MMSTTQED75MO type=write size=3366846 2024-09-05T00:56:19.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.813+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~9YH21MV7UK9S.0 size=925301 2024-09-05T00:56:19.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.817+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=9YH21MV7UK9S tag=P86P6LGOQQEY type=write size=1973877 2024-09-05T00:56:19.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.825+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~4A38S6V23IW5.0 size=1048576 2024-09-05T00:56:19.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.829+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~4A38S6V23IW5.1 size=527474 2024-09-05T00:56:19.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.829+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=4A38S6V23IW5 tag=I27FMJX9J2CP type=write size=2624626 2024-09-05T00:56:19.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.829+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=ZMCU24WQBUB6 type=del 2024-09-05T00:56:19.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.833+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=27Z652A8KH6C type=write size=690629 2024-09-05T00:56:19.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.833+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~K0DD1BXJURQK.0 size=487615 2024-09-05T00:56:19.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.841+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=K0DD1BXJURQK tag=43ALKJS2GI9Q type=write size=1536191 2024-09-05T00:56:19.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.841+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=2YXU7SLSLQI7 type=write size=447416 2024-09-05T00:56:19.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.845+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~8LVZTA3E7LQ8.0 size=924523 2024-09-05T00:56:19.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.849+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=8LVZTA3E7LQ8 tag=72Y4X4USRO3D type=write size=1973099 2024-09-05T00:56:19.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.857+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~RMN7BQYVBBV3.0 size=206195 2024-09-05T00:56:19.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.857+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=RMN7BQYVBBV3 tag=29JN0HTFHZB2 type=write size=1254771 2024-09-05T00:56:19.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.861+0000 7f325adab8c0 1 < suggested update operation key=EGPVSV2PFILM tag=8G29V0VY9PE9 type=del size=2750930 2024-09-05T00:56:19.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.865+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~I7AD353NGLQS.0 size=302445 2024-09-05T00:56:19.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.865+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=I7AD353NGLQS tag=Z9JH6SHOGY74 type=write size=1351021 2024-09-05T00:56:19.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.873+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=0WRQ1JL8JY3A type=del size=782586 2024-09-05T00:56:19.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.873+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=WAH1AOUK990C type=write size=452803 2024-09-05T00:56:19.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.877+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~LEU5H5EJ62AY.0 size=597046 2024-09-05T00:56:19.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.881+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=LEU5H5EJ62AY tag=8EZY2471ISES type=write size=1645622 2024-09-05T00:56:19.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.889+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.0 size=1048576 2024-09-05T00:56:19.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.893+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.1 size=1048576 2024-09-05T00:56:19.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.893+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.2 size=166265 2024-09-05T00:56:19.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.893+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=ORLUJHNS19UT tag=G16Y7Y01JYL5 type=write size=3311993 2024-09-05T00:56:19.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.897+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.0 size=1048576 2024-09-05T00:56:19.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.901+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.1 size=1048576 2024-09-05T00:56:19.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.901+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~LH0NLW1OHOSW.2 size=400598 2024-09-05T00:56:19.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.909+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=LH0NLW1OHOSW tag=Y9VA8KYFY67I type=write size=3546326 2024-09-05T00:56:19.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.913+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~8QCOSWLH2XUS.0 size=749673 2024-09-05T00:56:19.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.913+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=8QCOSWLH2XUS tag=C3EAF3AMH49J type=write size=1798249 2024-09-05T00:56:19.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.917+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=RT32OFDX20L5 type=del 2024-09-05T00:56:19.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.921+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=CWXQI1TX8ALN type=del size=3041291 2024-09-05T00:56:19.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.925+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.0 size=1048576 2024-09-05T00:56:19.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.925+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.1 size=1048576 2024-09-05T00:56:19.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.925+0000 7f325adab8c0 1 < canceled part key=_multipart_6N7BLJ1WLDGN.2~R4ECJWQPXQTD.2 size=592705 2024-09-05T00:56:19.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.933+0000 7f325adab8c0 1 < canceled multipart upload key=6N7BLJ1WLDGN upload=R4ECJWQPXQTD tag=Y6EPC2NGQIPJ type=write size=3738433 2024-09-05T00:56:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.937+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~128PRUXEZEE3.0 size=4171 2024-09-05T00:56:19.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.937+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=128PRUXEZEE3 tag=1QDFJT8IXZHV type=write size=1052747 2024-09-05T00:56:19.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.941+0000 7f325adab8c0 1 < suggested remove operation key=VYMRZPO6VKGS tag=3W8V4S2TEA45 type=write 2024-09-05T00:56:19.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.945+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=TX5WSWPT4F5X type=del size=2584104 2024-09-05T00:56:19.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.949+0000 7f325adab8c0 -1 < failed to complete operation key=EGPVSV2PFILM tag=3G6T1O2IAIDR type=del size=2544430: (22) Invalid argument 2024-09-05T00:56:19.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.953+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.0 size=1048576 2024-09-05T00:56:19.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.957+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.1 size=1048576 2024-09-05T00:56:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.957+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.2 size=123928 2024-09-05T00:56:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.957+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=Q91W5AGWQ59M tag=U5Y39NRV9195 type=write size=3269656 2024-09-05T00:56:19.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.965+0000 7f325adab8c0 1 < suggested remove operation key=YG43HSBBCRKH tag=K6H2B75LCR4F type=del 2024-09-05T00:56:19.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.969+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~LEOGMHF5T4BE.0 size=933985 2024-09-05T00:56:19.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.969+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=LEOGMHF5T4BE tag=HV34N2NQR0WX type=write size=1982561 2024-09-05T00:56:19.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.973+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.0 size=1048576 2024-09-05T00:56:19.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.973+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.1 size=1048576 2024-09-05T00:56:19.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.977+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~SHPDTUAYHVF9.2 size=753362 2024-09-05T00:56:19.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.981+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=SHPDTUAYHVF9 tag=8GV5Y0S3VOVN type=write size=3899090 2024-09-05T00:56:19.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.985+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=6C11QMOWJKJ4 type=del size=415786 2024-09-05T00:56:19.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.989+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.0 size=1048576 2024-09-05T00:56:19.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.989+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.1 size=1048576 2024-09-05T00:56:19.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.993+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~GD5WJJHCJHCG.2 size=8798 2024-09-05T00:56:20.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:19.997+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=GD5WJJHCJHCG tag=0SST7OZ93QQ5 type=write size=3154526 2024-09-05T00:56:20.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.005+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.0 size=1048576 2024-09-05T00:56:20.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.005+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.1 size=1048576 2024-09-05T00:56:20.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.009+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.2 size=1042191 2024-09-05T00:56:20.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.009+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=K5TIZQU678OI tag=U1N0E7AXANE0 type=write size=4187919 2024-09-05T00:56:20.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.013+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.0 size=1048576 2024-09-05T00:56:20.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.013+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.1 size=1048576 2024-09-05T00:56:20.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.017+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~DH28BBBMOL10.2 size=221118 2024-09-05T00:56:20.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.021+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=DH28BBBMOL10 tag=MMSTTQED75MO type=write size=3366846 2024-09-05T00:56:20.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.025+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=Q82GU31KVMUJ type=del size=2610360 2024-09-05T00:56:20.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.029+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~4A38S6V23IW5.0 size=1048576 2024-09-05T00:56:20.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.029+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~4A38S6V23IW5.1 size=527474 2024-09-05T00:56:20.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.033+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=4A38S6V23IW5 tag=I27FMJX9J2CP type=write size=2624626 2024-09-05T00:56:20.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.041+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~CJ6LKW0UI7IY.0 size=1048576 2024-09-05T00:56:20.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.041+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~CJ6LKW0UI7IY.1 size=746990 2024-09-05T00:56:20.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.041+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=CJ6LKW0UI7IY tag=8U9LQX1OHTMH type=write size=2844142 2024-09-05T00:56:20.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.045+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=27Z652A8KH6C type=write size=690629 2024-09-05T00:56:20.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.049+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~2057E89TXL74.0 size=1048576 2024-09-05T00:56:20.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.053+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~2057E89TXL74.1 size=607622 2024-09-05T00:56:20.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.053+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=2057E89TXL74 tag=1F5UJI2OMC1O type=write size=2704774 2024-09-05T00:56:20.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.057+0000 7f325adab8c0 1 < suggested update operation key=GF6OC9O60D5E tag=2YXU7SLSLQI7 type=write size=447416 2024-09-05T00:56:20.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.061+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=FV8B3ZP3X4P0 type=write size=743886 2024-09-05T00:56:20.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.061+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~RMN7BQYVBBV3.0 size=206195 2024-09-05T00:56:20.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.065+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=RMN7BQYVBBV3 tag=29JN0HTFHZB2 type=write size=1254771 2024-09-05T00:56:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.069+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~5Z4RNG0F60JV.0 size=1048576 2024-09-05T00:56:20.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.073+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~5Z4RNG0F60JV.1 size=527574 2024-09-05T00:56:20.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.073+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=5Z4RNG0F60JV tag=A01A04VBWD1Y type=write size=2624726 2024-09-05T00:56:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.077+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~I7AD353NGLQS.0 size=302445 2024-09-05T00:56:20.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.081+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=I7AD353NGLQS tag=Z9JH6SHOGY74 type=write size=1351021 2024-09-05T00:56:20.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.085+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~QEBLZSYF9IVB.0 size=1048576 2024-09-05T00:56:20.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.085+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~QEBLZSYF9IVB.1 size=862052 2024-09-05T00:56:20.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.085+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=QEBLZSYF9IVB tag=TT9BZ3VJZD19 type=write size=2959204 2024-09-05T00:56:20.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.093+0000 7f325adab8c0 1 < completed write operation key=ZYT3WYNFIIZN tag=WAH1AOUK990C type=write size=452803 2024-09-05T00:56:20.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.097+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=ECIKYL8N52XY type=write size=1039551 2024-09-05T00:56:20.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.097+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.0 size=1048576 2024-09-05T00:56:20.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.101+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.1 size=1048576 2024-09-05T00:56:20.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.101+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ORLUJHNS19UT.2 size=166265 2024-09-05T00:56:20.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.109+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=ORLUJHNS19UT tag=G16Y7Y01JYL5 type=write size=3311993 2024-09-05T00:56:20.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.113+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~PQP3C3MJ5PWT.0 size=1048576 2024-09-05T00:56:20.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.113+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~PQP3C3MJ5PWT.1 size=123830 2024-09-05T00:56:20.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.113+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=PQP3C3MJ5PWT tag=1HG5DY6B69G8 type=write size=2220982 2024-09-05T00:56:20.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.117+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~8QCOSWLH2XUS.0 size=749673 2024-09-05T00:56:20.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.121+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=8QCOSWLH2XUS tag=C3EAF3AMH49J type=write size=1798249 2024-09-05T00:56:20.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.125+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=9RTF2M76FMXS type=del size=339752 2024-09-05T00:56:20.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.129+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=CWXQI1TX8ALN type=del 2024-09-05T00:56:20.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.137+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.0 size=1048576 2024-09-05T00:56:20.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.141+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.1 size=1048576 2024-09-05T00:56:20.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.141+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.2 size=239849 2024-09-05T00:56:20.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.141+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=FK98LM9RJJTW tag=FYNFVIJ5TI8L type=write size=3385577 2024-09-05T00:56:20.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.145+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~128PRUXEZEE3.0 size=4171 2024-09-05T00:56:20.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.153+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=128PRUXEZEE3 tag=1QDFJT8IXZHV type=write size=1052747 2024-09-05T00:56:20.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.157+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=X1CAXHVDOH8V type=write size=226035 2024-09-05T00:56:20.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.157+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=TX5WSWPT4F5X type=del 2024-09-05T00:56:20.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.165+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.0 size=1048576 2024-09-05T00:56:20.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.169+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.1 size=1048576 2024-09-05T00:56:20.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.173+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.2 size=308789 2024-09-05T00:56:20.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.173+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=246AGQPXM8YW tag=8LUCKYFWTO78 type=write size=3454517 2024-09-05T00:56:20.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.173+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.0 size=1048576 2024-09-05T00:56:20.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.177+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.1 size=1048576 2024-09-05T00:56:20.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.181+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~Q91W5AGWQ59M.2 size=123928 2024-09-05T00:56:20.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.185+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=Q91W5AGWQ59M tag=U5Y39NRV9195 type=write size=3269656 2024-09-05T00:56:20.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.189+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=357NBA3BW9KR type=write size=308193 2024-09-05T00:56:20.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.193+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~LEOGMHF5T4BE.0 size=933985 2024-09-05T00:56:20.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.197+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=LEOGMHF5T4BE tag=HV34N2NQR0WX type=write size=1982561 2024-09-05T00:56:20.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.201+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=1T26Z6UFEFNJ type=del size=3348612 2024-09-05T00:56:20.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.205+0000 7f325adab8c0 1 < canceled operation key=ZYT3WYNFIIZN tag=6C11QMOWJKJ4 type=del size=415786 2024-09-05T00:56:20.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.205+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=8NLIHH74IYRN type=del size=3810673 2024-09-05T00:56:20.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.209+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.0 size=1048576 2024-09-05T00:56:20.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.213+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.1 size=1048576 2024-09-05T00:56:20.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.213+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~K5TIZQU678OI.2 size=1042191 2024-09-05T00:56:20.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.221+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=K5TIZQU678OI tag=U1N0E7AXANE0 type=write size=4187919 2024-09-05T00:56:20.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.225+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=JGU7WDKN9J6Q type=del size=2008956 2024-09-05T00:56:20.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.225+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=Q82GU31KVMUJ type=del 2024-09-05T00:56:20.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.233+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~9VV73MS2Q3IE.0 size=893131 2024-09-05T00:56:20.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.233+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=9VV73MS2Q3IE tag=FASJG0KYOV1F type=write size=1941707 2024-09-05T00:56:20.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.233+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~CJ6LKW0UI7IY.0 size=1048576 2024-09-05T00:56:20.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.237+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~CJ6LKW0UI7IY.1 size=746990 2024-09-05T00:56:20.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.241+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=CJ6LKW0UI7IY tag=8U9LQX1OHTMH type=write size=2844142 2024-09-05T00:56:20.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.245+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=OFNBFNQU2GEM type=write size=320209 2024-09-05T00:56:20.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.249+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~2057E89TXL74.0 size=1048576 2024-09-05T00:56:20.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.249+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~2057E89TXL74.1 size=607622 2024-09-05T00:56:20.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.257+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=2057E89TXL74 tag=1F5UJI2OMC1O type=write size=2704774 2024-09-05T00:56:20.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.257+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=DNB2WWHW1XDY type=del size=3610105 2024-09-05T00:56:20.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.261+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=FV8B3ZP3X4P0 type=write size=743886 2024-09-05T00:56:20.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.265+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=PBW471N3CM1Y type=del size=1753601 2024-09-05T00:56:20.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.269+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~5Z4RNG0F60JV.0 size=1048576 2024-09-05T00:56:20.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.269+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~5Z4RNG0F60JV.1 size=527574 2024-09-05T00:56:20.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.273+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=5Z4RNG0F60JV tag=A01A04VBWD1Y type=write size=2624726 2024-09-05T00:56:20.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.277+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=IKHWP11ULKHN type=write size=645879 2024-09-05T00:56:20.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.277+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~QEBLZSYF9IVB.0 size=1048576 2024-09-05T00:56:20.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.281+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~QEBLZSYF9IVB.1 size=862052 2024-09-05T00:56:20.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.285+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=QEBLZSYF9IVB tag=TT9BZ3VJZD19 type=write size=2959204 2024-09-05T00:56:20.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.289+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~814LI1C4VZHU.0 size=277953 2024-09-05T00:56:20.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.289+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=814LI1C4VZHU tag=SO5GIH6B68CH type=write size=1326529 2024-09-05T00:56:20.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.297+0000 7f325adab8c0 1 < suggested update operation key=MAS6EB753KO9 tag=ECIKYL8N52XY type=write size=1039551 2024-09-05T00:56:20.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.301+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~R20PLE892Y10.0 size=1048576 2024-09-05T00:56:20.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.305+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~R20PLE892Y10.1 size=167946 2024-09-05T00:56:20.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.305+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=R20PLE892Y10 tag=1T6AJDM44VW7 type=write size=2265098 2024-09-05T00:56:20.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.309+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~PQP3C3MJ5PWT.0 size=1048576 2024-09-05T00:56:20.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.309+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~PQP3C3MJ5PWT.1 size=123830 2024-09-05T00:56:20.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.317+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=PQP3C3MJ5PWT tag=1HG5DY6B69G8 type=write size=2220982 2024-09-05T00:56:20.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.317+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=5Y56C7JAK9CE type=write size=147056 2024-09-05T00:56:20.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.325+0000 7f325adab8c0 1 < suggested update operation key=XKOECM0CCOKX tag=9RTF2M76FMXS type=del size=339752 2024-09-05T00:56:20.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.329+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.0 size=1048576 2024-09-05T00:56:20.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.333+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.1 size=1048576 2024-09-05T00:56:20.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.337+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.2 size=738630 2024-09-05T00:56:20.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.337+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=W0HZFPZRNW6J tag=SI1V0BIO7B1N type=write size=3884358 2024-09-05T00:56:20.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.341+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.0 size=1048576 2024-09-05T00:56:20.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.341+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.1 size=1048576 2024-09-05T00:56:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.345+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~FK98LM9RJJTW.2 size=239849 2024-09-05T00:56:20.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.349+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=FK98LM9RJJTW tag=FYNFVIJ5TI8L type=write size=3385577 2024-09-05T00:56:20.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.353+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=CF3OLZN6UU3K type=del size=2726279 2024-09-05T00:56:20.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.357+0000 7f325adab8c0 1 < suggested update operation key=MAS6EB753KO9 tag=X1CAXHVDOH8V type=write size=226035 2024-09-05T00:56:20.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.361+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=G5KO199SOT86 type=write size=323684 2024-09-05T00:56:20.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.361+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.0 size=1048576 2024-09-05T00:56:20.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.365+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.1 size=1048576 2024-09-05T00:56:20.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.365+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~246AGQPXM8YW.2 size=308789 2024-09-05T00:56:20.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.373+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=246AGQPXM8YW tag=8LUCKYFWTO78 type=write size=3454517 2024-09-05T00:56:20.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.377+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=XBGKIYRITTSB type=del size=2578881 2024-09-05T00:56:20.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.381+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=357NBA3BW9KR type=write size=308193 2024-09-05T00:56:20.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.385+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2HTDQV4YKQPT.0 size=1048576 2024-09-05T00:56:20.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.389+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~2HTDQV4YKQPT.1 size=229269 2024-09-05T00:56:20.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.389+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=2HTDQV4YKQPT tag=VMTAI07KP5B2 type=write size=2326421 2024-09-05T00:56:20.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.393+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=1T26Z6UFEFNJ type=del 2024-09-05T00:56:20.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.397+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.0 size=1048576 2024-09-05T00:56:20.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.401+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.1 size=1048576 2024-09-05T00:56:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.401+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.2 size=860032 2024-09-05T00:56:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.401+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=14QJKM810NSX tag=1UYEZYC8MAQ4 type=write size=4005760 2024-09-05T00:56:20.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.409+0000 7f325adab8c0 1 < suggested update operation key=CB079FGXKNRO tag=8NLIHH74IYRN type=del size=3810673 2024-09-05T00:56:20.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.413+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~QK9L03F5M7Z1.0 size=1048576 2024-09-05T00:56:20.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.417+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~QK9L03F5M7Z1.1 size=740063 2024-09-05T00:56:20.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.417+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=QK9L03F5M7Z1 tag=Y0K6Q79HWC8U type=write size=2837215 2024-09-05T00:56:20.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.421+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=JGU7WDKN9J6Q type=del 2024-09-05T00:56:20.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.421+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=ISN2B217NV06 type=del size=3088957 2024-09-05T00:56:20.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.425+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~9VV73MS2Q3IE.0 size=893131 2024-09-05T00:56:20.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.429+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=9VV73MS2Q3IE tag=FASJG0KYOV1F type=write size=1941707 2024-09-05T00:56:20.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.433+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=61550BTSD4Z6 type=write size=596618 2024-09-05T00:56:20.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.437+0000 7f325adab8c0 -1 < failed to complete operation key=MAS6EB753KO9 tag=OFNBFNQU2GEM type=write size=320209: (22) Invalid argument 2024-09-05T00:56:20.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.441+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=K1S873WW239I type=del size=1721013 2024-09-05T00:56:20.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.445+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=DNB2WWHW1XDY type=del 2024-09-05T00:56:20.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.449+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=Q4TX5Y671RIO type=del size=3009657 2024-09-05T00:56:20.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.449+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=PBW471N3CM1Y type=del 2024-09-05T00:56:20.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.453+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=R8VGO2XXG13F type=del size=1799533 2024-09-05T00:56:20.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.457+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=IKHWP11ULKHN type=write size=645879 2024-09-05T00:56:20.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.461+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=EVAY5GZ94UFA type=del size=28621 2024-09-05T00:56:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.465+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~814LI1C4VZHU.0 size=277953 2024-09-05T00:56:20.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.469+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=814LI1C4VZHU tag=SO5GIH6B68CH type=write size=1326529 2024-09-05T00:56:20.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.473+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=BYSYJQZCZ5LM type=del size=1578717 2024-09-05T00:56:20.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.473+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~R20PLE892Y10.0 size=1048576 2024-09-05T00:56:20.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.477+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~R20PLE892Y10.1 size=167946 2024-09-05T00:56:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.481+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=R20PLE892Y10 tag=1T6AJDM44VW7 type=write size=2265098 2024-09-05T00:56:20.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.489+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.0 size=1048576 2024-09-05T00:56:20.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.493+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.1 size=1048576 2024-09-05T00:56:20.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.493+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.2 size=119842 2024-09-05T00:56:20.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.493+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=8AQ2I2WQ91AX tag=XWNYXIQKZCVN type=write size=3265570 2024-09-05T00:56:20.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.497+0000 7f325adab8c0 1 < completed write operation key=UW0SSQ8VFY1G tag=5Y56C7JAK9CE type=write size=147056 2024-09-05T00:56:20.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.501+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=8JVZ00ZH87PT type=write size=647592 2024-09-05T00:56:20.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.505+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.0 size=1048576 2024-09-05T00:56:20.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.509+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.1 size=1048576 2024-09-05T00:56:20.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.509+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~W0HZFPZRNW6J.2 size=738630 2024-09-05T00:56:20.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.517+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=W0HZFPZRNW6J tag=SI1V0BIO7B1N type=write size=3884358 2024-09-05T00:56:20.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.521+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=82VNY6DG015C type=del size=675814 2024-09-05T00:56:20.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.521+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=CF3OLZN6UU3K type=del 2024-09-05T00:56:20.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.529+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.0 size=1048576 2024-09-05T00:56:20.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.533+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.1 size=1048576 2024-09-05T00:56:20.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.533+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.2 size=726996 2024-09-05T00:56:20.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.533+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=1GYYUDNPM4PW tag=3B7OBGH7QX0N type=write size=3872724 2024-09-05T00:56:20.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.537+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=G5KO199SOT86 type=write size=323684 2024-09-05T00:56:20.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.541+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=3C4Y8Q089YT6 type=del size=922157 2024-09-05T00:56:20.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.545+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=XBGKIYRITTSB type=del 2024-09-05T00:56:20.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.549+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.0 size=1048576 2024-09-05T00:56:20.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.553+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.1 size=1048576 2024-09-05T00:56:20.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.557+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.2 size=922716 2024-09-05T00:56:20.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.557+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=ELLMLMNKZI92 tag=WWRZHE8GR7RU type=write size=4068444 2024-09-05T00:56:20.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.557+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~2HTDQV4YKQPT.0 size=1048576 2024-09-05T00:56:20.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.557+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~2HTDQV4YKQPT.1 size=229269 2024-09-05T00:56:20.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.565+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=2HTDQV4YKQPT tag=VMTAI07KP5B2 type=write size=2326421 2024-09-05T00:56:20.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.569+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RR6RB3134P9S.0 size=673837 2024-09-05T00:56:20.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.569+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=RR6RB3134P9S tag=XV9ET0KWGVO4 type=write size=1722413 2024-09-05T00:56:20.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.573+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.0 size=1048576 2024-09-05T00:56:20.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.577+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.1 size=1048576 2024-09-05T00:56:20.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.581+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~14QJKM810NSX.2 size=860032 2024-09-05T00:56:20.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.585+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=14QJKM810NSX tag=1UYEZYC8MAQ4 type=write size=4005760 2024-09-05T00:56:20.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.589+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=LW14H4D4XQ2C type=write size=40748 2024-09-05T00:56:20.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.593+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~QK9L03F5M7Z1.0 size=1048576 2024-09-05T00:56:20.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.593+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~QK9L03F5M7Z1.1 size=740063 2024-09-05T00:56:20.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.597+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=QK9L03F5M7Z1 tag=Y0K6Q79HWC8U type=write size=2837215 2024-09-05T00:56:20.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.605+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.0 size=1048576 2024-09-05T00:56:20.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.609+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.1 size=1048576 2024-09-05T00:56:20.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.609+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.2 size=510639 2024-09-05T00:56:20.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.609+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=SCJ1A1VX2XWQ tag=MS0K4NC8BMYS type=write size=3656367 2024-09-05T00:56:20.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.613+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=ISN2B217NV06 type=del 2024-09-05T00:56:20.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.617+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~3LAOEJQ68K5Y.0 size=1048576 2024-09-05T00:56:20.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.621+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~3LAOEJQ68K5Y.1 size=372935 2024-09-05T00:56:20.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.621+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=3LAOEJQ68K5Y tag=ZIUMALYOQ9F6 type=write size=2470087 2024-09-05T00:56:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.625+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=61550BTSD4Z6 type=write size=596618 2024-09-05T00:56:20.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.629+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=LWQM9BQELQ96 type=write size=659688 2024-09-05T00:56:20.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.633+0000 7f325adab8c0 1 < suggested remove operation key=71FWV15GD1QZ tag=K1S873WW239I type=del 2024-09-05T00:56:20.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.637+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=SKJRH4N4WSK1 type=write size=245274 2024-09-05T00:56:20.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.641+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=Q4TX5Y671RIO type=del 2024-09-05T00:56:20.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.641+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=OUPNSYHYDH94 type=del size=562989 2024-09-05T00:56:20.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.645+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=R8VGO2XXG13F type=del 2024-09-05T00:56:20.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.653+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~SNASQXO5N0MX.0 size=214904 2024-09-05T00:56:20.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.653+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=SNASQXO5N0MX tag=OXS3M0OEANG6 type=write size=1263480 2024-09-05T00:56:20.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.657+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=EVAY5GZ94UFA type=del size=28621 2024-09-05T00:56:20.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.657+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=KLPZES8TEZGB type=del size=3868039 2024-09-05T00:56:20.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.661+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=BYSYJQZCZ5LM type=del 2024-09-05T00:56:20.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.665+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=JTUIAL128E95 type=del size=3471052 2024-09-05T00:56:20.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.669+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.0 size=1048576 2024-09-05T00:56:20.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.669+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.1 size=1048576 2024-09-05T00:56:20.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.677+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~8AQ2I2WQ91AX.2 size=119842 2024-09-05T00:56:20.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.681+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=8AQ2I2WQ91AX tag=XWNYXIQKZCVN type=write size=3265570 2024-09-05T00:56:20.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.685+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=XDVT2TUJBZ1I type=del size=1156166 2024-09-05T00:56:20.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.685+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=8JVZ00ZH87PT type=write size=647592 2024-09-05T00:56:20.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.689+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=CWKH0VZ5N5MM type=del size=2763285 2024-09-05T00:56:20.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.689+0000 7f325adab8c0 -1 < no bi entry to suggest for operation key=71FWV15GD1QZ tag=82VNY6DG015C type=del size=675814: (2) No such file or directory 2024-09-05T00:56:20.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.693+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=QXOJOO2T5CNN type=del size=1505662 2024-09-05T00:56:20.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.697+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.0 size=1048576 2024-09-05T00:56:20.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.697+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.1 size=1048576 2024-09-05T00:56:20.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.701+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~1GYYUDNPM4PW.2 size=726996 2024-09-05T00:56:20.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.705+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=1GYYUDNPM4PW tag=3B7OBGH7QX0N type=write size=3872724 2024-09-05T00:56:20.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.709+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=QIXB576T4158 type=write size=609527 2024-09-05T00:56:20.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.713+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=3C4Y8Q089YT6 type=del 2024-09-05T00:56:20.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.717+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~U0W2GIVCISGQ.0 size=1048576 2024-09-05T00:56:20.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.721+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~U0W2GIVCISGQ.1 size=857063 2024-09-05T00:56:20.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.721+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=U0W2GIVCISGQ tag=ERC6W8EHVBL6 type=write size=2954215 2024-09-05T00:56:20.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.721+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.0 size=1048576 2024-09-05T00:56:20.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.725+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.1 size=1048576 2024-09-05T00:56:20.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.729+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~ELLMLMNKZI92.2 size=922716 2024-09-05T00:56:20.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.733+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=ELLMLMNKZI92 tag=WWRZHE8GR7RU type=write size=4068444 2024-09-05T00:56:20.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.737+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=BDME29UJ0Q2F type=del size=1058250 2024-09-05T00:56:20.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.737+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RR6RB3134P9S.0 size=673837 2024-09-05T00:56:20.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.745+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=RR6RB3134P9S tag=XV9ET0KWGVO4 type=write size=1722413 2024-09-05T00:56:20.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.749+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=0YTAA6HO1BV5 type=del size=747861 2024-09-05T00:56:20.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.749+0000 7f325adab8c0 1 < completed write operation key=CB079FGXKNRO tag=LW14H4D4XQ2C type=write size=40748 2024-09-05T00:56:20.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.757+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~37Z8IUFQM12I.0 size=1048576 2024-09-05T00:56:20.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.757+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~37Z8IUFQM12I.1 size=264547 2024-09-05T00:56:20.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.757+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=37Z8IUFQM12I tag=TTJJV2J5AO62 type=write size=2361699 2024-09-05T00:56:20.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.761+0000 7f325adab8c0 1 < canceled part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.0 size=1048576 2024-09-05T00:56:20.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.761+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.1 size=1048576 2024-09-05T00:56:20.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.765+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~SCJ1A1VX2XWQ.2 size=510639 2024-09-05T00:56:20.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.769+0000 7f325adab8c0 1 < canceled multipart upload key=VYMRZPO6VKGS upload=SCJ1A1VX2XWQ tag=MS0K4NC8BMYS type=write size=3656367 2024-09-05T00:56:20.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.773+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=5VOQKFAJBQ0W type=del size=367580 2024-09-05T00:56:20.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.773+0000 7f325adab8c0 1 < canceled part key=_multipart_YG43HSBBCRKH.2~3LAOEJQ68K5Y.0 size=1048576 2024-09-05T00:56:20.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.777+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~3LAOEJQ68K5Y.1 size=372935 2024-09-05T00:56:20.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.781+0000 7f325adab8c0 1 < canceled multipart upload key=YG43HSBBCRKH upload=3LAOEJQ68K5Y tag=ZIUMALYOQ9F6 type=write size=2470087 2024-09-05T00:56:20.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.785+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=9KJPSJ6LNGMU type=del size=805847 2024-09-05T00:56:20.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.789+0000 7f325adab8c0 1 < completed write operation key=9O7DVR04PCDB tag=LWQM9BQELQ96 type=write size=659688 2024-09-05T00:56:20.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.793+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~5G06MHKT2EMZ.0 size=1048576 2024-09-05T00:56:20.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.797+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~5G06MHKT2EMZ.1 size=3321 2024-09-05T00:56:20.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.797+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=5G06MHKT2EMZ tag=ZEUWMWXKOXBL type=write size=2100473 2024-09-05T00:56:20.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.801+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=SKJRH4N4WSK1 type=write size=245274 2024-09-05T00:56:20.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.805+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.0 size=1048576 2024-09-05T00:56:20.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.809+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.1 size=1048576 2024-09-05T00:56:20.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.813+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.2 size=1037799 2024-09-05T00:56:20.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.813+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=QR2U7TU9LB7H tag=94HD3XP5AGYJ type=write size=4183527 2024-09-05T00:56:20.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.817+0000 7f325adab8c0 1 < canceled operation key=UW0SSQ8VFY1G tag=OUPNSYHYDH94 type=del size=562989 2024-09-05T00:56:20.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.821+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=F2WCOJL4T1SE type=del size=1233985 2024-09-05T00:56:20.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.821+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~SNASQXO5N0MX.0 size=214904 2024-09-05T00:56:20.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.825+0000 7f325adab8c0 1 < canceled multipart upload key=XKOECM0CCOKX upload=SNASQXO5N0MX tag=OXS3M0OEANG6 type=write size=1263480 2024-09-05T00:56:20.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.833+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~RC5D90QWN3ZB.0 size=103682 2024-09-05T00:56:20.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.833+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=RC5D90QWN3ZB tag=HIEPKYGZE6DS type=write size=1152258 2024-09-05T00:56:20.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.837+0000 7f325adab8c0 1 < suggested update operation key=J9UIQE3CKYHM tag=KLPZES8TEZGB type=del size=3868039 2024-09-05T00:56:20.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.845+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.0 size=1048576 2024-09-05T00:56:20.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.845+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.1 size=1048576 2024-09-05T00:56:20.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.849+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.2 size=765054 2024-09-05T00:56:20.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.849+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=V1AOXT0A030G tag=I31OMFEKRZAQ type=write size=3910782 2024-09-05T00:56:20.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.853+0000 7f325adab8c0 1 < suggested remove operation key=GU25IIQWQNR2 tag=JTUIAL128E95 type=del 2024-09-05T00:56:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.861+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~HEO4C1UNMWNX.0 size=243015 2024-09-05T00:56:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.861+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=HEO4C1UNMWNX tag=Z35ET2IH54RY type=write size=1291591 2024-09-05T00:56:20.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.865+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=XDVT2TUJBZ1I type=del 2024-09-05T00:56:20.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.865+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=OVM7I19YTFYD type=del size=2857993 2024-09-05T00:56:20.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.869+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=CWKH0VZ5N5MM type=del 2024-09-05T00:56:20.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.877+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.0 size=1048576 2024-09-05T00:56:20.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.877+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.1 size=1048576 2024-09-05T00:56:20.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.881+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.2 size=356533 2024-09-05T00:56:20.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.881+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=RTNRT20T9WAB tag=26G7HA0VVKZQ type=write size=3502261 2024-09-05T00:56:20.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.885+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=QXOJOO2T5CNN type=del 2024-09-05T00:56:20.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.889+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~GHADN5BKS0IP.0 size=966869 2024-09-05T00:56:20.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.889+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=GHADN5BKS0IP tag=AQV9Q9GW86OV type=write size=2015445 2024-09-05T00:56:20.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.893+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=QIXB576T4158 type=write size=609527 2024-09-05T00:56:20.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.893+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=ZGU9NAHYIQB1 type=del size=1732014 2024-09-05T00:56:20.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.897+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~U0W2GIVCISGQ.0 size=1048576 2024-09-05T00:56:20.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.901+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~U0W2GIVCISGQ.1 size=857063 2024-09-05T00:56:20.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.905+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=U0W2GIVCISGQ tag=ERC6W8EHVBL6 type=write size=2954215 2024-09-05T00:56:20.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.909+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~JKVFSDUYGHTH.0 size=907227 2024-09-05T00:56:20.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.909+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=JKVFSDUYGHTH tag=8XG9CEVYYSWV type=write size=1955803 2024-09-05T00:56:20.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.913+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=BDME29UJ0Q2F type=del 2024-09-05T00:56:20.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.917+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~IDHZOPKF598C.0 size=286824 2024-09-05T00:56:20.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.917+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=IDHZOPKF598C tag=3WOA85YG610P type=write size=1335400 2024-09-05T00:56:20.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.921+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=0YTAA6HO1BV5 type=del 2024-09-05T00:56:20.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.921+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=OHZUC3R510KD type=del size=3829020 2024-09-05T00:56:20.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.925+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~37Z8IUFQM12I.0 size=1048576 2024-09-05T00:56:20.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.929+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~37Z8IUFQM12I.1 size=264547 2024-09-05T00:56:20.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.933+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=37Z8IUFQM12I tag=TTJJV2J5AO62 type=write size=2361699 2024-09-05T00:56:20.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.933+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=MS8A6F0QUX4E type=del size=2513139 2024-09-05T00:56:20.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.937+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=5VOQKFAJBQ0W type=del 2024-09-05T00:56:20.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.941+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~OXFOTOHHSLD1.0 size=145411 2024-09-05T00:56:20.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.941+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=OXFOTOHHSLD1 tag=PJM4SP70DJT1 type=write size=1193987 2024-09-05T00:56:20.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.945+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=9KJPSJ6LNGMU type=del size=805847 2024-09-05T00:56:20.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.949+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=EHO5XQ6LBXLM type=del size=2475328 2024-09-05T00:56:20.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.949+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~5G06MHKT2EMZ.0 size=1048576 2024-09-05T00:56:20.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.953+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~5G06MHKT2EMZ.1 size=3321 2024-09-05T00:56:20.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.961+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=5G06MHKT2EMZ tag=ZEUWMWXKOXBL type=write size=2100473 2024-09-05T00:56:20.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.965+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=2W1CT17BD0B7 type=del size=3478386 2024-09-05T00:56:20.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.965+0000 7f325adab8c0 1 < canceled part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.0 size=1048576 2024-09-05T00:56:20.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.969+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.1 size=1048576 2024-09-05T00:56:20.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.969+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~QR2U7TU9LB7H.2 size=1037799 2024-09-05T00:56:20.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.973+0000 7f325adab8c0 1 < canceled multipart upload key=MBJLOE5XFPYN upload=QR2U7TU9LB7H tag=94HD3XP5AGYJ type=write size=4183527 2024-09-05T00:56:20.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.977+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=47TZAJD5CTVT type=del size=985190 2024-09-05T00:56:20.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.981+0000 7f325adab8c0 -1 < failed to complete operation key=GU25IIQWQNR2 tag=F2WCOJL4T1SE type=del size=1233985: (22) Invalid argument 2024-09-05T00:56:20.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.985+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~1A78FO236093.0 size=1048576 2024-09-05T00:56:20.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.989+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~1A78FO236093.1 size=284377 2024-09-05T00:56:20.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.989+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=1A78FO236093 tag=GWVDW8EFX5II type=write size=2381529 2024-09-05T00:56:20.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.989+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~RC5D90QWN3ZB.0 size=103682 2024-09-05T00:56:20.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:20.997+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=RC5D90QWN3ZB tag=HIEPKYGZE6DS type=write size=1152258 2024-09-05T00:56:21.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.001+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~4Y9DZYEK9SQ6.0 size=1048576 2024-09-05T00:56:21.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.005+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~4Y9DZYEK9SQ6.1 size=940304 2024-09-05T00:56:21.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.005+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=4Y9DZYEK9SQ6 tag=VG4GRS2VBZTL type=write size=3037456 2024-09-05T00:56:21.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.005+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.0 size=1048576 2024-09-05T00:56:21.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.009+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.1 size=1048576 2024-09-05T00:56:21.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.009+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~V1AOXT0A030G.2 size=765054 2024-09-05T00:56:21.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.017+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=V1AOXT0A030G tag=I31OMFEKRZAQ type=write size=3910782 2024-09-05T00:56:21.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.021+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=YJHUXGMUC0U2 type=del size=695113 2024-09-05T00:56:21.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.021+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~HEO4C1UNMWNX.0 size=243015 2024-09-05T00:56:21.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.029+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=HEO4C1UNMWNX tag=Z35ET2IH54RY type=write size=1291591 2024-09-05T00:56:21.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.029+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=U6FN1065A9PZ type=del size=2949147 2024-09-05T00:56:21.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.033+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=OVM7I19YTFYD type=del 2024-09-05T00:56:21.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.037+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=ZY7OMXUHCG4I type=write size=253036 2024-09-05T00:56:21.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.041+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.0 size=1048576 2024-09-05T00:56:21.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.041+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.1 size=1048576 2024-09-05T00:56:21.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.045+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~RTNRT20T9WAB.2 size=356533 2024-09-05T00:56:21.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.049+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=RTNRT20T9WAB tag=26G7HA0VVKZQ type=write size=3502261 2024-09-05T00:56:21.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.057+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.0 size=1048576 2024-09-05T00:56:21.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.057+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.1 size=1048576 2024-09-05T00:56:21.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.061+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.2 size=910473 2024-09-05T00:56:21.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.061+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=MWK7U2LWEZ01 tag=BAO3R9NM4263 type=write size=4056201 2024-09-05T00:56:21.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.065+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~GHADN5BKS0IP.0 size=966869 2024-09-05T00:56:21.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.069+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=GHADN5BKS0IP tag=AQV9Q9GW86OV type=write size=2015445 2024-09-05T00:56:21.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.073+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=NWYVAA52J7M2 type=write size=750533 2024-09-05T00:56:21.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.077+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=ZGU9NAHYIQB1 type=del 2024-09-05T00:56:21.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.077+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=MRCFMDY7F0SP type=del size=4079134 2024-09-05T00:56:21.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.081+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~JKVFSDUYGHTH.0 size=907227 2024-09-05T00:56:21.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.085+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=JKVFSDUYGHTH tag=8XG9CEVYYSWV type=write size=1955803 2024-09-05T00:56:21.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.093+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~2MDBE7QHFDYM.0 size=179772 2024-09-05T00:56:21.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.093+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=2MDBE7QHFDYM tag=3DDF2IFR365G type=write size=1228348 2024-09-05T00:56:21.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.093+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~IDHZOPKF598C.0 size=286824 2024-09-05T00:56:21.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.097+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=IDHZOPKF598C tag=3WOA85YG610P type=write size=1335400 2024-09-05T00:56:21.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.101+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=V44WGHCFV4V5 type=del size=1443229 2024-09-05T00:56:21.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.105+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=OHZUC3R510KD type=del 2024-09-05T00:56:21.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.109+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=NKOPM4LP58AP type=del size=3261499 2024-09-05T00:56:21.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.109+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=MS8A6F0QUX4E type=del 2024-09-05T00:56:21.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.117+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.0 size=1048576 2024-09-05T00:56:21.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.117+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.1 size=1048576 2024-09-05T00:56:21.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.121+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.2 size=551203 2024-09-05T00:56:21.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.121+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=20Y4V2ICURDJ tag=41PYTQEX9IKQ type=write size=3696931 2024-09-05T00:56:21.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.121+0000 7f325adab8c0 1 < canceled part key=_multipart_MBJLOE5XFPYN.2~OXFOTOHHSLD1.0 size=145411 2024-09-05T00:56:21.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.125+0000 7f325adab8c0 1 < canceled multipart upload key=MBJLOE5XFPYN upload=OXFOTOHHSLD1 tag=PJM4SP70DJT1 type=write size=1193987 2024-09-05T00:56:21.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.129+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=P0Y8X6TVBW3X type=del size=586902 2024-09-05T00:56:21.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.133+0000 7f325adab8c0 1 < suggested update operation key=06YHJGLZQLK6 tag=EHO5XQ6LBXLM type=del size=2475328 2024-09-05T00:56:21.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.137+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~AX5O7W9R6IY9.0 size=31001 2024-09-05T00:56:21.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.137+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=AX5O7W9R6IY9 tag=BMHM2NJRYEZ6 type=write size=1079577 2024-09-05T00:56:21.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.141+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=2W1CT17BD0B7 type=del 2024-09-05T00:56:21.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.141+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=OG7UDDXJELQ0 type=del size=3190132 2024-09-05T00:56:21.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.149+0000 7f325adab8c0 1 < suggested remove operation key=GQB4HOYII01G tag=47TZAJD5CTVT type=del 2024-09-05T00:56:21.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.153+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~JXOWPNA4ZZ6H.0 size=379280 2024-09-05T00:56:21.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.153+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=JXOWPNA4ZZ6H tag=8KIUWXWAMF4S type=write size=1427856 2024-09-05T00:56:21.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.153+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~1A78FO236093.0 size=1048576 2024-09-05T00:56:21.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.157+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~1A78FO236093.1 size=284377 2024-09-05T00:56:21.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.161+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=1A78FO236093 tag=GWVDW8EFX5II type=write size=2381529 2024-09-05T00:56:21.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.165+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=GZNCDJCRGDS6 type=write size=253127 2024-09-05T00:56:21.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.165+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~4Y9DZYEK9SQ6.0 size=1048576 2024-09-05T00:56:21.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.169+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~4Y9DZYEK9SQ6.1 size=940304 2024-09-05T00:56:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.173+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=4Y9DZYEK9SQ6 tag=VG4GRS2VBZTL type=write size=3037456 2024-09-05T00:56:21.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.177+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=TIZDYEXF1H8L type=del size=1304470 2024-09-05T00:56:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.177+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=YJHUXGMUC0U2 type=del 2024-09-05T00:56:21.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.181+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=03VDMI4PP6SL type=del size=3241906 2024-09-05T00:56:21.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.185+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=U6FN1065A9PZ type=del 2024-09-05T00:56:21.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.189+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=KSLDGG2CHPZO type=write size=249059 2024-09-05T00:56:21.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.193+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=ZY7OMXUHCG4I type=write size=253036 2024-09-05T00:56:21.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.197+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.0 size=1048576 2024-09-05T00:56:21.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.197+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.1 size=1048576 2024-09-05T00:56:21.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.201+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.2 size=1025009 2024-09-05T00:56:21.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.201+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=WMRG6S9ZLJ79 tag=EEF6CO0L5X7L type=write size=4170737 2024-09-05T00:56:21.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.205+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.0 size=1048576 2024-09-05T00:56:21.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.205+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.1 size=1048576 2024-09-05T00:56:21.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.209+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~MWK7U2LWEZ01.2 size=910473 2024-09-05T00:56:21.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.213+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=MWK7U2LWEZ01 tag=BAO3R9NM4263 type=write size=4056201 2024-09-05T00:56:21.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.221+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~J2AY0NNKWZP0.0 size=487561 2024-09-05T00:56:21.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.221+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=J2AY0NNKWZP0 tag=POYQCK3656CK type=write size=1536137 2024-09-05T00:56:21.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.225+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=NWYVAA52J7M2 type=write size=750533 2024-09-05T00:56:21.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.225+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=07HYKDACDFG9 type=del size=3997233 2024-09-05T00:56:21.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.229+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=MRCFMDY7F0SP type=del size=4079134 2024-09-05T00:56:21.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.233+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.0 size=1048576 2024-09-05T00:56:21.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.233+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.1 size=1048576 2024-09-05T00:56:21.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.237+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.2 size=661214 2024-09-05T00:56:21.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.237+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=Z96R1SX1U08R tag=FJ2JYA601OO8 type=write size=3806942 2024-09-05T00:56:21.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.237+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~2MDBE7QHFDYM.0 size=179772 2024-09-05T00:56:21.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.241+0000 7f325adab8c0 1 < canceled multipart upload key=5WOUI4SHYTSS upload=2MDBE7QHFDYM tag=3DDF2IFR365G type=write size=1228348 2024-09-05T00:56:21.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.249+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~90X490SWNC23.0 size=1048576 2024-09-05T00:56:21.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.249+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~90X490SWNC23.1 size=429903 2024-09-05T00:56:21.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.249+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=90X490SWNC23 tag=X4JE6ZUSG9ME type=write size=2527055 2024-09-05T00:56:21.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.253+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=V44WGHCFV4V5 type=del 2024-09-05T00:56:21.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.253+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=5TAFFR2CWY1R type=write size=651395 2024-09-05T00:56:21.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.261+0000 7f325adab8c0 1 < suggested update operation key=06YHJGLZQLK6 tag=NKOPM4LP58AP type=del size=3261499 2024-09-05T00:56:21.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.261+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=ASG9MXYOMMU0 type=write size=520568 2024-09-05T00:56:21.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.265+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.0 size=1048576 2024-09-05T00:56:21.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.269+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.1 size=1048576 2024-09-05T00:56:21.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.269+0000 7f325adab8c0 1 < canceled part key=_multipart_9O7DVR04PCDB.2~20Y4V2ICURDJ.2 size=551203 2024-09-05T00:56:21.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.269+0000 7f325adab8c0 1 < canceled multipart upload key=9O7DVR04PCDB upload=20Y4V2ICURDJ tag=41PYTQEX9IKQ type=write size=3696931 2024-09-05T00:56:21.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.273+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=FLPTHH3Y9XQP type=del size=1773598 2024-09-05T00:56:21.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.277+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=P0Y8X6TVBW3X type=del size=586902 2024-09-05T00:56:21.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.281+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=UXZTY9XS79D9 type=del size=2043128 2024-09-05T00:56:21.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.281+0000 7f325adab8c0 1 < canceled part key=_multipart_YMIGZMLJSI4D.2~AX5O7W9R6IY9.0 size=31001 2024-09-05T00:56:21.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.285+0000 7f325adab8c0 1 < canceled multipart upload key=YMIGZMLJSI4D upload=AX5O7W9R6IY9 tag=BMHM2NJRYEZ6 type=write size=1079577 2024-09-05T00:56:21.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.289+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=RMMET0KUSD2Y type=del size=2457167 2024-09-05T00:56:21.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.293+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=OG7UDDXJELQ0 type=del 2024-09-05T00:56:21.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.297+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.0 size=1048576 2024-09-05T00:56:21.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.301+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.1 size=1048576 2024-09-05T00:56:21.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.301+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.2 size=366828 2024-09-05T00:56:21.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.301+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=O38VIRTWU1IB tag=RKKDSN7UWUYS type=write size=3512556 2024-09-05T00:56:21.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.305+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~JXOWPNA4ZZ6H.0 size=379280 2024-09-05T00:56:21.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.309+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=JXOWPNA4ZZ6H tag=8KIUWXWAMF4S type=write size=1427856 2024-09-05T00:56:21.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.313+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~A4OLG0ZNHYCL.0 size=1046647 2024-09-05T00:56:21.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.313+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=A4OLG0ZNHYCL tag=HH8XH2IG3DUR type=write size=2095223 2024-09-05T00:56:21.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.317+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=GZNCDJCRGDS6 type=write size=253127 2024-09-05T00:56:21.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.321+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~9SYPBU0KITV6.0 size=24005 2024-09-05T00:56:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.321+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=9SYPBU0KITV6 tag=2L9WAFHW73TX type=write size=1072581 2024-09-05T00:56:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.325+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=TIZDYEXF1H8L type=del 2024-09-05T00:56:21.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.325+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=M0OK8F2X38R8 type=write size=708796 2024-09-05T00:56:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.329+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=03VDMI4PP6SL type=del 2024-09-05T00:56:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.329+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=XU00UH9F5WDJ type=del size=3967633 2024-09-05T00:56:21.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.333+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=KSLDGG2CHPZO type=write size=249059 2024-09-05T00:56:21.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.337+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=DOKWWL4XNTLY type=del size=1977079 2024-09-05T00:56:21.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.337+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.0 size=1048576 2024-09-05T00:56:21.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.341+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.1 size=1048576 2024-09-05T00:56:21.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.341+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~WMRG6S9ZLJ79.2 size=1025009 2024-09-05T00:56:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.345+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=WMRG6S9ZLJ79 tag=EEF6CO0L5X7L type=write size=4170737 2024-09-05T00:56:21.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.349+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=M0H83AGUDD61 type=del size=1817590 2024-09-05T00:56:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.349+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~J2AY0NNKWZP0.0 size=487561 2024-09-05T00:56:21.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.353+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=J2AY0NNKWZP0 tag=POYQCK3656CK type=write size=1536137 2024-09-05T00:56:21.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.353+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=DQAY0WHR7SIA type=del size=1707012 2024-09-05T00:56:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.357+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=07HYKDACDFG9 type=del size=3997233: (22) Invalid argument 2024-09-05T00:56:21.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.361+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=RN9YW87O4U3N type=del size=2787823 2024-09-05T00:56:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.361+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.0 size=1048576 2024-09-05T00:56:21.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.365+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.1 size=1048576 2024-09-05T00:56:21.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.365+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~Z96R1SX1U08R.2 size=661214 2024-09-05T00:56:21.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.369+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=Z96R1SX1U08R tag=FJ2JYA601OO8 type=write size=3806942 2024-09-05T00:56:21.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.369+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=HSRAS0RMGL8O type=del size=407552 2024-09-05T00:56:21.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.373+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~90X490SWNC23.0 size=1048576 2024-09-05T00:56:21.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.373+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~90X490SWNC23.1 size=429903 2024-09-05T00:56:21.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.377+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=90X490SWNC23 tag=X4JE6ZUSG9ME type=write size=2527055 2024-09-05T00:56:21.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.381+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~WX0UYBLO7QZZ.0 size=1048576 2024-09-05T00:56:21.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.381+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~WX0UYBLO7QZZ.1 size=831662 2024-09-05T00:56:21.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.381+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=WX0UYBLO7QZZ tag=23S0G5AEHBDQ type=write size=2928814 2024-09-05T00:56:21.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.385+0000 7f325adab8c0 1 < suggested update operation key=ZYT3WYNFIIZN tag=5TAFFR2CWY1R type=write size=651395 2024-09-05T00:56:21.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.389+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~XBYCNJCMVMFX.0 size=409086 2024-09-05T00:56:21.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.389+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=XBYCNJCMVMFX tag=VIJK1A66MBF0 type=write size=1457662 2024-09-05T00:56:21.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.393+0000 7f325adab8c0 -1 < failed to complete operation key=ZVKLK751KO5T tag=ASG9MXYOMMU0 type=write size=520568: (22) Invalid argument 2024-09-05T00:56:21.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.393+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=WDJGOM60DIZC type=write size=551113 2024-09-05T00:56:21.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.397+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=FLPTHH3Y9XQP type=del size=1773598 2024-09-05T00:56:21.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.397+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=Y2X31KWQGX2J type=del size=2991204 2024-09-05T00:56:21.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.401+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=UXZTY9XS79D9 type=del 2024-09-05T00:56:21.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.401+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=YC1SQ6ERNC9N type=del size=3672061 2024-09-05T00:56:21.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.405+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=RMMET0KUSD2Y type=del 2024-09-05T00:56:21.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.409+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.0 size=1048576 2024-09-05T00:56:21.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.409+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.1 size=1048576 2024-09-05T00:56:21.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.409+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.2 size=33746 2024-09-05T00:56:21.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.409+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=QSFN6CQYAXZH tag=9V9ZWK8RJSMX type=write size=3179474 2024-09-05T00:56:21.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.413+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.0 size=1048576 2024-09-05T00:56:21.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.413+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.1 size=1048576 2024-09-05T00:56:21.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.417+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~O38VIRTWU1IB.2 size=366828 2024-09-05T00:56:21.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.417+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=O38VIRTWU1IB tag=RKKDSN7UWUYS type=write size=3512556 2024-09-05T00:56:21.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.421+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=V73OUPM1HXOY type=del size=2138100 2024-09-05T00:56:21.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.421+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~A4OLG0ZNHYCL.0 size=1046647 2024-09-05T00:56:21.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.425+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=A4OLG0ZNHYCL tag=HH8XH2IG3DUR type=write size=2095223 2024-09-05T00:56:21.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.429+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=BM856KV0BOU1 type=del size=2555624 2024-09-05T00:56:21.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.429+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~9SYPBU0KITV6.0 size=24005 2024-09-05T00:56:21.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.433+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=9SYPBU0KITV6 tag=2L9WAFHW73TX type=write size=1072581 2024-09-05T00:56:21.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.437+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.0 size=1048576 2024-09-05T00:56:21.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.441+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.1 size=1048576 2024-09-05T00:56:21.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.441+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.2 size=806677 2024-09-05T00:56:21.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.441+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=PX6CY0NHIE85 tag=LF4VF1QHD2E3 type=write size=3952405 2024-09-05T00:56:21.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.445+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=M0OK8F2X38R8 type=write size=708796 2024-09-05T00:56:21.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.449+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~87GDLEDMV6Y4.0 size=668283 2024-09-05T00:56:21.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.449+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=87GDLEDMV6Y4 tag=F1YYP64TZBGY type=write size=1716859 2024-09-05T00:56:21.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.453+0000 7f325adab8c0 1 < suggested update operation key=J9UIQE3CKYHM tag=XU00UH9F5WDJ type=del size=3967633 2024-09-05T00:56:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.453+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=0ASZNWMY8X84 type=del size=2490104 2024-09-05T00:56:21.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.457+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=DOKWWL4XNTLY type=del 2024-09-05T00:56:21.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.457+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=WBWIVRCP4E8S type=del size=3079758 2024-09-05T00:56:21.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.461+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=M0H83AGUDD61 type=del 2024-09-05T00:56:21.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.461+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=7P1ZO7NCDR7R type=del size=2407246 2024-09-05T00:56:21.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.465+0000 7f325adab8c0 1 < suggested remove operation key=XKOECM0CCOKX tag=DQAY0WHR7SIA type=del 2024-09-05T00:56:21.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.469+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=FVJNODI5ZOBP type=del size=3548915 2024-09-05T00:56:21.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.469+0000 7f325adab8c0 -1 < failed to complete operation key=XKOECM0CCOKX tag=RN9YW87O4U3N type=del size=2787823: (22) Invalid argument 2024-09-05T00:56:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.473+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~WPZ8OR57LGAH.0 size=1048576 2024-09-05T00:56:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.477+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~WPZ8OR57LGAH.1 size=497901 2024-09-05T00:56:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.477+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=WPZ8OR57LGAH tag=24YV0EJAGAWN type=write size=2595053 2024-09-05T00:56:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.477+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=HSRAS0RMGL8O type=del 2024-09-05T00:56:21.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.481+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=ZKTX9CJGMWDY type=del size=1086487 2024-09-05T00:56:21.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.481+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~WX0UYBLO7QZZ.0 size=1048576 2024-09-05T00:56:21.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.485+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~WX0UYBLO7QZZ.1 size=831662 2024-09-05T00:56:21.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.489+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=WX0UYBLO7QZZ tag=23S0G5AEHBDQ type=write size=2928814 2024-09-05T00:56:21.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.493+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.0 size=1048576 2024-09-05T00:56:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.493+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.1 size=1048576 2024-09-05T00:56:21.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.497+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.2 size=602621 2024-09-05T00:56:21.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.497+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=M7SSHDBIHP4X tag=33VYOETEI3TN type=write size=3748349 2024-09-05T00:56:21.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.497+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~XBYCNJCMVMFX.0 size=409086 2024-09-05T00:56:21.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.501+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=XBYCNJCMVMFX tag=VIJK1A66MBF0 type=write size=1457662 2024-09-05T00:56:21.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.505+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.0 size=1048576 2024-09-05T00:56:21.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.509+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.1 size=1048576 2024-09-05T00:56:21.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.509+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.2 size=171931 2024-09-05T00:56:21.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.509+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=RKH3FGRHA1BF tag=JUSG7PAVAL0I type=write size=3317659 2024-09-05T00:56:21.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.517+0000 7f325adab8c0 1 < suggested remove operation key=EGPVSV2PFILM tag=WDJGOM60DIZC type=write 2024-09-05T00:56:21.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.517+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=DWVLU19K29ZO type=write size=202443 2024-09-05T00:56:21.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.521+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=Y2X31KWQGX2J type=del 2024-09-05T00:56:21.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.521+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=TFBIJDEO0UVT type=del size=2709515 2024-09-05T00:56:21.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.525+0000 7f325adab8c0 -1 < failed to complete operation key=J9UIQE3CKYHM tag=YC1SQ6ERNC9N type=del size=3672061: (22) Invalid argument 2024-09-05T00:56:21.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.529+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=NVG62A95CU4C type=del size=253418 2024-09-05T00:56:21.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.529+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.0 size=1048576 2024-09-05T00:56:21.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.533+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.1 size=1048576 2024-09-05T00:56:21.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.533+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~QSFN6CQYAXZH.2 size=33746 2024-09-05T00:56:21.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.537+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=QSFN6CQYAXZH tag=9V9ZWK8RJSMX type=write size=3179474 2024-09-05T00:56:21.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.541+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=YJ8Y42GC0IS0 type=del size=3679978 2024-09-05T00:56:21.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.545+0000 7f325adab8c0 1 < suggested remove operation key=MYR9H12B5YYV tag=V73OUPM1HXOY type=del 2024-09-05T00:56:21.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.549+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=X0NC9JS5HRXJ type=write size=512281 2024-09-05T00:56:21.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.549+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=BM856KV0BOU1 type=del 2024-09-05T00:56:21.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.553+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=PQ92FAX4VLI1 type=del size=2370955 2024-09-05T00:56:21.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.553+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.0 size=1048576 2024-09-05T00:56:21.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.553+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.1 size=1048576 2024-09-05T00:56:21.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.553+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~PX6CY0NHIE85.2 size=806677 2024-09-05T00:56:21.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.557+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=PX6CY0NHIE85 tag=LF4VF1QHD2E3 type=write size=3952405 2024-09-05T00:56:21.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.561+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=OHFDYYTGKWY9 type=del size=3781153 2024-09-05T00:56:21.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.561+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~87GDLEDMV6Y4.0 size=668283 2024-09-05T00:56:21.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.565+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=87GDLEDMV6Y4 tag=F1YYP64TZBGY type=write size=1716859 2024-09-05T00:56:21.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.569+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=4HW7Q7SL1CSO type=del size=584521 2024-09-05T00:56:21.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.569+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=0ASZNWMY8X84 type=del 2024-09-05T00:56:21.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.573+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~7G7W4605GS8F.0 size=883892 2024-09-05T00:56:21.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.573+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=7G7W4605GS8F tag=YVOC0I32F1PH type=write size=1932468 2024-09-05T00:56:21.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.577+0000 7f325adab8c0 -1 < failed to complete operation key=EGPVSV2PFILM tag=WBWIVRCP4E8S type=del size=3079758: (22) Invalid argument 2024-09-05T00:56:21.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.581+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~I597GF7PL8M1.0 size=1048576 2024-09-05T00:56:21.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.581+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~I597GF7PL8M1.1 size=466487 2024-09-05T00:56:21.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.581+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=I597GF7PL8M1 tag=B428FI755PQS type=write size=2563639 2024-09-05T00:56:21.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.585+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=7P1ZO7NCDR7R type=del 2024-09-05T00:56:21.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.585+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=L9QBA94SXG4N type=del size=1768383 2024-09-05T00:56:21.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.589+0000 7f325adab8c0 1 < suggested remove operation key=71FWV15GD1QZ tag=FVJNODI5ZOBP type=del 2024-09-05T00:56:21.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.593+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VFP9ZCC7ZJZA.0 size=1048576 2024-09-05T00:56:21.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.597+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VFP9ZCC7ZJZA.1 size=1025052 2024-09-05T00:56:21.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.597+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=VFP9ZCC7ZJZA tag=VLCK1JZP1J26 type=write size=3122204 2024-09-05T00:56:21.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.597+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~WPZ8OR57LGAH.0 size=1048576 2024-09-05T00:56:21.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.601+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~WPZ8OR57LGAH.1 size=497901 2024-09-05T00:56:21.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.605+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=WPZ8OR57LGAH tag=24YV0EJAGAWN type=write size=2595053 2024-09-05T00:56:21.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.613+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~6V1MWJYTWAXX.0 size=133902 2024-09-05T00:56:21.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.613+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=6V1MWJYTWAXX tag=XPFOM134K1C6 type=write size=1182478 2024-09-05T00:56:21.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.617+0000 7f325adab8c0 1 < canceled operation key=IGOUBVL3XVS3 tag=ZKTX9CJGMWDY type=del size=1086487 2024-09-05T00:56:21.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.617+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=5NMY668ROK6J type=del size=905460 2024-09-05T00:56:21.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.621+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.0 size=1048576 2024-09-05T00:56:21.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.621+0000 7f325adab8c0 1 < canceled part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.1 size=1048576 2024-09-05T00:56:21.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.621+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~M7SSHDBIHP4X.2 size=602621 2024-09-05T00:56:21.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.625+0000 7f325adab8c0 1 < canceled multipart upload key=XKOECM0CCOKX upload=M7SSHDBIHP4X tag=33VYOETEI3TN type=write size=3748349 2024-09-05T00:56:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.629+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~EY5RB4HC756S.0 size=1047193 2024-09-05T00:56:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.629+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=EY5RB4HC756S tag=TGVFA9UEH34Q type=write size=2095769 2024-09-05T00:56:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.633+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.0 size=1048576 2024-09-05T00:56:21.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.633+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.1 size=1048576 2024-09-05T00:56:21.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.637+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~RKH3FGRHA1BF.2 size=171931 2024-09-05T00:56:21.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.641+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=RKH3FGRHA1BF tag=JUSG7PAVAL0I type=write size=3317659 2024-09-05T00:56:21.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.645+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~CEYJJDMS9ZHJ.0 size=188998 2024-09-05T00:56:21.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.645+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=CEYJJDMS9ZHJ tag=VK9H06JM5LW6 type=write size=1237574 2024-09-05T00:56:21.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.645+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=DWVLU19K29ZO type=write size=202443 2024-09-05T00:56:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.653+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=TC343RV7B5JZ type=del size=2683190 2024-09-05T00:56:21.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.653+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=TFBIJDEO0UVT type=del 2024-09-05T00:56:21.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.657+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~NMHHDMYZU7HW.0 size=676852 2024-09-05T00:56:21.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.657+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=NMHHDMYZU7HW tag=E08ZOA6699IC type=write size=1725428 2024-09-05T00:56:21.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.661+0000 7f325adab8c0 -1 < failed to complete operation key=71FWV15GD1QZ tag=NVG62A95CU4C type=del size=253418: (22) Invalid argument 2024-09-05T00:56:21.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.661+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=7UK07C661I2Z type=write size=1047735 2024-09-05T00:56:21.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.665+0000 7f325adab8c0 -1 < no bi entry to suggest for operation key=71FWV15GD1QZ tag=YJ8Y42GC0IS0 type=del size=3679978: (2) No such file or directory 2024-09-05T00:56:21.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.669+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~5G0UD7JBR13H.0 size=1048576 2024-09-05T00:56:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.669+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~5G0UD7JBR13H.1 size=100478 2024-09-05T00:56:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.669+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=5G0UD7JBR13H tag=4FJH03RULQ5S type=write size=2197630 2024-09-05T00:56:21.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.673+0000 7f325adab8c0 1 < completed write operation key=JKRZR0KRE93F tag=X0NC9JS5HRXJ type=write size=512281 2024-09-05T00:56:21.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.677+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~YVOF53LT472J.0 size=1048576 2024-09-05T00:56:21.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.677+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~YVOF53LT472J.1 size=359705 2024-09-05T00:56:21.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.677+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=YVOF53LT472J tag=PW4S8RH3Q9JZ type=write size=2456857 2024-09-05T00:56:21.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.681+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=PQ92FAX4VLI1 type=del 2024-09-05T00:56:21.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.681+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=ZPRF6COUVAII type=del size=129759 2024-09-05T00:56:21.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.685+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=OHFDYYTGKWY9 type=del 2024-09-05T00:56:21.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.689+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~3XB4UN6WS2QA.0 size=481166 2024-09-05T00:56:21.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.689+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=3XB4UN6WS2QA tag=3VF2YC47MTC8 type=write size=1529742 2024-09-05T00:56:21.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.689+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=4HW7Q7SL1CSO type=del 2024-09-05T00:56:21.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.693+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=XBLVJ3YZHFT1 type=del size=1093230 2024-09-05T00:56:21.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.693+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~7G7W4605GS8F.0 size=883892 2024-09-05T00:56:21.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.697+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=7G7W4605GS8F tag=YVOC0I32F1PH type=write size=1932468 2024-09-05T00:56:21.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.701+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=PP754LYNEKNS type=write size=1038594 2024-09-05T00:56:21.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.701+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~I597GF7PL8M1.0 size=1048576 2024-09-05T00:56:21.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.701+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~I597GF7PL8M1.1 size=466487 2024-09-05T00:56:21.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.705+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=I597GF7PL8M1 tag=B428FI755PQS type=write size=2563639 2024-09-05T00:56:21.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.709+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=8FKMICN94599 type=write size=532897 2024-09-05T00:56:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.713+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=L9QBA94SXG4N type=del 2024-09-05T00:56:21.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.717+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~LZDKI7VWI8YR.0 size=1048576 2024-09-05T00:56:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.717+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~LZDKI7VWI8YR.1 size=352097 2024-09-05T00:56:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.717+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=LZDKI7VWI8YR tag=TEC1KAUF4F90 type=write size=2449249 2024-09-05T00:56:21.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.721+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VFP9ZCC7ZJZA.0 size=1048576 2024-09-05T00:56:21.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.725+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VFP9ZCC7ZJZA.1 size=1025052 2024-09-05T00:56:21.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.725+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=VFP9ZCC7ZJZA tag=VLCK1JZP1J26 type=write size=3122204 2024-09-05T00:56:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.729+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=S2O1V2IFSQ0Z type=del size=3975209 2024-09-05T00:56:21.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.733+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~6V1MWJYTWAXX.0 size=133902 2024-09-05T00:56:21.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.737+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=6V1MWJYTWAXX tag=XPFOM134K1C6 type=write size=1182478 2024-09-05T00:56:21.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.737+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=QAUH7W518YGF type=del size=712791 2024-09-05T00:56:21.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.741+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=5NMY668ROK6J type=del 2024-09-05T00:56:21.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.741+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=HUVYUM81QD2D type=del size=2150120 2024-09-05T00:56:21.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.745+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~EY5RB4HC756S.0 size=1047193 2024-09-05T00:56:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.749+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=EY5RB4HC756S tag=TGVFA9UEH34Q type=write size=2095769 2024-09-05T00:56:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.753+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=9CUORMQ6HCJK type=del size=278490 2024-09-05T00:56:21.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.753+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~CEYJJDMS9ZHJ.0 size=188998 2024-09-05T00:56:21.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.757+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=CEYJJDMS9ZHJ tag=VK9H06JM5LW6 type=write size=1237574 2024-09-05T00:56:21.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.761+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~EO7WEQSV39BL.0 size=389144 2024-09-05T00:56:21.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.761+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=EO7WEQSV39BL tag=YFTKW1ANDTC3 type=write size=1437720 2024-09-05T00:56:21.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.765+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=TC343RV7B5JZ type=del 2024-09-05T00:56:21.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.769+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.0 size=1048576 2024-09-05T00:56:21.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.769+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.1 size=1048576 2024-09-05T00:56:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.773+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.2 size=518601 2024-09-05T00:56:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.773+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=GO3SMM1G43GF tag=Q0QNVT8NHIF4 type=write size=3664329 2024-09-05T00:56:21.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.773+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~NMHHDMYZU7HW.0 size=676852 2024-09-05T00:56:21.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.777+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=NMHHDMYZU7HW tag=E08ZOA6699IC type=write size=1725428 2024-09-05T00:56:21.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.781+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=J4K0263YI1E3 type=del size=708135 2024-09-05T00:56:21.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.781+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=7UK07C661I2Z type=write size=1047735 2024-09-05T00:56:21.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.785+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.0 size=1048576 2024-09-05T00:56:21.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.789+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.1 size=1048576 2024-09-05T00:56:21.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.789+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.2 size=1012390 2024-09-05T00:56:21.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.789+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=1V71WN2GEAQM tag=9371F3NQL301 type=write size=4158118 2024-09-05T00:56:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.793+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~5G0UD7JBR13H.0 size=1048576 2024-09-05T00:56:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.793+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~5G0UD7JBR13H.1 size=100478 2024-09-05T00:56:21.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.797+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=5G0UD7JBR13H tag=4FJH03RULQ5S type=write size=2197630 2024-09-05T00:56:21.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.801+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=0WM4SXTPLK1U type=del size=1201650 2024-09-05T00:56:21.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.805+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~YVOF53LT472J.0 size=1048576 2024-09-05T00:56:21.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.805+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~YVOF53LT472J.1 size=359705 2024-09-05T00:56:21.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.809+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=YVOF53LT472J tag=PW4S8RH3Q9JZ type=write size=2456857 2024-09-05T00:56:21.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.813+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~L307D2XREQ1G.0 size=696427 2024-09-05T00:56:21.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.813+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=L307D2XREQ1G tag=8OTPMVJGHI1U type=write size=1745003 2024-09-05T00:56:21.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.817+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=ZPRF6COUVAII type=del 2024-09-05T00:56:21.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.817+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=Y3P4KXM7A5JN type=del size=1635704 2024-09-05T00:56:21.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.821+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~3XB4UN6WS2QA.0 size=481166 2024-09-05T00:56:21.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.825+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=3XB4UN6WS2QA tag=3VF2YC47MTC8 type=write size=1529742 2024-09-05T00:56:21.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.825+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=VPIML4IMIFE7 type=write size=83859 2024-09-05T00:56:21.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.829+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=XBLVJ3YZHFT1 type=del 2024-09-05T00:56:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.833+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~L1FMI9O8JZSH.0 size=1048576 2024-09-05T00:56:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.833+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~L1FMI9O8JZSH.1 size=214880 2024-09-05T00:56:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.833+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=L1FMI9O8JZSH tag=8BN1JAZP87QE type=write size=2312032 2024-09-05T00:56:21.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.837+0000 7f325adab8c0 1 < completed write operation key=NIAW4BKW21LG tag=PP754LYNEKNS type=write size=1038594 2024-09-05T00:56:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.837+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=DQT3FQQBS3A1 type=del size=2088664 2024-09-05T00:56:21.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.845+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=8FKMICN94599 type=write size=532897 2024-09-05T00:56:21.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.845+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=MMMP9LD7R03P type=del size=438130 2024-09-05T00:56:21.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.849+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~LZDKI7VWI8YR.0 size=1048576 2024-09-05T00:56:21.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.853+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~LZDKI7VWI8YR.1 size=352097 2024-09-05T00:56:21.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.857+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=LZDKI7VWI8YR tag=TEC1KAUF4F90 type=write size=2449249 2024-09-05T00:56:21.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.861+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.0 size=1048576 2024-09-05T00:56:21.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.861+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.1 size=1048576 2024-09-05T00:56:21.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.865+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.2 size=21342 2024-09-05T00:56:21.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.865+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=DIRCN29VWVPB tag=NHXLOAS74UZG type=write size=3167070 2024-09-05T00:56:21.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.869+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=S2O1V2IFSQ0Z type=del 2024-09-05T00:56:21.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.869+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=I0A0P1CMXF0I type=del size=548645 2024-09-05T00:56:21.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.877+0000 7f325adab8c0 1 < suggested update operation key=LVZALGRNP5TU tag=QAUH7W518YGF type=del size=712791 2024-09-05T00:56:21.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.877+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=ZY0G6G01ZHSL type=del size=1829595 2024-09-05T00:56:21.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.881+0000 7f325adab8c0 1 < canceled operation key=9O7DVR04PCDB tag=HUVYUM81QD2D type=del size=2150120 2024-09-05T00:56:21.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.881+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=SWTIP0NQ6ZDE type=del size=3865974 2024-09-05T00:56:21.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.885+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=9CUORMQ6HCJK type=del size=278490 2024-09-05T00:56:21.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.885+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=NZ134F5L706Q type=del size=3970695 2024-09-05T00:56:21.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.889+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~EO7WEQSV39BL.0 size=389144 2024-09-05T00:56:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.893+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=EO7WEQSV39BL tag=YFTKW1ANDTC3 type=write size=1437720 2024-09-05T00:56:21.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.893+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=QCUEHJ1B0EE5 type=del size=3070491 2024-09-05T00:56:21.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.897+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.0 size=1048576 2024-09-05T00:56:21.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.897+0000 7f325adab8c0 1 < canceled part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.1 size=1048576 2024-09-05T00:56:21.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.897+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~GO3SMM1G43GF.2 size=518601 2024-09-05T00:56:21.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.901+0000 7f325adab8c0 1 < canceled multipart upload key=ZYT3WYNFIIZN upload=GO3SMM1G43GF tag=Q0QNVT8NHIF4 type=write size=3664329 2024-09-05T00:56:21.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.905+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=I6F0YPQA3MQX type=del size=2138014 2024-09-05T00:56:21.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.905+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=J4K0263YI1E3 type=del 2024-09-05T00:56:21.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.909+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.0 size=1048576 2024-09-05T00:56:21.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.913+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.1 size=1048576 2024-09-05T00:56:21.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.917+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.2 size=974579 2024-09-05T00:56:21.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.917+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=4GQJ6W0JSWZF tag=BPKC8CJITBDT type=write size=4120307 2024-09-05T00:56:21.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.917+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.0 size=1048576 2024-09-05T00:56:21.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.921+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.1 size=1048576 2024-09-05T00:56:21.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.921+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~1V71WN2GEAQM.2 size=1012390 2024-09-05T00:56:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.929+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=1V71WN2GEAQM tag=9371F3NQL301 type=write size=4158118 2024-09-05T00:56:21.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.933+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~Q590CHKF3NT5.0 size=1048576 2024-09-05T00:56:21.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.933+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~Q590CHKF3NT5.1 size=935509 2024-09-05T00:56:21.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.933+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=Q590CHKF3NT5 tag=B02BD8DPEQRO type=write size=3032661 2024-09-05T00:56:21.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.937+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=0WM4SXTPLK1U type=del 2024-09-05T00:56:21.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.941+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=B4A4Q3K0S9TX type=del size=3626835 2024-09-05T00:56:21.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.941+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~L307D2XREQ1G.0 size=696427 2024-09-05T00:56:21.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.945+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=L307D2XREQ1G tag=8OTPMVJGHI1U type=write size=1745003 2024-09-05T00:56:21.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.949+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~112EUTU7T3SJ.0 size=166417 2024-09-05T00:56:21.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.949+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=112EUTU7T3SJ tag=9TBSCAKUHHTX type=write size=1214993 2024-09-05T00:56:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.953+0000 7f325adab8c0 1 < canceled operation key=A9WMRV5QZ2FP tag=Y3P4KXM7A5JN type=del size=1635704 2024-09-05T00:56:21.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.957+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~P1XN4NK27WTB.0 size=1048576 2024-09-05T00:56:21.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.957+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~P1XN4NK27WTB.1 size=940957 2024-09-05T00:56:21.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.957+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=P1XN4NK27WTB tag=9401X3P8TVU3 type=write size=3038109 2024-09-05T00:56:21.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.961+0000 7f325adab8c0 1 < suggested remove operation key=SP188HM5LG2D tag=VPIML4IMIFE7 type=write 2024-09-05T00:56:21.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.965+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=ZO3UUAU4AX3G type=write size=551137 2024-09-05T00:56:21.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.969+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~L1FMI9O8JZSH.0 size=1048576 2024-09-05T00:56:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.969+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~L1FMI9O8JZSH.1 size=214880 2024-09-05T00:56:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.973+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=L1FMI9O8JZSH tag=8BN1JAZP87QE type=write size=2312032 2024-09-05T00:56:21.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.977+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.0 size=1048576 2024-09-05T00:56:21.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.981+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.1 size=1048576 2024-09-05T00:56:21.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.981+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.2 size=989465 2024-09-05T00:56:21.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.981+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=D416EMEDP8TK tag=AW93GKDS3H69 type=write size=4135193 2024-09-05T00:56:21.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.985+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=DQT3FQQBS3A1 type=del 2024-09-05T00:56:21.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.985+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=FEAJKW8ARSIO type=del size=3578807 2024-09-05T00:56:21.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.989+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=MMMP9LD7R03P type=del 2024-09-05T00:56:21.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.989+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=IF127FFDVQNK type=del size=2079439 2024-09-05T00:56:21.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.993+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.0 size=1048576 2024-09-05T00:56:21.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.993+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.1 size=1048576 2024-09-05T00:56:21.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.993+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~DIRCN29VWVPB.2 size=21342 2024-09-05T00:56:22.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.997+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=DIRCN29VWVPB tag=NHXLOAS74UZG type=write size=3167070 2024-09-05T00:56:22.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:21.997+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=W47Y6GJ3R1Y9 type=del size=1541317 2024-09-05T00:56:22.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.001+0000 7f325adab8c0 1 < suggested update operation key=G600UT533GTT tag=I0A0P1CMXF0I type=del size=548645 2024-09-05T00:56:22.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.005+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=IZWXQ8QVK6CE type=del size=3006342 2024-09-05T00:56:22.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.009+0000 7f325adab8c0 1 < suggested update operation key=EGPVSV2PFILM tag=ZY0G6G01ZHSL type=del size=1829595 2024-09-05T00:56:22.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.013+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~E6F3MGA9WXVA.0 size=1048576 2024-09-05T00:56:22.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.013+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~E6F3MGA9WXVA.1 size=835761 2024-09-05T00:56:22.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.013+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=E6F3MGA9WXVA tag=CD4G99K62YGX type=write size=2932913 2024-09-05T00:56:22.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.017+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=SWTIP0NQ6ZDE type=del 2024-09-05T00:56:22.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.017+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=K7A78IEXJKY1 type=del size=2856957 2024-09-05T00:56:22.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.021+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=NZ134F5L706Q type=del 2024-09-05T00:56:22.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.025+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~MC5FXH4IFGMW.0 size=1048576 2024-09-05T00:56:22.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.025+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~MC5FXH4IFGMW.1 size=158667 2024-09-05T00:56:22.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.025+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=MC5FXH4IFGMW tag=Z4UUD9SXDN8Q type=write size=2255819 2024-09-05T00:56:22.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.029+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=QCUEHJ1B0EE5 type=del 2024-09-05T00:56:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.029+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=E1TMJMO4KS50 type=del size=885915 2024-09-05T00:56:22.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.033+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=I6F0YPQA3MQX type=del size=2138014 2024-09-05T00:56:22.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.033+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=3SHEV5AMD17O type=write size=220305 2024-09-05T00:56:22.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.037+0000 7f325adab8c0 1 < canceled part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.0 size=1048576 2024-09-05T00:56:22.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.037+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.1 size=1048576 2024-09-05T00:56:22.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.041+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~4GQJ6W0JSWZF.2 size=974579 2024-09-05T00:56:22.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.041+0000 7f325adab8c0 1 < canceled multipart upload key=SP188HM5LG2D upload=4GQJ6W0JSWZF tag=BPKC8CJITBDT type=write size=4120307 2024-09-05T00:56:22.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.045+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=68HM7JVYNHVI type=del size=456908 2024-09-05T00:56:22.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.049+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~Q590CHKF3NT5.0 size=1048576 2024-09-05T00:56:22.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.049+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~Q590CHKF3NT5.1 size=935509 2024-09-05T00:56:22.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.053+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=Q590CHKF3NT5 tag=B02BD8DPEQRO type=write size=3032661 2024-09-05T00:56:22.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.053+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=QNNOU4P16BJ0 type=del size=1009627 2024-09-05T00:56:22.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.057+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=B4A4Q3K0S9TX type=del 2024-09-05T00:56:22.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.061+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~S31U5DV7ASU5.0 size=1048576 2024-09-05T00:56:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.061+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~S31U5DV7ASU5.1 size=995666 2024-09-05T00:56:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.061+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=S31U5DV7ASU5 tag=MF6GFDQ3ZENO type=write size=3092818 2024-09-05T00:56:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.065+0000 7f325adab8c0 1 < canceled part key=_multipart_MYR9H12B5YYV.2~112EUTU7T3SJ.0 size=166417 2024-09-05T00:56:22.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.065+0000 7f325adab8c0 1 < canceled multipart upload key=MYR9H12B5YYV upload=112EUTU7T3SJ tag=9TBSCAKUHHTX type=write size=1214993 2024-09-05T00:56:22.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.069+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~N0D78GU1AVC1.0 size=1048576 2024-09-05T00:56:22.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.073+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~N0D78GU1AVC1.1 size=913234 2024-09-05T00:56:22.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.073+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=N0D78GU1AVC1 tag=KBPOW79QBC0V type=write size=3010386 2024-09-05T00:56:22.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.077+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~P1XN4NK27WTB.0 size=1048576 2024-09-05T00:56:22.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.077+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~P1XN4NK27WTB.1 size=940957 2024-09-05T00:56:22.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.081+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=P1XN4NK27WTB tag=9401X3P8TVU3 type=write size=3038109 2024-09-05T00:56:22.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.085+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=CH4SAZVMJQ93 type=del size=3558841 2024-09-05T00:56:22.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.085+0000 7f325adab8c0 1 < completed write operation key=6N7BLJ1WLDGN tag=ZO3UUAU4AX3G type=write size=551137 2024-09-05T00:56:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.089+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=J7D8MWVDA4EU type=del size=557685 2024-09-05T00:56:22.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.089+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.0 size=1048576 2024-09-05T00:56:22.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.093+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.1 size=1048576 2024-09-05T00:56:22.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.093+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~D416EMEDP8TK.2 size=989465 2024-09-05T00:56:22.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.097+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=D416EMEDP8TK tag=AW93GKDS3H69 type=write size=4135193 2024-09-05T00:56:22.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.101+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=ZA0M3L14R9A5 type=del size=1792737 2024-09-05T00:56:22.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.101+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=FEAJKW8ARSIO type=del 2024-09-05T00:56:22.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.105+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.0 size=1048576 2024-09-05T00:56:22.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.105+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.1 size=1048576 2024-09-05T00:56:22.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.109+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.2 size=1033812 2024-09-05T00:56:22.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.109+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=TW3D0R86A02L tag=MSUR08EHQM4E type=write size=4179540 2024-09-05T00:56:22.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.113+0000 7f325adab8c0 1 < suggested update operation key=D6HSFIRN2X4Q tag=IF127FFDVQNK type=del size=2079439 2024-09-05T00:56:22.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.117+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KU4SEMBW1Q8M.0 size=1048576 2024-09-05T00:56:22.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.121+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KU4SEMBW1Q8M.1 size=258223 2024-09-05T00:56:22.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.121+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=KU4SEMBW1Q8M tag=2VAS6O9DXIKZ type=write size=2355375 2024-09-05T00:56:22.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.121+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=W47Y6GJ3R1Y9 type=del 2024-09-05T00:56:22.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.125+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=AWRN33LRXSX5 type=del size=237673 2024-09-05T00:56:22.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.125+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=IZWXQ8QVK6CE type=del 2024-09-05T00:56:22.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.129+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=5ZD2YMC6SC3F type=del size=3404406 2024-09-05T00:56:22.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.133+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~E6F3MGA9WXVA.0 size=1048576 2024-09-05T00:56:22.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.133+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~E6F3MGA9WXVA.1 size=835761 2024-09-05T00:56:22.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.141+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=E6F3MGA9WXVA tag=CD4G99K62YGX type=write size=2932913 2024-09-05T00:56:22.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.145+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~DZC1NU6195R4.0 size=272420 2024-09-05T00:56:22.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.145+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=DZC1NU6195R4 tag=BUDL3Z4WF91U type=write size=1320996 2024-09-05T00:56:22.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.149+0000 7f325adab8c0 -1 < failed to complete operation key=D6HSFIRN2X4Q tag=K7A78IEXJKY1 type=del size=2856957: (22) Invalid argument 2024-09-05T00:56:22.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.153+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=B15PRXT011K1 type=del size=373858 2024-09-05T00:56:22.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.153+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~MC5FXH4IFGMW.0 size=1048576 2024-09-05T00:56:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.157+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~MC5FXH4IFGMW.1 size=158667 2024-09-05T00:56:22.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.161+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=MC5FXH4IFGMW tag=Z4UUD9SXDN8Q type=write size=2255819 2024-09-05T00:56:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.165+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~49WO3JNNK8QR.0 size=1048576 2024-09-05T00:56:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.169+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~49WO3JNNK8QR.1 size=795741 2024-09-05T00:56:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.169+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=49WO3JNNK8QR tag=Y80WX33DQJZ7 type=write size=2892893 2024-09-05T00:56:22.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.169+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=E1TMJMO4KS50 type=del 2024-09-05T00:56:22.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.177+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~8P4PM2S44IE2.0 size=1048576 2024-09-05T00:56:22.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.177+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~8P4PM2S44IE2.1 size=303972 2024-09-05T00:56:22.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.177+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=8P4PM2S44IE2 tag=H3ZZE6Z92BOJ type=write size=2401124 2024-09-05T00:56:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.181+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=3SHEV5AMD17O type=write size=220305 2024-09-05T00:56:22.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.185+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~0OF8U0105EIE.0 size=774603 2024-09-05T00:56:22.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.185+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=0OF8U0105EIE tag=O7HBXA1TH7T4 type=write size=1823179 2024-09-05T00:56:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.189+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=68HM7JVYNHVI type=del 2024-09-05T00:56:22.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.193+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=B0J4JJDDA1WE type=del size=2792239 2024-09-05T00:56:22.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.197+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=QNNOU4P16BJ0 type=del 2024-09-05T00:56:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.197+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=F81ZQM6F5TA1 type=del size=3579998 2024-09-05T00:56:22.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.201+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~S31U5DV7ASU5.0 size=1048576 2024-09-05T00:56:22.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.205+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~S31U5DV7ASU5.1 size=995666 2024-09-05T00:56:22.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.209+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=S31U5DV7ASU5 tag=MF6GFDQ3ZENO type=write size=3092818 2024-09-05T00:56:22.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.217+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~XKSMRLNAFJAL.0 size=1048576 2024-09-05T00:56:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.217+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~XKSMRLNAFJAL.1 size=774261 2024-09-05T00:56:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.217+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=XKSMRLNAFJAL tag=9WFM9UWZW6DG type=write size=2871413 2024-09-05T00:56:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.221+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~N0D78GU1AVC1.0 size=1048576 2024-09-05T00:56:22.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.225+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~N0D78GU1AVC1.1 size=913234 2024-09-05T00:56:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.229+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=N0D78GU1AVC1 tag=KBPOW79QBC0V type=write size=3010386 2024-09-05T00:56:22.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.233+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=TIKYKR2OGR9I type=del size=3474077 2024-09-05T00:56:22.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.237+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=CH4SAZVMJQ93 type=del 2024-09-05T00:56:22.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.237+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=ATGG1F67X2AJ type=del size=1203127 2024-09-05T00:56:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.241+0000 7f325adab8c0 -1 < failed to complete operation key=D6HSFIRN2X4Q tag=J7D8MWVDA4EU type=del size=557685: (22) Invalid argument 2024-09-05T00:56:22.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.245+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=O2U457BZ4WI2 type=del size=1994255 2024-09-05T00:56:22.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.245+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=ZA0M3L14R9A5 type=del 2024-09-05T00:56:22.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.249+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=RP0KGYKU95DK type=del size=227406 2024-09-05T00:56:22.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.253+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.0 size=1048576 2024-09-05T00:56:22.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.253+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.1 size=1048576 2024-09-05T00:56:22.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.257+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~TW3D0R86A02L.2 size=1033812 2024-09-05T00:56:22.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.261+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=TW3D0R86A02L tag=MSUR08EHQM4E type=write size=4179540 2024-09-05T00:56:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.269+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~JDGQDH47XS2I.0 size=1004174 2024-09-05T00:56:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.269+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=JDGQDH47XS2I tag=8RTKZEFE6HTO type=write size=2052750 2024-09-05T00:56:22.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.269+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KU4SEMBW1Q8M.0 size=1048576 2024-09-05T00:56:22.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.273+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KU4SEMBW1Q8M.1 size=258223 2024-09-05T00:56:22.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.277+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=KU4SEMBW1Q8M tag=2VAS6O9DXIKZ type=write size=2355375 2024-09-05T00:56:22.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.281+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=JLWBCOP1JHMR type=del size=1393427 2024-09-05T00:56:22.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.285+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=AWRN33LRXSX5 type=del 2024-09-05T00:56:22.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.289+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=LKJT4CJD6VX0 type=del size=500600 2024-09-05T00:56:22.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.293+0000 7f325adab8c0 1 < canceled operation key=ZVKLK751KO5T tag=5ZD2YMC6SC3F type=del size=3404406 2024-09-05T00:56:22.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.293+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=QLEETLPG3Z04 type=del size=760757 2024-09-05T00:56:22.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.297+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~DZC1NU6195R4.0 size=272420 2024-09-05T00:56:22.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.305+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=DZC1NU6195R4 tag=BUDL3Z4WF91U type=write size=1320996 2024-09-05T00:56:22.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.305+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=9RPCJM0PXUG9 type=write size=338751 2024-09-05T00:56:22.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.309+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=B15PRXT011K1 type=del 2024-09-05T00:56:22.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.313+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=SBLF7UODQ3YL type=del size=2396203 2024-09-05T00:56:22.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.313+0000 7f325adab8c0 1 < canceled part key=_multipart_GU25IIQWQNR2.2~49WO3JNNK8QR.0 size=1048576 2024-09-05T00:56:22.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.313+0000 7f325adab8c0 1 < canceled part key=_multipart_GU25IIQWQNR2.2~49WO3JNNK8QR.1 size=795741 2024-09-05T00:56:22.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.317+0000 7f325adab8c0 1 < canceled multipart upload key=GU25IIQWQNR2 upload=49WO3JNNK8QR tag=Y80WX33DQJZ7 type=write size=2892893 2024-09-05T00:56:22.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.321+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=Q1JRFR6YBE4R type=del size=3477144 2024-09-05T00:56:22.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.321+0000 7f325adab8c0 1 < canceled part key=_multipart_YMIGZMLJSI4D.2~8P4PM2S44IE2.0 size=1048576 2024-09-05T00:56:22.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.321+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~8P4PM2S44IE2.1 size=303972 2024-09-05T00:56:22.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.325+0000 7f325adab8c0 1 < canceled multipart upload key=YMIGZMLJSI4D upload=8P4PM2S44IE2 tag=H3ZZE6Z92BOJ type=write size=2401124 2024-09-05T00:56:22.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.333+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~188NK8RPAMU1.0 size=1048576 2024-09-05T00:56:22.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.337+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~188NK8RPAMU1.1 size=548506 2024-09-05T00:56:22.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.337+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=188NK8RPAMU1 tag=N2A441I01HVV type=write size=2645658 2024-09-05T00:56:22.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.337+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~0OF8U0105EIE.0 size=774603 2024-09-05T00:56:22.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.341+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=0OF8U0105EIE tag=O7HBXA1TH7T4 type=write size=1823179 2024-09-05T00:56:22.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.345+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=9URSDOLISS13 type=del size=3309545 2024-09-05T00:56:22.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.349+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=B0J4JJDDA1WE type=del 2024-09-05T00:56:22.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.353+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.0 size=1048576 2024-09-05T00:56:22.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.357+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.1 size=1048576 2024-09-05T00:56:22.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.357+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.2 size=767152 2024-09-05T00:56:22.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.357+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=MVU0Q79RMGKD tag=C8P7N9UPOVO0 type=write size=3912880 2024-09-05T00:56:22.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.361+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=F81ZQM6F5TA1 type=del 2024-09-05T00:56:22.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.365+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=PM01ZAMY6UTE type=del size=2183913 2024-09-05T00:56:22.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.365+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~XKSMRLNAFJAL.0 size=1048576 2024-09-05T00:56:22.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.365+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~XKSMRLNAFJAL.1 size=774261 2024-09-05T00:56:22.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.369+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=XKSMRLNAFJAL tag=9WFM9UWZW6DG type=write size=2871413 2024-09-05T00:56:22.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.373+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~1MLM30FF534Z.0 size=951652 2024-09-05T00:56:22.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.373+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=1MLM30FF534Z tag=WEAYHB4CU948 type=write size=2000228 2024-09-05T00:56:22.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.377+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=TIKYKR2OGR9I type=del 2024-09-05T00:56:22.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.381+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=ODM0ZXUH30DG type=del size=2219425 2024-09-05T00:56:22.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.381+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=ATGG1F67X2AJ type=del size=1203127 2024-09-05T00:56:22.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.385+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=9IB6GZK25XJC type=del size=3846018 2024-09-05T00:56:22.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.389+0000 7f325adab8c0 1 < suggested remove operation key=O0RSK2S88XHP tag=O2U457BZ4WI2 type=del 2024-09-05T00:56:22.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.393+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.0 size=1048576 2024-09-05T00:56:22.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.393+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.1 size=1048576 2024-09-05T00:56:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.397+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.2 size=766100 2024-09-05T00:56:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.397+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=HGZOSYSM7V0J tag=IARUS1YDAO13 type=write size=3911828 2024-09-05T00:56:22.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.401+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=RP0KGYKU95DK type=del 2024-09-05T00:56:22.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.401+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=5WL315B8Y0JB type=del size=407798 2024-09-05T00:56:22.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.405+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~JDGQDH47XS2I.0 size=1004174 2024-09-05T00:56:22.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.409+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=JDGQDH47XS2I tag=8RTKZEFE6HTO type=write size=2052750 2024-09-05T00:56:22.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.409+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=4OQ6FNCQB3FX type=del size=3545122 2024-09-05T00:56:22.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.413+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=JLWBCOP1JHMR type=del 2024-09-05T00:56:22.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.417+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.0 size=1048576 2024-09-05T00:56:22.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.421+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.1 size=1048576 2024-09-05T00:56:22.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.421+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.2 size=262891 2024-09-05T00:56:22.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.421+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=NT319XBODXYI tag=UJR565JPACC5 type=write size=3408619 2024-09-05T00:56:22.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.425+0000 7f325adab8c0 1 < canceled operation key=MAS6EB753KO9 tag=LKJT4CJD6VX0 type=del size=500600 2024-09-05T00:56:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.429+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QYJRQASZWHCM.0 size=1048576 2024-09-05T00:56:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.433+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QYJRQASZWHCM.1 size=248951 2024-09-05T00:56:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.433+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=QYJRQASZWHCM tag=QU405K5Z1KSM type=write size=2346103 2024-09-05T00:56:22.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.433+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=QLEETLPG3Z04 type=del 2024-09-05T00:56:22.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.437+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=5IQ6M52ZDEG6 type=del size=699328 2024-09-05T00:56:22.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.441+0000 7f325adab8c0 1 < completed write operation key=CB079FGXKNRO tag=9RPCJM0PXUG9 type=write size=338751 2024-09-05T00:56:22.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.441+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=98VTWTDGRZ6J type=write size=17468 2024-09-05T00:56:22.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.445+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=SBLF7UODQ3YL type=del 2024-09-05T00:56:22.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.445+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=T66RK90AHAXJ type=del size=2505072 2024-09-05T00:56:22.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.449+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=Q1JRFR6YBE4R type=del 2024-09-05T00:56:22.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.453+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=FVJRZVOEQ4FA type=del size=3805973 2024-09-05T00:56:22.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.453+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~188NK8RPAMU1.0 size=1048576 2024-09-05T00:56:22.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.457+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~188NK8RPAMU1.1 size=548506 2024-09-05T00:56:22.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.461+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=188NK8RPAMU1 tag=N2A441I01HVV type=write size=2645658 2024-09-05T00:56:22.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.461+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=CDO7M6NU8Z06 type=del size=79549 2024-09-05T00:56:22.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.469+0000 7f325adab8c0 1 < suggested update operation key=HW4QK67332RW tag=9URSDOLISS13 type=del size=3309545 2024-09-05T00:56:22.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.473+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~KJTR4BV5W1GF.0 size=667598 2024-09-05T00:56:22.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.473+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=KJTR4BV5W1GF tag=WGAJDQ1UI82M type=write size=1716174 2024-09-05T00:56:22.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.473+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.0 size=1048576 2024-09-05T00:56:22.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.477+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.1 size=1048576 2024-09-05T00:56:22.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.477+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~MVU0Q79RMGKD.2 size=767152 2024-09-05T00:56:22.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.481+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=MVU0Q79RMGKD tag=C8P7N9UPOVO0 type=write size=3912880 2024-09-05T00:56:22.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.485+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~BH06H2CTJQGY.0 size=1048576 2024-09-05T00:56:22.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.489+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~BH06H2CTJQGY.1 size=83301 2024-09-05T00:56:22.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.489+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=BH06H2CTJQGY tag=8K8B6W8F057A type=write size=2180453 2024-09-05T00:56:22.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.493+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=PM01ZAMY6UTE type=del 2024-09-05T00:56:22.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.493+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=SAASF2JM5WJ0 type=del size=3788418 2024-09-05T00:56:22.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.497+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~1MLM30FF534Z.0 size=951652 2024-09-05T00:56:22.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.501+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=1MLM30FF534Z tag=WEAYHB4CU948 type=write size=2000228 2024-09-05T00:56:22.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.505+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~I8307LO15I3L.0 size=126153 2024-09-05T00:56:22.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.505+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=I8307LO15I3L tag=Q2FCOSD12CUH type=write size=1174729 2024-09-05T00:56:22.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.505+0000 7f325adab8c0 1 < canceled operation key=6N7BLJ1WLDGN tag=ODM0ZXUH30DG type=del size=2219425 2024-09-05T00:56:22.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.509+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=BVAGRCV1JRPR type=del size=705314 2024-09-05T00:56:22.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.509+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=9IB6GZK25XJC type=del 2024-09-05T00:56:22.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.513+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=1U3CJFFCZE24 type=del size=1502599 2024-09-05T00:56:22.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.513+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.0 size=1048576 2024-09-05T00:56:22.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.513+0000 7f325adab8c0 1 < canceled part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.1 size=1048576 2024-09-05T00:56:22.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.517+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~HGZOSYSM7V0J.2 size=766100 2024-09-05T00:56:22.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.521+0000 7f325adab8c0 1 < canceled multipart upload key=IGOUBVL3XVS3 upload=HGZOSYSM7V0J tag=IARUS1YDAO13 type=write size=3911828 2024-09-05T00:56:22.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.521+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=W0SYZDS3UEYL type=write size=997653 2024-09-05T00:56:22.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.525+0000 7f325adab8c0 -1 < failed to complete operation key=HW4QK67332RW tag=5WL315B8Y0JB type=del size=407798: (22) Invalid argument 2024-09-05T00:56:22.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.529+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~1CFQMTT7CWX3.0 size=25206 2024-09-05T00:56:22.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.529+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=1CFQMTT7CWX3 tag=NI5PT74DSK2J type=write size=1073782 2024-09-05T00:56:22.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.533+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=4OQ6FNCQB3FX type=del 2024-09-05T00:56:22.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.533+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=1GQQ9BTSBDHM type=del size=998029 2024-09-05T00:56:22.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.537+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.0 size=1048576 2024-09-05T00:56:22.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.537+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.1 size=1048576 2024-09-05T00:56:22.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.541+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~NT319XBODXYI.2 size=262891 2024-09-05T00:56:22.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.545+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=NT319XBODXYI tag=UJR565JPACC5 type=write size=3408619 2024-09-05T00:56:22.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.545+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=HEX17ZV64PLV type=write size=601301 2024-09-05T00:56:22.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.549+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QYJRQASZWHCM.0 size=1048576 2024-09-05T00:56:22.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.549+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QYJRQASZWHCM.1 size=248951 2024-09-05T00:56:22.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.553+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=QYJRQASZWHCM tag=QU405K5Z1KSM type=write size=2346103 2024-09-05T00:56:22.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.561+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KNXP4I1M9JPI.0 size=1048576 2024-09-05T00:56:22.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.565+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KNXP4I1M9JPI.1 size=1027032 2024-09-05T00:56:22.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.565+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=KNXP4I1M9JPI tag=E0C276XVU84U type=write size=3124184 2024-09-05T00:56:22.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.565+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=5IQ6M52ZDEG6 type=del 2024-09-05T00:56:22.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.569+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=S3JN0IB7JZFK type=write size=824527 2024-09-05T00:56:22.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.569+0000 7f325adab8c0 1 < completed write operation key=YMIGZMLJSI4D tag=98VTWTDGRZ6J type=write size=17468 2024-09-05T00:56:22.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.573+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=TE1XXHU07GSE type=del size=3239569 2024-09-05T00:56:22.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.573+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=T66RK90AHAXJ type=del 2024-09-05T00:56:22.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.577+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=ZT44UOWVM2Y0 type=del size=2222998 2024-09-05T00:56:22.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.577+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=FVJRZVOEQ4FA type=del 2024-09-05T00:56:22.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.581+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=0RPCHAU930LS type=del size=2350875 2024-09-05T00:56:22.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.585+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=CDO7M6NU8Z06 type=del 2024-09-05T00:56:22.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.585+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=7LXVQ8HE4OTD type=del size=3198960 2024-09-05T00:56:22.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.589+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~KJTR4BV5W1GF.0 size=667598 2024-09-05T00:56:22.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.593+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=KJTR4BV5W1GF tag=WGAJDQ1UI82M type=write size=1716174 2024-09-05T00:56:22.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.597+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~TX48QAVJC62M.0 size=1048576 2024-09-05T00:56:22.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.601+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~TX48QAVJC62M.1 size=185029 2024-09-05T00:56:22.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.601+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=TX48QAVJC62M tag=FABQZ86JXVHU type=write size=2282181 2024-09-05T00:56:22.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.601+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~BH06H2CTJQGY.0 size=1048576 2024-09-05T00:56:22.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.601+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~BH06H2CTJQGY.1 size=83301 2024-09-05T00:56:22.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.605+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=BH06H2CTJQGY tag=8K8B6W8F057A type=write size=2180453 2024-09-05T00:56:22.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.609+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~9ROKS6CL2SSH.0 size=967939 2024-09-05T00:56:22.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.609+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=9ROKS6CL2SSH tag=BEJ9JLQK7YDA type=write size=2016515 2024-09-05T00:56:22.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.613+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=SAASF2JM5WJ0 type=del 2024-09-05T00:56:22.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.617+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=JBATUWBB2VDN type=del size=3681552 2024-09-05T00:56:22.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.617+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~I8307LO15I3L.0 size=126153 2024-09-05T00:56:22.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.621+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=I8307LO15I3L tag=Q2FCOSD12CUH type=write size=1174729 2024-09-05T00:56:22.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.625+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=AD0RKTOGVASI type=write size=263617 2024-09-05T00:56:22.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.629+0000 7f325adab8c0 1 < suggested remove operation key=CB079FGXKNRO tag=BVAGRCV1JRPR type=del 2024-09-05T00:56:22.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.637+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~GM77N47CF2RX.0 size=186426 2024-09-05T00:56:22.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.637+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=GM77N47CF2RX tag=Q7JDDM0SFQ01 type=write size=1235002 2024-09-05T00:56:22.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.641+0000 7f325adab8c0 1 < suggested update operation key=GU25IIQWQNR2 tag=1U3CJFFCZE24 type=del size=1502599 2024-09-05T00:56:22.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.645+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~KC9J2CJ0S4TF.0 size=74417 2024-09-05T00:56:22.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.645+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=KC9J2CJ0S4TF tag=S7XZUVQ3XWH0 type=write size=1122993 2024-09-05T00:56:22.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.653+0000 7f325adab8c0 1 < suggested update operation key=LVZALGRNP5TU tag=W0SYZDS3UEYL type=write size=997653 2024-09-05T00:56:22.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.653+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=WZ640I4E30BZ type=del size=3970654 2024-09-05T00:56:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.657+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~1CFQMTT7CWX3.0 size=25206 2024-09-05T00:56:22.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.661+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=1CFQMTT7CWX3 tag=NI5PT74DSK2J type=write size=1073782 2024-09-05T00:56:22.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.665+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=0M1WG4E494DN type=write size=1022309 2024-09-05T00:56:22.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.669+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=1GQQ9BTSBDHM type=del 2024-09-05T00:56:22.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.669+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=PW0UL8MJP62D type=write size=431519 2024-09-05T00:56:22.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.673+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=HEX17ZV64PLV type=write size=601301 2024-09-05T00:56:22.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.677+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.0 size=1048576 2024-09-05T00:56:22.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.677+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.1 size=1048576 2024-09-05T00:56:22.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.681+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.2 size=257357 2024-09-05T00:56:22.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.681+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=ZD56ETADW509 tag=9FP7PURB2IVT type=write size=3403085 2024-09-05T00:56:22.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.681+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KNXP4I1M9JPI.0 size=1048576 2024-09-05T00:56:22.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.685+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KNXP4I1M9JPI.1 size=1027032 2024-09-05T00:56:22.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.689+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=KNXP4I1M9JPI tag=E0C276XVU84U type=write size=3124184 2024-09-05T00:56:22.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.693+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=OMXI38XFMRX1 type=del size=3037526 2024-09-05T00:56:22.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.693+0000 7f325adab8c0 1 < completed write operation key=GQB4HOYII01G tag=S3JN0IB7JZFK type=write size=824527 2024-09-05T00:56:22.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.697+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=GR4TCMLH071N type=del size=2377652 2024-09-05T00:56:22.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.701+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=TE1XXHU07GSE type=del 2024-09-05T00:56:22.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.701+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=XZ0BJR91CMSP type=del size=3436107 2024-09-05T00:56:22.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.705+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=ZT44UOWVM2Y0 type=del 2024-09-05T00:56:22.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.709+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~4LX4H6JQXD6Y.0 size=800718 2024-09-05T00:56:22.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.709+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=4LX4H6JQXD6Y tag=5S8PE3POIZ7Q type=write size=1849294 2024-09-05T00:56:22.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.713+0000 7f325adab8c0 -1 < failed to complete operation key=LVZALGRNP5TU tag=0RPCHAU930LS type=del size=2350875: (22) Invalid argument 2024-09-05T00:56:22.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.717+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=A8SXALNAO3AL type=del size=2804491 2024-09-05T00:56:22.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.717+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=7LXVQ8HE4OTD type=del 2024-09-05T00:56:22.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.721+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=P6C8P5SMQ4RQ type=del size=864563 2024-09-05T00:56:22.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.725+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~TX48QAVJC62M.0 size=1048576 2024-09-05T00:56:22.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.725+0000 7f325adab8c0 1 < canceled part key=_multipart_9O7DVR04PCDB.2~TX48QAVJC62M.1 size=185029 2024-09-05T00:56:22.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.729+0000 7f325adab8c0 1 < canceled multipart upload key=9O7DVR04PCDB upload=TX48QAVJC62M tag=FABQZ86JXVHU type=write size=2282181 2024-09-05T00:56:22.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.733+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~HBB0X6E3XVUB.0 size=144779 2024-09-05T00:56:22.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.733+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=HBB0X6E3XVUB tag=GD9F7RBXNKNZ type=write size=1193355 2024-09-05T00:56:22.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.733+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~9ROKS6CL2SSH.0 size=967939 2024-09-05T00:56:22.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.737+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=9ROKS6CL2SSH tag=BEJ9JLQK7YDA type=write size=2016515 2024-09-05T00:56:22.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.745+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.0 size=1048576 2024-09-05T00:56:22.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.745+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.1 size=1048576 2024-09-05T00:56:22.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.749+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.2 size=786720 2024-09-05T00:56:22.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.749+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=0SUSZCN9SFMZ tag=VGDNAETHVM2C type=write size=3932448 2024-09-05T00:56:22.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.749+0000 7f325adab8c0 -1 < failed to complete operation key=GU25IIQWQNR2 tag=JBATUWBB2VDN type=del size=3681552: (22) Invalid argument 2024-09-05T00:56:22.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.753+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.0 size=1048576 2024-09-05T00:56:22.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.757+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.1 size=1048576 2024-09-05T00:56:22.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.757+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.2 size=463840 2024-09-05T00:56:22.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.757+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=DVVU2Q62O3FZ tag=DF4UQU1LU8WC type=write size=3609568 2024-09-05T00:56:22.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.761+0000 7f325adab8c0 1 < completed write operation key=ZYT3WYNFIIZN tag=AD0RKTOGVASI type=write size=263617 2024-09-05T00:56:22.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.765+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=BJ8A3HEFMXGH type=del size=3254932 2024-09-05T00:56:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.765+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~GM77N47CF2RX.0 size=186426 2024-09-05T00:56:22.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.769+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=GM77N47CF2RX tag=Q7JDDM0SFQ01 type=write size=1235002 2024-09-05T00:56:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.773+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~8UP9TFGRL8NS.0 size=23546 2024-09-05T00:56:22.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.773+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=8UP9TFGRL8NS tag=8BEZ5IUDW5D6 type=write size=1072122 2024-09-05T00:56:22.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.777+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~KC9J2CJ0S4TF.0 size=74417 2024-09-05T00:56:22.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.781+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=KC9J2CJ0S4TF tag=S7XZUVQ3XWH0 type=write size=1122993 2024-09-05T00:56:22.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.785+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=XTRF569U1IP3 type=write size=818024 2024-09-05T00:56:22.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.785+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=WZ640I4E30BZ type=del 2024-09-05T00:56:22.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.789+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=A1G50TOPND67 type=write size=59406 2024-09-05T00:56:22.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.793+0000 7f325adab8c0 1 < completed write operation key=MBJLOE5XFPYN tag=0M1WG4E494DN type=write size=1022309 2024-09-05T00:56:22.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.801+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~4ZO0UKGX4CV4.0 size=342348 2024-09-05T00:56:22.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.801+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=4ZO0UKGX4CV4 tag=V0SX450BOT7S type=write size=1390924 2024-09-05T00:56:22.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.801+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=PW0UL8MJP62D type=write size=431519 2024-09-05T00:56:22.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.809+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~J2OEZ3169662.0 size=1048576 2024-09-05T00:56:22.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.809+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~J2OEZ3169662.1 size=1048576 2024-09-05T00:56:22.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.813+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~J2OEZ3169662.2 size=480029 2024-09-05T00:56:22.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.813+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=J2OEZ3169662 tag=ERVUDXFX49IC type=write size=3625757 2024-09-05T00:56:22.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.817+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.0 size=1048576 2024-09-05T00:56:22.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.817+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.1 size=1048576 2024-09-05T00:56:22.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.817+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~ZD56ETADW509.2 size=257357 2024-09-05T00:56:22.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.825+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=ZD56ETADW509 tag=9FP7PURB2IVT type=write size=3403085 2024-09-05T00:56:22.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.829+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~FWJWCHFBHDLP.0 size=1048576 2024-09-05T00:56:22.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.829+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~FWJWCHFBHDLP.1 size=761896 2024-09-05T00:56:22.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.829+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=FWJWCHFBHDLP tag=8VZITI1J0A8J type=write size=2859048 2024-09-05T00:56:22.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.837+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=OMXI38XFMRX1 type=del size=3037526 2024-09-05T00:56:22.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.837+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=G1B8WQZ6Y5P1 type=del size=1732926 2024-09-05T00:56:22.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.841+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=GR4TCMLH071N type=del 2024-09-05T00:56:22.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.845+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=NI0A5RF1LICZ type=del size=1407077 2024-09-05T00:56:22.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.849+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=XZ0BJR91CMSP type=del 2024-09-05T00:56:22.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.853+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=UJOV26KHU03E type=del size=3854277 2024-09-05T00:56:22.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.857+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~4LX4H6JQXD6Y.0 size=800718 2024-09-05T00:56:22.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.861+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=4LX4H6JQXD6Y tag=5S8PE3POIZ7Q type=write size=1849294 2024-09-05T00:56:22.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.865+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~9LGKC2PH2JV3.0 size=1048576 2024-09-05T00:56:22.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.869+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~9LGKC2PH2JV3.1 size=806629 2024-09-05T00:56:22.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.869+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=9LGKC2PH2JV3 tag=6LP1Y0JJ76KH type=write size=2903781 2024-09-05T00:56:22.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.869+0000 7f325adab8c0 1 < canceled operation key=UW0SSQ8VFY1G tag=A8SXALNAO3AL type=del size=2804491 2024-09-05T00:56:22.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.873+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=TZBUIQOWIG7B type=del size=3994606 2024-09-05T00:56:22.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.877+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=P6C8P5SMQ4RQ type=del 2024-09-05T00:56:22.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.877+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=M162AO14SRVG type=write size=781659 2024-09-05T00:56:22.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.877+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~HBB0X6E3XVUB.0 size=144779 2024-09-05T00:56:22.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.885+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=HBB0X6E3XVUB tag=GD9F7RBXNKNZ type=write size=1193355 2024-09-05T00:56:22.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.885+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=VN8LMJ48ESMB type=write size=303370 2024-09-05T00:56:22.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.889+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.0 size=1048576 2024-09-05T00:56:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.889+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.1 size=1048576 2024-09-05T00:56:22.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.893+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~0SUSZCN9SFMZ.2 size=786720 2024-09-05T00:56:22.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.897+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=0SUSZCN9SFMZ tag=VGDNAETHVM2C type=write size=3932448 2024-09-05T00:56:22.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.901+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=MEEGJ32NFUL7 type=del size=2502868 2024-09-05T00:56:22.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.905+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.0 size=1048576 2024-09-05T00:56:22.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.905+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.1 size=1048576 2024-09-05T00:56:22.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.909+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~DVVU2Q62O3FZ.2 size=463840 2024-09-05T00:56:22.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.913+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=DVVU2Q62O3FZ tag=DF4UQU1LU8WC type=write size=3609568 2024-09-05T00:56:22.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.913+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=QY6B2T0LV2J6 type=del size=3696771 2024-09-05T00:56:22.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.917+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=BJ8A3HEFMXGH type=del 2024-09-05T00:56:22.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.921+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~0OXTXOP2XTV1.0 size=1048576 2024-09-05T00:56:22.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.925+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~0OXTXOP2XTV1.1 size=1006548 2024-09-05T00:56:22.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.925+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=0OXTXOP2XTV1 tag=NFXUZ4A3248D type=write size=3103700 2024-09-05T00:56:22.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.929+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~8UP9TFGRL8NS.0 size=23546 2024-09-05T00:56:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.933+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=8UP9TFGRL8NS tag=8BEZ5IUDW5D6 type=write size=1072122 2024-09-05T00:56:22.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.933+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=46UKZOZF2WJH type=del size=1744385 2024-09-05T00:56:22.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.941+0000 7f325adab8c0 1 < suggested remove operation key=06YHJGLZQLK6 tag=XTRF569U1IP3 type=write 2024-09-05T00:56:22.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.941+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=PF61WJOR8ZNN type=write size=796088 2024-09-05T00:56:22.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.945+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=A1G50TOPND67 type=write size=59406 2024-09-05T00:56:22.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.949+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~BMHF4DWH4M7E.0 size=88223 2024-09-05T00:56:22.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.949+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=BMHF4DWH4M7E tag=NHHUFPZQH5RG type=write size=1136799 2024-09-05T00:56:22.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.953+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~4ZO0UKGX4CV4.0 size=342348 2024-09-05T00:56:22.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.957+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=4ZO0UKGX4CV4 tag=V0SX450BOT7S type=write size=1390924 2024-09-05T00:56:22.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.961+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=A398K9BFW1MV type=del size=2694746 2024-09-05T00:56:22.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.961+0000 7f325adab8c0 1 < canceled part key=_multipart_G600UT533GTT.2~J2OEZ3169662.0 size=1048576 2024-09-05T00:56:22.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.965+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~J2OEZ3169662.1 size=1048576 2024-09-05T00:56:22.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.965+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~J2OEZ3169662.2 size=480029 2024-09-05T00:56:22.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.973+0000 7f325adab8c0 1 < canceled multipart upload key=G600UT533GTT upload=J2OEZ3169662 tag=ERVUDXFX49IC type=write size=3625757 2024-09-05T00:56:22.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.973+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=2G2E7ZP9NIZT type=del size=2345873 2024-09-05T00:56:22.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.977+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~FWJWCHFBHDLP.0 size=1048576 2024-09-05T00:56:22.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.977+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~FWJWCHFBHDLP.1 size=761896 2024-09-05T00:56:22.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.981+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=FWJWCHFBHDLP tag=8VZITI1J0A8J type=write size=2859048 2024-09-05T00:56:22.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.985+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=E8K4KALFH3VH type=del size=3936102 2024-09-05T00:56:22.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.989+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=G1B8WQZ6Y5P1 type=del 2024-09-05T00:56:22.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.989+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=GH4GB32YDXBR type=del size=606301 2024-09-05T00:56:22.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.993+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=NI0A5RF1LICZ type=del 2024-09-05T00:56:22.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.997+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=R18XTGST3VFE type=del size=213451 2024-09-05T00:56:23.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:22.997+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=UJOV26KHU03E type=del 2024-09-05T00:56:23.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.001+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=NUK424L3HZY9 type=del size=21658 2024-09-05T00:56:23.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.005+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~9LGKC2PH2JV3.0 size=1048576 2024-09-05T00:56:23.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.005+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~9LGKC2PH2JV3.1 size=806629 2024-09-05T00:56:23.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.009+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=9LGKC2PH2JV3 tag=6LP1Y0JJ76KH type=write size=2903781 2024-09-05T00:56:23.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.013+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=DIG302TZU4YB type=del size=2114087 2024-09-05T00:56:23.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.017+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=TZBUIQOWIG7B type=del 2024-09-05T00:56:23.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.021+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=B3JF69617S2T type=del size=1643366 2024-09-05T00:56:23.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.025+0000 7f325adab8c0 1 < suggested remove operation key=GU25IIQWQNR2 tag=M162AO14SRVG type=write 2024-09-05T00:56:23.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.029+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=L2EE6H38YXS2 type=del size=1461330 2024-09-05T00:56:23.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.033+0000 7f325adab8c0 1 < suggested remove operation key=A9WMRV5QZ2FP tag=VN8LMJ48ESMB type=write 2024-09-05T00:56:23.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.037+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=2VKLHGTWPQA8 type=del size=2301830 2024-09-05T00:56:23.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.037+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=MEEGJ32NFUL7 type=del 2024-09-05T00:56:23.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.041+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=DHPIXDH5O2W1 type=del size=1697691 2024-09-05T00:56:23.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.045+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=QY6B2T0LV2J6 type=del 2024-09-05T00:56:23.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.049+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~MF3WZ0WKFBWY.0 size=1048576 2024-09-05T00:56:23.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.053+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~MF3WZ0WKFBWY.1 size=61780 2024-09-05T00:56:23.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.053+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=MF3WZ0WKFBWY tag=0ZT0TOOCRSWG type=write size=2158932 2024-09-05T00:56:23.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.053+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~0OXTXOP2XTV1.0 size=1048576 2024-09-05T00:56:23.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.061+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~0OXTXOP2XTV1.1 size=1006548 2024-09-05T00:56:23.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.065+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=0OXTXOP2XTV1 tag=NFXUZ4A3248D type=write size=3103700 2024-09-05T00:56:23.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.069+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=SR7Q9HB550GR type=write size=111609 2024-09-05T00:56:23.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.073+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=46UKZOZF2WJH type=del 2024-09-05T00:56:23.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.077+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~BP5YV5M0NMWH.0 size=1048576 2024-09-05T00:56:23.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.081+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~BP5YV5M0NMWH.1 size=50887 2024-09-05T00:56:23.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.081+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=BP5YV5M0NMWH tag=17WCTY6JXK5X type=write size=2148039 2024-09-05T00:56:23.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.081+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=PF61WJOR8ZNN type=write size=796088 2024-09-05T00:56:23.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.085+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=WFWJHK2POGJK type=write size=492619 2024-09-05T00:56:23.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.089+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~BMHF4DWH4M7E.0 size=88223 2024-09-05T00:56:23.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.093+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=BMHF4DWH4M7E tag=NHHUFPZQH5RG type=write size=1136799 2024-09-05T00:56:23.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.097+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=BJ1PASGH5SUL type=del size=2888546 2024-09-05T00:56:23.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.097+0000 7f325adab8c0 1 < canceled operation key=ZYT3WYNFIIZN tag=A398K9BFW1MV type=del size=2694746 2024-09-05T00:56:23.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.105+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~2M701270Y54O.0 size=1048576 2024-09-05T00:56:23.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.105+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~2M701270Y54O.1 size=195961 2024-09-05T00:56:23.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.105+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=2M701270Y54O tag=QOK8JZS0LPLG type=write size=2293113 2024-09-05T00:56:23.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.109+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=2G2E7ZP9NIZT type=del 2024-09-05T00:56:23.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.113+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~59AIS3CQBM4G.0 size=24727 2024-09-05T00:56:23.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.113+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=59AIS3CQBM4G tag=QTCLJSXKDT0G type=write size=1073303 2024-09-05T00:56:23.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.117+0000 7f325adab8c0 -1 < failed to complete operation key=GU25IIQWQNR2 tag=E8K4KALFH3VH type=del size=3936102: (22) Invalid argument 2024-09-05T00:56:23.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.121+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.0 size=1048576 2024-09-05T00:56:23.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.125+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.1 size=1048576 2024-09-05T00:56:23.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.125+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.2 size=808379 2024-09-05T00:56:23.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.125+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=8UR2WT0AYC61 tag=9P1D0Z1B2WHE type=write size=3954107 2024-09-05T00:56:23.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.129+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=GH4GB32YDXBR type=del 2024-09-05T00:56:23.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.133+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.0 size=1048576 2024-09-05T00:56:23.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.137+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.1 size=1048576 2024-09-05T00:56:23.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.137+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.2 size=140106 2024-09-05T00:56:23.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.137+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=AQLIMV85HLV7 tag=7FCU1ZOCT9E4 type=write size=3285834 2024-09-05T00:56:23.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.141+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=R18XTGST3VFE type=del 2024-09-05T00:56:23.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.145+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~GPTTG5U0FGX3.0 size=1048576 2024-09-05T00:56:23.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.149+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~GPTTG5U0FGX3.1 size=777912 2024-09-05T00:56:23.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.149+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=GPTTG5U0FGX3 tag=S4K2LTOND48T type=write size=2875064 2024-09-05T00:56:23.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.157+0000 7f325adab8c0 1 < suggested update operation key=O0RSK2S88XHP tag=NUK424L3HZY9 type=del size=21658 2024-09-05T00:56:23.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.161+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~5PRGELJP6TRV.0 size=608360 2024-09-05T00:56:23.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.161+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=5PRGELJP6TRV tag=VWLVENGYPJR2 type=write size=1656936 2024-09-05T00:56:23.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.165+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=DIG302TZU4YB type=del 2024-09-05T00:56:23.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.169+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=U0OOIYXJDS8U type=del size=3075261 2024-09-05T00:56:23.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.169+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=B3JF69617S2T type=del 2024-09-05T00:56:23.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.173+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=4FJHBH1TJZJ5 type=del size=3430711 2024-09-05T00:56:23.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.177+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=L2EE6H38YXS2 type=del 2024-09-05T00:56:23.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.181+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.0 size=1048576 2024-09-05T00:56:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.185+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.1 size=1048576 2024-09-05T00:56:23.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.189+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.2 size=152828 2024-09-05T00:56:23.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.189+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=9IFWBFXTGAO3 tag=12H4BUABJFTW type=write size=3298556 2024-09-05T00:56:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.189+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=2VKLHGTWPQA8 type=del 2024-09-05T00:56:23.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.197+0000 7f325adab8c0 1 > prepared part key=_multipart_XKOECM0CCOKX.2~668IH0KGUTB7.0 size=762108 2024-09-05T00:56:23.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.197+0000 7f325adab8c0 1 > prepared multipart upload key=XKOECM0CCOKX upload=668IH0KGUTB7 tag=2DTHQOXO9RLF type=write size=1810684 2024-09-05T00:56:23.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.197+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=DHPIXDH5O2W1 type=del 2024-09-05T00:56:23.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.201+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~RAB2VNV347AU.0 size=1048576 2024-09-05T00:56:23.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.205+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~RAB2VNV347AU.1 size=784385 2024-09-05T00:56:23.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.205+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=RAB2VNV347AU tag=JX9H9D28M4WS type=write size=2881537 2024-09-05T00:56:23.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.205+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~MF3WZ0WKFBWY.0 size=1048576 2024-09-05T00:56:23.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.209+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~MF3WZ0WKFBWY.1 size=61780 2024-09-05T00:56:23.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.213+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=MF3WZ0WKFBWY tag=0ZT0TOOCRSWG type=write size=2158932 2024-09-05T00:56:23.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.217+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=0HB8CLXT45ZY type=del size=171491 2024-09-05T00:56:23.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.217+0000 7f325adab8c0 1 < completed write operation key=G600UT533GTT tag=SR7Q9HB550GR type=write size=111609 2024-09-05T00:56:23.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.221+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=F2HAC4PRF5VF type=del size=2426813 2024-09-05T00:56:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.225+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~BP5YV5M0NMWH.0 size=1048576 2024-09-05T00:56:23.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.225+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~BP5YV5M0NMWH.1 size=50887 2024-09-05T00:56:23.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.229+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=BP5YV5M0NMWH tag=17WCTY6JXK5X type=write size=2148039 2024-09-05T00:56:23.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.233+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~XOPAWN7R9QMX.0 size=1048576 2024-09-05T00:56:23.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.237+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~XOPAWN7R9QMX.1 size=656320 2024-09-05T00:56:23.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.237+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=XOPAWN7R9QMX tag=YTEMOQHRG1LS type=write size=2753472 2024-09-05T00:56:23.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.241+0000 7f325adab8c0 1 < completed write operation key=A9WMRV5QZ2FP tag=WFWJHK2POGJK type=write size=492619 2024-09-05T00:56:23.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.245+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ZQ5BGBNRPUI7.0 size=696608 2024-09-05T00:56:23.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.245+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=ZQ5BGBNRPUI7 tag=OWOEVUQNCDVN type=write size=1745184 2024-09-05T00:56:23.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.249+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=BJ1PASGH5SUL type=del 2024-09-05T00:56:23.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.253+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.0 size=1048576 2024-09-05T00:56:23.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.253+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.1 size=1048576 2024-09-05T00:56:23.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.257+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.2 size=394820 2024-09-05T00:56:23.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.257+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=EYC6X14YHND4 tag=0L1JM0QW9DXX type=write size=3540548 2024-09-05T00:56:23.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.261+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~2M701270Y54O.0 size=1048576 2024-09-05T00:56:23.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.261+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~2M701270Y54O.1 size=195961 2024-09-05T00:56:23.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.265+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=2M701270Y54O tag=QOK8JZS0LPLG type=write size=2293113 2024-09-05T00:56:23.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.269+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~4KLMW8JM858R.0 size=1048576 2024-09-05T00:56:23.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.273+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~4KLMW8JM858R.1 size=412659 2024-09-05T00:56:23.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.273+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=4KLMW8JM858R tag=5T9FY92Q2IYG type=write size=2509811 2024-09-05T00:56:23.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.277+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~59AIS3CQBM4G.0 size=24727 2024-09-05T00:56:23.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.281+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=59AIS3CQBM4G tag=QTCLJSXKDT0G type=write size=1073303 2024-09-05T00:56:23.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.285+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=32HAX4DGWULA type=del size=3057921 2024-09-05T00:56:23.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.285+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.0 size=1048576 2024-09-05T00:56:23.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.289+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.1 size=1048576 2024-09-05T00:56:23.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.289+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~8UR2WT0AYC61.2 size=808379 2024-09-05T00:56:23.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.293+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=8UR2WT0AYC61 tag=9P1D0Z1B2WHE type=write size=3954107 2024-09-05T00:56:23.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.297+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=ODBB7ZNMYWLB type=write size=524635 2024-09-05T00:56:23.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.301+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.0 size=1048576 2024-09-05T00:56:23.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.301+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.1 size=1048576 2024-09-05T00:56:23.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.305+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~AQLIMV85HLV7.2 size=140106 2024-09-05T00:56:23.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.309+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=AQLIMV85HLV7 tag=7FCU1ZOCT9E4 type=write size=3285834 2024-09-05T00:56:23.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.313+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~9QNFM4SC4E8U.0 size=404805 2024-09-05T00:56:23.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.313+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=9QNFM4SC4E8U tag=PBEM1KSHFPC0 type=write size=1453381 2024-09-05T00:56:23.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.321+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~GPTTG5U0FGX3.0 size=1048576 2024-09-05T00:56:23.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.325+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~GPTTG5U0FGX3.1 size=777912 2024-09-05T00:56:23.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.329+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=GPTTG5U0FGX3 tag=S4K2LTOND48T type=write size=2875064 2024-09-05T00:56:23.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.333+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HW0BS1IUSH66.0 size=219479 2024-09-05T00:56:23.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.333+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=HW0BS1IUSH66 tag=U9EWKZKAXSVG type=write size=1268055 2024-09-05T00:56:23.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.337+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~5PRGELJP6TRV.0 size=608360 2024-09-05T00:56:23.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.341+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=5PRGELJP6TRV tag=VWLVENGYPJR2 type=write size=1656936 2024-09-05T00:56:23.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.341+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=G9ZZ2X3HTHMF type=del size=735764 2024-09-05T00:56:23.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.345+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=U0OOIYXJDS8U type=del 2024-09-05T00:56:23.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.349+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=EPJD7FB7YELT type=del size=1280789 2024-09-05T00:56:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.353+0000 7f325adab8c0 1 < suggested remove operation key=J9UIQE3CKYHM tag=4FJHBH1TJZJ5 type=del 2024-09-05T00:56:23.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.357+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~0Y89O9ISF7I4.0 size=872201 2024-09-05T00:56:23.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.357+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=0Y89O9ISF7I4 tag=EDAOHVORIOOL type=write size=1920777 2024-09-05T00:56:23.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.361+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.0 size=1048576 2024-09-05T00:56:23.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.361+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.1 size=1048576 2024-09-05T00:56:23.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.365+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~9IFWBFXTGAO3.2 size=152828 2024-09-05T00:56:23.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.369+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=9IFWBFXTGAO3 tag=12H4BUABJFTW type=write size=3298556 2024-09-05T00:56:23.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.369+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=E3RO7G46NA0J type=del size=3678329 2024-09-05T00:56:23.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.373+0000 7f325adab8c0 1 < completed part key=_multipart_XKOECM0CCOKX.2~668IH0KGUTB7.0 size=762108 2024-09-05T00:56:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.377+0000 7f325adab8c0 1 < completed multipart upload key=XKOECM0CCOKX upload=668IH0KGUTB7 tag=2DTHQOXO9RLF type=write size=1810684 2024-09-05T00:56:23.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.381+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~G7W3T3793UE4.0 size=952056 2024-09-05T00:56:23.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.381+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=G7W3T3793UE4 tag=5KDPSN9YWKBZ type=write size=2000632 2024-09-05T00:56:23.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.381+0000 7f325adab8c0 1 < canceled part key=_multipart_NIAW4BKW21LG.2~RAB2VNV347AU.0 size=1048576 2024-09-05T00:56:23.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.385+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~RAB2VNV347AU.1 size=784385 2024-09-05T00:56:23.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.389+0000 7f325adab8c0 1 < canceled multipart upload key=NIAW4BKW21LG upload=RAB2VNV347AU tag=JX9H9D28M4WS type=write size=2881537 2024-09-05T00:56:23.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.389+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=XTXKDV01BKRX type=del size=3443342 2024-09-05T00:56:23.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.393+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=0HB8CLXT45ZY type=del 2024-09-05T00:56:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.397+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.0 size=1048576 2024-09-05T00:56:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.401+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.1 size=1048576 2024-09-05T00:56:23.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.401+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.2 size=178290 2024-09-05T00:56:23.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.401+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=S2DIE2IXEV32 tag=70TVZDCEKEP3 type=write size=3324018 2024-09-05T00:56:23.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.405+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=F2HAC4PRF5VF type=del 2024-09-05T00:56:23.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.409+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=3IPI2U4XG13D type=write size=965822 2024-09-05T00:56:23.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.409+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~XOPAWN7R9QMX.0 size=1048576 2024-09-05T00:56:23.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.413+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~XOPAWN7R9QMX.1 size=656320 2024-09-05T00:56:23.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.417+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=XOPAWN7R9QMX tag=YTEMOQHRG1LS type=write size=2753472 2024-09-05T00:56:23.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.421+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~YTHGAFQIUTDE.0 size=1048576 2024-09-05T00:56:23.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.425+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~YTHGAFQIUTDE.1 size=250675 2024-09-05T00:56:23.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.425+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=YTHGAFQIUTDE tag=706DMBJOS149 type=write size=2347827 2024-09-05T00:56:23.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.425+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~ZQ5BGBNRPUI7.0 size=696608 2024-09-05T00:56:23.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.433+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=ZQ5BGBNRPUI7 tag=OWOEVUQNCDVN type=write size=1745184 2024-09-05T00:56:23.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.437+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~JULLSHVN8BKC.0 size=1048576 2024-09-05T00:56:23.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.437+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~JULLSHVN8BKC.1 size=875462 2024-09-05T00:56:23.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.437+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=JULLSHVN8BKC tag=QL6LU2HHKBVX type=write size=2972614 2024-09-05T00:56:23.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.441+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.0 size=1048576 2024-09-05T00:56:23.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.441+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.1 size=1048576 2024-09-05T00:56:23.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.441+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~EYC6X14YHND4.2 size=394820 2024-09-05T00:56:23.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.445+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=EYC6X14YHND4 tag=0L1JM0QW9DXX type=write size=3540548 2024-09-05T00:56:23.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.449+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=43ILGQT8E35S type=del size=176830 2024-09-05T00:56:23.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.453+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~4KLMW8JM858R.0 size=1048576 2024-09-05T00:56:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.453+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~4KLMW8JM858R.1 size=412659 2024-09-05T00:56:23.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.457+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=4KLMW8JM858R tag=5T9FY92Q2IYG type=write size=2509811 2024-09-05T00:56:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.461+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~4ZQIFKXU0Q7V.0 size=1048576 2024-09-05T00:56:23.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.465+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~4ZQIFKXU0Q7V.1 size=762890 2024-09-05T00:56:23.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.465+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=4ZQIFKXU0Q7V tag=08YRIH5320PY type=write size=2860042 2024-09-05T00:56:23.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.469+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=32HAX4DGWULA type=del size=3057921 2024-09-05T00:56:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.473+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~L6M9Z6GBN5ZG.0 size=1048576 2024-09-05T00:56:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.473+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~L6M9Z6GBN5ZG.1 size=604049 2024-09-05T00:56:23.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.473+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=L6M9Z6GBN5ZG tag=3VOQ397IA5OD type=write size=2701201 2024-09-05T00:56:23.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.477+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=ODBB7ZNMYWLB type=write size=524635 2024-09-05T00:56:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.481+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=9J0PGVMK6QOU type=write size=59857 2024-09-05T00:56:23.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.485+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~9QNFM4SC4E8U.0 size=404805 2024-09-05T00:56:23.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.489+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=9QNFM4SC4E8U tag=PBEM1KSHFPC0 type=write size=1453381 2024-09-05T00:56:23.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.493+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=WJY3OS9WNU8L type=del size=1476404 2024-09-05T00:56:23.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.493+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HW0BS1IUSH66.0 size=219479 2024-09-05T00:56:23.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.501+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=HW0BS1IUSH66 tag=U9EWKZKAXSVG type=write size=1268055 2024-09-05T00:56:23.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.505+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=D216QH3XDKKP type=del size=737673 2024-09-05T00:56:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.509+0000 7f325adab8c0 1 < suggested update operation key=LVZALGRNP5TU tag=G9ZZ2X3HTHMF type=del size=735764 2024-09-05T00:56:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.513+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=J5AB9LJC56EN type=del size=1917067 2024-09-05T00:56:23.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.517+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=EPJD7FB7YELT type=del 2024-09-05T00:56:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.517+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=JRO3MPEVPQFA type=del size=2173126 2024-09-05T00:56:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.521+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~0Y89O9ISF7I4.0 size=872201 2024-09-05T00:56:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.525+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=0Y89O9ISF7I4 tag=EDAOHVORIOOL type=write size=1920777 2024-09-05T00:56:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.533+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~Y3KNDHSU23T5.0 size=415688 2024-09-05T00:56:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.533+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=Y3KNDHSU23T5 tag=NW4RSVVP5TWG type=write size=1464264 2024-09-05T00:56:23.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.533+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=E3RO7G46NA0J type=del 2024-09-05T00:56:23.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.537+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=4CK7Q12TAPID type=del size=3411192 2024-09-05T00:56:23.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.541+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~G7W3T3793UE4.0 size=952056 2024-09-05T00:56:23.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.545+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=G7W3T3793UE4 tag=5KDPSN9YWKBZ type=write size=2000632 2024-09-05T00:56:23.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.549+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=44GIKIHCXFYR type=del size=2811544 2024-09-05T00:56:23.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.553+0000 7f325adab8c0 1 < suggested update operation key=SP188HM5LG2D tag=XTXKDV01BKRX type=del size=3443342 2024-09-05T00:56:23.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.557+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.0 size=1048576 2024-09-05T00:56:23.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.561+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.1 size=1048576 2024-09-05T00:56:23.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.561+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.2 size=442692 2024-09-05T00:56:23.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.561+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=PVROKPM90NOL tag=A8MOBTQCD46Q type=write size=3588420 2024-09-05T00:56:23.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.565+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.0 size=1048576 2024-09-05T00:56:23.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.565+0000 7f325adab8c0 1 < canceled part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.1 size=1048576 2024-09-05T00:56:23.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.565+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~S2DIE2IXEV32.2 size=178290 2024-09-05T00:56:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.573+0000 7f325adab8c0 1 < canceled multipart upload key=5WOUI4SHYTSS upload=S2DIE2IXEV32 tag=70TVZDCEKEP3 type=write size=3324018 2024-09-05T00:56:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.577+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=F60A8CUUX3MP type=del size=734487 2024-09-05T00:56:23.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.581+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=3IPI2U4XG13D type=write size=965822 2024-09-05T00:56:23.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.585+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~19XKJ1FORBGM.0 size=228025 2024-09-05T00:56:23.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.585+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=19XKJ1FORBGM tag=1SW1L1LAB5C0 type=write size=1276601 2024-09-05T00:56:23.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.589+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~YTHGAFQIUTDE.0 size=1048576 2024-09-05T00:56:23.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.589+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~YTHGAFQIUTDE.1 size=250675 2024-09-05T00:56:23.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.593+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=YTHGAFQIUTDE tag=706DMBJOS149 type=write size=2347827 2024-09-05T00:56:23.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.597+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=B38TZOR6QBWX type=del size=907761 2024-09-05T00:56:23.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.601+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~JULLSHVN8BKC.0 size=1048576 2024-09-05T00:56:23.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.601+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~JULLSHVN8BKC.1 size=875462 2024-09-05T00:56:23.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.605+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=JULLSHVN8BKC tag=QL6LU2HHKBVX type=write size=2972614 2024-09-05T00:56:23.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.609+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=198BLHEI8JIP type=write size=912215 2024-09-05T00:56:23.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.613+0000 7f325adab8c0 1 < suggested update operation key=71FWV15GD1QZ tag=43ILGQT8E35S type=del size=176830 2024-09-05T00:56:23.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.617+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=U8C8PPWD5FJ3 type=del size=1847349 2024-09-05T00:56:23.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.617+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~4ZQIFKXU0Q7V.0 size=1048576 2024-09-05T00:56:23.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.621+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~4ZQIFKXU0Q7V.1 size=762890 2024-09-05T00:56:23.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.625+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=4ZQIFKXU0Q7V tag=08YRIH5320PY type=write size=2860042 2024-09-05T00:56:23.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.629+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~VLT2CQX2HZD0.0 size=417396 2024-09-05T00:56:23.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.629+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=VLT2CQX2HZD0 tag=UX1EJG8HVTKG type=write size=1465972 2024-09-05T00:56:23.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.633+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~L6M9Z6GBN5ZG.0 size=1048576 2024-09-05T00:56:23.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.633+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~L6M9Z6GBN5ZG.1 size=604049 2024-09-05T00:56:23.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.637+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=L6M9Z6GBN5ZG tag=3VOQ397IA5OD type=write size=2701201 2024-09-05T00:56:23.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.641+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=NV7S5B6WU4SZ type=write size=590513 2024-09-05T00:56:23.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.641+0000 7f325adab8c0 1 < completed write operation key=VYMRZPO6VKGS tag=9J0PGVMK6QOU type=write size=59857 2024-09-05T00:56:23.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.645+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~0C7FNYBO88DM.0 size=332865 2024-09-05T00:56:23.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.645+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=0C7FNYBO88DM tag=3LQ2JTZ8B2C3 type=write size=1381441 2024-09-05T00:56:23.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.649+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=WJY3OS9WNU8L type=del 2024-09-05T00:56:23.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.653+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~4RGSJ1B9A9UK.0 size=500512 2024-09-05T00:56:23.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.653+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=4RGSJ1B9A9UK tag=MGGKIXBV71LH type=write size=1549088 2024-09-05T00:56:23.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.657+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=D216QH3XDKKP type=del 2024-09-05T00:56:23.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.661+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=X1CF47CHR3PC type=write size=806971 2024-09-05T00:56:23.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.665+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=J5AB9LJC56EN type=del 2024-09-05T00:56:23.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.669+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=QNYLMCX7L2RI type=write size=697631 2024-09-05T00:56:23.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.669+0000 7f325adab8c0 1 < canceled operation key=GQB4HOYII01G tag=JRO3MPEVPQFA type=del size=2173126 2024-09-05T00:56:23.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.673+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=CTQIB1YS725H type=del size=251581 2024-09-05T00:56:23.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.677+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~Y3KNDHSU23T5.0 size=415688 2024-09-05T00:56:23.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.681+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=Y3KNDHSU23T5 tag=NW4RSVVP5TWG type=write size=1464264 2024-09-05T00:56:23.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.685+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.0 size=1048576 2024-09-05T00:56:23.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.689+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.1 size=1048576 2024-09-05T00:56:23.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.689+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.2 size=727802 2024-09-05T00:56:23.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.689+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=KBV0IHS4U0L3 tag=1GPA28GELPSM type=write size=3873530 2024-09-05T00:56:23.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.693+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=4CK7Q12TAPID type=del 2024-09-05T00:56:23.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.693+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=61WMZJGF4D8D type=del size=3851407 2024-09-05T00:56:23.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.697+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=44GIKIHCXFYR type=del 2024-09-05T00:56:23.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.701+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~R5LBIB8HVXN1.0 size=1048576 2024-09-05T00:56:23.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.705+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~R5LBIB8HVXN1.1 size=124579 2024-09-05T00:56:23.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.705+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=R5LBIB8HVXN1 tag=MS85WUO85D8D type=write size=2221731 2024-09-05T00:56:23.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.705+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.0 size=1048576 2024-09-05T00:56:23.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.705+0000 7f325adab8c0 1 < canceled part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.1 size=1048576 2024-09-05T00:56:23.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.709+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~PVROKPM90NOL.2 size=442692 2024-09-05T00:56:23.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.713+0000 7f325adab8c0 1 < canceled multipart upload key=JKRZR0KRE93F upload=PVROKPM90NOL tag=A8MOBTQCD46Q type=write size=3588420 2024-09-05T00:56:23.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.717+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=JH3XK7DBYRKW type=del size=2835352 2024-09-05T00:56:23.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.721+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=F60A8CUUX3MP type=del 2024-09-05T00:56:23.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.721+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=U6KR6F5TWSAQ type=del size=747133 2024-09-05T00:56:23.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.725+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~19XKJ1FORBGM.0 size=228025 2024-09-05T00:56:23.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.729+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=19XKJ1FORBGM tag=1SW1L1LAB5C0 type=write size=1276601 2024-09-05T00:56:23.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.737+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~1A3M4ABNK6Y3.0 size=1048576 2024-09-05T00:56:23.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.737+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~1A3M4ABNK6Y3.1 size=741012 2024-09-05T00:56:23.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.737+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=1A3M4ABNK6Y3 tag=72I2IXHEQTFT type=write size=2838164 2024-09-05T00:56:23.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.741+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=B38TZOR6QBWX type=del 2024-09-05T00:56:23.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.745+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=F2WRLVA8NC1W type=del size=485674 2024-09-05T00:56:23.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.745+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=198BLHEI8JIP type=write size=912215 2024-09-05T00:56:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.749+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=1YX57M71A155 type=write size=35291 2024-09-05T00:56:23.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.753+0000 7f325adab8c0 1 < suggested update operation key=079QFDETDGGC tag=U8C8PPWD5FJ3 type=del size=1847349 2024-09-05T00:56:23.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.757+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=O2ESRQH0ZBXI type=write size=901016 2024-09-05T00:56:23.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.761+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~VLT2CQX2HZD0.0 size=417396 2024-09-05T00:56:23.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.765+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=VLT2CQX2HZD0 tag=UX1EJG8HVTKG type=write size=1465972 2024-09-05T00:56:23.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.769+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=DSVSN2B7EKEO type=del size=3885908 2024-09-05T00:56:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.773+0000 7f325adab8c0 1 < completed write operation key=YMIGZMLJSI4D tag=NV7S5B6WU4SZ type=write size=590513 2024-09-05T00:56:23.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.777+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.0 size=1048576 2024-09-05T00:56:23.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.781+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.1 size=1048576 2024-09-05T00:56:23.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.781+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.2 size=179524 2024-09-05T00:56:23.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.781+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=BPS6LUXHFN7Z tag=RR9MHX85U80J type=write size=3325252 2024-09-05T00:56:23.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.785+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~0C7FNYBO88DM.0 size=332865 2024-09-05T00:56:23.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.789+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=0C7FNYBO88DM tag=3LQ2JTZ8B2C3 type=write size=1381441 2024-09-05T00:56:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.793+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=73YUF292T0E9 type=del size=2894779 2024-09-05T00:56:23.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.793+0000 7f325adab8c0 1 < canceled part key=_multipart_HW4QK67332RW.2~4RGSJ1B9A9UK.0 size=500512 2024-09-05T00:56:23.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.801+0000 7f325adab8c0 1 < canceled multipart upload key=HW4QK67332RW upload=4RGSJ1B9A9UK tag=MGGKIXBV71LH type=write size=1549088 2024-09-05T00:56:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.801+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=73NZX43303IV type=del size=1823819 2024-09-05T00:56:23.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.805+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=X1CF47CHR3PC type=write size=806971 2024-09-05T00:56:23.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.809+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~D8SXCNG0YT5L.0 size=730883 2024-09-05T00:56:23.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.809+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=D8SXCNG0YT5L tag=TZ7AJN9WC0QA type=write size=1779459 2024-09-05T00:56:23.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.813+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=QNYLMCX7L2RI type=write size=697631 2024-09-05T00:56:23.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.817+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=L191VSK158DR type=write size=789380 2024-09-05T00:56:23.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.821+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=CTQIB1YS725H type=del 2024-09-05T00:56:23.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.825+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~90SVQ97HZDSU.0 size=289304 2024-09-05T00:56:23.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.825+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=90SVQ97HZDSU tag=PG9Q0EACW0D9 type=write size=1337880 2024-09-05T00:56:23.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.829+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.0 size=1048576 2024-09-05T00:56:23.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.833+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.1 size=1048576 2024-09-05T00:56:23.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.833+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~KBV0IHS4U0L3.2 size=727802 2024-09-05T00:56:23.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.837+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=KBV0IHS4U0L3 tag=1GPA28GELPSM type=write size=3873530 2024-09-05T00:56:23.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.841+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=HX51J9EN6HMS type=del size=532138 2024-09-05T00:56:23.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.849+0000 7f325adab8c0 1 < suggested update operation key=YMIGZMLJSI4D tag=61WMZJGF4D8D type=del size=3851407 2024-09-05T00:56:23.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.853+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~FZQYZT1Z6QMQ.0 size=1048576 2024-09-05T00:56:23.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.853+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~FZQYZT1Z6QMQ.1 size=243266 2024-09-05T00:56:23.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.853+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=FZQYZT1Z6QMQ tag=Q27NWP7RSCNN type=write size=2340418 2024-09-05T00:56:23.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.857+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~R5LBIB8HVXN1.0 size=1048576 2024-09-05T00:56:23.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.861+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~R5LBIB8HVXN1.1 size=124579 2024-09-05T00:56:23.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.865+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=R5LBIB8HVXN1 tag=MS85WUO85D8D type=write size=2221731 2024-09-05T00:56:23.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.869+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.0 size=1048576 2024-09-05T00:56:23.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.869+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.1 size=1048576 2024-09-05T00:56:23.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.873+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.2 size=869051 2024-09-05T00:56:23.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.873+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=XKY0E034LVGF tag=BT5TV11MLAK0 type=write size=4014779 2024-09-05T00:56:23.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.877+0000 7f325adab8c0 1 < suggested remove operation key=5WOUI4SHYTSS tag=JH3XK7DBYRKW type=del 2024-09-05T00:56:23.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.881+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=AEYQ2SPR5WZN type=del size=3362103 2024-09-05T00:56:23.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.885+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=U6KR6F5TWSAQ type=del 2024-09-05T00:56:23.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.885+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=K53OZ9HMVEE7 type=del size=844509 2024-09-05T00:56:23.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.889+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~1A3M4ABNK6Y3.0 size=1048576 2024-09-05T00:56:23.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.893+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~1A3M4ABNK6Y3.1 size=741012 2024-09-05T00:56:23.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.897+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=1A3M4ABNK6Y3 tag=72I2IXHEQTFT type=write size=2838164 2024-09-05T00:56:23.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.897+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=OWY87U0XCLEL type=del size=1572264 2024-09-05T00:56:23.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.901+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=F2WRLVA8NC1W type=del 2024-09-05T00:56:23.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.905+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=DFUJZGLCPO3L type=del size=1543965 2024-09-05T00:56:23.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.905+0000 7f325adab8c0 1 < completed write operation key=NIAW4BKW21LG tag=1YX57M71A155 type=write size=35291 2024-09-05T00:56:23.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.909+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=NHDY07FZWE5I type=del size=54890 2024-09-05T00:56:23.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.913+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=O2ESRQH0ZBXI type=write size=901016 2024-09-05T00:56:23.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.913+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=0MK2FJHO0KXO type=del size=381318 2024-09-05T00:56:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.917+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=DSVSN2B7EKEO type=del 2024-09-05T00:56:23.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.921+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=WZYA9CUVVZVK type=del size=784021 2024-09-05T00:56:23.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.921+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.0 size=1048576 2024-09-05T00:56:23.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.925+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.1 size=1048576 2024-09-05T00:56:23.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.925+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~BPS6LUXHFN7Z.2 size=179524 2024-09-05T00:56:23.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.929+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=BPS6LUXHFN7Z tag=RR9MHX85U80J type=write size=3325252 2024-09-05T00:56:23.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.933+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.0 size=1048576 2024-09-05T00:56:23.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.937+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.1 size=1048576 2024-09-05T00:56:23.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.937+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.2 size=625738 2024-09-05T00:56:23.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.937+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=H7VT0WVVYI8H tag=8PNUFRSW0NWQ type=write size=3771466 2024-09-05T00:56:23.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.945+0000 7f325adab8c0 1 < suggested update operation key=IGOUBVL3XVS3 tag=73YUF292T0E9 type=del size=2894779 2024-09-05T00:56:23.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.945+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=P6PML8U4I6ND type=del size=1553336 2024-09-05T00:56:23.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.953+0000 7f325adab8c0 1 < suggested remove operation key=GF6OC9O60D5E tag=73NZX43303IV type=del 2024-09-05T00:56:23.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.953+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=K1TR0Y7ZSLWU type=del size=1851986 2024-09-05T00:56:23.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.957+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~D8SXCNG0YT5L.0 size=730883 2024-09-05T00:56:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.961+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=D8SXCNG0YT5L tag=TZ7AJN9WC0QA type=write size=1779459 2024-09-05T00:56:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.965+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~8N7A7XR32LP4.0 size=1048576 2024-09-05T00:56:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.969+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~8N7A7XR32LP4.1 size=392967 2024-09-05T00:56:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.969+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=8N7A7XR32LP4 tag=LZYOUJEVQ8UR type=write size=2490119 2024-09-05T00:56:23.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.973+0000 7f325adab8c0 -1 < failed to complete operation key=IGOUBVL3XVS3 tag=L191VSK158DR type=write size=789380: (22) Invalid argument 2024-09-05T00:56:23.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.977+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=IWT3CTN2HBLK type=del size=3217814 2024-09-05T00:56:23.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.977+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~90SVQ97HZDSU.0 size=289304 2024-09-05T00:56:23.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.981+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=90SVQ97HZDSU tag=PG9Q0EACW0D9 type=write size=1337880 2024-09-05T00:56:23.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.985+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=ZYI2FMTBU3SS type=del size=1983422 2024-09-05T00:56:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.993+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=HX51J9EN6HMS type=del 2024-09-05T00:56:24.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:23.997+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.0 size=1048576 2024-09-05T00:56:24.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.001+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.1 size=1048576 2024-09-05T00:56:24.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.001+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.2 size=43356 2024-09-05T00:56:24.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.001+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=WFR2XRXQDSN0 tag=89EHZ2DB8IOM type=write size=3189084 2024-09-05T00:56:24.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.001+0000 7f325adab8c0 1 < canceled part key=_multipart_NIAW4BKW21LG.2~FZQYZT1Z6QMQ.0 size=1048576 2024-09-05T00:56:24.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.005+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~FZQYZT1Z6QMQ.1 size=243266 2024-09-05T00:56:24.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.009+0000 7f325adab8c0 1 < canceled multipart upload key=NIAW4BKW21LG upload=FZQYZT1Z6QMQ tag=Q27NWP7RSCNN type=write size=2340418 2024-09-05T00:56:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.013+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=82VNVHJOPD65 type=del size=2651899 2024-09-05T00:56:24.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.017+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.0 size=1048576 2024-09-05T00:56:24.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.017+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.1 size=1048576 2024-09-05T00:56:24.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.021+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~XKY0E034LVGF.2 size=869051 2024-09-05T00:56:24.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.025+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=XKY0E034LVGF tag=BT5TV11MLAK0 type=write size=4014779 2024-09-05T00:56:24.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.029+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=LIN8DJTUXITC type=write size=185783 2024-09-05T00:56:24.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.033+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=AEYQ2SPR5WZN type=del 2024-09-05T00:56:24.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.037+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=SGUNHX953DR3 type=del size=2540352 2024-09-05T00:56:24.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.037+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=K53OZ9HMVEE7 type=del 2024-09-05T00:56:24.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.041+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=BDZJAHZX295W type=write size=739511 2024-09-05T00:56:24.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.045+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=OWY87U0XCLEL type=del 2024-09-05T00:56:24.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.045+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=2WTLC8ZS4IH7 type=del size=187276 2024-09-05T00:56:24.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.049+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=DFUJZGLCPO3L type=del 2024-09-05T00:56:24.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.053+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=VJMLWLBMOU8Z type=del size=699914 2024-09-05T00:56:24.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.053+0000 7f325adab8c0 -1 < no bi entry to suggest for operation key=GF6OC9O60D5E tag=NHDY07FZWE5I type=del size=54890: (2) No such file or directory 2024-09-05T00:56:24.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.057+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=Q1AGEY0JW07D type=del size=1656081 2024-09-05T00:56:24.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.061+0000 7f325adab8c0 1 < suggested update operation key=ZYT3WYNFIIZN tag=0MK2FJHO0KXO type=del size=381318 2024-09-05T00:56:24.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.065+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=2JKT8XKKJUIA type=del size=1829943 2024-09-05T00:56:24.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.069+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=WZYA9CUVVZVK type=del 2024-09-05T00:56:24.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.073+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=21G8PXH5WGNR type=del size=2030940 2024-09-05T00:56:24.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.077+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.0 size=1048576 2024-09-05T00:56:24.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.077+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.1 size=1048576 2024-09-05T00:56:24.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.081+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~H7VT0WVVYI8H.2 size=625738 2024-09-05T00:56:24.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.085+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=H7VT0WVVYI8H tag=8PNUFRSW0NWQ type=write size=3771466 2024-09-05T00:56:24.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.089+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=D2P5H3EI4LVL type=del size=3850930 2024-09-05T00:56:24.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.093+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=P6PML8U4I6ND type=del size=1553336: (22) Invalid argument 2024-09-05T00:56:24.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.101+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.0 size=1048576 2024-09-05T00:56:24.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.105+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.1 size=1048576 2024-09-05T00:56:24.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.105+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.2 size=342020 2024-09-05T00:56:24.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.105+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=DTSXYGHFEP11 tag=9Z3E4RSZHW1U type=write size=3487748 2024-09-05T00:56:24.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.109+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=K1TR0Y7ZSLWU type=del 2024-09-05T00:56:24.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.113+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=S1LFHXGPV8BL type=del size=3707236 2024-09-05T00:56:24.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.117+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~8N7A7XR32LP4.0 size=1048576 2024-09-05T00:56:24.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.121+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~8N7A7XR32LP4.1 size=392967 2024-09-05T00:56:24.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.125+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=8N7A7XR32LP4 tag=LZYOUJEVQ8UR type=write size=2490119 2024-09-05T00:56:24.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.133+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.0 size=1048576 2024-09-05T00:56:24.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.137+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.1 size=1048576 2024-09-05T00:56:24.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.137+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.2 size=646837 2024-09-05T00:56:24.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.137+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=6X06NLJST7MR tag=JKP2S9LYUEUJ type=write size=3792565 2024-09-05T00:56:24.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.141+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=IWT3CTN2HBLK type=del 2024-09-05T00:56:24.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.149+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~YKLX7SAQGU3D.0 size=1048576 2024-09-05T00:56:24.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.149+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~YKLX7SAQGU3D.1 size=684541 2024-09-05T00:56:24.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.149+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=YKLX7SAQGU3D tag=SP64BMBAZJT3 type=write size=2781693 2024-09-05T00:56:24.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.153+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=ZYI2FMTBU3SS type=del size=1983422: (22) Invalid argument 2024-09-05T00:56:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.157+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=BN8CDQUIM2QJ type=write size=647516 2024-09-05T00:56:24.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.161+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.0 size=1048576 2024-09-05T00:56:24.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.165+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.1 size=1048576 2024-09-05T00:56:24.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.165+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~WFR2XRXQDSN0.2 size=43356 2024-09-05T00:56:24.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.173+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=WFR2XRXQDSN0 tag=89EHZ2DB8IOM type=write size=3189084 2024-09-05T00:56:24.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.173+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=H7Z3KZPK5DXJ type=del size=3214302 2024-09-05T00:56:24.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.177+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=82VNVHJOPD65 type=del 2024-09-05T00:56:24.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.185+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.0 size=1048576 2024-09-05T00:56:24.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.185+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.1 size=1048576 2024-09-05T00:56:24.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.189+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.2 size=165357 2024-09-05T00:56:24.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.189+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=7U51MD6XF9W5 tag=760OYTX07FMU type=write size=3311085 2024-09-05T00:56:24.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.193+0000 7f325adab8c0 1 < completed write operation key=MYR9H12B5YYV tag=LIN8DJTUXITC type=write size=185783 2024-09-05T00:56:24.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.193+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=T75ZGVHQZBOG type=del size=1828846 2024-09-05T00:56:24.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.197+0000 7f325adab8c0 1 < canceled operation key=5WOUI4SHYTSS tag=SGUNHX953DR3 type=del size=2540352 2024-09-05T00:56:24.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.201+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=HPGBMMM0LT9J type=del size=2697241 2024-09-05T00:56:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.205+0000 7f325adab8c0 1 < canceled operation key=NIAW4BKW21LG tag=BDZJAHZX295W type=write size=739511 2024-09-05T00:56:24.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.205+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=NE5EQG9WJB3M type=del size=1002165 2024-09-05T00:56:24.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.209+0000 7f325adab8c0 -1 < failed to complete operation key=ZYT3WYNFIIZN tag=2WTLC8ZS4IH7 type=del size=187276: (22) Invalid argument 2024-09-05T00:56:24.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.213+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~M0F6KF0B20F3.0 size=1048576 2024-09-05T00:56:24.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.217+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~M0F6KF0B20F3.1 size=749679 2024-09-05T00:56:24.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.217+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=M0F6KF0B20F3 tag=3VXUTI22B1SZ type=write size=2846831 2024-09-05T00:56:24.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.221+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=VJMLWLBMOU8Z type=del 2024-09-05T00:56:24.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.225+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=GO2YN88Z8A72 type=del size=127677 2024-09-05T00:56:24.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.229+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=Q1AGEY0JW07D type=del 2024-09-05T00:56:24.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.233+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=0OC8ZLHAXVTY type=del size=3439828 2024-09-05T00:56:24.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.233+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=2JKT8XKKJUIA type=del 2024-09-05T00:56:24.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.237+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=MJX664JESBZ8 type=del size=331698 2024-09-05T00:56:24.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.241+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=21G8PXH5WGNR type=del 2024-09-05T00:56:24.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.245+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.0 size=1048576 2024-09-05T00:56:24.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.249+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.1 size=1048576 2024-09-05T00:56:24.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.249+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.2 size=421395 2024-09-05T00:56:24.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.249+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=X1LZCSFCP23D tag=03I65TW1RFT9 type=write size=3567123 2024-09-05T00:56:24.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.253+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=D2P5H3EI4LVL type=del 2024-09-05T00:56:24.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.257+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=FEHBR9E76KOA type=write size=675223 2024-09-05T00:56:24.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.257+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.0 size=1048576 2024-09-05T00:56:24.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.261+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.1 size=1048576 2024-09-05T00:56:24.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.261+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~DTSXYGHFEP11.2 size=342020 2024-09-05T00:56:24.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.269+0000 7f325adab8c0 1 < completed multipart upload key=LVZALGRNP5TU upload=DTSXYGHFEP11 tag=9Z3E4RSZHW1U type=write size=3487748 2024-09-05T00:56:24.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.269+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=S0IYGFIHHFM0 type=del size=2327800 2024-09-05T00:56:24.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.273+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=S1LFHXGPV8BL type=del 2024-09-05T00:56:24.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.277+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=O6LIDX8Y1T30 type=del size=172108 2024-09-05T00:56:24.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.281+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.0 size=1048576 2024-09-05T00:56:24.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.281+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.1 size=1048576 2024-09-05T00:56:24.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.285+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~6X06NLJST7MR.2 size=646837 2024-09-05T00:56:24.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.289+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=6X06NLJST7MR tag=JKP2S9LYUEUJ type=write size=3792565 2024-09-05T00:56:24.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.293+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=BIFJ30GIBRKP type=del size=950439 2024-09-05T00:56:24.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.293+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~YKLX7SAQGU3D.0 size=1048576 2024-09-05T00:56:24.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.293+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~YKLX7SAQGU3D.1 size=684541 2024-09-05T00:56:24.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.301+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=YKLX7SAQGU3D tag=SP64BMBAZJT3 type=write size=2781693 2024-09-05T00:56:24.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.301+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=BFT13WSV31PX type=del size=385744 2024-09-05T00:56:24.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.305+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=BN8CDQUIM2QJ type=write size=647516 2024-09-05T00:56:24.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.309+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=1HNSFRQJWEFX type=del size=4051954 2024-09-05T00:56:24.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.313+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=H7Z3KZPK5DXJ type=del 2024-09-05T00:56:24.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.317+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=MDKILXC3CDRH type=del size=540210 2024-09-05T00:56:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.317+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.0 size=1048576 2024-09-05T00:56:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.321+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.1 size=1048576 2024-09-05T00:56:24.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.325+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~7U51MD6XF9W5.2 size=165357 2024-09-05T00:56:24.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.329+0000 7f325adab8c0 1 < completed multipart upload key=71FWV15GD1QZ upload=7U51MD6XF9W5 tag=760OYTX07FMU type=write size=3311085 2024-09-05T00:56:24.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.333+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=UQ4BVGL350KC type=write size=884775 2024-09-05T00:56:24.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.337+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=T75ZGVHQZBOG type=del 2024-09-05T00:56:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.341+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=VHSL7ANB61DI type=write size=21176 2024-09-05T00:56:24.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.345+0000 7f325adab8c0 -1 < failed to complete operation key=HW4QK67332RW tag=HPGBMMM0LT9J type=del size=2697241: (22) Invalid argument 2024-09-05T00:56:24.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.349+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~177SWSVGYABT.0 size=1048576 2024-09-05T00:56:24.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.353+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~177SWSVGYABT.1 size=691541 2024-09-05T00:56:24.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.353+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=177SWSVGYABT tag=9XVZX22U5DOB type=write size=2788693 2024-09-05T00:56:24.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.357+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=NE5EQG9WJB3M type=del 2024-09-05T00:56:24.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.361+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~JYPO4C09VMWY.0 size=1048576 2024-09-05T00:56:24.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.365+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~JYPO4C09VMWY.1 size=428020 2024-09-05T00:56:24.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.365+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=JYPO4C09VMWY tag=8QKUWJNI5HUD type=write size=2525172 2024-09-05T00:56:24.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.369+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~M0F6KF0B20F3.0 size=1048576 2024-09-05T00:56:24.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.369+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~M0F6KF0B20F3.1 size=749679 2024-09-05T00:56:24.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.377+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=M0F6KF0B20F3 tag=3VXUTI22B1SZ type=write size=2846831 2024-09-05T00:56:24.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.381+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=NLP7T7VJ2SBG type=del size=3368500 2024-09-05T00:56:24.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.385+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=GO2YN88Z8A72 type=del 2024-09-05T00:56:24.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.385+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=P7TKKSVX7WYW type=del size=3923994 2024-09-05T00:56:24.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.397+0000 7f325adab8c0 1 < suggested update operation key=HW4QK67332RW tag=0OC8ZLHAXVTY type=del size=3439828 2024-09-05T00:56:24.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.401+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=NBZD1RINCUJZ type=del size=1592051 2024-09-05T00:56:24.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.405+0000 7f325adab8c0 1 < canceled operation key=XKOECM0CCOKX tag=MJX664JESBZ8 type=del size=331698 2024-09-05T00:56:24.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.409+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=9OYYCQ8B83U6 type=del size=3545516 2024-09-05T00:56:24.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.409+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.0 size=1048576 2024-09-05T00:56:24.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.413+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.1 size=1048576 2024-09-05T00:56:24.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.417+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~X1LZCSFCP23D.2 size=421395 2024-09-05T00:56:24.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.421+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=X1LZCSFCP23D tag=03I65TW1RFT9 type=write size=3567123 2024-09-05T00:56:24.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.429+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~9G1Z42HT03Y8.0 size=1048576 2024-09-05T00:56:24.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.429+0000 7f325adab8c0 1 > prepared part key=_multipart_6N7BLJ1WLDGN.2~9G1Z42HT03Y8.1 size=1001220 2024-09-05T00:56:24.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.429+0000 7f325adab8c0 1 > prepared multipart upload key=6N7BLJ1WLDGN upload=9G1Z42HT03Y8 tag=VE3VKEGEKVIP type=write size=3098372 2024-09-05T00:56:24.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.437+0000 7f325adab8c0 1 < suggested remove operation key=CB079FGXKNRO tag=FEHBR9E76KOA type=write 2024-09-05T00:56:24.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.441+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=6WUQJIJX5JBG type=del size=2248455 2024-09-05T00:56:24.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.449+0000 7f325adab8c0 1 < suggested update operation key=5WOUI4SHYTSS tag=S0IYGFIHHFM0 type=del size=2327800 2024-09-05T00:56:24.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.449+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=VOK9IAZTEY7V type=del size=2736952 2024-09-05T00:56:24.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.453+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=O6LIDX8Y1T30 type=del 2024-09-05T00:56:24.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.457+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=UBAQ6CS44YP9 type=del size=1300943 2024-09-05T00:56:24.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.461+0000 7f325adab8c0 -1 < failed to complete operation key=5WOUI4SHYTSS tag=BIFJ30GIBRKP type=del size=950439: (22) Invalid argument 2024-09-05T00:56:24.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.465+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=U500TL8K7B1Z type=del size=2494208 2024-09-05T00:56:24.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.469+0000 7f325adab8c0 1 < canceled operation key=GF6OC9O60D5E tag=BFT13WSV31PX type=del size=385744 2024-09-05T00:56:24.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.477+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~0MRD5NAJG1ZK.0 size=1048576 2024-09-05T00:56:24.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.477+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~0MRD5NAJG1ZK.1 size=897309 2024-09-05T00:56:24.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.477+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=0MRD5NAJG1ZK tag=1HMPJMXAJPZH type=write size=2994461 2024-09-05T00:56:24.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.481+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=1HNSFRQJWEFX type=del 2024-09-05T00:56:24.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.485+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=GDK2XFHEK80S type=write size=636600 2024-09-05T00:56:24.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.489+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=MDKILXC3CDRH type=del 2024-09-05T00:56:24.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.493+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=L3YLJJ60NMN7 type=write size=148312 2024-09-05T00:56:24.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.501+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=UQ4BVGL350KC type=write size=884775 2024-09-05T00:56:24.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.509+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.0 size=1048576 2024-09-05T00:56:24.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.513+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.1 size=1048576 2024-09-05T00:56:24.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.517+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.2 size=361962 2024-09-05T00:56:24.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.517+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=314GA0TXIC5D tag=OXRSM9W5S9N9 type=write size=3507690 2024-09-05T00:56:24.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.525+0000 7f325adab8c0 1 < suggested remove operation key=6N7BLJ1WLDGN tag=VHSL7ANB61DI type=write 2024-09-05T00:56:24.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.525+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=AREICVRP8CXV type=del size=4105369 2024-09-05T00:56:24.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.529+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~177SWSVGYABT.0 size=1048576 2024-09-05T00:56:24.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.533+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~177SWSVGYABT.1 size=691541 2024-09-05T00:56:24.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.541+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=177SWSVGYABT tag=9XVZX22U5DOB type=write size=2788693 2024-09-05T00:56:24.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.541+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=1P21AMR69HBU type=del size=3926232 2024-09-05T00:56:24.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.545+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~JYPO4C09VMWY.0 size=1048576 2024-09-05T00:56:24.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.545+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~JYPO4C09VMWY.1 size=428020 2024-09-05T00:56:24.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.553+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=JYPO4C09VMWY tag=8QKUWJNI5HUD type=write size=2525172 2024-09-05T00:56:24.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.557+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~VI2Y58WKU4BA.0 size=379590 2024-09-05T00:56:24.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.557+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=VI2Y58WKU4BA tag=K19KAL3LMFG9 type=write size=1428166 2024-09-05T00:56:24.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.561+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=NLP7T7VJ2SBG type=del 2024-09-05T00:56:24.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.565+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=UC7EAHA0E76P type=del size=775468 2024-09-05T00:56:24.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.565+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=P7TKKSVX7WYW type=del 2024-09-05T00:56:24.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.573+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~6CMPR6SWHPDY.0 size=709466 2024-09-05T00:56:24.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.573+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=6CMPR6SWHPDY tag=7FTE2BLMGM0N type=write size=1758042 2024-09-05T00:56:24.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.573+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=NBZD1RINCUJZ type=del 2024-09-05T00:56:24.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.581+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.0 size=1048576 2024-09-05T00:56:24.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.581+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.1 size=1048576 2024-09-05T00:56:24.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.585+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.2 size=112271 2024-09-05T00:56:24.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.585+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=1VEMOGYEFPTB tag=GGQDJ1NA1PR5 type=write size=3257999 2024-09-05T00:56:24.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.589+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=9OYYCQ8B83U6 type=del 2024-09-05T00:56:24.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.589+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=M9IL4NYDLQ1W type=del size=3463278 2024-09-05T00:56:24.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.593+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~9G1Z42HT03Y8.0 size=1048576 2024-09-05T00:56:24.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.597+0000 7f325adab8c0 1 < completed part key=_multipart_6N7BLJ1WLDGN.2~9G1Z42HT03Y8.1 size=1001220 2024-09-05T00:56:24.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.601+0000 7f325adab8c0 1 < completed multipart upload key=6N7BLJ1WLDGN upload=9G1Z42HT03Y8 tag=VE3VKEGEKVIP type=write size=3098372 2024-09-05T00:56:24.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.601+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=UT0E4TTV27Z7 type=write size=519864 2024-09-05T00:56:24.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.605+0000 7f325adab8c0 1 < canceled operation key=9O7DVR04PCDB tag=6WUQJIJX5JBG type=del size=2248455 2024-09-05T00:56:24.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.613+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~Y3P0ZEVTDWUT.0 size=173082 2024-09-05T00:56:24.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.613+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=Y3P0ZEVTDWUT tag=TOO2LTRF0HDJ type=write size=1221658 2024-09-05T00:56:24.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.613+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=VOK9IAZTEY7V type=del 2024-09-05T00:56:24.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.617+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=WUNUAY32OIYD type=del size=1657970 2024-09-05T00:56:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.621+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=UBAQ6CS44YP9 type=del 2024-09-05T00:56:24.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.625+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=MEOAJZI5J20Z type=del size=231611 2024-09-05T00:56:24.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.629+0000 7f325adab8c0 1 < suggested remove operation key=5WOUI4SHYTSS tag=U500TL8K7B1Z type=del 2024-09-05T00:56:24.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.633+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=NL49UCG78VVD type=del size=3047384 2024-09-05T00:56:24.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.637+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~0MRD5NAJG1ZK.0 size=1048576 2024-09-05T00:56:24.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.637+0000 7f325adab8c0 1 < canceled part key=_multipart_UW0SSQ8VFY1G.2~0MRD5NAJG1ZK.1 size=897309 2024-09-05T00:56:24.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.641+0000 7f325adab8c0 1 < canceled multipart upload key=UW0SSQ8VFY1G upload=0MRD5NAJG1ZK tag=1HMPJMXAJPZH type=write size=2994461 2024-09-05T00:56:24.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.645+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=S2AEJUZFGZG3 type=del size=2736836 2024-09-05T00:56:24.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.645+0000 7f325adab8c0 1 < completed write operation key=XKOECM0CCOKX tag=GDK2XFHEK80S type=write size=636600 2024-09-05T00:56:24.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.649+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=67GHGKU7L5UV type=del size=1315350 2024-09-05T00:56:24.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.653+0000 7f325adab8c0 1 < completed write operation key=71FWV15GD1QZ tag=L3YLJJ60NMN7 type=write size=148312 2024-09-05T00:56:24.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.653+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=V99W5N5P98QY type=del size=1325068 2024-09-05T00:56:24.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.657+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.0 size=1048576 2024-09-05T00:56:24.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.657+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.1 size=1048576 2024-09-05T00:56:24.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.661+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~314GA0TXIC5D.2 size=361962 2024-09-05T00:56:24.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.665+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=314GA0TXIC5D tag=OXRSM9W5S9N9 type=write size=3507690 2024-09-05T00:56:24.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.669+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=ALXPF2IQE6IL type=del size=791787 2024-09-05T00:56:24.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.673+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=AREICVRP8CXV type=del 2024-09-05T00:56:24.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.673+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=900162T5USPN type=write size=1027057 2024-09-05T00:56:24.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.677+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=1P21AMR69HBU type=del 2024-09-05T00:56:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.681+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~5024AR2CLP9O.0 size=1048576 2024-09-05T00:56:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.685+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~5024AR2CLP9O.1 size=784970 2024-09-05T00:56:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.685+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=5024AR2CLP9O tag=ZMT730QUR008 type=write size=2882122 2024-09-05T00:56:24.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.689+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~VI2Y58WKU4BA.0 size=379590 2024-09-05T00:56:24.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.693+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=VI2Y58WKU4BA tag=K19KAL3LMFG9 type=write size=1428166 2024-09-05T00:56:24.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.693+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=Q8E79M7QBI6J type=del size=2139167 2024-09-05T00:56:24.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.705+0000 7f325adab8c0 1 < suggested update operation key=MBJLOE5XFPYN tag=UC7EAHA0E76P type=del size=775468 2024-09-05T00:56:24.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.709+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.0 size=1048576 2024-09-05T00:56:24.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.713+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.1 size=1048576 2024-09-05T00:56:24.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.717+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.2 size=357120 2024-09-05T00:56:24.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.717+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=BH44045ZEK4Y tag=A90SYE3L7E64 type=write size=3502848 2024-09-05T00:56:24.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.717+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~6CMPR6SWHPDY.0 size=709466 2024-09-05T00:56:24.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.725+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=6CMPR6SWHPDY tag=7FTE2BLMGM0N type=write size=1758042 2024-09-05T00:56:24.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.729+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.0 size=1048576 2024-09-05T00:56:24.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.729+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.1 size=1048576 2024-09-05T00:56:24.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.733+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.2 size=428192 2024-09-05T00:56:24.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.733+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=GAJLTTSD1BRU tag=VSNYECJX1GN2 type=write size=3573920 2024-09-05T00:56:24.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.733+0000 7f325adab8c0 1 < canceled part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.0 size=1048576 2024-09-05T00:56:24.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.737+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.1 size=1048576 2024-09-05T00:56:24.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.737+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~1VEMOGYEFPTB.2 size=112271 2024-09-05T00:56:24.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.745+0000 7f325adab8c0 1 < canceled multipart upload key=YMIGZMLJSI4D upload=1VEMOGYEFPTB tag=GGQDJ1NA1PR5 type=write size=3257999 2024-09-05T00:56:24.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.745+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=8KO0L8DPNCWU type=del size=1399782 2024-09-05T00:56:24.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.753+0000 7f325adab8c0 1 < suggested update operation key=G600UT533GTT tag=M9IL4NYDLQ1W type=del size=3463278 2024-09-05T00:56:24.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.757+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=UGLFAWKMHTEB type=del size=3130036 2024-09-05T00:56:24.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.761+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=UT0E4TTV27Z7 type=write size=519864 2024-09-05T00:56:24.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.761+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=Q8THUBTUEVSY type=write size=199067 2024-09-05T00:56:24.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.765+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~Y3P0ZEVTDWUT.0 size=173082 2024-09-05T00:56:24.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.773+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=Y3P0ZEVTDWUT tag=TOO2LTRF0HDJ type=write size=1221658 2024-09-05T00:56:24.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.773+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=8NXN96ITIUT3 type=del size=4046257 2024-09-05T00:56:24.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.777+0000 7f325adab8c0 1 < canceled operation key=O0RSK2S88XHP tag=WUNUAY32OIYD type=del size=1657970 2024-09-05T00:56:24.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.781+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=TVWCMR8MJ6K1 type=del size=409248 2024-09-05T00:56:24.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.785+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=MEOAJZI5J20Z type=del 2024-09-05T00:56:24.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.785+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=QA35CSP1AX2I type=del size=467615 2024-09-05T00:56:24.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.793+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=NL49UCG78VVD type=del size=3047384 2024-09-05T00:56:24.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.797+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.0 size=1048576 2024-09-05T00:56:24.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.801+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.1 size=1048576 2024-09-05T00:56:24.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.801+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.2 size=536463 2024-09-05T00:56:24.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.801+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=P5KMZUFT1NVF tag=Z1O7UCTX43QE type=write size=3682191 2024-09-05T00:56:24.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.805+0000 7f325adab8c0 1 < canceled operation key=GF6OC9O60D5E tag=S2AEJUZFGZG3 type=del size=2736836 2024-09-05T00:56:24.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.813+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~X127KF3HJQ6Y.0 size=715225 2024-09-05T00:56:24.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.813+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=X127KF3HJQ6Y tag=TE3VES3FUMOM type=write size=1763801 2024-09-05T00:56:24.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.817+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=67GHGKU7L5UV type=del 2024-09-05T00:56:24.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.821+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~LKO88X7QVO0F.0 size=1048576 2024-09-05T00:56:24.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.825+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~LKO88X7QVO0F.1 size=810699 2024-09-05T00:56:24.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.825+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=LKO88X7QVO0F tag=C6TVF2DBT64J type=write size=2907851 2024-09-05T00:56:24.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.829+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=V99W5N5P98QY type=del 2024-09-05T00:56:24.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.837+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.0 size=1048576 2024-09-05T00:56:24.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.841+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.1 size=1048576 2024-09-05T00:56:24.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.841+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.2 size=605969 2024-09-05T00:56:24.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.841+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=OYRVCQP2I1OI tag=2V299YBXFRAY type=write size=3751697 2024-09-05T00:56:24.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.845+0000 7f325adab8c0 1 < canceled operation key=6N7BLJ1WLDGN tag=ALXPF2IQE6IL type=del size=791787 2024-09-05T00:56:24.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.849+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=REMEWFOFCJE6 type=del size=1517022 2024-09-05T00:56:24.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.853+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=900162T5USPN type=write size=1027057 2024-09-05T00:56:24.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.857+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=SC9EFK5BGHGH type=del size=144094 2024-09-05T00:56:24.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.861+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~5024AR2CLP9O.0 size=1048576 2024-09-05T00:56:24.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.865+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~5024AR2CLP9O.1 size=784970 2024-09-05T00:56:24.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.869+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=5024AR2CLP9O tag=ZMT730QUR008 type=write size=2882122 2024-09-05T00:56:24.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.873+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=G3BZWJ0GC5FG type=del size=1037642 2024-09-05T00:56:24.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.877+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=Q8E79M7QBI6J type=del 2024-09-05T00:56:24.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.881+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=QPW29DRRS6XB type=del size=3476933 2024-09-05T00:56:24.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.881+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.0 size=1048576 2024-09-05T00:56:24.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.885+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.1 size=1048576 2024-09-05T00:56:24.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.889+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~BH44045ZEK4Y.2 size=357120 2024-09-05T00:56:24.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.893+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=BH44045ZEK4Y tag=A90SYE3L7E64 type=write size=3502848 2024-09-05T00:56:24.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.901+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~SCLLBP4LH6R4.0 size=897652 2024-09-05T00:56:24.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.901+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=SCLLBP4LH6R4 tag=JB8BNHFQ184N type=write size=1946228 2024-09-05T00:56:24.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.905+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.0 size=1048576 2024-09-05T00:56:24.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.909+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.1 size=1048576 2024-09-05T00:56:24.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.909+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~GAJLTTSD1BRU.2 size=428192 2024-09-05T00:56:24.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.917+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=GAJLTTSD1BRU tag=VSNYECJX1GN2 type=write size=3573920 2024-09-05T00:56:24.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.921+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.0 size=1048576 2024-09-05T00:56:24.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.925+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.1 size=1048576 2024-09-05T00:56:24.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.929+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.2 size=552988 2024-09-05T00:56:24.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.929+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=0F8CS9VBJ3DP tag=SVO62YOEJ1KH type=write size=3698716 2024-09-05T00:56:24.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.933+0000 7f325adab8c0 1 < suggested update operation key=GU25IIQWQNR2 tag=8KO0L8DPNCWU type=del size=1399782 2024-09-05T00:56:24.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.941+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~Y726R6AWH18K.0 size=1048576 2024-09-05T00:56:24.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.941+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~Y726R6AWH18K.1 size=559673 2024-09-05T00:56:24.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.941+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=Y726R6AWH18K tag=NJBBSJ5ES4B0 type=write size=2656825 2024-09-05T00:56:24.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.945+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=UGLFAWKMHTEB type=del 2024-09-05T00:56:24.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.949+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=8HA40ZP59QNY type=del size=2772934 2024-09-05T00:56:24.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.953+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=Q8THUBTUEVSY type=write size=199067 2024-09-05T00:56:24.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.961+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.0 size=1048576 2024-09-05T00:56:24.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.961+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.1 size=1048576 2024-09-05T00:56:24.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.965+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.2 size=709489 2024-09-05T00:56:24.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.965+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=YD88M6NL7H59 tag=ZYF6DM09POPE type=write size=3855217 2024-09-05T00:56:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.969+0000 7f325adab8c0 1 < canceled operation key=YMIGZMLJSI4D tag=8NXN96ITIUT3 type=del size=4046257 2024-09-05T00:56:24.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.973+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=7N3C8N6O5FM3 type=del size=2890186 2024-09-05T00:56:24.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.973+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=TVWCMR8MJ6K1 type=del 2024-09-05T00:56:24.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.977+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=V3BQYFKN8OSE type=del size=2252023 2024-09-05T00:56:24.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.981+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=QA35CSP1AX2I type=del 2024-09-05T00:56:24.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.985+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=3M33AW6MLPEC type=write size=757142 2024-09-05T00:56:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.985+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.0 size=1048576 2024-09-05T00:56:24.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.985+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.1 size=1048576 2024-09-05T00:56:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.989+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~P5KMZUFT1NVF.2 size=536463 2024-09-05T00:56:24.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:24.993+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=P5KMZUFT1NVF tag=Z1O7UCTX43QE type=write size=3682191 2024-09-05T00:56:25.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.001+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~T1CVQESHHLZ9.0 size=905634 2024-09-05T00:56:25.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.001+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=T1CVQESHHLZ9 tag=0SRXF6CX0JJE type=write size=1954210 2024-09-05T00:56:25.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.005+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~X127KF3HJQ6Y.0 size=715225 2024-09-05T00:56:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.013+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=X127KF3HJQ6Y tag=TE3VES3FUMOM type=write size=1763801 2024-09-05T00:56:25.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.017+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~S0SMCP7A7Y16.0 size=1048576 2024-09-05T00:56:25.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.021+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~S0SMCP7A7Y16.1 size=78382 2024-09-05T00:56:25.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.021+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=S0SMCP7A7Y16 tag=UV5OPWWLV559 type=write size=2175534 2024-09-05T00:56:25.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.025+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~LKO88X7QVO0F.0 size=1048576 2024-09-05T00:56:25.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.025+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~LKO88X7QVO0F.1 size=810699 2024-09-05T00:56:25.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.033+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=LKO88X7QVO0F tag=C6TVF2DBT64J type=write size=2907851 2024-09-05T00:56:25.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.037+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=R4BNPR0UEL2H type=del size=4082146 2024-09-05T00:56:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.037+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.0 size=1048576 2024-09-05T00:56:25.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.041+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.1 size=1048576 2024-09-05T00:56:25.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.045+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~OYRVCQP2I1OI.2 size=605969 2024-09-05T00:56:25.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.049+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=OYRVCQP2I1OI tag=2V299YBXFRAY type=write size=3751697 2024-09-05T00:56:25.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.053+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=OFBGNJ08VU2W type=del size=3862309 2024-09-05T00:56:25.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.057+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=REMEWFOFCJE6 type=del 2024-09-05T00:56:25.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.061+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=4KTD2A5EGZNU type=del size=2936685 2024-09-05T00:56:25.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.061+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=SC9EFK5BGHGH type=del 2024-09-05T00:56:25.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.069+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~ZEJTK9A5A1SH.0 size=1048576 2024-09-05T00:56:25.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.073+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~ZEJTK9A5A1SH.1 size=12717 2024-09-05T00:56:25.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.073+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=ZEJTK9A5A1SH tag=SRJKU2Q5KO9I type=write size=2109869 2024-09-05T00:56:25.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.077+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=G3BZWJ0GC5FG type=del 2024-09-05T00:56:25.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.077+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=S1QMAIEZM7NJ type=write size=696501 2024-09-05T00:56:25.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.081+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=QPW29DRRS6XB type=del 2024-09-05T00:56:25.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.085+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=QRMEBK3W9XL5 type=del size=4143810 2024-09-05T00:56:25.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.089+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~SCLLBP4LH6R4.0 size=897652 2024-09-05T00:56:25.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.097+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=SCLLBP4LH6R4 tag=JB8BNHFQ184N type=write size=1946228 2024-09-05T00:56:25.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.101+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=LS8I4NJVGQVT type=del size=1896772 2024-09-05T00:56:25.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.101+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.0 size=1048576 2024-09-05T00:56:25.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.105+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.1 size=1048576 2024-09-05T00:56:25.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.109+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~0F8CS9VBJ3DP.2 size=552988 2024-09-05T00:56:25.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.113+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=0F8CS9VBJ3DP tag=SVO62YOEJ1KH type=write size=3698716 2024-09-05T00:56:25.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.117+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=N7164I01ZF23 type=write size=567995 2024-09-05T00:56:25.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.121+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~Y726R6AWH18K.0 size=1048576 2024-09-05T00:56:25.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.125+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~Y726R6AWH18K.1 size=559673 2024-09-05T00:56:25.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.129+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=Y726R6AWH18K tag=NJBBSJ5ES4B0 type=write size=2656825 2024-09-05T00:56:25.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.133+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~AUYA14ZBGLON.0 size=577927 2024-09-05T00:56:25.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.133+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=AUYA14ZBGLON tag=R5M4BYQML9EU type=write size=1626503 2024-09-05T00:56:25.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.137+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=8HA40ZP59QNY type=del 2024-09-05T00:56:25.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.141+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=WDKQ2KDG0KAG type=del size=452700 2024-09-05T00:56:25.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.145+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.0 size=1048576 2024-09-05T00:56:25.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.149+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.1 size=1048576 2024-09-05T00:56:25.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.149+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~YD88M6NL7H59.2 size=709489 2024-09-05T00:56:25.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.157+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=YD88M6NL7H59 tag=ZYF6DM09POPE type=write size=3855217 2024-09-05T00:56:25.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.161+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~W9SP3BORH8TA.0 size=1048576 2024-09-05T00:56:25.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.165+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~W9SP3BORH8TA.1 size=557076 2024-09-05T00:56:25.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.165+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=W9SP3BORH8TA tag=IIZGQ5WF0WHZ type=write size=2654228 2024-09-05T00:56:25.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.169+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=7N3C8N6O5FM3 type=del 2024-09-05T00:56:25.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.169+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=S3BEX8NQ3U76 type=del size=2977650 2024-09-05T00:56:25.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.173+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=V3BQYFKN8OSE type=del 2024-09-05T00:56:25.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.181+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.0 size=1048576 2024-09-05T00:56:25.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.181+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.1 size=1048576 2024-09-05T00:56:25.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.185+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.2 size=264648 2024-09-05T00:56:25.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.185+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=2H1JIBEBXCW8 tag=8QUFA0DCOS7I type=write size=3410376 2024-09-05T00:56:25.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.189+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=3M33AW6MLPEC type=write size=757142 2024-09-05T00:56:25.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.197+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~3ISEN235G6I4.0 size=1048576 2024-09-05T00:56:25.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.197+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~3ISEN235G6I4.1 size=53341 2024-09-05T00:56:25.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.197+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=3ISEN235G6I4 tag=1GZB9WCF4CCL type=write size=2150493 2024-09-05T00:56:25.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.201+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~T1CVQESHHLZ9.0 size=905634 2024-09-05T00:56:25.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.205+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=T1CVQESHHLZ9 tag=0SRXF6CX0JJE type=write size=1954210 2024-09-05T00:56:25.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.213+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.0 size=1048576 2024-09-05T00:56:25.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.1 size=1048576 2024-09-05T00:56:25.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.2 size=198141 2024-09-05T00:56:25.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.217+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=8XK03176IQ04 tag=6G2A5RWQ1B23 type=write size=3343869 2024-09-05T00:56:25.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.221+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~S0SMCP7A7Y16.0 size=1048576 2024-09-05T00:56:25.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.221+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~S0SMCP7A7Y16.1 size=78382 2024-09-05T00:56:25.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.229+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=S0SMCP7A7Y16 tag=UV5OPWWLV559 type=write size=2175534 2024-09-05T00:56:25.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.233+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=IKI8D4CAU195 type=del size=2697488 2024-09-05T00:56:25.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.233+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=R4BNPR0UEL2H type=del 2024-09-05T00:56:25.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.241+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~DAYIHE87JNBG.0 size=1048576 2024-09-05T00:56:25.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.241+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~DAYIHE87JNBG.1 size=8709 2024-09-05T00:56:25.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.241+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=DAYIHE87JNBG tag=598G5894IXMN type=write size=2105861 2024-09-05T00:56:25.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.245+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=OFBGNJ08VU2W type=del 2024-09-05T00:56:25.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.249+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=ZW4N6QTBMYYX type=del size=3304543 2024-09-05T00:56:25.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.253+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=4KTD2A5EGZNU type=del 2024-09-05T00:56:25.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.257+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=71QBDHCPZOHS type=del size=1134327 2024-09-05T00:56:25.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.261+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~ZEJTK9A5A1SH.0 size=1048576 2024-09-05T00:56:25.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.261+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~ZEJTK9A5A1SH.1 size=12717 2024-09-05T00:56:25.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.269+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=ZEJTK9A5A1SH tag=SRJKU2Q5KO9I type=write size=2109869 2024-09-05T00:56:25.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.273+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~K41048ATEWEO.0 size=980838 2024-09-05T00:56:25.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.273+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=K41048ATEWEO tag=MY40TF7M1WUF type=write size=2029414 2024-09-05T00:56:25.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.277+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=S1QMAIEZM7NJ type=write size=696501 2024-09-05T00:56:25.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.281+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=K3NFQHC88ID1 type=del size=2029729 2024-09-05T00:56:25.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.285+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=QRMEBK3W9XL5 type=del 2024-09-05T00:56:25.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.289+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.0 size=1048576 2024-09-05T00:56:25.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.297+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.1 size=1048576 2024-09-05T00:56:25.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.301+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.2 size=124958 2024-09-05T00:56:25.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.301+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=RM6PN2AD18L5 tag=F5ZFSVDPXDY6 type=write size=3270686 2024-09-05T00:56:25.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.301+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=LS8I4NJVGQVT type=del 2024-09-05T00:56:25.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.313+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.0 size=1048576 2024-09-05T00:56:25.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.313+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.1 size=1048576 2024-09-05T00:56:25.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.317+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.2 size=893268 2024-09-05T00:56:25.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.317+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=NKCBD6K60DKE tag=4C69DP2G7UYC type=write size=4038996 2024-09-05T00:56:25.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.321+0000 7f325adab8c0 1 < canceled operation key=71FWV15GD1QZ tag=N7164I01ZF23 type=write size=567995 2024-09-05T00:56:25.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.325+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=1705Z47NA0PH type=del size=1843830 2024-09-05T00:56:25.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.329+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~AUYA14ZBGLON.0 size=577927 2024-09-05T00:56:25.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.333+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=AUYA14ZBGLON tag=R5M4BYQML9EU type=write size=1626503 2024-09-05T00:56:25.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.337+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=JDMCX7COX03J type=del size=2440698 2024-09-05T00:56:25.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.337+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=WDKQ2KDG0KAG type=del size=452700 2024-09-05T00:56:25.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.341+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=0KF1BP3YJ0GP type=del size=4120500 2024-09-05T00:56:25.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.341+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~W9SP3BORH8TA.0 size=1048576 2024-09-05T00:56:25.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.341+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~W9SP3BORH8TA.1 size=557076 2024-09-05T00:56:25.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.345+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=W9SP3BORH8TA tag=IIZGQ5WF0WHZ type=write size=2654228 2024-09-05T00:56:25.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.353+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~2JOYT7TYID2O.0 size=375672 2024-09-05T00:56:25.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.353+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=2JOYT7TYID2O tag=GYGCMABWLP93 type=write size=1424248 2024-09-05T00:56:25.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.353+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=S3BEX8NQ3U76 type=del 2024-09-05T00:56:25.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.357+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.0 size=1048576 2024-09-05T00:56:25.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.361+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.1 size=1048576 2024-09-05T00:56:25.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.365+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.2 size=1003659 2024-09-05T00:56:25.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.365+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=2W8YN0OX05U0 tag=FSXIQP76QIJ1 type=write size=4149387 2024-09-05T00:56:25.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.365+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.0 size=1048576 2024-09-05T00:56:25.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.369+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.1 size=1048576 2024-09-05T00:56:25.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.369+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~2H1JIBEBXCW8.2 size=264648 2024-09-05T00:56:25.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.373+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=2H1JIBEBXCW8 tag=8QUFA0DCOS7I type=write size=3410376 2024-09-05T00:56:25.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.377+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=8AO3HOME6PCL type=write size=693571 2024-09-05T00:56:25.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.377+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~3ISEN235G6I4.0 size=1048576 2024-09-05T00:56:25.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.377+0000 7f325adab8c0 1 < canceled part key=_multipart_HW4QK67332RW.2~3ISEN235G6I4.1 size=53341 2024-09-05T00:56:25.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.385+0000 7f325adab8c0 1 < canceled multipart upload key=HW4QK67332RW upload=3ISEN235G6I4 tag=1GZB9WCF4CCL type=write size=2150493 2024-09-05T00:56:25.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.385+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=RFETR5R4NTIT type=write size=880301 2024-09-05T00:56:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.389+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.0 size=1048576 2024-09-05T00:56:25.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.389+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.1 size=1048576 2024-09-05T00:56:25.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.393+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~8XK03176IQ04.2 size=198141 2024-09-05T00:56:25.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.397+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=8XK03176IQ04 tag=6G2A5RWQ1B23 type=write size=3343869 2024-09-05T00:56:25.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.401+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.0 size=1048576 2024-09-05T00:56:25.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.405+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.1 size=1048576 2024-09-05T00:56:25.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.405+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.2 size=463092 2024-09-05T00:56:25.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.405+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=SYR07T2TF1QJ tag=WRTW7SHRK316 type=write size=3608820 2024-09-05T00:56:25.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.409+0000 7f325adab8c0 1 < completed delete operation key=71FWV15GD1QZ tag=IKI8D4CAU195 type=del 2024-09-05T00:56:25.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.413+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=9XEV7SVNG0ZK type=del size=3302355 2024-09-05T00:56:25.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.413+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~DAYIHE87JNBG.0 size=1048576 2024-09-05T00:56:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.413+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~DAYIHE87JNBG.1 size=8709 2024-09-05T00:56:25.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.421+0000 7f325adab8c0 1 < canceled multipart upload key=O0RSK2S88XHP upload=DAYIHE87JNBG tag=598G5894IXMN type=write size=2105861 2024-09-05T00:56:25.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.421+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=B19Q6QM0DIGQ type=del size=2546205 2024-09-05T00:56:25.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.425+0000 7f325adab8c0 -1 < failed to complete operation key=VYMRZPO6VKGS tag=ZW4N6QTBMYYX type=del size=3304543: (22) Invalid argument 2024-09-05T00:56:25.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.429+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=V1ZDLM8TCRSV type=del size=1607954 2024-09-05T00:56:25.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.429+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=71QBDHCPZOHS type=del 2024-09-05T00:56:25.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.433+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=E0WWSQ4LBBAV type=del size=3529639 2024-09-05T00:56:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.437+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~K41048ATEWEO.0 size=980838 2024-09-05T00:56:25.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.441+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=K41048ATEWEO tag=MY40TF7M1WUF type=write size=2029414 2024-09-05T00:56:25.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.445+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~HA9UNM399EH8.0 size=242088 2024-09-05T00:56:25.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.445+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=HA9UNM399EH8 tag=0U6K9QR352X2 type=write size=1290664 2024-09-05T00:56:25.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.449+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=K3NFQHC88ID1 type=del 2024-09-05T00:56:25.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.453+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=27SFZ5I7PG1Q type=del size=2720107 2024-09-05T00:56:25.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.453+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.0 size=1048576 2024-09-05T00:56:25.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.457+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.1 size=1048576 2024-09-05T00:56:25.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.457+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~RM6PN2AD18L5.2 size=124958 2024-09-05T00:56:25.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.461+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=RM6PN2AD18L5 tag=F5ZFSVDPXDY6 type=write size=3270686 2024-09-05T00:56:25.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.465+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=9FM8CE21Z5KA type=del size=3102560 2024-09-05T00:56:25.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.469+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.0 size=1048576 2024-09-05T00:56:25.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.469+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.1 size=1048576 2024-09-05T00:56:25.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.473+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~NKCBD6K60DKE.2 size=893268 2024-09-05T00:56:25.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.477+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=NKCBD6K60DKE tag=4C69DP2G7UYC type=write size=4038996 2024-09-05T00:56:25.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.481+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~5KARVCVJT37N.0 size=1048576 2024-09-05T00:56:25.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.481+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~5KARVCVJT37N.1 size=224193 2024-09-05T00:56:25.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.481+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=5KARVCVJT37N tag=TUH0SPEOG53Q type=write size=2321345 2024-09-05T00:56:25.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.485+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=1705Z47NA0PH type=del 2024-09-05T00:56:25.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.489+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~D7WA2XR4NQVF.0 size=1012761 2024-09-05T00:56:25.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.489+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=D7WA2XR4NQVF tag=Q4U40VW3A5R7 type=write size=2061337 2024-09-05T00:56:25.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.493+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=JDMCX7COX03J type=del 2024-09-05T00:56:25.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.497+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=DNWH63VIPUBQ type=write size=699064 2024-09-05T00:56:25.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.501+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=0KF1BP3YJ0GP type=del 2024-09-05T00:56:25.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.505+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OKHUX9BA45F5.0 size=1048576 2024-09-05T00:56:25.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.505+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OKHUX9BA45F5.1 size=759677 2024-09-05T00:56:25.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.505+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=OKHUX9BA45F5 tag=GLLHY31ODPGY type=write size=2856829 2024-09-05T00:56:25.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.509+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~2JOYT7TYID2O.0 size=375672 2024-09-05T00:56:25.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.513+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=2JOYT7TYID2O tag=GYGCMABWLP93 type=write size=1424248 2024-09-05T00:56:25.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.517+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=45W9HODRYKPB type=del size=4003608 2024-09-05T00:56:25.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.517+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.0 size=1048576 2024-09-05T00:56:25.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.521+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.1 size=1048576 2024-09-05T00:56:25.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.521+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~2W8YN0OX05U0.2 size=1003659 2024-09-05T00:56:25.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.525+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=2W8YN0OX05U0 tag=FSXIQP76QIJ1 type=write size=4149387 2024-09-05T00:56:25.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.525+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=1OKQA55XA3AH type=del size=2928210 2024-09-05T00:56:25.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.529+0000 7f325adab8c0 1 < completed write operation key=O0RSK2S88XHP tag=8AO3HOME6PCL type=write size=693571 2024-09-05T00:56:25.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.533+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~BSEDMISZ1XOZ.0 size=1048576 2024-09-05T00:56:25.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.537+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~BSEDMISZ1XOZ.1 size=79123 2024-09-05T00:56:25.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.537+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=BSEDMISZ1XOZ tag=K38UN4YSOGMT type=write size=2176275 2024-09-05T00:56:25.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.537+0000 7f325adab8c0 1 < completed write operation key=UW0SSQ8VFY1G tag=RFETR5R4NTIT type=write size=880301 2024-09-05T00:56:25.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.545+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.0 size=1048576 2024-09-05T00:56:25.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.545+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.1 size=1048576 2024-09-05T00:56:25.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.549+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.2 size=441818 2024-09-05T00:56:25.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.549+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=M3SK44S6JEPS tag=A8EO1VFL0YHL type=write size=3587546 2024-09-05T00:56:25.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.549+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.0 size=1048576 2024-09-05T00:56:25.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.553+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.1 size=1048576 2024-09-05T00:56:25.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.553+0000 7f325adab8c0 1 < canceled part key=_multipart_079QFDETDGGC.2~SYR07T2TF1QJ.2 size=463092 2024-09-05T00:56:25.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.557+0000 7f325adab8c0 1 < canceled multipart upload key=079QFDETDGGC upload=SYR07T2TF1QJ tag=WRTW7SHRK316 type=write size=3608820 2024-09-05T00:56:25.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.565+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=6QYXRDWDEAC5 type=del size=1832190 2024-09-05T00:56:25.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.569+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=9XEV7SVNG0ZK type=del 2024-09-05T00:56:25.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.569+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=B24VM5W7ICBK type=del size=1524377 2024-09-05T00:56:25.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.573+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=B19Q6QM0DIGQ type=del 2024-09-05T00:56:25.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.577+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=NJDA8HSPA96W type=del size=59842 2024-09-05T00:56:25.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.581+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=V1ZDLM8TCRSV type=del 2024-09-05T00:56:25.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.581+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=NRYRMR5WVW4W type=del size=3571602 2024-09-05T00:56:25.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.585+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=E0WWSQ4LBBAV type=del 2024-09-05T00:56:25.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.593+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.0 size=1048576 2024-09-05T00:56:25.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.593+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.1 size=1048576 2024-09-05T00:56:25.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.597+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.2 size=467285 2024-09-05T00:56:25.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.597+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=2V3FES7QRR6N tag=P75EWKMQZHL1 type=write size=3613013 2024-09-05T00:56:25.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.597+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~HA9UNM399EH8.0 size=242088 2024-09-05T00:56:25.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.605+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=HA9UNM399EH8 tag=0U6K9QR352X2 type=write size=1290664 2024-09-05T00:56:25.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.605+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=QJS1GBPDFMSP type=del size=607254 2024-09-05T00:56:25.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.609+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=27SFZ5I7PG1Q type=del 2024-09-05T00:56:25.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.613+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=FDFNAZZJT3VZ type=del size=18387 2024-09-05T00:56:25.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.617+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=9FM8CE21Z5KA type=del 2024-09-05T00:56:25.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.617+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=WFRV22QZ1KXU type=del size=2362310 2024-09-05T00:56:25.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.621+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~5KARVCVJT37N.0 size=1048576 2024-09-05T00:56:25.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.625+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~5KARVCVJT37N.1 size=224193 2024-09-05T00:56:25.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.629+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=5KARVCVJT37N tag=TUH0SPEOG53Q type=write size=2321345 2024-09-05T00:56:25.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.633+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.0 size=1048576 2024-09-05T00:56:25.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.637+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.1 size=1048576 2024-09-05T00:56:25.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.637+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.2 size=883799 2024-09-05T00:56:25.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.637+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=96SV7UW67NNM tag=BKYWV30P6Q6H type=write size=4029527 2024-09-05T00:56:25.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.641+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~D7WA2XR4NQVF.0 size=1012761 2024-09-05T00:56:25.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.645+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=D7WA2XR4NQVF tag=Q4U40VW3A5R7 type=write size=2061337 2024-09-05T00:56:25.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.649+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~3ELOF2C59UN9.0 size=654348 2024-09-05T00:56:25.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.649+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=3ELOF2C59UN9 tag=66NBAB4BDGKP type=write size=1702924 2024-09-05T00:56:25.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.653+0000 7f325adab8c0 1 < completed write operation key=VYMRZPO6VKGS tag=DNWH63VIPUBQ type=write size=699064 2024-09-05T00:56:25.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.653+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=VEUWR3ZATJ2J type=del size=3144880 2024-09-05T00:56:25.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.657+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OKHUX9BA45F5.0 size=1048576 2024-09-05T00:56:25.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.661+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OKHUX9BA45F5.1 size=759677 2024-09-05T00:56:25.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.665+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=OKHUX9BA45F5 tag=GLLHY31ODPGY type=write size=2856829 2024-09-05T00:56:25.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.669+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~T4ZB10WALN6Z.0 size=1048576 2024-09-05T00:56:25.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.669+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~T4ZB10WALN6Z.1 size=246068 2024-09-05T00:56:25.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.669+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=T4ZB10WALN6Z tag=II2FOK8CONJG type=write size=2343220 2024-09-05T00:56:25.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.677+0000 7f325adab8c0 1 < suggested update operation key=YMIGZMLJSI4D tag=45W9HODRYKPB type=del size=4003608 2024-09-05T00:56:25.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.677+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=RH3ODWQHVWDP type=write size=364404 2024-09-05T00:56:25.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.681+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=1OKQA55XA3AH type=del 2024-09-05T00:56:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.685+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.0 size=1048576 2024-09-05T00:56:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.685+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.1 size=1048576 2024-09-05T00:56:25.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.689+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.2 size=67562 2024-09-05T00:56:25.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.689+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=HAPOOVO8LZRJ tag=RPLEY7CR41DI type=write size=3213290 2024-09-05T00:56:25.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.689+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~BSEDMISZ1XOZ.0 size=1048576 2024-09-05T00:56:25.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.693+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~BSEDMISZ1XOZ.1 size=79123 2024-09-05T00:56:25.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.697+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=BSEDMISZ1XOZ tag=K38UN4YSOGMT type=write size=2176275 2024-09-05T00:56:25.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.701+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=LTMWIEOYHAST type=write size=131286 2024-09-05T00:56:25.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.701+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.0 size=1048576 2024-09-05T00:56:25.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.701+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.1 size=1048576 2024-09-05T00:56:25.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.705+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~M3SK44S6JEPS.2 size=441818 2024-09-05T00:56:25.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.709+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=M3SK44S6JEPS tag=A8EO1VFL0YHL type=write size=3587546 2024-09-05T00:56:25.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.709+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=5VZJQSLY76QA type=del size=2148550 2024-09-05T00:56:25.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.713+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=6QYXRDWDEAC5 type=del 2024-09-05T00:56:25.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.717+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=TWIIT2WKZX0E type=write size=874186 2024-09-05T00:56:25.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.721+0000 7f325adab8c0 1 < suggested update operation key=G600UT533GTT tag=B24VM5W7ICBK type=del size=1524377 2024-09-05T00:56:25.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.725+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=KQZ2FRWO0D64 type=del size=2462872 2024-09-05T00:56:25.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.729+0000 7f325adab8c0 -1 < failed to complete operation key=G600UT533GTT tag=NJDA8HSPA96W type=del size=59842: (22) Invalid argument 2024-09-05T00:56:25.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.733+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OPBV0O7M0X29.0 size=1048576 2024-09-05T00:56:25.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.733+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~OPBV0O7M0X29.1 size=596588 2024-09-05T00:56:25.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.733+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=OPBV0O7M0X29 tag=L08JSW3N2K0P type=write size=2693740 2024-09-05T00:56:25.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.737+0000 7f325adab8c0 1 < canceled operation key=GQB4HOYII01G tag=NRYRMR5WVW4W type=del size=3571602 2024-09-05T00:56:25.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.741+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~I9TTTISVDK71.0 size=826481 2024-09-05T00:56:25.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.741+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=I9TTTISVDK71 tag=J104UBPD4P41 type=write size=1875057 2024-09-05T00:56:25.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.741+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.0 size=1048576 2024-09-05T00:56:25.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.745+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.1 size=1048576 2024-09-05T00:56:25.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.745+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~2V3FES7QRR6N.2 size=467285 2024-09-05T00:56:25.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.749+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=2V3FES7QRR6N tag=P75EWKMQZHL1 type=write size=3613013 2024-09-05T00:56:25.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.753+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=E3NIAS339WHD type=del size=1596203 2024-09-05T00:56:25.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.753+0000 7f325adab8c0 -1 < failed to complete operation key=G600UT533GTT tag=QJS1GBPDFMSP type=del size=607254: (22) Invalid argument 2024-09-05T00:56:25.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.761+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~93JLYW59QWXT.0 size=1048576 2024-09-05T00:56:25.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.761+0000 7f325adab8c0 1 > prepared part key=_multipart_GQB4HOYII01G.2~93JLYW59QWXT.1 size=943475 2024-09-05T00:56:25.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.761+0000 7f325adab8c0 1 > prepared multipart upload key=GQB4HOYII01G upload=93JLYW59QWXT tag=ZDK75BN67UHO type=write size=3040627 2024-09-05T00:56:25.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.765+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=FDFNAZZJT3VZ type=del 2024-09-05T00:56:25.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.769+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.0 size=1048576 2024-09-05T00:56:25.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.769+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.1 size=1048576 2024-09-05T00:56:25.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.773+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.2 size=682006 2024-09-05T00:56:25.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.773+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=8B9WSRWFWMAN tag=L3PC4Q8J2UZQ type=write size=3827734 2024-09-05T00:56:25.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.777+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=WFRV22QZ1KXU type=del size=2362310 2024-09-05T00:56:25.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.781+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=5VHO6MD1YX1F type=del size=10800 2024-09-05T00:56:25.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.781+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.0 size=1048576 2024-09-05T00:56:25.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.785+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.1 size=1048576 2024-09-05T00:56:25.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.785+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~96SV7UW67NNM.2 size=883799 2024-09-05T00:56:25.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.789+0000 7f325adab8c0 1 < completed multipart upload key=O0RSK2S88XHP upload=96SV7UW67NNM tag=BKYWV30P6Q6H type=write size=4029527 2024-09-05T00:56:25.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.793+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=TU75HTE8K152 type=del size=1588279 2024-09-05T00:56:25.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.797+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~3ELOF2C59UN9.0 size=654348 2024-09-05T00:56:25.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.801+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=3ELOF2C59UN9 tag=66NBAB4BDGKP type=write size=1702924 2024-09-05T00:56:25.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.801+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=GNXRRHT6SKUA type=write size=1008852 2024-09-05T00:56:25.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.809+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=VEUWR3ZATJ2J type=del 2024-09-05T00:56:25.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.813+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=F5XDS43G6PBD type=del size=2426621 2024-09-05T00:56:25.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.813+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~T4ZB10WALN6Z.0 size=1048576 2024-09-05T00:56:25.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.813+0000 7f325adab8c0 1 < canceled part key=_multipart_A9WMRV5QZ2FP.2~T4ZB10WALN6Z.1 size=246068 2024-09-05T00:56:25.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.821+0000 7f325adab8c0 1 < canceled multipart upload key=A9WMRV5QZ2FP upload=T4ZB10WALN6Z tag=II2FOK8CONJG type=write size=2343220 2024-09-05T00:56:25.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.821+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=RD89Q6472C3K type=del size=3044177 2024-09-05T00:56:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.825+0000 7f325adab8c0 1 < completed write operation key=71FWV15GD1QZ tag=RH3ODWQHVWDP type=write size=364404 2024-09-05T00:56:25.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.825+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=MSJRK3EJNISH type=del size=1021185 2024-09-05T00:56:25.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.829+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.0 size=1048576 2024-09-05T00:56:25.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.833+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.1 size=1048576 2024-09-05T00:56:25.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.833+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HAPOOVO8LZRJ.2 size=67562 2024-09-05T00:56:25.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.837+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=HAPOOVO8LZRJ tag=RPLEY7CR41DI type=write size=3213290 2024-09-05T00:56:25.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.841+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=ERFDP0K8IKYH type=del size=650288 2024-09-05T00:56:25.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.845+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=LTMWIEOYHAST type=write size=131286 2024-09-05T00:56:25.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.849+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.0 size=1048576 2024-09-05T00:56:25.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.849+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.1 size=1048576 2024-09-05T00:56:25.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.853+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.2 size=866799 2024-09-05T00:56:25.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.853+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=644FC0WFRRRF tag=U202OO3S67B1 type=write size=4012527 2024-09-05T00:56:25.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.857+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=5VZJQSLY76QA type=del size=2148550 2024-09-05T00:56:25.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.861+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QCFP443F8JTG.0 size=1048576 2024-09-05T00:56:25.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.865+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~QCFP443F8JTG.1 size=377912 2024-09-05T00:56:25.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.865+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=QCFP443F8JTG tag=GVFGV2GBDMTI type=write size=2475064 2024-09-05T00:56:25.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.869+0000 7f325adab8c0 1 < completed write operation key=5WOUI4SHYTSS tag=TWIIT2WKZX0E type=write size=874186 2024-09-05T00:56:25.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.869+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=9HZ4F2A7Z26O type=del size=570992 2024-09-05T00:56:25.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.873+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=KQZ2FRWO0D64 type=del 2024-09-05T00:56:25.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.877+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=XDQG4I3QT0SZ type=write size=880675 2024-09-05T00:56:25.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.877+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~OPBV0O7M0X29.0 size=1048576 2024-09-05T00:56:25.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.881+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~OPBV0O7M0X29.1 size=596588 2024-09-05T00:56:25.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.889+0000 7f325adab8c0 1 < canceled multipart upload key=O0RSK2S88XHP upload=OPBV0O7M0X29 tag=L08JSW3N2K0P type=write size=2693740 2024-09-05T00:56:25.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.889+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=UQT1K7C0D99U type=del size=1909927 2024-09-05T00:56:25.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.893+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~I9TTTISVDK71.0 size=826481 2024-09-05T00:56:25.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.897+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=I9TTTISVDK71 tag=J104UBPD4P41 type=write size=1875057 2024-09-05T00:56:25.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.901+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=W1LKJAAMEW06 type=del size=1541424 2024-09-05T00:56:25.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.905+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=E3NIAS339WHD type=del 2024-09-05T00:56:25.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.909+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=32PB2Z6M7R4Z type=del size=654030 2024-09-05T00:56:25.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.913+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~93JLYW59QWXT.0 size=1048576 2024-09-05T00:56:25.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.913+0000 7f325adab8c0 1 < completed part key=_multipart_GQB4HOYII01G.2~93JLYW59QWXT.1 size=943475 2024-09-05T00:56:25.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.921+0000 7f325adab8c0 1 < completed multipart upload key=GQB4HOYII01G upload=93JLYW59QWXT tag=ZDK75BN67UHO type=write size=3040627 2024-09-05T00:56:25.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.925+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.0 size=1048576 2024-09-05T00:56:25.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.925+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.1 size=1048576 2024-09-05T00:56:25.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.929+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.2 size=323476 2024-09-05T00:56:25.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.929+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=KMQJD28S6XVC tag=UM2TQX3N6TA8 type=write size=3469204 2024-09-05T00:56:25.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.933+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.0 size=1048576 2024-09-05T00:56:25.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.933+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.1 size=1048576 2024-09-05T00:56:25.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.933+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~8B9WSRWFWMAN.2 size=682006 2024-09-05T00:56:25.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.941+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=8B9WSRWFWMAN tag=L3PC4Q8J2UZQ type=write size=3827734 2024-09-05T00:56:25.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.941+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=4YB2NSHENRLK type=del size=1719402 2024-09-05T00:56:25.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.945+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=5VHO6MD1YX1F type=del 2024-09-05T00:56:25.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.949+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=2G6E0T2XJQGX type=del size=140928 2024-09-05T00:56:25.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.949+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=TU75HTE8K152 type=del 2024-09-05T00:56:25.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.953+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.0 size=1048576 2024-09-05T00:56:25.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.957+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.1 size=1048576 2024-09-05T00:56:25.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.957+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.2 size=228114 2024-09-05T00:56:25.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.957+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=9O0RAB4SCAYV tag=27A7DTMG41LG type=write size=3373842 2024-09-05T00:56:25.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.961+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=GNXRRHT6SKUA type=write size=1008852 2024-09-05T00:56:25.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.965+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=32RX3NKY7KPR type=del size=3743798 2024-09-05T00:56:25.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.965+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=F5XDS43G6PBD type=del 2024-09-05T00:56:25.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.969+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~5IYYA6QMEZX0.0 size=1048576 2024-09-05T00:56:25.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.973+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~5IYYA6QMEZX0.1 size=868334 2024-09-05T00:56:25.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.973+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=5IYYA6QMEZX0 tag=AYJCX2ZKM2I3 type=write size=2965486 2024-09-05T00:56:25.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.977+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=RD89Q6472C3K type=del 2024-09-05T00:56:25.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.981+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~QQGTI6SB81H0.0 size=76897 2024-09-05T00:56:25.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.981+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=QQGTI6SB81H0 tag=LCYXAOPRZMZW type=write size=1125473 2024-09-05T00:56:25.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.985+0000 7f325adab8c0 1 < canceled operation key=MBJLOE5XFPYN tag=MSJRK3EJNISH type=del size=1021185 2024-09-05T00:56:25.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.989+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.0 size=1048576 2024-09-05T00:56:25.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.989+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.1 size=1048576 2024-09-05T00:56:25.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.993+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.2 size=495018 2024-09-05T00:56:25.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.993+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=BJJAPFCPICZH tag=0064Z4SCM93U type=write size=3640746 2024-09-05T00:56:25.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.997+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=ERFDP0K8IKYH type=del 2024-09-05T00:56:26.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:25.997+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=GAOI3872S9JO type=del size=697009 2024-09-05T00:56:26.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.001+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.0 size=1048576 2024-09-05T00:56:26.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.001+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.1 size=1048576 2024-09-05T00:56:26.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.005+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~644FC0WFRRRF.2 size=866799 2024-09-05T00:56:26.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.009+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=644FC0WFRRRF tag=U202OO3S67B1 type=write size=4012527 2024-09-05T00:56:26.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.013+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~W20HCE2B0GG5.0 size=169080 2024-09-05T00:56:26.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.013+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=W20HCE2B0GG5 tag=0UN9H6HLCO4W type=write size=1217656 2024-09-05T00:56:26.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.017+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QCFP443F8JTG.0 size=1048576 2024-09-05T00:56:26.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.017+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~QCFP443F8JTG.1 size=377912 2024-09-05T00:56:26.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.021+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=QCFP443F8JTG tag=GVFGV2GBDMTI type=write size=2475064 2024-09-05T00:56:26.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.025+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~2NDXOUXG6N1W.0 size=734329 2024-09-05T00:56:26.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.025+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=2NDXOUXG6N1W tag=IAP6UM7ILHG2 type=write size=1782905 2024-09-05T00:56:26.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.029+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=9HZ4F2A7Z26O type=del 2024-09-05T00:56:26.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.033+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ZFSG2H3WV3RQ.0 size=1048576 2024-09-05T00:56:26.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.033+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~ZFSG2H3WV3RQ.1 size=534634 2024-09-05T00:56:26.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.033+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=ZFSG2H3WV3RQ tag=B933T30DF4L2 type=write size=2631786 2024-09-05T00:56:26.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.037+0000 7f325adab8c0 1 < suggested remove operation key=ZYT3WYNFIIZN tag=XDQG4I3QT0SZ type=write 2024-09-05T00:56:26.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.041+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=3X4J3AWE48RH type=del size=2951810 2024-09-05T00:56:26.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.045+0000 7f325adab8c0 1 < canceled operation key=ZVKLK751KO5T tag=UQT1K7C0D99U type=del size=1909927 2024-09-05T00:56:26.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.049+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.0 size=1048576 2024-09-05T00:56:26.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.049+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.1 size=1048576 2024-09-05T00:56:26.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.053+0000 7f325adab8c0 1 > prepared part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.2 size=401779 2024-09-05T00:56:26.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.053+0000 7f325adab8c0 1 > prepared multipart upload key=YMIGZMLJSI4D upload=21N4DPBE8XSL tag=FKZH64O1GLZA type=write size=3547507 2024-09-05T00:56:26.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.057+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=W1LKJAAMEW06 type=del 2024-09-05T00:56:26.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.061+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=3M9SX0KPZBBX type=del size=4033398 2024-09-05T00:56:26.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.061+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=32PB2Z6M7R4Z type=del 2024-09-05T00:56:26.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.065+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=MD23LLF29F1U type=del size=1386891 2024-09-05T00:56:26.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.069+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.0 size=1048576 2024-09-05T00:56:26.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.069+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.1 size=1048576 2024-09-05T00:56:26.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.073+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KMQJD28S6XVC.2 size=323476 2024-09-05T00:56:26.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.077+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=KMQJD28S6XVC tag=UM2TQX3N6TA8 type=write size=3469204 2024-09-05T00:56:26.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.077+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=BGDIAFKD9HBJ type=write size=393088 2024-09-05T00:56:26.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.081+0000 7f325adab8c0 1 < canceled operation key=GQB4HOYII01G tag=4YB2NSHENRLK type=del size=1719402 2024-09-05T00:56:26.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.085+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=PM1OL959U21N type=write size=246019 2024-09-05T00:56:26.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.085+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=2G6E0T2XJQGX type=del 2024-09-05T00:56:26.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.089+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~77FLADE2GCRA.0 size=1048576 2024-09-05T00:56:26.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.093+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~77FLADE2GCRA.1 size=138464 2024-09-05T00:56:26.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.093+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=77FLADE2GCRA tag=8Y8LMKEYL36B type=write size=2235616 2024-09-05T00:56:26.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.093+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.0 size=1048576 2024-09-05T00:56:26.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.097+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.1 size=1048576 2024-09-05T00:56:26.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.097+0000 7f325adab8c0 1 < canceled part key=_multipart_MYR9H12B5YYV.2~9O0RAB4SCAYV.2 size=228114 2024-09-05T00:56:26.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.101+0000 7f325adab8c0 1 < canceled multipart upload key=MYR9H12B5YYV upload=9O0RAB4SCAYV tag=27A7DTMG41LG type=write size=3373842 2024-09-05T00:56:26.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.105+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~T0IYISS340ME.0 size=411432 2024-09-05T00:56:26.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.105+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=T0IYISS340ME tag=5BPJUHRGXWLT type=write size=1460008 2024-09-05T00:56:26.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.109+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=32RX3NKY7KPR type=del 2024-09-05T00:56:26.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.113+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.0 size=1048576 2024-09-05T00:56:26.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.117+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.1 size=1048576 2024-09-05T00:56:26.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.117+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.2 size=425845 2024-09-05T00:56:26.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.117+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=6DV0G2CU45LC tag=OIYNUKM6BW7U type=write size=3571573 2024-09-05T00:56:26.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.121+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~5IYYA6QMEZX0.0 size=1048576 2024-09-05T00:56:26.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.121+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~5IYYA6QMEZX0.1 size=868334 2024-09-05T00:56:26.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.129+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=5IYYA6QMEZX0 tag=AYJCX2ZKM2I3 type=write size=2965486 2024-09-05T00:56:26.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.133+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.0 size=1048576 2024-09-05T00:56:26.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.133+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.1 size=1048576 2024-09-05T00:56:26.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.137+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.2 size=181553 2024-09-05T00:56:26.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.137+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=3HAMXT0CDFGZ tag=IZ127W0GQL5K type=write size=3327281 2024-09-05T00:56:26.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.141+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~QQGTI6SB81H0.0 size=76897 2024-09-05T00:56:26.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.145+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=QQGTI6SB81H0 tag=LCYXAOPRZMZW type=write size=1125473 2024-09-05T00:56:26.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.149+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=XWO6C3R40G6K type=del size=3548089 2024-09-05T00:56:26.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.149+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.0 size=1048576 2024-09-05T00:56:26.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.153+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.1 size=1048576 2024-09-05T00:56:26.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.153+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BJJAPFCPICZH.2 size=495018 2024-09-05T00:56:26.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.157+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=BJJAPFCPICZH tag=0064Z4SCM93U type=write size=3640746 2024-09-05T00:56:26.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.161+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~Z2R84HA0E68R.0 size=641697 2024-09-05T00:56:26.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.161+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=Z2R84HA0E68R tag=7DZ5LD8O6TFY type=write size=1690273 2024-09-05T00:56:26.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.165+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=GAOI3872S9JO type=del 2024-09-05T00:56:26.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.169+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=BEBXWCBOZEK0 type=del size=4046646 2024-09-05T00:56:26.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.169+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~W20HCE2B0GG5.0 size=169080 2024-09-05T00:56:26.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.173+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=W20HCE2B0GG5 tag=0UN9H6HLCO4W type=write size=1217656 2024-09-05T00:56:26.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.177+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=GMGJAU7ZN714 type=del size=788053 2024-09-05T00:56:26.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.181+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~2NDXOUXG6N1W.0 size=734329 2024-09-05T00:56:26.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.185+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=2NDXOUXG6N1W tag=IAP6UM7ILHG2 type=write size=1782905 2024-09-05T00:56:26.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.189+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.0 size=1048576 2024-09-05T00:56:26.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.189+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.1 size=1048576 2024-09-05T00:56:26.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.189+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.2 size=213548 2024-09-05T00:56:26.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.189+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=N15VGTMRXVR0 tag=IZ329PHJN0KO type=write size=3359276 2024-09-05T00:56:26.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.193+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~ZFSG2H3WV3RQ.0 size=1048576 2024-09-05T00:56:26.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.197+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~ZFSG2H3WV3RQ.1 size=534634 2024-09-05T00:56:26.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.201+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=ZFSG2H3WV3RQ tag=B933T30DF4L2 type=write size=2631786 2024-09-05T00:56:26.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.201+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=RIPCB0ERHG15 type=del size=1948534 2024-09-05T00:56:26.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.205+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=3X4J3AWE48RH type=del 2024-09-05T00:56:26.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.205+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=HT8BM41MYU0G type=write size=585944 2024-09-05T00:56:26.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.209+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.0 size=1048576 2024-09-05T00:56:26.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.209+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.1 size=1048576 2024-09-05T00:56:26.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.213+0000 7f325adab8c0 1 < completed part key=_multipart_YMIGZMLJSI4D.2~21N4DPBE8XSL.2 size=401779 2024-09-05T00:56:26.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.213+0000 7f325adab8c0 1 < completed multipart upload key=YMIGZMLJSI4D upload=21N4DPBE8XSL tag=FKZH64O1GLZA type=write size=3547507 2024-09-05T00:56:26.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~A17XK6D3RZTU.0 size=864693 2024-09-05T00:56:26.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.217+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=A17XK6D3RZTU tag=MN2Q0FFZYP2V type=write size=1913269 2024-09-05T00:56:26.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.221+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=3M9SX0KPZBBX type=del 2024-09-05T00:56:26.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.221+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=OJR95I4O22HH type=del size=734306 2024-09-05T00:56:26.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.225+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=MD23LLF29F1U type=del 2024-09-05T00:56:26.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.229+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=HTMWZCT5TDEW type=del size=3544282 2024-09-05T00:56:26.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.229+0000 7f325adab8c0 1 < completed write operation key=6N7BLJ1WLDGN tag=BGDIAFKD9HBJ type=write size=393088 2024-09-05T00:56:26.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.233+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~6JE819OK9TEN.0 size=757261 2024-09-05T00:56:26.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.233+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=6JE819OK9TEN tag=4FIZSNOAM845 type=write size=1805837 2024-09-05T00:56:26.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.237+0000 7f325adab8c0 1 < canceled operation key=UW0SSQ8VFY1G tag=PM1OL959U21N type=write size=246019 2024-09-05T00:56:26.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.241+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.0 size=1048576 2024-09-05T00:56:26.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.241+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.1 size=1048576 2024-09-05T00:56:26.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.245+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.2 size=15988 2024-09-05T00:56:26.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.245+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=QHD5637X3KKV tag=XLKL7BKLSXZI type=write size=3161716 2024-09-05T00:56:26.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.245+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~77FLADE2GCRA.0 size=1048576 2024-09-05T00:56:26.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.249+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~77FLADE2GCRA.1 size=138464 2024-09-05T00:56:26.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.253+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=77FLADE2GCRA tag=8Y8LMKEYL36B type=write size=2235616 2024-09-05T00:56:26.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.253+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=UBPLGG81RFLL type=del size=3852100 2024-09-05T00:56:26.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.257+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~T0IYISS340ME.0 size=411432 2024-09-05T00:56:26.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.261+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=T0IYISS340ME tag=5BPJUHRGXWLT type=write size=1460008 2024-09-05T00:56:26.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.261+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=P6FR3IMPACLQ type=del size=1511962 2024-09-05T00:56:26.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.265+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.0 size=1048576 2024-09-05T00:56:26.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.269+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.1 size=1048576 2024-09-05T00:56:26.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.269+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~6DV0G2CU45LC.2 size=425845 2024-09-05T00:56:26.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.273+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=6DV0G2CU45LC tag=OIYNUKM6BW7U type=write size=3571573 2024-09-05T00:56:26.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.277+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=4RQDHMPGA2K5 type=del size=1271872 2024-09-05T00:56:26.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.281+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.0 size=1048576 2024-09-05T00:56:26.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.285+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.1 size=1048576 2024-09-05T00:56:26.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.289+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~3HAMXT0CDFGZ.2 size=181553 2024-09-05T00:56:26.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.293+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=3HAMXT0CDFGZ tag=IZ127W0GQL5K type=write size=3327281 2024-09-05T00:56:26.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.297+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~TELG25CUXUDN.0 size=23243 2024-09-05T00:56:26.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.297+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=TELG25CUXUDN tag=WBNH4NSLFM03 type=write size=1071819 2024-09-05T00:56:26.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.301+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=XWO6C3R40G6K type=del 2024-09-05T00:56:26.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.305+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~HV8GZYSYQEQG.0 size=638285 2024-09-05T00:56:26.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.305+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=HV8GZYSYQEQG tag=P5KY50N95FZ8 type=write size=1686861 2024-09-05T00:56:26.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.309+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~Z2R84HA0E68R.0 size=641697 2024-09-05T00:56:26.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.313+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=Z2R84HA0E68R tag=7DZ5LD8O6TFY type=write size=1690273 2024-09-05T00:56:26.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.317+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=XDN9FWSN5J26 type=write size=440262 2024-09-05T00:56:26.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.321+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=BEBXWCBOZEK0 type=del 2024-09-05T00:56:26.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.321+0000 7f325adab8c0 1 > prepared operation key=ZYT3WYNFIIZN tag=BHKZTNSX7W8W type=del size=1661358 2024-09-05T00:56:26.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.329+0000 7f325adab8c0 1 < suggested remove operation key=MYR9H12B5YYV tag=GMGJAU7ZN714 type=del 2024-09-05T00:56:26.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.329+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=PXERYIOCAWFT type=del size=816878 2024-09-05T00:56:26.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.333+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.0 size=1048576 2024-09-05T00:56:26.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.333+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.1 size=1048576 2024-09-05T00:56:26.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.333+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~N15VGTMRXVR0.2 size=213548 2024-09-05T00:56:26.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.337+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=N15VGTMRXVR0 tag=IZ329PHJN0KO type=write size=3359276 2024-09-05T00:56:26.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.337+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=610T07XRPWTI type=del size=1942685 2024-09-05T00:56:26.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.341+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=RIPCB0ERHG15 type=del 2024-09-05T00:56:26.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.345+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UP6CBXENK4DI.0 size=1048576 2024-09-05T00:56:26.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.345+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UP6CBXENK4DI.1 size=58556 2024-09-05T00:56:26.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.345+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=UP6CBXENK4DI tag=RV3FSB502188 type=write size=2155708 2024-09-05T00:56:26.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.353+0000 7f325adab8c0 1 < suggested remove operation key=JKRZR0KRE93F tag=HT8BM41MYU0G type=write 2024-09-05T00:56:26.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.353+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=DJYZGK03C5VL type=del size=1289988 2024-09-05T00:56:26.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.353+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~A17XK6D3RZTU.0 size=864693 2024-09-05T00:56:26.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.361+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=A17XK6D3RZTU tag=MN2Q0FFZYP2V type=write size=1913269 2024-09-05T00:56:26.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.361+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=XVDFO9OD8NI3 type=del size=2101536 2024-09-05T00:56:26.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.365+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=OJR95I4O22HH type=del 2024-09-05T00:56:26.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.365+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=9MWIJAOFEUSG type=del size=2538678 2024-09-05T00:56:26.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.369+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=HTMWZCT5TDEW type=del 2024-09-05T00:56:26.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.369+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=K7GRYIT3MYLF type=del size=3834978 2024-09-05T00:56:26.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.373+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~6JE819OK9TEN.0 size=757261 2024-09-05T00:56:26.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.377+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=6JE819OK9TEN tag=4FIZSNOAM845 type=write size=1805837 2024-09-05T00:56:26.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.377+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=0NZQEVTP7J7G type=del size=2692791 2024-09-05T00:56:26.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.381+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.0 size=1048576 2024-09-05T00:56:26.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.381+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.1 size=1048576 2024-09-05T00:56:26.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.385+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~QHD5637X3KKV.2 size=15988 2024-09-05T00:56:26.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.389+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=QHD5637X3KKV tag=XLKL7BKLSXZI type=write size=3161716 2024-09-05T00:56:26.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.389+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=X99T0I93A2TV type=write size=347712 2024-09-05T00:56:26.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.393+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=UBPLGG81RFLL type=del 2024-09-05T00:56:26.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.397+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.0 size=1048576 2024-09-05T00:56:26.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.397+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.1 size=1048576 2024-09-05T00:56:26.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.397+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.2 size=1018885 2024-09-05T00:56:26.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.397+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=RZNKMDBMP0IW tag=5X03S0ZUE73I type=write size=4164613 2024-09-05T00:56:26.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.401+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=P6FR3IMPACLQ type=del 2024-09-05T00:56:26.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.405+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=HC55NJ6Y1L8C type=del size=2786605 2024-09-05T00:56:26.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.405+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=4RQDHMPGA2K5 type=del 2024-09-05T00:56:26.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.409+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=6YQVXU21ZDCM type=del size=1114173 2024-09-05T00:56:26.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.409+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~TELG25CUXUDN.0 size=23243 2024-09-05T00:56:26.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.413+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=TELG25CUXUDN tag=WBNH4NSLFM03 type=write size=1071819 2024-09-05T00:56:26.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.417+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=LL4DRWFXTM1M type=del size=1409519 2024-09-05T00:56:26.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.417+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~HV8GZYSYQEQG.0 size=638285 2024-09-05T00:56:26.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.421+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=HV8GZYSYQEQG tag=P5KY50N95FZ8 type=write size=1686861 2024-09-05T00:56:26.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.421+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=5LL8EMP89N77 type=del size=3613067 2024-09-05T00:56:26.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.425+0000 7f325adab8c0 1 < completed write operation key=G600UT533GTT tag=XDN9FWSN5J26 type=write size=440262 2024-09-05T00:56:26.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.429+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=OVV76NYMADE1 type=del size=3259023 2024-09-05T00:56:26.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.429+0000 7f325adab8c0 1 < completed delete operation key=ZYT3WYNFIIZN tag=BHKZTNSX7W8W type=del 2024-09-05T00:56:26.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.433+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=EE27V11OYVKJ type=del size=614763 2024-09-05T00:56:26.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.433+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=PXERYIOCAWFT type=del 2024-09-05T00:56:26.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.437+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~HQCSQG7AFI73.0 size=1048576 2024-09-05T00:56:26.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.441+0000 7f325adab8c0 1 > prepared part key=_multipart_LVZALGRNP5TU.2~HQCSQG7AFI73.1 size=891784 2024-09-05T00:56:26.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.441+0000 7f325adab8c0 1 > prepared multipart upload key=LVZALGRNP5TU upload=HQCSQG7AFI73 tag=Z1QDKUR14D9G type=write size=2988936 2024-09-05T00:56:26.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.441+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=610T07XRPWTI type=del 2024-09-05T00:56:26.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.445+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=BGXCR5DH18NJ type=del size=1970072 2024-09-05T00:56:26.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.449+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~UP6CBXENK4DI.0 size=1048576 2024-09-05T00:56:26.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.449+0000 7f325adab8c0 1 < completed part key=_multipart_MYR9H12B5YYV.2~UP6CBXENK4DI.1 size=58556 2024-09-05T00:56:26.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.453+0000 7f325adab8c0 1 < completed multipart upload key=MYR9H12B5YYV upload=UP6CBXENK4DI tag=RV3FSB502188 type=write size=2155708 2024-09-05T00:56:26.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.457+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=3PASJSSJQSO7 type=del size=1261022 2024-09-05T00:56:26.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.461+0000 7f325adab8c0 1 < suggested update operation key=6N7BLJ1WLDGN tag=DJYZGK03C5VL type=del size=1289988 2024-09-05T00:56:26.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.461+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=KZ43ZWEY4CWM type=del size=4013484 2024-09-05T00:56:26.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.465+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=XVDFO9OD8NI3 type=del size=2101536 2024-09-05T00:56:26.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.469+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=SMYGTVE7Z3IO type=del size=1045131 2024-09-05T00:56:26.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.469+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=9MWIJAOFEUSG type=del 2024-09-05T00:56:26.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.473+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~A6SK0RBIF1IE.0 size=383924 2024-09-05T00:56:26.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.473+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=A6SK0RBIF1IE tag=V67YSS9WL9L5 type=write size=1432500 2024-09-05T00:56:26.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.477+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=K7GRYIT3MYLF type=del 2024-09-05T00:56:26.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.477+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=CFQ6THSB5ECJ type=del size=2650780 2024-09-05T00:56:26.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.481+0000 7f325adab8c0 1 < suggested update operation key=CB079FGXKNRO tag=0NZQEVTP7J7G type=del size=2692791 2024-09-05T00:56:26.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.485+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VMW0L66BQSLB.0 size=1048576 2024-09-05T00:56:26.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.489+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~VMW0L66BQSLB.1 size=124989 2024-09-05T00:56:26.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.489+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=VMW0L66BQSLB tag=0VU8NBGMR0XC type=write size=2222141 2024-09-05T00:56:26.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.493+0000 7f325adab8c0 1 < completed write operation key=XKOECM0CCOKX tag=X99T0I93A2TV type=write size=347712 2024-09-05T00:56:26.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.493+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=DAKGFTJJIG6D type=write size=208925 2024-09-05T00:56:26.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.497+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.0 size=1048576 2024-09-05T00:56:26.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.497+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.1 size=1048576 2024-09-05T00:56:26.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.501+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~RZNKMDBMP0IW.2 size=1018885 2024-09-05T00:56:26.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.505+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=RZNKMDBMP0IW tag=5X03S0ZUE73I type=write size=4164613 2024-09-05T00:56:26.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.509+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=CE0EPX74QMI4 type=del size=2079642 2024-09-05T00:56:26.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.513+0000 7f325adab8c0 1 < canceled operation key=VYMRZPO6VKGS tag=HC55NJ6Y1L8C type=del size=2786605 2024-09-05T00:56:26.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.517+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.0 size=1048576 2024-09-05T00:56:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.517+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.1 size=1048576 2024-09-05T00:56:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.517+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.2 size=726711 2024-09-05T00:56:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.517+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=446KBES2NOV6 tag=1JDI5T5D8AGH type=write size=3872439 2024-09-05T00:56:26.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.521+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=6YQVXU21ZDCM type=del 2024-09-05T00:56:26.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.525+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MI5IJG780AR1.0 size=1048576 2024-09-05T00:56:26.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.525+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MI5IJG780AR1.1 size=1035749 2024-09-05T00:56:26.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.525+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=MI5IJG780AR1 tag=E06EDGWK7BUL type=write size=3132901 2024-09-05T00:56:26.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.529+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=LL4DRWFXTM1M type=del 2024-09-05T00:56:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.533+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=5Q3ZCVMGF3RZ type=del size=4071491 2024-09-05T00:56:26.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.533+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=5LL8EMP89N77 type=del size=3613067 2024-09-05T00:56:26.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.537+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=WSO3W2GSDGQC type=del size=1290606 2024-09-05T00:56:26.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.537+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=OVV76NYMADE1 type=del 2024-09-05T00:56:26.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.541+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~QYNBPURU0ZZY.0 size=729986 2024-09-05T00:56:26.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.541+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=QYNBPURU0ZZY tag=VXBQV92CVGCR type=write size=1778562 2024-09-05T00:56:26.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.545+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=EE27V11OYVKJ type=del 2024-09-05T00:56:26.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.549+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~G16J5HGYD4GW.0 size=681768 2024-09-05T00:56:26.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.549+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=G16J5HGYD4GW tag=5GG20EHID0T5 type=write size=1730344 2024-09-05T00:56:26.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.549+0000 7f325adab8c0 1 < completed part key=_multipart_LVZALGRNP5TU.2~HQCSQG7AFI73.0 size=1048576 2024-09-05T00:56:26.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.549+0000 7f325adab8c0 1 < canceled part key=_multipart_LVZALGRNP5TU.2~HQCSQG7AFI73.1 size=891784 2024-09-05T00:56:26.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.553+0000 7f325adab8c0 1 < canceled multipart upload key=LVZALGRNP5TU upload=HQCSQG7AFI73 tag=Z1QDKUR14D9G type=write size=2988936 2024-09-05T00:56:26.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.557+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.0 size=1048576 2024-09-05T00:56:26.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.557+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.1 size=1048576 2024-09-05T00:56:26.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.561+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.2 size=382058 2024-09-05T00:56:26.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.561+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=0W9QAPLJWUQ7 tag=JF82FIYNJBAW type=write size=3527786 2024-09-05T00:56:26.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.561+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=BGXCR5DH18NJ type=del 2024-09-05T00:56:26.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.565+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=OTSPLI5FCBZW type=del size=1708021 2024-09-05T00:56:26.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.565+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=3PASJSSJQSO7 type=del 2024-09-05T00:56:26.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.569+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=NBQCFL8GLD0W type=del size=1776921 2024-09-05T00:56:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.569+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=KZ43ZWEY4CWM type=del 2024-09-05T00:56:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.573+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~R4M5J0HF8FFZ.0 size=1048576 2024-09-05T00:56:26.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.577+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~R4M5J0HF8FFZ.1 size=71979 2024-09-05T00:56:26.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.577+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=R4M5J0HF8FFZ tag=1QHCIHGX9GZ2 type=write size=2169131 2024-09-05T00:56:26.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.577+0000 7f325adab8c0 -1 < failed to complete operation key=CB079FGXKNRO tag=SMYGTVE7Z3IO type=del size=1045131: (22) Invalid argument 2024-09-05T00:56:26.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.581+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=K7EJA13FTJ43 type=del size=2872291 2024-09-05T00:56:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.581+0000 7f325adab8c0 1 < canceled part key=_multipart_MYR9H12B5YYV.2~A6SK0RBIF1IE.0 size=383924 2024-09-05T00:56:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.581+0000 7f325adab8c0 1 < canceled multipart upload key=MYR9H12B5YYV upload=A6SK0RBIF1IE tag=V67YSS9WL9L5 type=write size=1432500 2024-09-05T00:56:26.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.585+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=TQ56GYVFTU1X type=del size=1164591 2024-09-05T00:56:26.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.585+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=CFQ6THSB5ECJ type=del 2024-09-05T00:56:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.589+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=UPSM2Q9U1XP6 type=del size=4017546 2024-09-05T00:56:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.589+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VMW0L66BQSLB.0 size=1048576 2024-09-05T00:56:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.593+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~VMW0L66BQSLB.1 size=124989 2024-09-05T00:56:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.597+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=VMW0L66BQSLB tag=0VU8NBGMR0XC type=write size=2222141 2024-09-05T00:56:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.597+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=MC2FD8CIYFF2 type=del size=2001885 2024-09-05T00:56:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.601+0000 7f325adab8c0 1 < canceled operation key=SP188HM5LG2D tag=DAKGFTJJIG6D type=write size=208925 2024-09-05T00:56:26.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.601+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.0 size=1048576 2024-09-05T00:56:26.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.605+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.1 size=1048576 2024-09-05T00:56:26.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.605+0000 7f325adab8c0 1 > prepared part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.2 size=302750 2024-09-05T00:56:26.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.605+0000 7f325adab8c0 1 > prepared multipart upload key=O0RSK2S88XHP upload=UST9PNQQXEV6 tag=UIKYZ07E5BNE type=write size=3448478 2024-09-05T00:56:26.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.609+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=CE0EPX74QMI4 type=del 2024-09-05T00:56:26.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.609+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=4Q3HITKZ0BP3 type=write size=35734 2024-09-05T00:56:26.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.613+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.0 size=1048576 2024-09-05T00:56:26.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.613+0000 7f325adab8c0 1 < canceled part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.1 size=1048576 2024-09-05T00:56:26.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.617+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~446KBES2NOV6.2 size=726711 2024-09-05T00:56:26.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.621+0000 7f325adab8c0 1 < canceled multipart upload key=JKRZR0KRE93F upload=446KBES2NOV6 tag=1JDI5T5D8AGH type=write size=3872439 2024-09-05T00:56:26.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.621+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=4MXKYPF91I26 type=del size=2390131 2024-09-05T00:56:26.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.625+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~MI5IJG780AR1.0 size=1048576 2024-09-05T00:56:26.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.625+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~MI5IJG780AR1.1 size=1035749 2024-09-05T00:56:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.629+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=MI5IJG780AR1 tag=E06EDGWK7BUL type=write size=3132901 2024-09-05T00:56:26.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.633+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=7BLPAJAM3LFB type=del size=438291 2024-09-05T00:56:26.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.633+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=5Q3ZCVMGF3RZ type=del 2024-09-05T00:56:26.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.637+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=EBTA7334AYD2 type=del size=78156 2024-09-05T00:56:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.637+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=WSO3W2GSDGQC type=del 2024-09-05T00:56:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.641+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.0 size=1048576 2024-09-05T00:56:26.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.645+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.1 size=1048576 2024-09-05T00:56:26.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.645+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.2 size=885681 2024-09-05T00:56:26.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.645+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=4L3VC7QFKVU8 tag=10VEO5NX0Z83 type=write size=4031409 2024-09-05T00:56:26.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.649+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~QYNBPURU0ZZY.0 size=729986 2024-09-05T00:56:26.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.653+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=QYNBPURU0ZZY tag=VXBQV92CVGCR type=write size=1778562 2024-09-05T00:56:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.653+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=1N47SNBP163O type=del size=2578260 2024-09-05T00:56:26.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.657+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~G16J5HGYD4GW.0 size=681768 2024-09-05T00:56:26.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.661+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=G16J5HGYD4GW tag=5GG20EHID0T5 type=write size=1730344 2024-09-05T00:56:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.661+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=SLUD5JBG0T7M type=del size=1143702 2024-09-05T00:56:26.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.665+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.0 size=1048576 2024-09-05T00:56:26.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.669+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.1 size=1048576 2024-09-05T00:56:26.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.669+0000 7f325adab8c0 1 < canceled part key=_multipart_HW4QK67332RW.2~0W9QAPLJWUQ7.2 size=382058 2024-09-05T00:56:26.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.669+0000 7f325adab8c0 1 < canceled multipart upload key=HW4QK67332RW upload=0W9QAPLJWUQ7 tag=JF82FIYNJBAW type=write size=3527786 2024-09-05T00:56:26.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.673+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=NOSL23FSVQ3B type=del size=3701192 2024-09-05T00:56:26.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.677+0000 7f325adab8c0 1 < canceled operation key=VYMRZPO6VKGS tag=OTSPLI5FCBZW type=del size=1708021 2024-09-05T00:56:26.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.677+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=RLEJJB4AY0NU type=del size=3112488 2024-09-05T00:56:26.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.681+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=NBQCFL8GLD0W type=del 2024-09-05T00:56:26.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.681+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=6U6H2TQDXO08 type=del size=2298086 2024-09-05T00:56:26.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.685+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~R4M5J0HF8FFZ.0 size=1048576 2024-09-05T00:56:26.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.685+0000 7f325adab8c0 1 < completed part key=_multipart_IGOUBVL3XVS3.2~R4M5J0HF8FFZ.1 size=71979 2024-09-05T00:56:26.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.689+0000 7f325adab8c0 1 < completed multipart upload key=IGOUBVL3XVS3 upload=R4M5J0HF8FFZ tag=1QHCIHGX9GZ2 type=write size=2169131 2024-09-05T00:56:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.693+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=J1QW4UT8F0XP type=write size=797277 2024-09-05T00:56:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.693+0000 7f325adab8c0 1 < completed delete operation key=JKRZR0KRE93F tag=K7EJA13FTJ43 type=del 2024-09-05T00:56:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.697+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=M4TYN50NHVTE type=write size=189291 2024-09-05T00:56:26.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.697+0000 7f325adab8c0 1 < canceled operation key=079QFDETDGGC tag=TQ56GYVFTU1X type=del size=1164591 2024-09-05T00:56:26.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.701+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=RFZJS3QXZ7JF type=write size=364242 2024-09-05T00:56:26.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.701+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=UPSM2Q9U1XP6 type=del 2024-09-05T00:56:26.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.705+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~WP19ZEH56L7M.0 size=157511 2024-09-05T00:56:26.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.705+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=WP19ZEH56L7M tag=66PSEATMV4BW type=write size=1206087 2024-09-05T00:56:26.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.713+0000 7f325adab8c0 1 < completed delete operation key=GF6OC9O60D5E tag=MC2FD8CIYFF2 type=del 2024-09-05T00:56:26.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.713+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=VG0WX2WRQ1ZY type=write size=767491 2024-09-05T00:56:26.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.717+0000 7f325adab8c0 1 < completed part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.0 size=1048576 2024-09-05T00:56:26.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.717+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.1 size=1048576 2024-09-05T00:56:26.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.717+0000 7f325adab8c0 1 < canceled part key=_multipart_O0RSK2S88XHP.2~UST9PNQQXEV6.2 size=302750 2024-09-05T00:56:26.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.721+0000 7f325adab8c0 1 < canceled multipart upload key=O0RSK2S88XHP upload=UST9PNQQXEV6 tag=UIKYZ07E5BNE type=write size=3448478 2024-09-05T00:56:26.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.721+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=YUB5W0G2CCYU type=del size=544984 2024-09-05T00:56:26.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.725+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=4Q3HITKZ0BP3 type=write size=35734 2024-09-05T00:56:26.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.725+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=8ZFSB2MKJQ8M type=del size=3105983 2024-09-05T00:56:26.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.729+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=4MXKYPF91I26 type=del 2024-09-05T00:56:26.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.733+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=KY31FIND3451 type=write size=901878 2024-09-05T00:56:26.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.733+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=7BLPAJAM3LFB type=del 2024-09-05T00:56:26.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.737+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=ONTFWGYQEDQ8 type=write size=406623 2024-09-05T00:56:26.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.741+0000 7f325adab8c0 1 < suggested update operation key=079QFDETDGGC tag=EBTA7334AYD2 type=del size=78156 2024-09-05T00:56:26.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.741+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=QB57Y0W1M15B type=del size=2765142 2024-09-05T00:56:26.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.745+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.0 size=1048576 2024-09-05T00:56:26.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.749+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.1 size=1048576 2024-09-05T00:56:26.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.749+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~4L3VC7QFKVU8.2 size=885681 2024-09-05T00:56:26.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.753+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=4L3VC7QFKVU8 tag=10VEO5NX0Z83 type=write size=4031409 2024-09-05T00:56:26.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.757+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=73BBKOGPFO69 type=del size=3655445 2024-09-05T00:56:26.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.765+0000 7f325adab8c0 1 < suggested update operation key=079QFDETDGGC tag=1N47SNBP163O type=del size=2578260 2024-09-05T00:56:26.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.765+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=21G3ZXL740SJ type=write size=845642 2024-09-05T00:56:26.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.769+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=SLUD5JBG0T7M type=del 2024-09-05T00:56:26.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.773+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=PHBO7DTC03WE type=del size=1811338 2024-09-05T00:56:26.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.773+0000 7f325adab8c0 1 < canceled operation key=D6HSFIRN2X4Q tag=NOSL23FSVQ3B type=del size=3701192 2024-09-05T00:56:26.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.777+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=Z5TQV7SN16U5 type=del size=1309754 2024-09-05T00:56:26.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.781+0000 7f325adab8c0 1 < canceled operation key=G600UT533GTT tag=RLEJJB4AY0NU type=del size=3112488 2024-09-05T00:56:26.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.785+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~B7VVEK6MPUOW.0 size=626222 2024-09-05T00:56:26.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.785+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=B7VVEK6MPUOW tag=NIFGWJ14BYR5 type=write size=1674798 2024-09-05T00:56:26.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.785+0000 7f325adab8c0 1 < completed delete operation key=J9UIQE3CKYHM tag=6U6H2TQDXO08 type=del 2024-09-05T00:56:26.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.789+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=52SJ3Q38GLCO type=del size=2521003 2024-09-05T00:56:26.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.793+0000 7f325adab8c0 1 < suggested update operation key=UW0SSQ8VFY1G tag=J1QW4UT8F0XP type=write size=797277 2024-09-05T00:56:26.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.801+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~AC4ZPYDJSQTP.0 size=962338 2024-09-05T00:56:26.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.801+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=AC4ZPYDJSQTP tag=9TYU8Z5OI8NA type=write size=2010914 2024-09-05T00:56:26.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.805+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=M4TYN50NHVTE type=write size=189291 2024-09-05T00:56:26.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.809+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=V7KTV58F7ZDP type=del size=11175 2024-09-05T00:56:26.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.813+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=RFZJS3QXZ7JF type=write size=364242 2024-09-05T00:56:26.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.813+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=LW8MRNR2J1AU type=del size=3309467 2024-09-05T00:56:26.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.817+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~WP19ZEH56L7M.0 size=157511 2024-09-05T00:56:26.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.821+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=WP19ZEH56L7M tag=66PSEATMV4BW type=write size=1206087 2024-09-05T00:56:26.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.825+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=FE4MSVUIHP16 type=del size=3575109 2024-09-05T00:56:26.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.829+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=VG0WX2WRQ1ZY type=write size=767491 2024-09-05T00:56:26.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.833+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~5O2XXD1HTF4K.0 size=1048576 2024-09-05T00:56:26.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.833+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~5O2XXD1HTF4K.1 size=346509 2024-09-05T00:56:26.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.833+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=5O2XXD1HTF4K tag=4NDUJYHJLD2N type=write size=2443661 2024-09-05T00:56:26.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.837+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=YUB5W0G2CCYU type=del 2024-09-05T00:56:26.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.841+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=PH9K8GMI0YBG type=del size=1309355 2024-09-05T00:56:26.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.841+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=8ZFSB2MKJQ8M type=del 2024-09-05T00:56:26.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.845+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=47TM40HSKHHB type=del size=1660802 2024-09-05T00:56:26.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.845+0000 7f325adab8c0 1 < canceled operation key=SP188HM5LG2D tag=KY31FIND3451 type=write size=901878 2024-09-05T00:56:26.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.849+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.0 size=1048576 2024-09-05T00:56:26.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.853+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.1 size=1048576 2024-09-05T00:56:26.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.853+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.2 size=519020 2024-09-05T00:56:26.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.853+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=SADAL5ZTZS1B tag=338VD99IZGTE type=write size=3664748 2024-09-05T00:56:26.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.857+0000 7f325adab8c0 1 < completed write operation key=J9UIQE3CKYHM tag=ONTFWGYQEDQ8 type=write size=406623 2024-09-05T00:56:26.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.861+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.0 size=1048576 2024-09-05T00:56:26.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.865+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.1 size=1048576 2024-09-05T00:56:26.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.865+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.2 size=628021 2024-09-05T00:56:26.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.865+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=KVQ6VX7CB1FM tag=J3X3L60B3STE type=write size=3773749 2024-09-05T00:56:26.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.869+0000 7f325adab8c0 1 < suggested remove operation key=5WOUI4SHYTSS tag=QB57Y0W1M15B type=del 2024-09-05T00:56:26.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.873+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=HPLPIZPG9L96 type=write size=521080 2024-09-05T00:56:26.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.873+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=73BBKOGPFO69 type=del 2024-09-05T00:56:26.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.881+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.0 size=1048576 2024-09-05T00:56:26.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.881+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.1 size=1048576 2024-09-05T00:56:26.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.881+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.2 size=554580 2024-09-05T00:56:26.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.881+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=5S0TIJLSKJMW tag=HZ02TEYVBBH8 type=write size=3700308 2024-09-05T00:56:26.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.885+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=21G3ZXL740SJ type=write size=845642 2024-09-05T00:56:26.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.889+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=ACK480L1HB4G type=del size=1119633 2024-09-05T00:56:26.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.889+0000 7f325adab8c0 1 < completed delete operation key=06YHJGLZQLK6 tag=PHBO7DTC03WE type=del 2024-09-05T00:56:26.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.893+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=WTH5UELHZWAA type=del size=757244 2024-09-05T00:56:26.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.893+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=Z5TQV7SN16U5 type=del 2024-09-05T00:56:26.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.901+0000 7f325adab8c0 1 > prepared part key=_multipart_079QFDETDGGC.2~HOF85V8P5BL8.0 size=12708 2024-09-05T00:56:26.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.901+0000 7f325adab8c0 1 > prepared multipart upload key=079QFDETDGGC upload=HOF85V8P5BL8 tag=P0GAODDFSSKS type=write size=1061284 2024-09-05T00:56:26.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.901+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~B7VVEK6MPUOW.0 size=626222 2024-09-05T00:56:26.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.905+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=B7VVEK6MPUOW tag=NIFGWJ14BYR5 type=write size=1674798 2024-09-05T00:56:26.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.909+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=GH2R5VHYA28Z type=del size=4089916 2024-09-05T00:56:26.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.913+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=52SJ3Q38GLCO type=del 2024-09-05T00:56:26.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.913+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=IQ2A1ZBEJ44G type=del size=408275 2024-09-05T00:56:26.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.917+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~AC4ZPYDJSQTP.0 size=962338 2024-09-05T00:56:26.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.921+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=AC4ZPYDJSQTP tag=9TYU8Z5OI8NA type=write size=2010914 2024-09-05T00:56:26.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.925+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.0 size=1048576 2024-09-05T00:56:26.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.929+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.1 size=1048576 2024-09-05T00:56:26.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.929+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.2 size=431636 2024-09-05T00:56:26.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.929+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=9VZSPO7I0FIO tag=8YMA55RXGWT6 type=write size=3577364 2024-09-05T00:56:26.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.933+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=V7KTV58F7ZDP type=del 2024-09-05T00:56:26.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.933+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=MS9XAB11JQM1 type=del size=2309674 2024-09-05T00:56:26.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.937+0000 7f325adab8c0 1 < canceled operation key=LVZALGRNP5TU tag=LW8MRNR2J1AU type=del size=3309467 2024-09-05T00:56:26.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.937+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=EZ9ZO8V88RBA type=del size=2643036 2024-09-05T00:56:26.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.945+0000 7f325adab8c0 1 < suggested remove operation key=YG43HSBBCRKH tag=FE4MSVUIHP16 type=del 2024-09-05T00:56:26.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.945+0000 7f325adab8c0 1 > prepared operation key=MBJLOE5XFPYN tag=Y8FJAJ5W0OIJ type=del size=641118 2024-09-05T00:56:26.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.945+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~5O2XXD1HTF4K.0 size=1048576 2024-09-05T00:56:26.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.949+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~5O2XXD1HTF4K.1 size=346509 2024-09-05T00:56:26.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.953+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=5O2XXD1HTF4K tag=4NDUJYHJLD2N type=write size=2443661 2024-09-05T00:56:26.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.957+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=BTFKNETTSILM type=del size=681613 2024-09-05T00:56:26.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.961+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=PH9K8GMI0YBG type=del 2024-09-05T00:56:26.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.961+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=LYR68JWYPTQK type=write size=793103 2024-09-05T00:56:26.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.965+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=47TM40HSKHHB type=del 2024-09-05T00:56:26.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.969+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.0 size=1048576 2024-09-05T00:56:26.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.969+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.1 size=1048576 2024-09-05T00:56:26.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.973+0000 7f325adab8c0 1 > prepared part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.2 size=607180 2024-09-05T00:56:26.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.973+0000 7f325adab8c0 1 > prepared multipart upload key=ZYT3WYNFIIZN upload=JCCCGGCEHZDN tag=QESINGM3WT62 type=write size=3752908 2024-09-05T00:56:26.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.977+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.0 size=1048576 2024-09-05T00:56:26.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.977+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.1 size=1048576 2024-09-05T00:56:26.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.981+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~SADAL5ZTZS1B.2 size=519020 2024-09-05T00:56:26.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.985+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=SADAL5ZTZS1B tag=338VD99IZGTE type=write size=3664748 2024-09-05T00:56:26.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.989+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.0 size=1048576 2024-09-05T00:56:26.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.993+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.1 size=1048576 2024-09-05T00:56:26.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.997+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.2 size=808424 2024-09-05T00:56:26.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.997+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=H81XKGBM40OW tag=W4OSCR2EK74F type=write size=3954152 2024-09-05T00:56:27.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:26.997+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.0 size=1048576 2024-09-05T00:56:27.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.001+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.1 size=1048576 2024-09-05T00:56:27.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.001+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~KVQ6VX7CB1FM.2 size=628021 2024-09-05T00:56:27.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.009+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=KVQ6VX7CB1FM tag=J3X3L60B3STE type=write size=3773749 2024-09-05T00:56:27.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.013+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~QI3PPG3LIMXK.0 size=1048576 2024-09-05T00:56:27.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.013+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~QI3PPG3LIMXK.1 size=863794 2024-09-05T00:56:27.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.013+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=QI3PPG3LIMXK tag=0DR7RA90I38F type=write size=2960946 2024-09-05T00:56:27.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.017+0000 7f325adab8c0 1 < completed write operation key=UW0SSQ8VFY1G tag=HPLPIZPG9L96 type=write size=521080 2024-09-05T00:56:27.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.021+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HVT2LFAZOYSF.0 size=1048576 2024-09-05T00:56:27.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.025+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~HVT2LFAZOYSF.1 size=967832 2024-09-05T00:56:27.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.025+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=HVT2LFAZOYSF tag=F06SSELSTUD0 type=write size=3064984 2024-09-05T00:56:27.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.025+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.0 size=1048576 2024-09-05T00:56:27.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.029+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.1 size=1048576 2024-09-05T00:56:27.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.029+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~5S0TIJLSKJMW.2 size=554580 2024-09-05T00:56:27.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.033+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=5S0TIJLSKJMW tag=HZ02TEYVBBH8 type=write size=3700308 2024-09-05T00:56:27.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.037+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=CV1VOKMXVR5J type=del size=1517152 2024-09-05T00:56:27.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.041+0000 7f325adab8c0 1 < completed delete operation key=9O7DVR04PCDB tag=ACK480L1HB4G type=del 2024-09-05T00:56:27.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.045+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=F5EJUI5GK586 type=write size=497304 2024-09-05T00:56:27.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.045+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=WTH5UELHZWAA type=del 2024-09-05T00:56:27.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.049+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.0 size=1048576 2024-09-05T00:56:27.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.053+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.1 size=1048576 2024-09-05T00:56:27.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.053+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.2 size=793269 2024-09-05T00:56:27.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.053+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=1PYTU0KZ61KT tag=N4IDNE0C51DI type=write size=3938997 2024-09-05T00:56:27.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.057+0000 7f325adab8c0 1 < completed part key=_multipart_079QFDETDGGC.2~HOF85V8P5BL8.0 size=12708 2024-09-05T00:56:27.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.061+0000 7f325adab8c0 1 < completed multipart upload key=079QFDETDGGC upload=HOF85V8P5BL8 tag=P0GAODDFSSKS type=write size=1061284 2024-09-05T00:56:27.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.065+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=S3GD299S5UPC type=write size=438268 2024-09-05T00:56:27.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.065+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=GH2R5VHYA28Z type=del 2024-09-05T00:56:27.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.069+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=F5NZ1N9ALP4X type=del size=190854 2024-09-05T00:56:27.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.073+0000 7f325adab8c0 1 < suggested remove operation key=VYMRZPO6VKGS tag=IQ2A1ZBEJ44G type=del 2024-09-05T00:56:27.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.077+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=FWYGWG78OY97 type=del size=3666317 2024-09-05T00:56:27.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.077+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.0 size=1048576 2024-09-05T00:56:27.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.081+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.1 size=1048576 2024-09-05T00:56:27.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.081+0000 7f325adab8c0 1 < canceled part key=_multipart_ZVKLK751KO5T.2~9VZSPO7I0FIO.2 size=431636 2024-09-05T00:56:27.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.085+0000 7f325adab8c0 1 < canceled multipart upload key=ZVKLK751KO5T upload=9VZSPO7I0FIO tag=8YMA55RXGWT6 type=write size=3577364 2024-09-05T00:56:27.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.085+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=GGP305LO5ROR type=del size=1791692 2024-09-05T00:56:27.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.089+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=MS9XAB11JQM1 type=del 2024-09-05T00:56:27.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.093+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=NL7YJIXAGF36 type=del size=1124300 2024-09-05T00:56:27.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.093+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=EZ9ZO8V88RBA type=del 2024-09-05T00:56:27.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.101+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.0 size=1048576 2024-09-05T00:56:27.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.101+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.1 size=1048576 2024-09-05T00:56:27.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.101+0000 7f325adab8c0 1 > prepared part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.2 size=615600 2024-09-05T00:56:27.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.101+0000 7f325adab8c0 1 > prepared multipart upload key=JKRZR0KRE93F upload=20DPGL5WRHTV tag=8CDV3F1AWC8V type=write size=3761328 2024-09-05T00:56:27.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.105+0000 7f325adab8c0 1 < completed delete operation key=MBJLOE5XFPYN tag=Y8FJAJ5W0OIJ type=del 2024-09-05T00:56:27.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.109+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~OTX8YNYWOWAL.0 size=217646 2024-09-05T00:56:27.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.109+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=OTX8YNYWOWAL tag=UDD7KT7WN152 type=write size=1266222 2024-09-05T00:56:27.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.109+0000 7f325adab8c0 1 < completed delete operation key=GQB4HOYII01G tag=BTFKNETTSILM type=del 2024-09-05T00:56:27.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.113+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=PY103UH3H1T7 type=write size=45968 2024-09-05T00:56:27.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.117+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=LYR68JWYPTQK type=write size=793103 2024-09-05T00:56:27.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.121+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~NSDAHCOG9I90.0 size=1048576 2024-09-05T00:56:27.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.121+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~NSDAHCOG9I90.1 size=62286 2024-09-05T00:56:27.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.121+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=NSDAHCOG9I90 tag=37G4IWVC7ML6 type=write size=2159438 2024-09-05T00:56:27.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.125+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.0 size=1048576 2024-09-05T00:56:27.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.125+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.1 size=1048576 2024-09-05T00:56:27.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.129+0000 7f325adab8c0 1 < completed part key=_multipart_ZYT3WYNFIIZN.2~JCCCGGCEHZDN.2 size=607180 2024-09-05T00:56:27.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.133+0000 7f325adab8c0 1 < completed multipart upload key=ZYT3WYNFIIZN upload=JCCCGGCEHZDN tag=QESINGM3WT62 type=write size=3752908 2024-09-05T00:56:27.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.137+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~ZJCG3U9KK01C.0 size=734382 2024-09-05T00:56:27.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.137+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=ZJCG3U9KK01C tag=TGBKH2UARF74 type=write size=1782958 2024-09-05T00:56:27.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.137+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.0 size=1048576 2024-09-05T00:56:27.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.141+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.1 size=1048576 2024-09-05T00:56:27.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.141+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~H81XKGBM40OW.2 size=808424 2024-09-05T00:56:27.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.145+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=H81XKGBM40OW tag=W4OSCR2EK74F type=write size=3954152 2024-09-05T00:56:27.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.149+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~1KLKTG1S7QTW.0 size=423206 2024-09-05T00:56:27.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.149+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=1KLKTG1S7QTW tag=H6EUGI8RP7S2 type=write size=1471782 2024-09-05T00:56:27.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.149+0000 7f325adab8c0 1 < canceled part key=_multipart_J9UIQE3CKYHM.2~QI3PPG3LIMXK.0 size=1048576 2024-09-05T00:56:27.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.149+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~QI3PPG3LIMXK.1 size=863794 2024-09-05T00:56:27.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.153+0000 7f325adab8c0 1 < canceled multipart upload key=J9UIQE3CKYHM upload=QI3PPG3LIMXK tag=0DR7RA90I38F type=write size=2960946 2024-09-05T00:56:27.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.157+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=5ELAWRO7SHP5 type=del size=3138490 2024-09-05T00:56:27.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.161+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HVT2LFAZOYSF.0 size=1048576 2024-09-05T00:56:27.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.161+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~HVT2LFAZOYSF.1 size=967832 2024-09-05T00:56:27.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.165+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=HVT2LFAZOYSF tag=F06SSELSTUD0 type=write size=3064984 2024-09-05T00:56:27.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.169+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~BMTHLTS1Z93J.0 size=1048576 2024-09-05T00:56:27.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.173+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~BMTHLTS1Z93J.1 size=557658 2024-09-05T00:56:27.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.173+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=BMTHLTS1Z93J tag=2JF2GNLACVEW type=write size=2654810 2024-09-05T00:56:27.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.173+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=CV1VOKMXVR5J type=del 2024-09-05T00:56:27.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.177+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=FZACUD4PPSR7 type=write size=731825 2024-09-05T00:56:27.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.181+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=F5EJUI5GK586 type=write size=497304 2024-09-05T00:56:27.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.181+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=768KFFUSKF9I type=del size=4026092 2024-09-05T00:56:27.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.185+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.0 size=1048576 2024-09-05T00:56:27.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.189+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.1 size=1048576 2024-09-05T00:56:27.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.189+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~1PYTU0KZ61KT.2 size=793269 2024-09-05T00:56:27.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.193+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=1PYTU0KZ61KT tag=N4IDNE0C51DI type=write size=3938997 2024-09-05T00:56:27.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.197+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=1OLJB6G3SGUZ type=write size=654778 2024-09-05T00:56:27.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.197+0000 7f325adab8c0 1 < completed write operation key=D6HSFIRN2X4Q tag=S3GD299S5UPC type=write size=438268 2024-09-05T00:56:27.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.201+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=8S4GLHGKCSYW type=del size=373409 2024-09-05T00:56:27.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.201+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=F5NZ1N9ALP4X type=del 2024-09-05T00:56:27.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.205+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=WH27VVKRBTJ4 type=del size=3737756 2024-09-05T00:56:27.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.205+0000 7f325adab8c0 1 < completed delete operation key=EGPVSV2PFILM tag=FWYGWG78OY97 type=del 2024-09-05T00:56:27.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.213+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~W03848CLUL96.0 size=732448 2024-09-05T00:56:27.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.213+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=W03848CLUL96 tag=YYYYFR9YW3TK type=write size=1781024 2024-09-05T00:56:27.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.213+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=GGP305LO5ROR type=del 2024-09-05T00:56:27.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~NZA1V9BHXCKH.0 size=1048576 2024-09-05T00:56:27.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.217+0000 7f325adab8c0 1 > prepared part key=_multipart_MAS6EB753KO9.2~NZA1V9BHXCKH.1 size=1027357 2024-09-05T00:56:27.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.217+0000 7f325adab8c0 1 > prepared multipart upload key=MAS6EB753KO9 upload=NZA1V9BHXCKH tag=5JUBEX3XW3WP type=write size=3124509 2024-09-05T00:56:27.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.221+0000 7f325adab8c0 1 < completed delete operation key=SP188HM5LG2D tag=NL7YJIXAGF36 type=del 2024-09-05T00:56:27.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.225+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=LN68HLTUVT9E type=del size=3782025 2024-09-05T00:56:27.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.225+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.0 size=1048576 2024-09-05T00:56:27.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.229+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.1 size=1048576 2024-09-05T00:56:27.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.229+0000 7f325adab8c0 1 < completed part key=_multipart_JKRZR0KRE93F.2~20DPGL5WRHTV.2 size=615600 2024-09-05T00:56:27.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.233+0000 7f325adab8c0 1 < completed multipart upload key=JKRZR0KRE93F upload=20DPGL5WRHTV tag=8CDV3F1AWC8V type=write size=3761328 2024-09-05T00:56:27.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.237+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.0 size=1048576 2024-09-05T00:56:27.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.237+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.1 size=1048576 2024-09-05T00:56:27.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.241+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.2 size=315905 2024-09-05T00:56:27.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.241+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=QP3PDN30RPUJ tag=Z97AP0MG2HES type=write size=3461633 2024-09-05T00:56:27.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.241+0000 7f325adab8c0 1 < canceled part key=_multipart_EGPVSV2PFILM.2~OTX8YNYWOWAL.0 size=217646 2024-09-05T00:56:27.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.245+0000 7f325adab8c0 1 < canceled multipart upload key=EGPVSV2PFILM upload=OTX8YNYWOWAL tag=UDD7KT7WN152 type=write size=1266222 2024-09-05T00:56:27.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.249+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=GV5H1JBOKUUA type=del size=3702844 2024-09-05T00:56:27.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.249+0000 7f325adab8c0 1 < completed write operation key=IGOUBVL3XVS3 tag=PY103UH3H1T7 type=write size=45968 2024-09-05T00:56:27.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.253+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=UPQSFNJONVHD type=del size=3577163 2024-09-05T00:56:27.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.253+0000 7f325adab8c0 1 < canceled part key=_multipart_MAS6EB753KO9.2~NSDAHCOG9I90.0 size=1048576 2024-09-05T00:56:27.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.253+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~NSDAHCOG9I90.1 size=62286 2024-09-05T00:56:27.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.261+0000 7f325adab8c0 1 < canceled multipart upload key=MAS6EB753KO9 upload=NSDAHCOG9I90 tag=37G4IWVC7ML6 type=write size=2159438 2024-09-05T00:56:27.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.261+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=TQYGFQT6S6WY type=del size=566393 2024-09-05T00:56:27.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.265+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~ZJCG3U9KK01C.0 size=734382 2024-09-05T00:56:27.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.269+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=ZJCG3U9KK01C tag=TGBKH2UARF74 type=write size=1782958 2024-09-05T00:56:27.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.273+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=P4A2INNFK51X type=del size=3288992 2024-09-05T00:56:27.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.273+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~1KLKTG1S7QTW.0 size=423206 2024-09-05T00:56:27.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.277+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=1KLKTG1S7QTW tag=H6EUGI8RP7S2 type=write size=1471782 2024-09-05T00:56:27.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.285+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~ZFZ0RUS8PFW4.0 size=1048576 2024-09-05T00:56:27.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.285+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~ZFZ0RUS8PFW4.1 size=946624 2024-09-05T00:56:27.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.285+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=ZFZ0RUS8PFW4 tag=ZS4MQ4BLEBM5 type=write size=3043776 2024-09-05T00:56:27.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.289+0000 7f325adab8c0 1 < completed delete operation key=MAS6EB753KO9 tag=5ELAWRO7SHP5 type=del 2024-09-05T00:56:27.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.289+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=JMYUITS9MK57 type=write size=362246 2024-09-05T00:56:27.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.293+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~BMTHLTS1Z93J.0 size=1048576 2024-09-05T00:56:27.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.293+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~BMTHLTS1Z93J.1 size=557658 2024-09-05T00:56:27.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.297+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=BMTHLTS1Z93J tag=2JF2GNLACVEW type=write size=2654810 2024-09-05T00:56:27.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.301+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.0 size=1048576 2024-09-05T00:56:27.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.305+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.1 size=1048576 2024-09-05T00:56:27.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.305+0000 7f325adab8c0 1 > prepared part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.2 size=893778 2024-09-05T00:56:27.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.305+0000 7f325adab8c0 1 > prepared multipart upload key=A9WMRV5QZ2FP upload=41G01AOIQ6EH tag=GABWX1MR2I2B type=write size=4039506 2024-09-05T00:56:27.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.309+0000 7f325adab8c0 1 < canceled operation key=XKOECM0CCOKX tag=FZACUD4PPSR7 type=write size=731825 2024-09-05T00:56:27.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.313+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=LLK71NKJG0FZ type=write size=475875 2024-09-05T00:56:27.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.317+0000 7f325adab8c0 1 < suggested update operation key=YG43HSBBCRKH tag=768KFFUSKF9I type=del size=4026092 2024-09-05T00:56:27.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.321+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~A2IOI3HW9DO0.0 size=1048576 2024-09-05T00:56:27.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.321+0000 7f325adab8c0 1 > prepared part key=_multipart_71FWV15GD1QZ.2~A2IOI3HW9DO0.1 size=147342 2024-09-05T00:56:27.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.321+0000 7f325adab8c0 1 > prepared multipart upload key=71FWV15GD1QZ upload=A2IOI3HW9DO0 tag=VT4QLBF5IVLM type=write size=2244494 2024-09-05T00:56:27.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.325+0000 7f325adab8c0 1 < completed write operation key=GQB4HOYII01G tag=1OLJB6G3SGUZ type=write size=654778 2024-09-05T00:56:27.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.325+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=HOQO16971LFG type=del size=3259949 2024-09-05T00:56:27.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.329+0000 7f325adab8c0 1 < completed delete operation key=D6HSFIRN2X4Q tag=8S4GLHGKCSYW type=del 2024-09-05T00:56:27.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.333+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=V3KV7UTJ46MG type=del size=1058419 2024-09-05T00:56:27.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.333+0000 7f325adab8c0 1 < completed delete operation key=IGOUBVL3XVS3 tag=WH27VVKRBTJ4 type=del 2024-09-05T00:56:27.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.337+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=9574GIULI4ZQ type=del size=948467 2024-09-05T00:56:27.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.337+0000 7f325adab8c0 1 < completed part key=_multipart_9O7DVR04PCDB.2~W03848CLUL96.0 size=732448 2024-09-05T00:56:27.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.341+0000 7f325adab8c0 1 < completed multipart upload key=9O7DVR04PCDB upload=W03848CLUL96 tag=YYYYFR9YW3TK type=write size=1781024 2024-09-05T00:56:27.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.345+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.0 size=1048576 2024-09-05T00:56:27.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.349+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.1 size=1048576 2024-09-05T00:56:27.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.349+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.2 size=670885 2024-09-05T00:56:27.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.349+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=0R4QE044MOS4 tag=Q25CO9G7L6UG type=write size=3816613 2024-09-05T00:56:27.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.353+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~NZA1V9BHXCKH.0 size=1048576 2024-09-05T00:56:27.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.353+0000 7f325adab8c0 1 < completed part key=_multipart_MAS6EB753KO9.2~NZA1V9BHXCKH.1 size=1027357 2024-09-05T00:56:27.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.357+0000 7f325adab8c0 1 < completed multipart upload key=MAS6EB753KO9 upload=NZA1V9BHXCKH tag=5JUBEX3XW3WP type=write size=3124509 2024-09-05T00:56:27.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.361+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~UIB03VILE777.0 size=10773 2024-09-05T00:56:27.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.361+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=UIB03VILE777 tag=K34BU6MW4ZOM type=write size=1059349 2024-09-05T00:56:27.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.361+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=LN68HLTUVT9E type=del 2024-09-05T00:56:27.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.365+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=WQS0A6HBZOYD type=del size=4052031 2024-09-05T00:56:27.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.365+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.0 size=1048576 2024-09-05T00:56:27.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.369+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.1 size=1048576 2024-09-05T00:56:27.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.369+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~QP3PDN30RPUJ.2 size=315905 2024-09-05T00:56:27.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.373+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=QP3PDN30RPUJ tag=Z97AP0MG2HES type=write size=3461633 2024-09-05T00:56:27.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.377+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=N6SFVTX35UCJ type=del size=2500981 2024-09-05T00:56:27.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.381+0000 7f325adab8c0 1 < suggested update operation key=MYR9H12B5YYV tag=GV5H1JBOKUUA type=del size=3702844 2024-09-05T00:56:27.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.385+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~KZTUGUFKUHQ6.0 size=941691 2024-09-05T00:56:27.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.385+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=KZTUGUFKUHQ6 tag=MTBQ4VS3WC7R type=write size=1990267 2024-09-05T00:56:27.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.385+0000 7f325adab8c0 1 < completed delete operation key=5WOUI4SHYTSS tag=UPQSFNJONVHD type=del 2024-09-05T00:56:27.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.389+0000 7f325adab8c0 1 > prepared operation key=UW0SSQ8VFY1G tag=00JBRW9UQ4AO type=del size=298297 2024-09-05T00:56:27.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.389+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=TQYGFQT6S6WY type=del 2024-09-05T00:56:27.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.397+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=CI51NB5GL0IQ type=del size=1700929 2024-09-05T00:56:27.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.397+0000 7f325adab8c0 -1 < failed to complete operation key=MYR9H12B5YYV tag=P4A2INNFK51X type=del size=3288992: (22) Invalid argument 2024-09-05T00:56:27.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.401+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=Z20UT2SY458F type=del size=1958018 2024-09-05T00:56:27.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.401+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~ZFZ0RUS8PFW4.0 size=1048576 2024-09-05T00:56:27.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.401+0000 7f325adab8c0 1 < canceled part key=_multipart_NIAW4BKW21LG.2~ZFZ0RUS8PFW4.1 size=946624 2024-09-05T00:56:27.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.405+0000 7f325adab8c0 1 < canceled multipart upload key=NIAW4BKW21LG upload=ZFZ0RUS8PFW4 tag=ZS4MQ4BLEBM5 type=write size=3043776 2024-09-05T00:56:27.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.409+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~WFK21KFSXAG1.0 size=124538 2024-09-05T00:56:27.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.409+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=WFK21KFSXAG1 tag=E94CR9Y2DJYY type=write size=1173114 2024-09-05T00:56:27.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.413+0000 7f325adab8c0 1 < completed write operation key=YMIGZMLJSI4D tag=JMYUITS9MK57 type=write size=362246 2024-09-05T00:56:27.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.413+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=D30UTDEA5Q5B type=write size=991076 2024-09-05T00:56:27.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.417+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.0 size=1048576 2024-09-05T00:56:27.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.417+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.1 size=1048576 2024-09-05T00:56:27.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.421+0000 7f325adab8c0 1 < completed part key=_multipart_A9WMRV5QZ2FP.2~41G01AOIQ6EH.2 size=893778 2024-09-05T00:56:27.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.421+0000 7f325adab8c0 1 < completed multipart upload key=A9WMRV5QZ2FP upload=41G01AOIQ6EH tag=GABWX1MR2I2B type=write size=4039506 2024-09-05T00:56:27.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.429+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~2040VBKW4T9G.0 size=1048576 2024-09-05T00:56:27.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.429+0000 7f325adab8c0 1 > prepared part key=_multipart_YG43HSBBCRKH.2~2040VBKW4T9G.1 size=767234 2024-09-05T00:56:27.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.429+0000 7f325adab8c0 1 > prepared multipart upload key=YG43HSBBCRKH upload=2040VBKW4T9G tag=65ZE13SG6YL9 type=write size=2864386 2024-09-05T00:56:27.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.433+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=LLK71NKJG0FZ type=write size=475875 2024-09-05T00:56:27.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.433+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=TTJQW8ZY05KG type=write size=704285 2024-09-05T00:56:27.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.437+0000 7f325adab8c0 1 < completed part key=_multipart_71FWV15GD1QZ.2~A2IOI3HW9DO0.0 size=1048576 2024-09-05T00:56:27.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.437+0000 7f325adab8c0 1 < canceled part key=_multipart_71FWV15GD1QZ.2~A2IOI3HW9DO0.1 size=147342 2024-09-05T00:56:27.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.441+0000 7f325adab8c0 1 < canceled multipart upload key=71FWV15GD1QZ upload=A2IOI3HW9DO0 tag=VT4QLBF5IVLM type=write size=2244494 2024-09-05T00:56:27.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.441+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=ETTSHDYM89MO type=write size=124415 2024-09-05T00:56:27.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.445+0000 7f325adab8c0 1 < completed delete operation key=NIAW4BKW21LG tag=HOQO16971LFG type=del 2024-09-05T00:56:27.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.449+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~O8LQSOO9KT87.0 size=1048576 2024-09-05T00:56:27.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.449+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~O8LQSOO9KT87.1 size=859443 2024-09-05T00:56:27.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.449+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=O8LQSOO9KT87 tag=2QSYLH0UUCM2 type=write size=2956595 2024-09-05T00:56:27.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.453+0000 7f325adab8c0 1 < suggested remove operation key=EGPVSV2PFILM tag=V3KV7UTJ46MG type=del 2024-09-05T00:56:27.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.457+0000 7f325adab8c0 1 > prepared operation key=MAS6EB753KO9 tag=GUOWAECR30E9 type=write size=81256 2024-09-05T00:56:27.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.457+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=9574GIULI4ZQ type=del 2024-09-05T00:56:27.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.461+0000 7f325adab8c0 1 > prepared operation key=D6HSFIRN2X4Q tag=MW0I221S1E0E type=del size=607978 2024-09-05T00:56:27.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.461+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.0 size=1048576 2024-09-05T00:56:27.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.465+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.1 size=1048576 2024-09-05T00:56:27.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.465+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~0R4QE044MOS4.2 size=670885 2024-09-05T00:56:27.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.469+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=0R4QE044MOS4 tag=Q25CO9G7L6UG type=write size=3816613 2024-09-05T00:56:27.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.473+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.0 size=1048576 2024-09-05T00:56:27.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.473+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.1 size=1048576 2024-09-05T00:56:27.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.477+0000 7f325adab8c0 1 > prepared part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.2 size=444221 2024-09-05T00:56:27.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.477+0000 7f325adab8c0 1 > prepared multipart upload key=SP188HM5LG2D upload=97C5TLNV0RE1 tag=OEQSMEKCF6US type=write size=3589949 2024-09-05T00:56:27.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.477+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~UIB03VILE777.0 size=10773 2024-09-05T00:56:27.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.481+0000 7f325adab8c0 1 < completed multipart upload key=SP188HM5LG2D upload=UIB03VILE777 tag=K34BU6MW4ZOM type=write size=1059349 2024-09-05T00:56:27.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.485+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~27VOG0H9R890.0 size=1048576 2024-09-05T00:56:27.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.485+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~27VOG0H9R890.1 size=647235 2024-09-05T00:56:27.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.485+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=27VOG0H9R890 tag=IMRIEDV8IMK1 type=write size=2744387 2024-09-05T00:56:27.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.489+0000 7f325adab8c0 1 < completed delete operation key=VYMRZPO6VKGS tag=WQS0A6HBZOYD type=del 2024-09-05T00:56:27.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.489+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=6AQRPMWASG2F type=del size=3591556 2024-09-05T00:56:27.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.493+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=N6SFVTX35UCJ type=del 2024-09-05T00:56:27.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.493+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=QCVUYGIWATPK type=write size=496289 2024-09-05T00:56:27.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.497+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~KZTUGUFKUHQ6.0 size=941691 2024-09-05T00:56:27.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.501+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=KZTUGUFKUHQ6 tag=MTBQ4VS3WC7R type=write size=1990267 2024-09-05T00:56:27.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.505+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~ZDC1EFB7IPWD.0 size=602366 2024-09-05T00:56:27.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.505+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=ZDC1EFB7IPWD tag=MVHIDBHP830I type=write size=1650942 2024-09-05T00:56:27.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.505+0000 7f325adab8c0 1 < completed delete operation key=UW0SSQ8VFY1G tag=00JBRW9UQ4AO type=del 2024-09-05T00:56:27.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.505+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=2ISU7PQNYHC6 type=del size=1523324 2024-09-05T00:56:27.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.509+0000 7f325adab8c0 1 < suggested update operation key=D6HSFIRN2X4Q tag=CI51NB5GL0IQ type=del size=1700929 2024-09-05T00:56:27.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.513+0000 7f325adab8c0 1 > prepared operation key=XKOECM0CCOKX tag=9EAST2C00MKZ type=del size=2534424 2024-09-05T00:56:27.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.513+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=Z20UT2SY458F type=del 2024-09-05T00:56:27.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.517+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=U5KZWEZVGERL type=del size=2123407 2024-09-05T00:56:27.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.517+0000 7f325adab8c0 1 < canceled part key=_multipart_MBJLOE5XFPYN.2~WFK21KFSXAG1.0 size=124538 2024-09-05T00:56:27.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.521+0000 7f325adab8c0 1 < canceled multipart upload key=MBJLOE5XFPYN upload=WFK21KFSXAG1 tag=E94CR9Y2DJYY type=write size=1173114 2024-09-05T00:56:27.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.521+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=1LGZCD4QY15W type=del size=1315650 2024-09-05T00:56:27.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.525+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=D30UTDEA5Q5B type=write size=991076 2024-09-05T00:56:27.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.525+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=NUPFP7FL8CH4 type=del size=2957406 2024-09-05T00:56:27.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.529+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~2040VBKW4T9G.0 size=1048576 2024-09-05T00:56:27.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.529+0000 7f325adab8c0 1 < completed part key=_multipart_YG43HSBBCRKH.2~2040VBKW4T9G.1 size=767234 2024-09-05T00:56:27.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.537+0000 7f325adab8c0 1 < completed multipart upload key=YG43HSBBCRKH upload=2040VBKW4T9G tag=65ZE13SG6YL9 type=write size=2864386 2024-09-05T00:56:27.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.537+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=LU2P64QYO8YG type=write size=1005108 2024-09-05T00:56:27.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.541+0000 7f325adab8c0 1 < completed write operation key=XKOECM0CCOKX tag=TTJQW8ZY05KG type=write size=704285 2024-09-05T00:56:27.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.545+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~SSA2BC8TZH78.0 size=1048576 2024-09-05T00:56:27.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.549+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~SSA2BC8TZH78.1 size=338051 2024-09-05T00:56:27.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.549+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=SSA2BC8TZH78 tag=HYR68LJ6M1ZG type=write size=2435203 2024-09-05T00:56:27.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.549+0000 7f325adab8c0 1 < canceled operation key=HW4QK67332RW tag=ETTSHDYM89MO type=write size=124415 2024-09-05T00:56:27.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.557+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.0 size=1048576 2024-09-05T00:56:27.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.557+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.1 size=1048576 2024-09-05T00:56:27.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.561+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.2 size=758623 2024-09-05T00:56:27.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.561+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=MAS4JGSZ2J9U tag=EW6GKLONYUEN type=write size=3904351 2024-09-05T00:56:27.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.561+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~O8LQSOO9KT87.0 size=1048576 2024-09-05T00:56:27.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.565+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~O8LQSOO9KT87.1 size=859443 2024-09-05T00:56:27.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.569+0000 7f325adab8c0 1 < completed multipart upload key=GF6OC9O60D5E upload=O8LQSOO9KT87 tag=2QSYLH0UUCM2 type=write size=2956595 2024-09-05T00:56:27.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.573+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.0 size=1048576 2024-09-05T00:56:27.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.577+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.1 size=1048576 2024-09-05T00:56:27.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.577+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.2 size=170470 2024-09-05T00:56:27.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.577+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=UKVQYBQ9K8QK tag=FIW7DKXQFCGE type=write size=3316198 2024-09-05T00:56:27.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.581+0000 7f325adab8c0 1 < completed write operation key=MAS6EB753KO9 tag=GUOWAECR30E9 type=write size=81256 2024-09-05T00:56:27.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.581+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=P7R9FYU3PC8O type=write size=644649 2024-09-05T00:56:27.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.589+0000 7f325adab8c0 1 < suggested update operation key=D6HSFIRN2X4Q tag=MW0I221S1E0E type=del size=607978 2024-09-05T00:56:27.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.589+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=NKH3DRW4U46S type=del size=3910244 2024-09-05T00:56:27.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.593+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.0 size=1048576 2024-09-05T00:56:27.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.593+0000 7f325adab8c0 1 < canceled part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.1 size=1048576 2024-09-05T00:56:27.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.597+0000 7f325adab8c0 1 < completed part key=_multipart_SP188HM5LG2D.2~97C5TLNV0RE1.2 size=444221 2024-09-05T00:56:27.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.601+0000 7f325adab8c0 1 < canceled multipart upload key=SP188HM5LG2D upload=97C5TLNV0RE1 tag=OEQSMEKCF6US type=write size=3589949 2024-09-05T00:56:27.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.605+0000 7f325adab8c0 1 > prepared operation key=NIAW4BKW21LG tag=HAAZXV701PAC type=write size=573444 2024-09-05T00:56:27.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.609+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~27VOG0H9R890.0 size=1048576 2024-09-05T00:56:27.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.609+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~27VOG0H9R890.1 size=647235 2024-09-05T00:56:27.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.613+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=27VOG0H9R890 tag=IMRIEDV8IMK1 type=write size=2744387 2024-09-05T00:56:27.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.617+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=CZBK2L4T9STA type=write size=116988 2024-09-05T00:56:27.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.621+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=6AQRPMWASG2F type=del 2024-09-05T00:56:27.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.621+0000 7f325adab8c0 1 > prepared operation key=VYMRZPO6VKGS tag=DNUZLKZ358DZ type=write size=289385 2024-09-05T00:56:27.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.625+0000 7f325adab8c0 1 < completed write operation key=ZVKLK751KO5T tag=QCVUYGIWATPK type=write size=496289 2024-09-05T00:56:27.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.629+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.0 size=1048576 2024-09-05T00:56:27.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.629+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.1 size=1048576 2024-09-05T00:56:27.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.633+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.2 size=218236 2024-09-05T00:56:27.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.633+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=4B5QJA0NS0O0 tag=5CD5LHCB23TD type=write size=3363964 2024-09-05T00:56:27.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.633+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~ZDC1EFB7IPWD.0 size=602366 2024-09-05T00:56:27.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.637+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=ZDC1EFB7IPWD tag=MVHIDBHP830I type=write size=1650942 2024-09-05T00:56:27.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.641+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.0 size=1048576 2024-09-05T00:56:27.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.645+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.1 size=1048576 2024-09-05T00:56:27.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.645+0000 7f325adab8c0 1 > prepared part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.2 size=661970 2024-09-05T00:56:27.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.645+0000 7f325adab8c0 1 > prepared multipart upload key=GF6OC9O60D5E upload=63ANEG9YEMOF tag=J338T4BA1MTP type=write size=3807698 2024-09-05T00:56:27.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.645+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=2ISU7PQNYHC6 type=del size=1523324 2024-09-05T00:56:27.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.649+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~69GNFB101GSH.0 size=1048576 2024-09-05T00:56:27.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.653+0000 7f325adab8c0 1 > prepared part key=_multipart_GU25IIQWQNR2.2~69GNFB101GSH.1 size=697046 2024-09-05T00:56:27.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.653+0000 7f325adab8c0 1 > prepared multipart upload key=GU25IIQWQNR2 upload=69GNFB101GSH tag=TUZHWB1K57ID type=write size=2794198 2024-09-05T00:56:27.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.653+0000 7f325adab8c0 1 < completed delete operation key=XKOECM0CCOKX tag=9EAST2C00MKZ type=del 2024-09-05T00:56:27.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.657+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~BP16YSNGRJEB.0 size=884531 2024-09-05T00:56:27.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.657+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=BP16YSNGRJEB tag=QZRA64DAN27P type=write size=1933107 2024-09-05T00:56:27.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.661+0000 7f325adab8c0 1 < canceled operation key=GU25IIQWQNR2 tag=U5KZWEZVGERL type=del size=2123407 2024-09-05T00:56:27.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.661+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=VT074PZ22PRU type=del size=2463724 2024-09-05T00:56:27.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.665+0000 7f325adab8c0 1 < suggested update operation key=GQB4HOYII01G tag=1LGZCD4QY15W type=del size=1315650 2024-09-05T00:56:27.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.669+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=0G4J1M13F51K type=write size=939463 2024-09-05T00:56:27.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.669+0000 7f325adab8c0 1 < suggested update operation key=9O7DVR04PCDB tag=NUPFP7FL8CH4 type=del size=2957406 2024-09-05T00:56:27.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.673+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=FVL168T4G50E type=del size=3523673 2024-09-05T00:56:27.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.677+0000 7f325adab8c0 1 < suggested update operation key=GF6OC9O60D5E tag=LU2P64QYO8YG type=write size=1005108 2024-09-05T00:56:27.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.677+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=N05HWQ62EXCZ type=write size=424324 2024-09-05T00:56:27.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.681+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~SSA2BC8TZH78.0 size=1048576 2024-09-05T00:56:27.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.681+0000 7f325adab8c0 1 < completed part key=_multipart_MBJLOE5XFPYN.2~SSA2BC8TZH78.1 size=338051 2024-09-05T00:56:27.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.685+0000 7f325adab8c0 1 < completed multipart upload key=MBJLOE5XFPYN upload=SSA2BC8TZH78 tag=HYR68LJ6M1ZG type=write size=2435203 2024-09-05T00:56:27.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.689+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.0 size=1048576 2024-09-05T00:56:27.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.689+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.1 size=1048576 2024-09-05T00:56:27.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.693+0000 7f325adab8c0 1 > prepared part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.2 size=533954 2024-09-05T00:56:27.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.693+0000 7f325adab8c0 1 > prepared multipart upload key=VYMRZPO6VKGS upload=WW3VH0X8T66F tag=DFP9WW8K8VR7 type=write size=3679682 2024-09-05T00:56:27.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.693+0000 7f325adab8c0 1 < canceled part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.0 size=1048576 2024-09-05T00:56:27.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.693+0000 7f325adab8c0 1 < canceled part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.1 size=1048576 2024-09-05T00:56:27.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.693+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~MAS4JGSZ2J9U.2 size=758623 2024-09-05T00:56:27.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.697+0000 7f325adab8c0 1 < canceled multipart upload key=HW4QK67332RW upload=MAS4JGSZ2J9U tag=EW6GKLONYUEN type=write size=3904351 2024-09-05T00:56:27.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.697+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=USW2T5K0B8DG type=del size=1133390 2024-09-05T00:56:27.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.701+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.0 size=1048576 2024-09-05T00:56:27.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.701+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.1 size=1048576 2024-09-05T00:56:27.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.705+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~UKVQYBQ9K8QK.2 size=170470 2024-09-05T00:56:27.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.709+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=UKVQYBQ9K8QK tag=FIW7DKXQFCGE type=write size=3316198 2024-09-05T00:56:27.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.713+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~STJYFY5BQS2R.0 size=1048576 2024-09-05T00:56:27.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.713+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~STJYFY5BQS2R.1 size=438623 2024-09-05T00:56:27.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.713+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=STJYFY5BQS2R tag=K2XDKKOX2HC4 type=write size=2535775 2024-09-05T00:56:27.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.717+0000 7f325adab8c0 1 < suggested remove operation key=HW4QK67332RW tag=P7R9FYU3PC8O type=write 2024-09-05T00:56:27.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.721+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~0OJHLF4HKG5K.0 size=592437 2024-09-05T00:56:27.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.721+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=0OJHLF4HKG5K tag=LVHO0223URXE type=write size=1641013 2024-09-05T00:56:27.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.721+0000 7f325adab8c0 1 < completed delete operation key=O0RSK2S88XHP tag=NKH3DRW4U46S type=del 2024-09-05T00:56:27.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.725+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.0 size=1048576 2024-09-05T00:56:27.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.729+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.1 size=1048576 2024-09-05T00:56:27.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.729+0000 7f325adab8c0 1 > prepared part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.2 size=804802 2024-09-05T00:56:27.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.729+0000 7f325adab8c0 1 > prepared multipart upload key=UW0SSQ8VFY1G upload=9CK10RJVWCFH tag=U90R6MAUTLLT type=write size=3950530 2024-09-05T00:56:27.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.733+0000 7f325adab8c0 1 < suggested remove operation key=NIAW4BKW21LG tag=HAAZXV701PAC type=write 2024-09-05T00:56:27.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.737+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=7JRFPNBAPQ9K type=del size=3203521 2024-09-05T00:56:27.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.737+0000 7f325adab8c0 1 < completed write operation key=CB079FGXKNRO tag=CZBK2L4T9STA type=write size=116988 2024-09-05T00:56:27.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.741+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=8TF5J689U8WQ type=del size=3256140 2024-09-05T00:56:27.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.745+0000 7f325adab8c0 1 < suggested update operation key=VYMRZPO6VKGS tag=DNUZLKZ358DZ type=write size=289385 2024-09-05T00:56:27.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.749+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=HEFRFBHC9CKE type=del size=2606983 2024-09-05T00:56:27.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.749+0000 7f325adab8c0 1 < canceled part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.0 size=1048576 2024-09-05T00:56:27.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.749+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.1 size=1048576 2024-09-05T00:56:27.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.753+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~4B5QJA0NS0O0.2 size=218236 2024-09-05T00:56:27.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.757+0000 7f325adab8c0 1 < canceled multipart upload key=CB079FGXKNRO upload=4B5QJA0NS0O0 tag=5CD5LHCB23TD type=write size=3363964 2024-09-05T00:56:27.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.757+0000 7f325adab8c0 1 > prepared operation key=SP188HM5LG2D tag=SL4D8MLXOA37 type=write size=948283 2024-09-05T00:56:27.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.761+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.0 size=1048576 2024-09-05T00:56:27.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.761+0000 7f325adab8c0 1 < canceled part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.1 size=1048576 2024-09-05T00:56:27.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.761+0000 7f325adab8c0 1 < completed part key=_multipart_GF6OC9O60D5E.2~63ANEG9YEMOF.2 size=661970 2024-09-05T00:56:27.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.765+0000 7f325adab8c0 1 < canceled multipart upload key=GF6OC9O60D5E upload=63ANEG9YEMOF tag=J338T4BA1MTP type=write size=3807698 2024-09-05T00:56:27.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.773+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~581D2ZZHTMQ2.0 size=1048576 2024-09-05T00:56:27.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.773+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~581D2ZZHTMQ2.1 size=620626 2024-09-05T00:56:27.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.773+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=581D2ZZHTMQ2 tag=AWID7F134GPG type=write size=2717778 2024-09-05T00:56:27.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.777+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~69GNFB101GSH.0 size=1048576 2024-09-05T00:56:27.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.777+0000 7f325adab8c0 1 < completed part key=_multipart_GU25IIQWQNR2.2~69GNFB101GSH.1 size=697046 2024-09-05T00:56:27.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.781+0000 7f325adab8c0 1 < completed multipart upload key=GU25IIQWQNR2 upload=69GNFB101GSH tag=TUZHWB1K57ID type=write size=2794198 2024-09-05T00:56:27.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.781+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=M1PT9JFNGW2Z type=del size=3151110 2024-09-05T00:56:27.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.785+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~BP16YSNGRJEB.0 size=884531 2024-09-05T00:56:27.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.789+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=BP16YSNGRJEB tag=QZRA64DAN27P type=write size=1933107 2024-09-05T00:56:27.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.789+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=OC4BSOK4D677 type=del size=2377293 2024-09-05T00:56:27.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.793+0000 7f325adab8c0 1 < completed delete operation key=ZVKLK751KO5T tag=VT074PZ22PRU type=del 2024-09-05T00:56:27.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.793+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=0ZIT86MGE0HG type=del size=3095477 2024-09-05T00:56:27.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.797+0000 7f325adab8c0 1 < completed write operation key=GQB4HOYII01G tag=0G4J1M13F51K type=write size=939463 2024-09-05T00:56:27.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.805+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.0 size=1048576 2024-09-05T00:56:27.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.805+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.1 size=1048576 2024-09-05T00:56:27.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.805+0000 7f325adab8c0 1 > prepared part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.2 size=255390 2024-09-05T00:56:27.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.805+0000 7f325adab8c0 1 > prepared multipart upload key=J9UIQE3CKYHM upload=1Z49QFQEQYF2 tag=DEGJKQ12ZJYR type=write size=3401118 2024-09-05T00:56:27.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.809+0000 7f325adab8c0 1 < canceled operation key=YG43HSBBCRKH tag=FVL168T4G50E type=del size=3523673 2024-09-05T00:56:27.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.809+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=G7VIENQK2VGF type=del size=3635046 2024-09-05T00:56:27.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.813+0000 7f325adab8c0 1 < completed write operation key=LVZALGRNP5TU tag=N05HWQ62EXCZ type=write size=424324 2024-09-05T00:56:27.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.817+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~D11R0MJ5BTKF.0 size=1048576 2024-09-05T00:56:27.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.817+0000 7f325adab8c0 1 > prepared part key=_multipart_NIAW4BKW21LG.2~D11R0MJ5BTKF.1 size=596466 2024-09-05T00:56:27.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.817+0000 7f325adab8c0 1 > prepared multipart upload key=NIAW4BKW21LG upload=D11R0MJ5BTKF tag=GX8FHI65S9P4 type=write size=2693618 2024-09-05T00:56:27.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.821+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.0 size=1048576 2024-09-05T00:56:27.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.821+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.1 size=1048576 2024-09-05T00:56:27.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.825+0000 7f325adab8c0 1 < completed part key=_multipart_VYMRZPO6VKGS.2~WW3VH0X8T66F.2 size=533954 2024-09-05T00:56:27.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.829+0000 7f325adab8c0 1 < completed multipart upload key=VYMRZPO6VKGS upload=WW3VH0X8T66F tag=DFP9WW8K8VR7 type=write size=3679682 2024-09-05T00:56:27.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.829+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=AEABGLA5Y10S type=del size=213920 2024-09-05T00:56:27.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.833+0000 7f325adab8c0 1 < completed delete operation key=GU25IIQWQNR2 tag=USW2T5K0B8DG type=del 2024-09-05T00:56:27.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.833+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=4MLREJIJI891 type=del size=3534325 2024-09-05T00:56:27.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.837+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~STJYFY5BQS2R.0 size=1048576 2024-09-05T00:56:27.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.837+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~STJYFY5BQS2R.1 size=438623 2024-09-05T00:56:27.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.841+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=STJYFY5BQS2R tag=K2XDKKOX2HC4 type=write size=2535775 2024-09-05T00:56:27.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.845+0000 7f325adab8c0 1 > prepared operation key=6N7BLJ1WLDGN tag=KLLE2OFG829V type=del size=610141 2024-09-05T00:56:27.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.845+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~0OJHLF4HKG5K.0 size=592437 2024-09-05T00:56:27.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.849+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=0OJHLF4HKG5K tag=LVHO0223URXE type=write size=1641013 2024-09-05T00:56:27.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.853+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~YLNFQCV68E3N.0 size=1048576 2024-09-05T00:56:27.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.857+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~YLNFQCV68E3N.1 size=530674 2024-09-05T00:56:27.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.857+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=YLNFQCV68E3N tag=X3IZ0P8DR6H5 type=write size=2627826 2024-09-05T00:56:27.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.857+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.0 size=1048576 2024-09-05T00:56:27.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.861+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.1 size=1048576 2024-09-05T00:56:27.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.861+0000 7f325adab8c0 1 < completed part key=_multipart_UW0SSQ8VFY1G.2~9CK10RJVWCFH.2 size=804802 2024-09-05T00:56:27.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.865+0000 7f325adab8c0 1 < completed multipart upload key=UW0SSQ8VFY1G upload=9CK10RJVWCFH tag=U90R6MAUTLLT type=write size=3950530 2024-09-05T00:56:27.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.865+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=40RTHSUL4J01 type=write size=913412 2024-09-05T00:56:27.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.869+0000 7f325adab8c0 1 < completed delete operation key=LVZALGRNP5TU tag=7JRFPNBAPQ9K type=del 2024-09-05T00:56:27.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.869+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=H2TD0KOY9STM type=del size=2322915 2024-09-05T00:56:27.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.873+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=8TF5J689U8WQ type=del 2024-09-05T00:56:27.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.877+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=XA1D4EZPUHDW type=del size=2126816 2024-09-05T00:56:27.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.877+0000 7f325adab8c0 1 < completed delete operation key=MYR9H12B5YYV tag=HEFRFBHC9CKE type=del 2024-09-05T00:56:27.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.881+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~BII6NKQ155QE.0 size=1048576 2024-09-05T00:56:27.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.885+0000 7f325adab8c0 1 > prepared part key=_multipart_06YHJGLZQLK6.2~BII6NKQ155QE.1 size=530203 2024-09-05T00:56:27.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.885+0000 7f325adab8c0 1 > prepared multipart upload key=06YHJGLZQLK6 upload=BII6NKQ155QE tag=2QG54NO0U0MS type=write size=2627355 2024-09-05T00:56:27.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.885+0000 7f325adab8c0 1 < completed write operation key=SP188HM5LG2D tag=SL4D8MLXOA37 type=write size=948283 2024-09-05T00:56:27.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.889+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~Y80M7UGH80CS.0 size=147918 2024-09-05T00:56:27.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.889+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=Y80M7UGH80CS tag=J6G37EZLJ46Q type=write size=1196494 2024-09-05T00:56:27.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.893+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~581D2ZZHTMQ2.0 size=1048576 2024-09-05T00:56:27.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.893+0000 7f325adab8c0 1 < completed part key=_multipart_ZVKLK751KO5T.2~581D2ZZHTMQ2.1 size=620626 2024-09-05T00:56:27.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.897+0000 7f325adab8c0 1 < completed multipart upload key=ZVKLK751KO5T upload=581D2ZZHTMQ2 tag=AWID7F134GPG type=write size=2717778 2024-09-05T00:56:27.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.901+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~QDEIQHKZG7PF.0 size=1048576 2024-09-05T00:56:27.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.905+0000 7f325adab8c0 1 > prepared part key=_multipart_HW4QK67332RW.2~QDEIQHKZG7PF.1 size=552790 2024-09-05T00:56:27.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.905+0000 7f325adab8c0 1 > prepared multipart upload key=HW4QK67332RW upload=QDEIQHKZG7PF tag=26F10IRU8NG0 type=write size=2649942 2024-09-05T00:56:27.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.905+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=M1PT9JFNGW2Z type=del 2024-09-05T00:56:27.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.909+0000 7f325adab8c0 1 > prepared part key=_multipart_D6HSFIRN2X4Q.2~DMCAC0WICL19.0 size=59893 2024-09-05T00:56:27.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.909+0000 7f325adab8c0 1 > prepared multipart upload key=D6HSFIRN2X4Q upload=DMCAC0WICL19 tag=A32OEEUCAGQL type=write size=1108469 2024-09-05T00:56:27.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.913+0000 7f325adab8c0 1 < canceled operation key=EGPVSV2PFILM tag=OC4BSOK4D677 type=del size=2377293 2024-09-05T00:56:27.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.917+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=ZTGRX5W882VK type=write size=336733 2024-09-05T00:56:27.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.917+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=0ZIT86MGE0HG type=del 2024-09-05T00:56:27.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.921+0000 7f325adab8c0 1 > prepared operation key=O0RSK2S88XHP tag=F3TXC3FIMLPQ type=write size=437196 2024-09-05T00:56:27.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.921+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.0 size=1048576 2024-09-05T00:56:27.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.925+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.1 size=1048576 2024-09-05T00:56:27.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.925+0000 7f325adab8c0 1 < completed part key=_multipart_J9UIQE3CKYHM.2~1Z49QFQEQYF2.2 size=255390 2024-09-05T00:56:27.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.929+0000 7f325adab8c0 1 < completed multipart upload key=J9UIQE3CKYHM upload=1Z49QFQEQYF2 tag=DEGJKQ12ZJYR type=write size=3401118 2024-09-05T00:56:27.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.933+0000 7f325adab8c0 1 > prepared operation key=71FWV15GD1QZ tag=F1RI5VMCUYGV type=del size=3636374 2024-09-05T00:56:27.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.933+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=G7VIENQK2VGF type=del 2024-09-05T00:56:27.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.937+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=OETM11KPTR09 type=del size=3616287 2024-09-05T00:56:27.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.937+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~D11R0MJ5BTKF.0 size=1048576 2024-09-05T00:56:27.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.941+0000 7f325adab8c0 1 < completed part key=_multipart_NIAW4BKW21LG.2~D11R0MJ5BTKF.1 size=596466 2024-09-05T00:56:27.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.945+0000 7f325adab8c0 1 < completed multipart upload key=NIAW4BKW21LG upload=D11R0MJ5BTKF tag=GX8FHI65S9P4 type=write size=2693618 2024-09-05T00:56:27.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.945+0000 7f325adab8c0 1 > prepared operation key=GF6OC9O60D5E tag=C42TFQK8GZGV type=del size=1535603 2024-09-05T00:56:27.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.949+0000 7f325adab8c0 1 < suggested remove operation key=GF6OC9O60D5E tag=AEABGLA5Y10S type=del 2024-09-05T00:56:27.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.953+0000 7f325adab8c0 1 > prepared operation key=EGPVSV2PFILM tag=ZZ5ER18RTOP2 type=write size=752347 2024-09-05T00:56:27.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.953+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=4MLREJIJI891 type=del 2024-09-05T00:56:27.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.957+0000 7f325adab8c0 1 > prepared operation key=06YHJGLZQLK6 tag=YFBCY6LW8L5X type=del size=1881003 2024-09-05T00:56:27.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.957+0000 7f325adab8c0 1 < completed delete operation key=6N7BLJ1WLDGN tag=KLLE2OFG829V type=del 2024-09-05T00:56:27.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.961+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UM9NDQTIB1JG.0 size=1048576 2024-09-05T00:56:27.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.965+0000 7f325adab8c0 1 > prepared part key=_multipart_EGPVSV2PFILM.2~UM9NDQTIB1JG.1 size=921425 2024-09-05T00:56:27.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.965+0000 7f325adab8c0 1 > prepared multipart upload key=EGPVSV2PFILM upload=UM9NDQTIB1JG tag=HRCMK1G70BVL type=write size=3018577 2024-09-05T00:56:27.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.965+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~YLNFQCV68E3N.0 size=1048576 2024-09-05T00:56:27.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.969+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~YLNFQCV68E3N.1 size=530674 2024-09-05T00:56:27.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.969+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=YLNFQCV68E3N tag=X3IZ0P8DR6H5 type=write size=2627826 2024-09-05T00:56:27.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.973+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=JZ4N3LI6U9PD type=del size=3412579 2024-09-05T00:56:27.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.977+0000 7f325adab8c0 1 < completed write operation key=HW4QK67332RW tag=40RTHSUL4J01 type=write size=913412 2024-09-05T00:56:27.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.977+0000 7f325adab8c0 1 > prepared operation key=YMIGZMLJSI4D tag=VXVASD1DWI0B type=del size=2632254 2024-09-05T00:56:27.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.981+0000 7f325adab8c0 1 < suggested update operation key=71FWV15GD1QZ tag=H2TD0KOY9STM type=del size=2322915 2024-09-05T00:56:27.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.985+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~BQB8DBNLHF9N.0 size=1048576 2024-09-05T00:56:27.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.989+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~BQB8DBNLHF9N.1 size=662298 2024-09-05T00:56:27.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.989+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=BQB8DBNLHF9N tag=FMXQ2WD8T6T8 type=write size=2759450 2024-09-05T00:56:27.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.989+0000 7f325adab8c0 1 < completed delete operation key=YG43HSBBCRKH tag=XA1D4EZPUHDW type=del 2024-09-05T00:56:27.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.993+0000 7f325adab8c0 1 > prepared operation key=IGOUBVL3XVS3 tag=OBGLWFADQIYO type=del size=2444323 2024-09-05T00:56:27.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.993+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~BII6NKQ155QE.0 size=1048576 2024-09-05T00:56:27.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.997+0000 7f325adab8c0 1 < completed part key=_multipart_06YHJGLZQLK6.2~BII6NKQ155QE.1 size=530203 2024-09-05T00:56:28.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:27.997+0000 7f325adab8c0 1 < completed multipart upload key=06YHJGLZQLK6 upload=BII6NKQ155QE tag=2QG54NO0U0MS type=write size=2627355 2024-09-05T00:56:28.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.001+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=SQMKNRV0Z7QU type=del size=1519180 2024-09-05T00:56:28.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.005+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~Y80M7UGH80CS.0 size=147918 2024-09-05T00:56:28.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.009+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=Y80M7UGH80CS tag=J6G37EZLJ46Q type=write size=1196494 2024-09-05T00:56:28.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.013+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=97DWD2O6065B type=del size=2279286 2024-09-05T00:56:28.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.013+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~QDEIQHKZG7PF.0 size=1048576 2024-09-05T00:56:28.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.017+0000 7f325adab8c0 1 < completed part key=_multipart_HW4QK67332RW.2~QDEIQHKZG7PF.1 size=552790 2024-09-05T00:56:28.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.021+0000 7f325adab8c0 1 < completed multipart upload key=HW4QK67332RW upload=QDEIQHKZG7PF tag=26F10IRU8NG0 type=write size=2649942 2024-09-05T00:56:28.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.025+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~VWG7OU9AAHJS.0 size=1048576 2024-09-05T00:56:28.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.025+0000 7f325adab8c0 1 > prepared part key=_multipart_CB079FGXKNRO.2~VWG7OU9AAHJS.1 size=830905 2024-09-05T00:56:28.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.025+0000 7f325adab8c0 1 > prepared multipart upload key=CB079FGXKNRO upload=VWG7OU9AAHJS tag=UG11WZ2T1HC1 type=write size=2928057 2024-09-05T00:56:28.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.029+0000 7f325adab8c0 1 < completed part key=_multipart_D6HSFIRN2X4Q.2~DMCAC0WICL19.0 size=59893 2024-09-05T00:56:28.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.033+0000 7f325adab8c0 1 < completed multipart upload key=D6HSFIRN2X4Q upload=DMCAC0WICL19 tag=A32OEEUCAGQL type=write size=1108469 2024-09-05T00:56:28.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.037+0000 7f325adab8c0 1 > prepared operation key=079QFDETDGGC tag=TGD03ZYW75AS type=del size=1082873 2024-09-05T00:56:28.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.037+0000 7f325adab8c0 1 < completed write operation key=YG43HSBBCRKH tag=ZTGRX5W882VK type=write size=336733 2024-09-05T00:56:28.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.041+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=BXND4PP6FYQP type=write size=898700 2024-09-05T00:56:28.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.045+0000 7f325adab8c0 1 < suggested update operation key=O0RSK2S88XHP tag=F3TXC3FIMLPQ type=write size=437196 2024-09-05T00:56:28.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.053+0000 7f325adab8c0 1 > prepared part key=_multipart_G600UT533GTT.2~IR9JWJESSLC0.0 size=452319 2024-09-05T00:56:28.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.053+0000 7f325adab8c0 1 > prepared multipart upload key=G600UT533GTT upload=IR9JWJESSLC0 tag=7ZSYL0PT0QEP type=write size=1500895 2024-09-05T00:56:28.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.053+0000 7f325adab8c0 -1 < failed to complete operation key=71FWV15GD1QZ tag=F1RI5VMCUYGV type=del size=3636374: (22) Invalid argument 2024-09-05T00:56:28.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.057+0000 7f325adab8c0 1 > prepared operation key=GQB4HOYII01G tag=21TL90S28O9N type=del size=1757867 2024-09-05T00:56:28.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.061+0000 7f325adab8c0 1 < suggested update operation key=9O7DVR04PCDB tag=OETM11KPTR09 type=del size=3616287 2024-09-05T00:56:28.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.065+0000 7f325adab8c0 1 > prepared operation key=GU25IIQWQNR2 tag=8YL1SMSA0E8Q type=write size=449599 2024-09-05T00:56:28.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.069+0000 7f325adab8c0 -1 < failed to complete operation key=GF6OC9O60D5E tag=C42TFQK8GZGV type=del size=1535603: (22) Invalid argument 2024-09-05T00:56:28.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.069+0000 7f325adab8c0 1 > prepared operation key=CB079FGXKNRO tag=ONG7L4XTQRXN type=del size=3676413 2024-09-05T00:56:28.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.073+0000 7f325adab8c0 1 < completed write operation key=EGPVSV2PFILM tag=ZZ5ER18RTOP2 type=write size=752347 2024-09-05T00:56:28.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.077+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=N0UG0NE31NR3 type=del size=2729512 2024-09-05T00:56:28.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.077+0000 7f325adab8c0 1 < canceled operation key=06YHJGLZQLK6 tag=YFBCY6LW8L5X type=del size=1881003 2024-09-05T00:56:28.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.085+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~QBQI123EDQ4V.0 size=614833 2024-09-05T00:56:28.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.085+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=QBQI123EDQ4V tag=6G8SH0I1RXG1 type=write size=1663409 2024-09-05T00:56:28.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.085+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UM9NDQTIB1JG.0 size=1048576 2024-09-05T00:56:28.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.089+0000 7f325adab8c0 1 < completed part key=_multipart_EGPVSV2PFILM.2~UM9NDQTIB1JG.1 size=921425 2024-09-05T00:56:28.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.093+0000 7f325adab8c0 1 < completed multipart upload key=EGPVSV2PFILM upload=UM9NDQTIB1JG tag=HRCMK1G70BVL type=write size=3018577 2024-09-05T00:56:28.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.097+0000 7f325adab8c0 1 > prepared operation key=HW4QK67332RW tag=DMVC6ZCSP9U5 type=del size=3880300 2024-09-05T00:56:28.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.097+0000 7f325adab8c0 1 < completed delete operation key=A9WMRV5QZ2FP tag=JZ4N3LI6U9PD type=del 2024-09-05T00:56:28.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.101+0000 7f325adab8c0 1 > prepared part key=_multipart_IGOUBVL3XVS3.2~61E6BVFOTFKP.0 size=414861 2024-09-05T00:56:28.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.101+0000 7f325adab8c0 1 > prepared multipart upload key=IGOUBVL3XVS3 upload=61E6BVFOTFKP tag=NRYX2GHAYI7H type=write size=1463437 2024-09-05T00:56:28.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.105+0000 7f325adab8c0 1 < completed delete operation key=YMIGZMLJSI4D tag=VXVASD1DWI0B type=del 2024-09-05T00:56:28.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.109+0000 7f325adab8c0 1 > prepared part key=_multipart_MBJLOE5XFPYN.2~IFGIEQDGJ0AR.0 size=694386 2024-09-05T00:56:28.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.109+0000 7f325adab8c0 1 > prepared multipart upload key=MBJLOE5XFPYN upload=IFGIEQDGJ0AR tag=22G2QXBO7TOS type=write size=1742962 2024-09-05T00:56:28.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.113+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~BQB8DBNLHF9N.0 size=1048576 2024-09-05T00:56:28.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.117+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~BQB8DBNLHF9N.1 size=662298 2024-09-05T00:56:28.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.121+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=BQB8DBNLHF9N tag=FMXQ2WD8T6T8 type=write size=2759450 2024-09-05T00:56:28.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.121+0000 7f325adab8c0 1 > prepared operation key=5WOUI4SHYTSS tag=XFV6U8S9Z14T type=write size=472160 2024-09-05T00:56:28.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.129+0000 7f325adab8c0 1 < suggested remove operation key=IGOUBVL3XVS3 tag=OBGLWFADQIYO type=del 2024-09-05T00:56:28.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.133+0000 7f325adab8c0 1 > prepared part key=_multipart_ZVKLK751KO5T.2~A4IJIDBQUZLE.0 size=449759 2024-09-05T00:56:28.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.133+0000 7f325adab8c0 1 > prepared multipart upload key=ZVKLK751KO5T upload=A4IJIDBQUZLE tag=P5HORU52UK4F type=write size=1498335 2024-09-05T00:56:28.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.137+0000 7f325adab8c0 1 < suggested remove operation key=A9WMRV5QZ2FP tag=SQMKNRV0Z7QU type=del 2024-09-05T00:56:28.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.141+0000 7f325adab8c0 1 > prepared part key=_multipart_MYR9H12B5YYV.2~UZU4E6SNUIHB.0 size=374045 2024-09-05T00:56:28.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.141+0000 7f325adab8c0 1 > prepared multipart upload key=MYR9H12B5YYV upload=UZU4E6SNUIHB tag=0PQ39D03C63K type=write size=1422621 2024-09-05T00:56:28.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.145+0000 7f325adab8c0 -1 < failed to complete operation key=9O7DVR04PCDB tag=97DWD2O6065B type=del size=2279286: (22) Invalid argument 2024-09-05T00:56:28.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.149+0000 7f325adab8c0 1 > prepared operation key=JKRZR0KRE93F tag=M0A16TR2A6BP type=del size=683480 2024-09-05T00:56:28.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.149+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~VWG7OU9AAHJS.0 size=1048576 2024-09-05T00:56:28.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.153+0000 7f325adab8c0 1 < completed part key=_multipart_CB079FGXKNRO.2~VWG7OU9AAHJS.1 size=830905 2024-09-05T00:56:28.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.157+0000 7f325adab8c0 1 < completed multipart upload key=CB079FGXKNRO upload=VWG7OU9AAHJS tag=UG11WZ2T1HC1 type=write size=2928057 2024-09-05T00:56:28.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.157+0000 7f325adab8c0 1 > prepared operation key=G600UT533GTT tag=7VFKSGHK835E type=del size=3975816 2024-09-05T00:56:28.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.161+0000 7f325adab8c0 1 < completed delete operation key=079QFDETDGGC tag=TGD03ZYW75AS type=del 2024-09-05T00:56:28.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.165+0000 7f325adab8c0 1 > prepared operation key=ZVKLK751KO5T tag=8BQT5JNJ5S0T type=del size=3207616 2024-09-05T00:56:28.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.169+0000 7f325adab8c0 1 < suggested update operation key=ZVKLK751KO5T tag=BXND4PP6FYQP type=write size=898700 2024-09-05T00:56:28.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.173+0000 7f325adab8c0 1 > prepared part key=_multipart_9O7DVR04PCDB.2~5KJDQ9R1E4I5.0 size=355574 2024-09-05T00:56:28.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.173+0000 7f325adab8c0 1 > prepared multipart upload key=9O7DVR04PCDB upload=5KJDQ9R1E4I5 tag=FLC5DGMTLBSM type=write size=1404150 2024-09-05T00:56:28.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.177+0000 7f325adab8c0 1 < completed part key=_multipart_G600UT533GTT.2~IR9JWJESSLC0.0 size=452319 2024-09-05T00:56:28.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.181+0000 7f325adab8c0 1 < completed multipart upload key=G600UT533GTT upload=IR9JWJESSLC0 tag=7ZSYL0PT0QEP type=write size=1500895 2024-09-05T00:56:28.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.185+0000 7f325adab8c0 1 > prepared operation key=YG43HSBBCRKH tag=SV7LDLBG5HOE type=del size=1349769 2024-09-05T00:56:28.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.189+0000 7f325adab8c0 1 < canceled operation key=GQB4HOYII01G tag=21TL90S28O9N type=del size=1757867 2024-09-05T00:56:28.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.193+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~JP0FQA7Z1JZ8.0 size=1048576 2024-09-05T00:56:28.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.193+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~JP0FQA7Z1JZ8.1 size=1048576 2024-09-05T00:56:28.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.197+0000 7f325adab8c0 1 > prepared part key=_multipart_5WOUI4SHYTSS.2~JP0FQA7Z1JZ8.2 size=811148 2024-09-05T00:56:28.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.197+0000 7f325adab8c0 1 > prepared multipart upload key=5WOUI4SHYTSS upload=JP0FQA7Z1JZ8 tag=VEU2LKB4M98A type=write size=3956876 2024-09-05T00:56:28.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.197+0000 7f325adab8c0 1 < completed write operation key=GU25IIQWQNR2 tag=8YL1SMSA0E8Q type=write size=449599 2024-09-05T00:56:28.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.201+0000 7f325adab8c0 1 > prepared operation key=LVZALGRNP5TU tag=4WMNNFUCF1H2 type=del size=1281963 2024-09-05T00:56:28.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.205+0000 7f325adab8c0 1 < completed delete operation key=CB079FGXKNRO tag=ONG7L4XTQRXN type=del 2024-09-05T00:56:28.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.205+0000 7f325adab8c0 1 > prepared operation key=9O7DVR04PCDB tag=JNMZAENCA911 type=del size=198130 2024-09-05T00:56:28.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.209+0000 7f325adab8c0 1 < completed delete operation key=G600UT533GTT tag=N0UG0NE31NR3 type=del 2024-09-05T00:56:28.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.213+0000 7f325adab8c0 1 > prepared operation key=MYR9H12B5YYV tag=HIFUBJF4FW5I type=del size=3172530 2024-09-05T00:56:28.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.213+0000 7f325adab8c0 1 < completed part key=_multipart_5WOUI4SHYTSS.2~QBQI123EDQ4V.0 size=614833 2024-09-05T00:56:28.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.217+0000 7f325adab8c0 1 < completed multipart upload key=5WOUI4SHYTSS upload=QBQI123EDQ4V tag=6G8SH0I1RXG1 type=write size=1663409 2024-09-05T00:56:28.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.221+0000 7f325adab8c0 1 > prepared operation key=A9WMRV5QZ2FP tag=4GIA00SRD32I type=del size=3371837 2024-09-05T00:56:28.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.225+0000 7f325adab8c0 1 < completed delete operation key=HW4QK67332RW tag=DMVC6ZCSP9U5 type=del 2024-09-05T00:56:28.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:56:28.229+0000 7f325adab8c0 1 > prepared operation key=J9UIQE3CKYHM tag=HYRP0VUD5WY8 type=del size=1054238 2024-09-05T00:56:28.231 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_stats.simulate (19703 ms) 2024-09-05T00:56:28.232 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 1 test from cls_rgw_stats (19703 ms total) 2024-09-05T00:56:28.232 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:56:28.232 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:56:28.353 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 1 test from 1 test suite ran. (21713 ms total) 2024-09-05T00:56:28.353 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 1 test. 2024-09-05T00:56:28.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:56:28.361 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:56:28.416 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-05T00:56:28.417 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-05T00:56:28.417 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-05T00:56:28.480 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:56:28.480 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-05T00:56:28.481 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:56:30.358 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 31 tests from CmpOmap 2024-09-05T00:56:30.358 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-05T00:56:30.388 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (30 ms) 2024-09-05T00:56:30.389 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-05T00:56:30.404 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (15 ms) 2024-09-05T00:56:30.404 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-05T00:56:30.412 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (9 ms) 2024-09-05T00:56:30.412 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-05T00:56:30.418 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (5 ms) 2024-09-05T00:56:30.418 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-05T00:56:30.435 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_str (17 ms) 2024-09-05T00:56:30.435 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-05T00:56:30.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64 (12 ms) 2024-09-05T00:56:30.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-05T00:56:30.452 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-05T00:56:30.452 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-05T00:56:30.461 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (9 ms) 2024-09-05T00:56:30.461 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-05T00:56:30.471 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (9 ms) 2024-09-05T00:56:30.471 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-05T00:56:30.482 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (12 ms) 2024-09-05T00:56:30.482 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-05T00:56:30.484 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-05T00:56:30.484 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-05T00:56:30.485 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-05T00:56:30.485 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-05T00:56:30.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (19 ms) 2024-09-05T00:56:30.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-05T00:56:30.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-05T00:56:30.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-05T00:56:30.538 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-09-05T00:56:30.538 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-05T00:56:30.554 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (15 ms) 2024-09-05T00:56:30.554 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-05T00:56:30.574 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-05T00:56:30.574 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-05T00:56:30.595 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-05T00:56:30.595 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-05T00:56:30.603 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-09-05T00:56:30.603 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-05T00:56:30.610 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-05T00:56:30.610 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-05T00:56:30.613 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-05T00:56:30.613 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-05T00:56:30.614 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-05T00:56:30.614 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-05T00:56:30.631 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-05T00:56:30.632 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-05T00:56:30.649 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (18 ms) 2024-09-05T00:56:30.649 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-05T00:56:30.668 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (18 ms) 2024-09-05T00:56:30.668 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-05T00:56:30.691 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (23 ms) 2024-09-05T00:56:30.691 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-05T00:56:30.696 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-05T00:56:30.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-05T00:56:30.703 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-05T00:56:30.703 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-05T00:56:30.706 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-05T00:56:30.706 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-05T00:56:30.708 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-05T00:56:30.708 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-05T00:56:30.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (20 ms) 2024-09-05T00:56:30.729 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 31 tests from CmpOmap (370 ms total) 2024-09-05T00:56:30.729 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:56:30.729 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:56:31.404 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 31 tests from 1 test suite ran. (2923 ms total) 2024-09-05T00:56:31.404 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 31 tests. 2024-09-05T00:56:31.410 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:56:31.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:56:31.468 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-05T00:56:31.470 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-05T00:56:31.470 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-05T00:56:31.534 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:56:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-05T00:56:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:56:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-05T00:56:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-05T00:56:34.409 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2874 ms) 2024-09-05T00:56:34.409 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-05T00:56:37.416 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3008 ms) 2024-09-05T00:56:37.416 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-05T00:56:40.490 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Reserve (3069 ms) 2024-09-05T00:56:40.490 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-05T00:56:43.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3013 ms) 2024-09-05T00:56:43.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-05T00:56:47.565 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Commit (4067 ms) 2024-09-05T00:56:47.565 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-05T00:56:51.621 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Stats (4056 ms) 2024-09-05T00:56:51.622 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-05T00:56:55.672 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4050 ms) 2024-09-05T00:56:55.672 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-05T00:56:58.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Abort (3025 ms) 2024-09-05T00:56:58.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-05T00:57:01.760 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveError (3061 ms) 2024-09-05T00:57:01.760 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-05T00:57:04.757 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.CommitError (3000 ms) 2024-09-05T00:57:04.758 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-05T00:57:07.800 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AbortError (3038 ms) 2024-09-05T00:57:07.800 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-05T00:57:10.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3065 ms) 2024-09-05T00:57:10.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-05T00:57:13.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3029 ms) 2024-09-05T00:57:13.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-05T00:57:16.937 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3047 ms) 2024-09-05T00:57:16.937 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-05T00:57:19.992 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3054 ms) 2024-09-05T00:57:19.992 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-05T00:57:23.063 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3072 ms) 2024-09-05T00:57:23.064 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-05T00:57:26.072 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3009 ms) 2024-09-05T00:57:26.072 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-05T00:57:29.123 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Cleanup (3051 ms) 2024-09-05T00:57:29.123 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-05T00:57:41.181 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12058 ms) 2024-09-05T00:57:41.181 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-05T00:57:46.215 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5034 ms) 2024-09-05T00:57:46.215 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-05T00:58:00.395 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14180 ms) 2024-09-05T00:58:00.396 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-05T00:58:06.441 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6046 ms) 2024-09-05T00:58:06.441 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-05T00:58:16.491 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10050 ms) 2024-09-05T00:58:16.491 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10052 ms) 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from TestCls2PCQueue (115009 ms total) 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (115009 ms total) 2024-09-05T00:58:26.543 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-09-05T00:58:26.549 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:58:26.549 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:58:26.609 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-05T00:58:26.611 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-05T00:58:26.611 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-05T00:58:26.686 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:58:26.686 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:58:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-05T00:58:26.687 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:58:28.551 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from ClsAccount 2024-09-05T00:58:28.551 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.add 2024-09-05T00:58:28.597 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.add (46 ms) 2024-09-05T00:58:28.597 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.get 2024-09-05T00:58:28.606 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.get (9 ms) 2024-09-05T00:58:28.606 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.rm 2024-09-05T00:58:28.910 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.rm (304 ms) 2024-09-05T00:58:28.910 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.list 2024-09-05T00:58:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.list (44 ms) 2024-09-05T00:58:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from ClsAccount (403 ms total) 2024-09-05T00:58:28.955 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:58:28.956 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:58:29.555 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (2869 ms total) 2024-09-05T00:58:29.555 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-09-05T00:58:29.560 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:58:29.561 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:58:29.618 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-05T00:58:29.620 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-05T00:58:29.620 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-05T00:58:29.694 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:58:29.694 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:58:29.694 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-05T00:58:29.694 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:58:31.586 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 6 tests from rgw_gc_log 2024-09-05T00:58:31.587 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-05T00:58:31.622 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.init_existing_queue (37 ms) 2024-09-05T00:58:31.622 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-05T00:58:31.628 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-09-05T00:58:31.628 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-05T00:58:31.635 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-05T00:58:31.635 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-05T00:58:31.638 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-05T00:58:31.638 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-05T00:58:31.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-09-05T00:58:31.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-05T00:58:31.646 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-05T00:58:31.646 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 6 tests from rgw_gc_log (61 ms total) 2024-09-05T00:58:31.646 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:58:31.646 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:58:32.594 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 6 tests from 1 test suite ran. (2900 ms total) 2024-09-05T00:58:32.595 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 6 tests. 2024-09-05T00:58:32.599 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:58:32.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:58:32.654 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-05T00:58:32.656 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-05T00:58:32.656 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-05T00:58:32.728 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-09-05T00:58:32.728 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-05T00:58:32.728 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from TestRGWObj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.underscore 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.729 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.730 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.731 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.732 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.733 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.734 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-09-05T00:58:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.736 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.737 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.738 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.739 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.740 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.741 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.742 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.743 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.744 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.745 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.746 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.747 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.748 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.749 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.750 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.751 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.752 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.753 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.755 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.756 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.757 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.758 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.759 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.760 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.761 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.762 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.763 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.764 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.765 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.766 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.767 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-09-05T00:58:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.769 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.770 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.771 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.772 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.773 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-09-05T00:58:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.775 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.776 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.777 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.778 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.779 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-05T00:58:32.780 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.781 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.782 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.783 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.784 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.785 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.786 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.787 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.788 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.789 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.790 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.791 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.792 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.793 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.794 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.795 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.796 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.797 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.798 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.799 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.800 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.801 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.802 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.803 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.804 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.805 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.806 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.807 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.808 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.809 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.810 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.811 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.812 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.813 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.814 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.815 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.816 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.817 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.818 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.819 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.820 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.821 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.822 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.823 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.824 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.825 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.826 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.827 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.830 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.831 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.832 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.833 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.834 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.835 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.836 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.837 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.838 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.839 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.840 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.841 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.842 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.843 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.844 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.845 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.846 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.847 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.848 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.849 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.850 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.851 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.852 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.853 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.854 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.855 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.856 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.857 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.858 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.859 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.860 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.861 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.862 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.863 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.864 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.865 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.866 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.867 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.868 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.869 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.870 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.871 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.872 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.873 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.874 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.875 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.876 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.877 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.878 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.879 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-09-05T00:58:32.880 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.881 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.882 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.883 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-05T00:58:32.884 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.885 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.886 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.887 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker_myobj 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.888 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.889 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker_myobj 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.890 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.891 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns_myobj 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.892 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.893 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.894 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.895 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.896 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.897 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.898 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.899 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.900 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.901 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.902 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.903 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.904 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker___myobj 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.905 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.906 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker___myobj 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.907 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.908 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns__myobj 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.909 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.910 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.911 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.912 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.913 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.914 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.915 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.916 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-09-05T00:58:32.918 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.919 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.920 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker___myobj_ 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.921 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.922 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker___myobj_ 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.923 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.924 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-09-05T00:58:32.925 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.926 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.927 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.928 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-09-05T00:58:32.929 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.930 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.932 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.933 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:32.934 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-05T00:58:32.935 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-09-05T00:58:32.936 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T00:58:32.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T00:58:32.950 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-05T00:58:32.951 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-05T00:58:32.952 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-05T00:58:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:58:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:58:33.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 realm 2024-09-05T00:58:33.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T00:58:33.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.136+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:58:33.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T00:58:33.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.140+0000 7fd5818949c0 20 searching for the correct realm 2024-09-05T00:58:33.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.144+0000 7fd57eb99640 0 -- 172.21.15.99:0/794000736 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fd5700ec030 msgr2=0x7fd5700fa450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:58:33.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.152+0000 7fd57eb99640 0 -- 172.21.15.99:0/794000736 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fd44807dfa0 msgr2=0x7fd4480803d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T00:58:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T00:58:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T00:58:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T00:58:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T00:58:33.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 zone default found 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 4 Realm: () 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 zonegroup default 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.160+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.164+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.164+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.164+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.164+0000 7fd5818949c0 20 started sync module instance, tier type = 2024-09-05T00:58:33.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.164+0000 7fd5818949c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=0 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=1 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=2 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=3 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=4 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=5 2024-09-05T00:58:33.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=6 2024-09-05T00:58:33.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 20 add_watcher() i=7 2024-09-05T00:58:33.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.180+0000 7fd5818949c0 2 all 8 watchers are set, enabling cache 2024-09-05T00:58:33.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 5 note: GC not initialized 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd434fe1640 20 reqs_thread_entry: start 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 init_complete bucket index max shards: 11 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 Filter name: none 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd3ae7fc640 20 reqs_thread_entry: start 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-05T00:58:33.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-05T00:58:33.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-05T00:58:33.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.183+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 cache get: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= : miss 2024-09-05T00:58:33.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 20 rados->read ofs=0 len=0 2024-09-05T00:58:33.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T00:58:33.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= info.flags=0x0 2024-09-05T00:58:33.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 adding default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= to cache LRU end 2024-09-05T00:58:33.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 cache get: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= : hit (negative entry) 2024-09-05T00:58:33.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.187+0000 7fd5818949c0 10 cache get: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= : hit (negative entry) 2024-09-05T00:58:33.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-05T00:58:33.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd5818949c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-05T00:58:33.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd5818949c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-05T00:58:33.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd462ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824001 cookie 94476408030064 notifier 5315 bl.length()=697 2024-09-05T00:58:33.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd462ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-05T00:58:33.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.191+0000 7fd462ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-05T00:58:33.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-05T00:58:33.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd5818949c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-05T00:58:33.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd5818949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-05T00:58:33.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd462ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824003 cookie 94476408027856 notifier 5315 bl.length()=194 2024-09-05T00:58:33.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd462ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-05T00:58:33.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.195+0000 7fd462ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.199+0000 7fd5818949c0 10 cache put: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= info.flags=0x7 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.199+0000 7fd5818949c0 10 moving default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= to cache LRU end 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.199+0000 7fd5818949c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:yixYaCMkS6KZxKIh+dhQciqmex4=, ofs0, ns] 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.199+0000 7fd4627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94476408045536 notifier 5315 bl.length()=203 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.203+0000 7fd4627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= info.flags=0x7 2024-09-05T00:58:33.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.203+0000 7fd4627fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+yixYaCMkS6KZxKIh+dhQciqmex4= to cache LRU end 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "ceph-test-librgw-file", 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "librgw test user", 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "librgw@example.com", 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-09-05T00:58:33.203 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "ceph-test-librgw-file", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "yixYaCMkS6KZxKIh+dhQciqmex4=", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "sEyKmTBSDv//W3PQHPyaxTuln4IB1tfiELHjntw8FbQkC9SngiGSbQ==", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T00:58:33.189911Z" 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-09-05T00:58:33.204 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T00:58:33.205 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T00:58:33.189890Z", 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T00:58:33.206 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:58:33.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.203+0000 7fd435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T00:58:33.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.207+0000 7fd5818949c0 20 remove_watcher() i=0 2024-09-05T00:58:33.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.207+0000 7fd5818949c0 2 removed watcher, disabling cache 2024-09-05T00:58:33.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.211+0000 7fd5818949c0 20 remove_watcher() i=1 2024-09-05T00:58:33.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.211+0000 7fd5818949c0 20 remove_watcher() i=2 2024-09-05T00:58:33.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.215+0000 7fd5818949c0 20 remove_watcher() i=3 2024-09-05T00:58:33.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.219+0000 7fd5818949c0 20 remove_watcher() i=4 2024-09-05T00:58:33.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.219+0000 7fd5818949c0 20 remove_watcher() i=5 2024-09-05T00:58:33.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.219+0000 7fd5818949c0 20 remove_watcher() i=6 2024-09-05T00:58:33.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:33.223+0000 7fd5818949c0 20 remove_watcher() i=7 2024-09-05T00:58:33.234 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.1 2024-09-05T00:58:33.251 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-05T00:58:33.251 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:58:33.252 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-09-05T00:58:33.252 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T00:58:33.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:58:33.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:58:33.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (564 ms) 2024-09-05T00:58:33.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-05T00:58:33.818 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-05T00:58:33.818 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T00:58:33.818 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-05T00:58:33.818 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-05T00:58:33.837 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-05T00:58:33.846 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/f1 2024-09-05T00:58:33.849 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/f2 2024-09-05T00:58:33.853 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/f1 2024-09-05T00:58:33.859 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-05T00:58:33.866 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-05T00:58:33.872 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-05T00:58:33.878 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-05T00:58:33.883 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-05T00:58:33.888 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-05T00:58:33.892 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-05T00:58:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-05T00:58:33.902 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (84 ms) 2024-09-05T00:58:33.902 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-05T00:58:34.112 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (210 ms) 2024-09-05T00:58:34.112 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-09-05T00:58:34.112 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-05T00:58:34.112 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-05T00:58:34.148 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (35 ms) 2024-09-05T00:58:34.148 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-05T00:58:34.266 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (119 ms) 2024-09-05T00:58:34.266 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-05T00:58:34.266 INFO:tasks.workunit.client.0.smithi099.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-05T00:58:34.282 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (16 ms) 2024-09-05T00:58:34.282 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-05T00:58:34.282 INFO:tasks.workunit.client.0.smithi099.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (14 ms) 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_0 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.297 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_2 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_0 2024-09-05T00:58:34.298 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_0 2024-09-05T00:58:34.300 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:58:34.300 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_1 2024-09-05T00:58:34.302 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:58:34.302 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_1 2024-09-05T00:58:34.302 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_0 2024-09-05T00:58:34.305 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:58:34.305 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_1 2024-09-05T00:58:34.307 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:58:34.307 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_2 2024-09-05T00:58:34.307 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_0 2024-09-05T00:58:34.309 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:58:34.309 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_1 2024-09-05T00:58:34.311 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:58:34.311 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (15 ms) 2024-09-05T00:58:34.311 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (222 ms) 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-05T00:58:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (1 ms) 2024-09-05T00:58:34.535 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-09-05T00:58:34.552 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-05T00:58:34.553 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-05T00:58:34.559 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-05T00:58:34.561 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-05T00:58:34.567 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-05T00:58:34.568 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-05T00:58:34.569 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-05T00:58:34.570 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-05T00:58:34.571 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-05T00:58:34.571 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-05T00:58:34.572 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-05T00:58:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-05T00:58:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-05T00:58:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-05T00:58:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo (foo): DIR 2024-09-05T00:58:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot (nfsroot): DIR 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (41 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T00:58:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T00:58:34.577 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T00:58:34.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:34.575+0000 7f6736500a80 -1 shutting down 2024-09-05T00:58:34.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:58:34.579+0000 7f6610252640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56185, si_uid : 1000, si_addr0x3e80000db79, si_status0 2024-09-05T00:59:04.141 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29565 ms) 2024-09-05T00:59:04.141 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (30889 ms total) 2024-09-05T00:59:04.141 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:59:04.141 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:59:04.141 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (30889 ms total) 2024-09-05T00:59:04.142 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-09-05T00:59:04.155 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.2 2024-09-05T00:59:04.177 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-05T00:59:04.178 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:59:04.178 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-09-05T00:59:04.178 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T00:59:04.187 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:59:04.187 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:59:04.520 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (343 ms) 2024-09-05T00:59:04.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-05T00:59:04.523 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-05T00:59:04.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-05T00:59:04.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T00:59:04.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T00:59:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:59:04.523+0000 7fd5c5e62a80 -1 shutting down 2024-09-05T00:59:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:59:04.527+0000 7fd49fbb4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56832, si_uid : 1000, si_addr0x3e80000de00, si_status0 2024-09-05T00:59:34.726 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (30203 ms) 2024-09-05T00:59:34.726 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (30548 ms total) 2024-09-05T00:59:34.726 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T00:59:34.727 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T00:59:34.727 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (30548 ms total) 2024-09-05T00:59:34.727 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-09-05T00:59:34.740 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.3 2024-09-05T00:59:34.762 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-05T00:59:34.762 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T00:59:34.763 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-09-05T00:59:34.763 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T00:59:34.774 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T00:59:34.775 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T00:59:35.085 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (323 ms) 2024-09-05T00:59:35.085 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-05T00:59:35.087 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-05T00:59:35.087 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T00:59:35.087 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-05T00:59:35.088 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-05T00:59:35.095 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (8 ms) 2024-09-05T00:59:35.095 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-05T00:59:35.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (108 ms) 2024-09-05T00:59:35.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-09-05T00:59:35.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-05T00:59:35.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-05T00:59:35.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_0 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_1 2024-09-05T00:59:35.204 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_2 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-05T00:59:35.205 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_0 2024-09-05T00:59:35.206 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_0 2024-09-05T00:59:35.206 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:59:35.206 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_1 2024-09-05T00:59:35.207 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:59:35.207 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_1 2024-09-05T00:59:35.207 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_0 2024-09-05T00:59:35.209 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:59:35.209 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_1 2024-09-05T00:59:35.211 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:59:35.211 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_2 2024-09-05T00:59:35.211 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_0 2024-09-05T00:59:35.213 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-05T00:59:35.214 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_1 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (13 ms) 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-05T00:59:35.217 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:59:35.218 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-05T00:59:35.219 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-09-05T00:59:35.232 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-05T00:59:35.233 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-05T00:59:35.239 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-05T00:59:35.243 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-05T00:59:35.249 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-05T00:59:35.250 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-05T00:59:35.251 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-05T00:59:35.253 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-05T00:59:35.254 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-05T00:59:35.255 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-05T00:59:35.256 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo (foo): DIR 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot (nfsroot): DIR 2024-09-05T00:59:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (44 ms) 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T00:59:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T00:59:35.262 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T00:59:35.262 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T00:59:35.262 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T00:59:35.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:59:35.258+0000 7efdf1905a80 -1 shutting down 2024-09-05T00:59:35.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T00:59:35.262+0000 7efccb657640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57477, si_uid : 1000, si_addr0x3e80000e085, si_status0 2024-09-05T01:00:05.207 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29947 ms) 2024-09-05T01:00:05.208 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (30445 ms total) 2024-09-05T01:00:05.208 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:00:05.208 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:00:05.208 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (30445 ms total) 2024-09-05T01:00:05.209 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-09-05T01:00:05.222 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2.1 2024-09-05T01:00:05.246 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-05T01:00:05.246 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:00:05.246 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW 2024-09-05T01:00:05.246 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:00:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:00:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:00:05.793 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (548 ms) 2024-09-05T01:00:05.794 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:00:05.795 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:00:05.795 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:00:05.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (20 ms) 2024-09-05T01:00:05.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:00:05.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-05T01:00:05.816 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-05T01:00:05.833 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave0 2024-09-05T01:00:05.852 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave1 2024-09-05T01:00:05.870 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave2 2024-09-05T01:00:05.886 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave3 2024-09-05T01:00:05.904 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave4 2024-09-05T01:00:05.920 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave5 2024-09-05T01:00:05.940 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave6 2024-09-05T01:00:05.958 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave7 2024-09-05T01:00:05.974 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave8 2024-09-05T01:00:05.993 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave9 2024-09-05T01:00:05.993 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (177 ms) 2024-09-05T01:00:05.993 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-05T01:00:06.662 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (670 ms) 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:00:06.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:00:06.662+0000 7f771e086a80 -1 shutting down 2024-09-05T01:00:06.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:00:06.666+0000 7f75f7dd8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58122, si_uid : 1000, si_addr0x3e80000e30a, si_status0 2024-09-05T01:00:36.133 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29466 ms) 2024-09-05T01:00:36.133 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW (30883 ms total) 2024-09-05T01:00:36.133 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:00:36.134 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:00:36.134 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (30883 ms total) 2024-09-05T01:00:36.134 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-09-05T01:00:36.143 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2.2 2024-09-05T01:00:36.165 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-05T01:00:36.165 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:00:36.165 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW 2024-09-05T01:00:36.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:00:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:00:36.177 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:00:36.458 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (293 ms) 2024-09-05T01:00:36.458 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:00:36.460 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-05T01:00:36.460 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:00:36.460 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-05T01:00:36.460 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:00:36.532 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (73 ms) 2024-09-05T01:00:36.533 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-05T01:00:36.549 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave0 2024-09-05T01:00:36.572 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave1 2024-09-05T01:00:36.591 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave2 2024-09-05T01:00:36.610 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave3 2024-09-05T01:00:36.629 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave4 2024-09-05T01:00:36.647 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave5 2024-09-05T01:00:36.667 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave6 2024-09-05T01:00:36.686 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave7 2024-09-05T01:00:36.706 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave8 2024-09-05T01:00:36.724 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave9 2024-09-05T01:00:36.724 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (192 ms) 2024-09-05T01:00:36.724 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-05T01:00:37.464 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (740 ms) 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:00:37.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:00:37.465+0000 7f70faf02a80 -1 shutting down 2024-09-05T01:00:37.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:00:37.465+0000 7f6fd4c54640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58767, si_uid : 1000, si_addr0x3e80000e58f, si_status0 2024-09-05T01:01:06.644 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29180 ms) 2024-09-05T01:01:06.645 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW (30479 ms total) 2024-09-05T01:01:06.645 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:01:06.645 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:01:06.645 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (30479 ms total) 2024-09-05T01:01:06.645 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-09-05T01:01:06.658 INFO:tasks.workunit.client.0.smithi099.stdout:phase 3.1 2024-09-05T01:01:07.000 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-05T01:01:07.000 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:01:07.000 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW 2024-09-05T01:01:07.000 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:01:07.009 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:01:07.010 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:01:07.319 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (320 ms) 2024-09-05T01:01:07.319 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:01:07.321 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:01:07.321 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:01:07.342 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (22 ms) 2024-09-05T01:01:07.343 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-05T01:01:07.350 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-05T01:01:07.350 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-05T01:01:07.354 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-05T01:01:07.354 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE1 2024-09-05T01:01:07.431 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE1 (77 ms) 2024-09-05T01:01:07.431 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE2 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE2 (66 ms) 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (1 ms) 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-05T01:01:07.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:01:07.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:01:07.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:01:07.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:01:07.499 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:01:07.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:01:07.497+0000 7f0a5d54aa80 -1 shutting down 2024-09-05T01:01:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:01:07.501+0000 7f093729c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59412, si_uid : 1000, si_addr0x3e80000e814, si_status0 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (30105 ms) 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW (30604 ms total) 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 13 tests from 1 test suite ran. (30604 ms total) 2024-09-05T01:01:37.604 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 13 tests. 2024-09-05T01:01:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:phase 3.2 2024-09-05T01:01:37.964 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-05T01:01:37.964 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:01:37.964 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW 2024-09-05T01:01:37.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:01:37.973 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:01:37.973 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:01:38.545 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (581 ms) 2024-09-05T01:01:38.545 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:01:38.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:01:38.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:01:38.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-05T01:01:38.547 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-05T01:01:38.557 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-05T01:01:38.557 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-05T01:01:38.562 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-05T01:01:38.562 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE1 2024-09-05T01:01:38.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE1 (81 ms) 2024-09-05T01:01:38.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE2 2024-09-05T01:01:38.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-05T01:01:38.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-05T01:01:38.644 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-05T01:01:38.644 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-05T01:01:38.651 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (8 ms) 2024-09-05T01:01:38.651 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:01:38.728 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (76 ms) 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (1 ms) 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:01:38.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:01:38.732+0000 7f8d4cbd0a80 -1 shutting down 2024-09-05T01:01:38.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:01:38.736+0000 7f8c26922640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60057, si_uid : 1000, si_addr0x3e80000ea99, si_status0 2024-09-05T01:02:08.667 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29938 ms) 2024-09-05T01:02:08.668 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW (30703 ms total) 2024-09-05T01:02:08.668 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:02:08.668 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:02:08.668 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 13 tests from 1 test suite ran. (30703 ms total) 2024-09-05T01:02:08.668 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 13 tests. 2024-09-05T01:02:08.686 INFO:tasks.workunit.client.0.smithi099.stdout:phase 4.1 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.TVAR 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:read i1: 64001 2024-09-05T01:02:08.709 INFO:tasks.workunit.client.0.smithi099.stdout:read s1: blunderbuss 2024-09-05T01:02:08.710 INFO:tasks.workunit.client.0.smithi099.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-05T01:02:08.710 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:02:08.723 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:02:08.723 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:02:09.268 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (559 ms) 2024-09-05T01:02:09.268 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:02:09.270 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-05T01:02:09.270 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-05T01:02:09.306 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (35 ms) 2024-09-05T01:02:09.306 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_0 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_1 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_2 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_3 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_4 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_5 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_6 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_7 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_8 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_9 2024-09-05T01:02:10.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_10 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_11 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_12 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_13 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_14 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_15 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_16 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_17 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_18 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_19 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_20 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_21 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_22 2024-09-05T01:02:10.735 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_23 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_24 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_25 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_26 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_27 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_28 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_29 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_30 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_31 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_32 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_33 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_34 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_35 2024-09-05T01:02:10.736 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_36 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_37 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_38 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_39 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_40 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_41 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_42 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_43 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_44 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_45 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_46 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_47 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_48 2024-09-05T01:02:10.737 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_49 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_50 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_51 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_52 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_53 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_54 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_55 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_56 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_57 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_58 2024-09-05T01:02:10.738 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_59 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_60 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_61 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_62 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_63 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_64 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_65 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_66 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_67 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_68 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_69 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_70 2024-09-05T01:02:10.739 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_71 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_72 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_73 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_74 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_75 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_76 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_77 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_78 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_79 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_80 2024-09-05T01:02:10.740 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_81 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_82 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_83 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_84 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_85 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_86 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_87 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_88 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_89 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_90 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_91 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_92 2024-09-05T01:02:10.741 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_93 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_94 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_95 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_96 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_97 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_98 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_99 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1428 ms) 2024-09-05T01:02:10.742 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-05T01:02:10.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-05T01:02:10.744 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-05T01:02:10.745 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-05T01:02:10.746 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-05T01:02:10.747 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-05T01:02:10.748 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-05T01:02:10.749 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-05T01:02:10.750 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-05T01:02:10.751 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-05T01:02:10.752 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-05T01:02:10.753 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-05T01:02:10.754 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-05T01:02:10.755 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-05T01:02:10.756 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-05T01:02:10.757 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-05T01:02:10.758 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-05T01:02:10.759 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-05T01:02:10.760 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-05T01:02:10.761 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:02:10.762 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:02:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:02:10.748+0000 7f3ddba9fa80 -1 shutting down 2024-09-05T01:02:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:02:10.752+0000 7f3cb57f1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60703, si_uid : 1000, si_addr0x3e80000ed1f, si_status0 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (28824 ms) 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW (30862 ms total) 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (30862 ms total) 2024-09-05T01:02:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-09-05T01:02:39.585 INFO:tasks.workunit.client.0.smithi099.stdout:phase 4.2 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.TVAR 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:read i1: 64001 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:read s1: blunderbuss 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-05T01:02:39.608 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:02:39.618 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:02:39.618 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:02:40.248 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (640 ms) 2024-09-05T01:02:40.248 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:02:40.250 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:02:40.250 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-05T01:02:40.268 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-05T01:02:40.269 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-05T01:02:40.269 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-05T01:02:40.269 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-05T01:02:40.269 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-05T01:02:40.269 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-05T01:02:40.273 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-05T01:02:40.273 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-05T01:02:40.274 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-05T01:02:40.275 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-05T01:02:40.276 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-05T01:02:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-05T01:02:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-05T01:02:40.279 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-05T01:02:40.280 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:02:40.281 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:02:40.282 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:02:40.282 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:02:40.282 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:02:40.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:02:40.276+0000 7f7acb794a80 -1 shutting down 2024-09-05T01:02:40.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:02:40.280+0000 7f79a54e6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61348, si_uid : 1000, si_addr0x3e80000efa4, si_status0 2024-09-05T01:03:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (30261 ms) 2024-09-05T01:03:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW (30926 ms total) 2024-09-05T01:03:10.535 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:03:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:03:10.535 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (30926 ms total) 2024-09-05T01:03:10.536 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-09-05T01:03:10.548 INFO:tasks.workunit.client.0.smithi099.stdout:phase 5.1 2024-09-05T01:03:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-05T01:03:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:03:10.582 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW 2024-09-05T01:03:10.583 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:03:10.594 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:03:10.594 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:03:10.894 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (312 ms) 2024-09-05T01:03:10.894 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:03:10.896 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:03:10.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:03:10.912 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-05T01:03:10.912 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-05T01:03:10.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-05T01:03:10.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-05T01:03:10.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-05T01:03:10.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-05T01:03:10.919 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-05T01:03:10.920 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-05T01:03:10.920 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-05T01:03:10.920 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-05T01:03:10.926 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.PUT_OBJECT (6 ms) 2024-09-05T01:03:10.926 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEV 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-05T01:03:10.929 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:03:10.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:03:10.931+0000 7f3975e17a80 -1 shutting down 2024-09-05T01:03:10.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:03:10.935+0000 7f384fb69640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61993, si_uid : 1000, si_addr0x3e80000f229, si_status0 2024-09-05T01:03:41.218 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (30289 ms) 2024-09-05T01:03:41.219 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW (30636 ms total) 2024-09-05T01:03:41.219 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:03:41.219 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:03:41.219 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 19 tests from 1 test suite ran. (30636 ms total) 2024-09-05T01:03:41.219 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 19 tests. 2024-09-05T01:03:41.232 INFO:tasks.workunit.client.0.smithi099.stdout:phase 5.2 2024-09-05T01:03:41.266 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-05T01:03:41.266 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:03:41.266 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW 2024-09-05T01:03:41.266 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:03:41.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:03:41.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:03:41.849 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (583 ms) 2024-09-05T01:03:41.849 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:03:41.851 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:03:41.851 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-05T01:03:41.851 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-05T01:03:41.851 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-05T01:03:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEV 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-05T01:03:41.861 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-05T01:03:41.867 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (8 ms) 2024-09-05T01:03:41.867 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (47 ms) 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:03:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:03:41.919+0000 7f8d6e2e3a80 -1 shutting down 2024-09-05T01:03:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:03:41.919+0000 7f8c48035640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62638, si_uid : 1000, si_addr0x3e80000f4ae, si_status0 2024-09-05T01:04:11.972 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (30057 ms) 2024-09-05T01:04:11.972 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW (30706 ms total) 2024-09-05T01:04:11.972 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:04:11.972 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:04:11.972 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 19 tests from 1 test suite ran. (30706 ms total) 2024-09-05T01:04:11.973 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 19 tests. 2024-09-05T01:04:11.984 INFO:tasks.workunit.client.0.smithi099.stdout:phase 6.1 2024-09-05T01:04:12.008 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-05T01:04:12.008 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-09-05T01:04:12.008 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from LibRGW 2024-09-05T01:04:12.009 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-09-05T01:04:12.016 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:04:12.016 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:04:12.606 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (598 ms) 2024-09-05T01:04:12.606 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-09-05T01:04:12.607 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-05T01:04:12.608 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-05T01:04:12.647 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKETS (40 ms) 2024-09-05T01:04:12.647 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-05T01:04:12.661 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (14 ms) 2024-09-05T01:04:12.661 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-05T01:04:12.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.TOPDIR_RENAME (36 ms) 2024-09-05T01:04:12.697 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-05T01:04:12.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SUBDIR_RENAME (50 ms) 2024-09-05T01:04:12.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-05T01:04:12.798 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (51 ms) 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-05T01:04:12.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:12.802+0000 7fcaff238a80 -1 shutting down 2024-09-05T01:04:12.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:12.802+0000 7fc9d8f8a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63284, si_uid : 1000, si_addr0x3e80000f734, si_status0 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (29814 ms) 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from LibRGW (30605 ms total) 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 10 tests from 1 test suite ran. (30605 ms total) 2024-09-05T01:04:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 10 tests. 2024-09-05T01:04:42.628 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T01:04:42.629 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T01:04:42.645 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-05T01:04:42.646 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-05T01:04:42.646 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-05T01:04:42.695 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z ] 2024-09-05T01:04:42.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-05T01:04:42.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-05T01:04:42.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-05T01:04:42.738 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:04:42.738 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:04:42.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.782+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:42.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:42.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 realm 2024-09-05T01:04:42.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:42.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:42.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:04:42.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:42.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:42.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:42.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:04:42.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.786+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:42.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.790+0000 7fded430e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:04:42.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.790+0000 7fded430e9c0 20 searching for the correct realm 2024-09-05T01:04:42.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:42.998+0000 7fded2615640 0 -- 172.21.15.99:0/2847474318 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fdebc132040 msgr2=0x7fdebc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:04:43.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.414+0000 7fded2615640 0 -- 172.21.15.99:0/2847474318 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fdebc132040 msgr2=0x7fdebc1136d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.422+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:04:43.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 zone default found 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 4 Realm: () 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 zonegroup default 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 started sync module instance, tier type = 2024-09-05T01:04:43.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.426+0000 7fded430e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=0 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=1 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=2 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=3 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=4 2024-09-05T01:04:43.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=5 2024-09-05T01:04:43.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.450+0000 7fded430e9c0 20 add_watcher() i=6 2024-09-05T01:04:43.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.454+0000 7fded430e9c0 20 add_watcher() i=7 2024-09-05T01:04:43.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.454+0000 7fded430e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:04:43.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fdd837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:04:43.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:04:43.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:04:43.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 5 note: GC not initialized 2024-09-05T01:04:43.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fdd827fc640 20 reqs_thread_entry: start 2024-09-05T01:04:43.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:04:43.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 20 Filter name: none 2024-09-05T01:04:43.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fdcf3fff640 20 reqs_thread_entry: start 2024-09-05T01:04:43.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-05T01:04:43.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.458+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-05T01:04:43.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:04:43.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:04:43.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-05T01:04:43.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-05T01:04:43.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-05T01:04:43.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-05T01:04:43.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-05T01:04:43.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-05T01:04:43.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.462+0000 7fded430e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-05T01:04:43.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.466+0000 7fddb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824052 cookie 94076428434704 notifier 5537 bl.length()=677 2024-09-05T01:04:43.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.466+0000 7fddb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-05T01:04:43.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.466+0000 7fddb57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-05T01:04:43.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-05T01:04:43.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fded430e9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-05T01:04:43.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fded430e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-05T01:04:43.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fddb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824007 cookie 94076428419648 notifier 5537 bl.length()=187 2024-09-05T01:04:43.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fddb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-05T01:04:43.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.470+0000 7fddb57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-05T01:04:43.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fded430e9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-05T01:04:43.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fded430e9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-05T01:04:43.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fded430e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-05T01:04:43.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fddb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824008 cookie 94076428419648 notifier 5537 bl.length()=197 2024-09-05T01:04:43.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fddb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-05T01:04:43.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.474+0000 7fddb57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-05T01:04:43.474 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T01:04:43.474 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "ceph-test-maven", 2024-09-05T01:04:43.474 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "maven test user", 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "sigv4@example.com", 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "ceph-test-maven", 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-09-05T01:04:43.475 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T01:04:43.466873Z" 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T01:04:43.476 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T01:04:43.477 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T01:04:43.466842Z", 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T01:04:43.478 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:04:43.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.478+0000 7fdd837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:04:43.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.482+0000 7fded430e9c0 20 remove_watcher() i=0 2024-09-05T01:04:43.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.482+0000 7fded430e9c0 2 removed watcher, disabling cache 2024-09-05T01:04:43.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.486+0000 7fded430e9c0 20 remove_watcher() i=1 2024-09-05T01:04:43.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.486+0000 7fded430e9c0 20 remove_watcher() i=2 2024-09-05T01:04:43.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.490+0000 7fded430e9c0 20 remove_watcher() i=3 2024-09-05T01:04:43.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.490+0000 7fded430e9c0 20 remove_watcher() i=4 2024-09-05T01:04:43.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.494+0000 7fded430e9c0 20 remove_watcher() i=5 2024-09-05T01:04:43.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.494+0000 7fded430e9c0 20 remove_watcher() i=6 2024-09-05T01:04:43.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:04:43.494+0000 7fded430e9c0 20 remove_watcher() i=7 2024-09-05T01:04:43.508 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z ] 2024-09-05T01:04:43.508 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-05T01:04:43.508 INFO:tasks.workunit.client.0.smithi099.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-05T01:04:43.509 INFO:tasks.workunit.client.0.smithi099.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi099.front.sepia.ceph.com:80 2024-09-05T01:04:43.509 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-05T01:04:43.509 INFO:tasks.workunit.client.0.smithi099.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-05T01:04:43.509 INFO:tasks.workunit.client.0.smithi099.stderr:+ ./mvnw clean package 2024-09-05T01:04:43.516 INFO:tasks.workunit.client.0.smithi099.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-05T01:04:47.810 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Scanning for projects... 2024-09-05T01:04:48.038 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-05T01:04:48.192 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 36 kB/s) 2024-09-05T01:04:48.228 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-05T01:04:48.271 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-09-05T01:04:48.286 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-05T01:04:48.308 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.5 MB/s) 2024-09-05T01:04:48.347 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:48.347 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-05T01:04:48.347 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jcksum 1.0 2024-09-05T01:04:48.347 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] from pom.xml 2024-09-05T01:04:48.347 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-05T01:04:48.352 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-05T01:04:48.374 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 231 kB/s) 2024-09-05T01:04:48.381 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-05T01:04:48.399 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 550 kB/s) 2024-09-05T01:04:48.403 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-05T01:04:48.419 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-05T01:04:48.426 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-05T01:04:48.449 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 893 kB/s) 2024-09-05T01:04:48.465 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-05T01:04:48.486 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.7 MB/s) 2024-09-05T01:04:48.495 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-05T01:04:48.518 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 355 kB/s) 2024-09-05T01:04:48.521 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-05T01:04:48.537 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-05T01:04:48.540 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-05T01:04:48.558 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.7 MB/s) 2024-09-05T01:04:48.562 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-05T01:04:48.582 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-09-05T01:04:48.589 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-05T01:04:48.609 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.5 MB/s) 2024-09-05T01:04:48.618 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-05T01:04:48.634 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-05T01:04:48.641 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-05T01:04:48.664 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.0 MB/s) 2024-09-05T01:04:48.676 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-05T01:04:48.694 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 280 kB/s) 2024-09-05T01:04:48.698 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-05T01:04:48.716 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-05T01:04:48.722 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-05T01:04:48.741 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.6 MB/s) 2024-09-05T01:04:48.747 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-05T01:04:48.770 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.1 MB/s) 2024-09-05T01:04:48.778 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-05T01:04:48.794 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-05T01:04:48.800 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-05T01:04:48.818 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.3 MB/s) 2024-09-05T01:04:48.829 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-05T01:04:48.847 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-09-05T01:04:48.851 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-05T01:04:48.871 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 495 kB/s) 2024-09-05T01:04:48.874 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-05T01:04:48.893 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15/46 kB Progress (1): 31/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-09-05T01:04:48.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-05T01:04:48.920 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 970 kB/s) 2024-09-05T01:04:48.934 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-05T01:04:48.956 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.2 MB/s) 2024-09-05T01:04:48.985 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-05T01:04:49.003 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-05T01:04:49.007 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-05T01:04:49.034 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.6/21 kB Progress (1): 19/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 762 kB/s) 2024-09-05T01:04:49.044 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-05T01:04:49.070 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 800 kB/s) 2024-09-05T01:04:49.089 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-05T01:04:49.109 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 200 kB/s) 2024-09-05T01:04:49.113 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-05T01:04:49.134 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 71 kB/s) 2024-09-05T01:04:49.138 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-05T01:04:49.169 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 70 kB/s) 2024-09-05T01:04:49.183 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-05T01:04:49.209 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 140 kB/s) 2024-09-05T01:04:49.218 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-05T01:04:49.238 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 153 kB/s) 2024-09-05T01:04:49.248 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-05T01:04:49.269 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 522 kB/s) 2024-09-05T01:04:49.278 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-05T01:04:49.300 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 77 kB/s) 2024-09-05T01:04:49.311 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-05T01:04:49.359 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 80 kB/s) 2024-09-05T01:04:49.366 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-05T01:04:49.383 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-05T01:04:49.389 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-05T01:04:49.449 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 20 kB/s) 2024-09-05T01:04:49.455 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-05T01:04:49.481 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 142 kB/s) 2024-09-05T01:04:49.486 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-05T01:04:49.517 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 445 kB/s) 2024-09-05T01:04:49.524 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-05T01:04:49.552 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 127 kB/s) 2024-09-05T01:04:49.562 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-05T01:04:49.595 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 72 kB/s) 2024-09-05T01:04:49.605 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-05T01:04:49.630 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 116 kB/s) 2024-09-05T01:04:49.639 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-05T01:04:49.670 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 239 kB/s) 2024-09-05T01:04:49.679 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-05T01:04:49.703 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 218 kB/s) 2024-09-05T01:04:49.713 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-05T01:04:49.732 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-05T01:04:49.742 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-05T01:04:49.766 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 183 kB/s) 2024-09-05T01:04:49.771 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-05T01:04:49.798 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 89 kB/s) 2024-09-05T01:04:49.807 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-05T01:04:49.830 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 280 kB/s) 2024-09-05T01:04:49.840 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-05T01:04:49.858 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 337 kB/s) 2024-09-05T01:04:49.868 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-05T01:04:49.894 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 110 kB/s) 2024-09-05T01:04:49.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-05T01:04:49.935 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 109 kB/s) 2024-09-05T01:04:49.946 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-05T01:04:50.051 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 39 kB/s) 2024-09-05T01:04:50.056 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-05T01:04:50.083 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 66 kB/s) 2024-09-05T01:04:50.094 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-05T01:04:50.143 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 135 kB/s) 2024-09-05T01:04:50.150 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-05T01:04:50.173 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 712 kB/s) 2024-09-05T01:04:50.178 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-05T01:04:50.196 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-05T01:04:50.202 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-05T01:04:50.225 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 744 kB/s) 2024-09-05T01:04:50.233 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-05T01:04:50.252 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 261 kB/s) 2024-09-05T01:04:50.256 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-05T01:04:50.275 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 658 kB/s) 2024-09-05T01:04:50.284 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-05T01:04:50.299 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-05T01:04:50.304 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-05T01:04:50.322 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 37/68 kB Progress (1): 53/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-05T01:04:50.350 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-05T01:04:50.369 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 825 kB/s) 2024-09-05T01:04:50.377 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-05T01:04:50.393 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 965 kB/s) 2024-09-05T01:04:50.397 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-05T01:04:50.421 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.3 MB/s) 2024-09-05T01:04:50.430 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-05T01:04:50.450 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 877 kB/s) 2024-09-05T01:04:50.457 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-05T01:04:50.486 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 689 kB/s) 2024-09-05T01:04:50.491 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-05T01:04:50.523 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 2.4 MB/s) 2024-09-05T01:04:50.535 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-05T01:04:50.557 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 174 kB/s) 2024-09-05T01:04:50.560 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-05T01:04:50.578 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-09-05T01:04:50.583 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-05T01:04:50.604 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 160 kB/s) 2024-09-05T01:04:50.609 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-05T01:04:50.626 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-05T01:04:50.631 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-05T01:04:50.652 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 97 kB/s) 2024-09-05T01:04:50.657 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-05T01:04:50.679 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 129 kB/s) 2024-09-05T01:04:50.684 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-05T01:04:50.704 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 76 kB/s) 2024-09-05T01:04:50.709 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-05T01:04:50.735 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 111 kB/s) 2024-09-05T01:04:50.741 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-05T01:04:50.760 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 169 kB/s) 2024-09-05T01:04:50.765 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-05T01:04:50.783 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 178 kB/s) 2024-09-05T01:04:50.790 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-05T01:04:50.809 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 54 kB/s) 2024-09-05T01:04:50.818 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-05T01:04:50.838 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 48 kB/s) 2024-09-05T01:04:50.844 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-05T01:04:50.862 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-09-05T01:04:50.867 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-05T01:04:50.887 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 152 kB/s) 2024-09-05T01:04:50.895 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-05T01:04:50.913 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 181 kB/s) 2024-09-05T01:04:50.919 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-05T01:04:50.938 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 181 kB/s) 2024-09-05T01:04:50.943 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-05T01:04:50.964 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 144 kB/s) 2024-09-05T01:04:51.010 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-05T01:04:51.123 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 29 MB/s) 2024-09-05T01:04:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-05T01:04:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-05T01:04:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-05T01:04:51.127 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-05T01:04:51.127 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-05T01:04:51.159 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/71 kB Progress (1): 32/71 kB Progress (1): 49/71 kB Progress (1): 65/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 2.0 MB/s) 2024-09-05T01:04:51.160 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-05T01:04:51.177 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 314 kB/s) 2024-09-05T01:04:51.177 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-05T01:04:51.184 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (2): 6.9/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 1.4/35 kB Progress (2): 8.3/16 kB | 2.8/35 kB Progress (2): 9.7/16 kB | 2.8/35 kB Progress (2): 9.7/16 kB | 2.9/35 kB Progress (2): 11/16 kB | 2.9/35 kB Progress (2): 11/16 kB | 4.3/35 kB Progress (2): 12/16 kB | 4.3/35 kB Progress (2): 12/16 kB | 5.7/35 kB Progress (2): 14/16 kB | 5.7/35 kB Progress (2): 14/16 kB | 7.1/35 kB Progress (2): 15/16 kB | 7.1/35 kB Progress (2): 15/16 kB | 8.4/35 kB Progress (2): 16 kB | 8.4/35 kB Progress (2): 16 kB | 9.8/35 kB Progress (2): 16 kB | 11/35 kB Progress (2): 16 kB | 13/35 kB Progress (2): 16 kB | 14/35 kB Progress (2): 16 kB | 15/35 kB Progress (2): 16 kB | 17/35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 272 kB/s) 2024-09-05T01:04:51.184 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 18/35 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-05T01:04:51.189 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 19/35 kB Progress (1): 21/35 kB Progress (1): 22/35 kB Progress (1): 24/35 kB Progress (1): 25/35 kB Progress (1): 26/35 kB Progress (1): 28/35 kB Progress (1): 29/35 kB Progress (1): 31/35 kB Progress (1): 32/35 kB Progress (1): 33/35 kB Progress (1): 35/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 558 kB/s) 2024-09-05T01:04:51.189 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-05T01:04:51.202 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/782 kB Progress (1): 33/782 kB Progress (1): 49/782 kB Progress (1): 65/782 kB Progress (1): 82/782 kB Progress (1): 98/782 kB Progress (1): 115/782 kB Progress (1): 131/782 kB Progress (1): 147/782 kB Progress (1): 164/782 kB Progress (1): 180/782 kB Progress (1): 197/782 kB Progress (1): 213/782 kB Progress (1): 229/782 kB Progress (1): 246/782 kB Progress (1): 262/782 kB Progress (1): 278/782 kB Progress (1): 295/782 kB Progress (1): 311/782 kB Progress (2): 311/782 kB | 1.4/11 kB Progress (2): 328/782 kB | 1.4/11 kB Progress (2): 328/782 kB | 2.8/11 kB Progress (2): 328/782 kB | 4.1/11 kB Progress (2): 344/782 kB | 4.1/11 kB Progress (2): 344/782 kB | 5.5/11 kB Progress (2): 344/782 kB | 6.9/11 kB Progress (2): 360/782 kB | 6.9/11 kB Progress (2): 377/782 kB | 6.9/11 kB Progress (2): 377/782 kB | 8.3/11 kB Progress (3): 377/782 kB | 8.3/11 kB | 1.4/98 kB Progress (3): 393/782 kB | 8.3/11 kB | 1.4/98 kB Progress (3): 393/782 kB | 9.7/11 kB | 1.4/98 kB Progress (3): 393/782 kB | 9.7/11 kB | 2.8/98 kB Progress (3): 393/782 kB | 11/11 kB | 2.8/98 kB Progress (4): 393/782 kB | 11/11 kB | 2.8/98 kB | 1.4/49 kB Progress (4): 393/782 kB | 11 kB | 2.8/98 kB | 1.4/49 kB Progress (4): 410/782 kB | 11 kB | 2.8/98 kB | 1.4/49 kB Progress (4): 410/782 kB | 11 kB | 4.1/98 kB | 1.4/49 kB Progress (4): 410/782 kB | 11 kB | 4.1/98 kB | 2.8/49 kB Progress (4): 410/782 kB | 11 kB | 5.5/98 kB | 2.8/49 kB Progress (4): 426/782 kB | 11 kB | 5.5/98 kB | 2.8/49 kB Progress (4): 426/782 kB | 11 kB | 6.9/98 kB | 2.8/49 kB Progress (4): 426/782 kB | 11 kB | 6.9/98 kB | 4.1/49 kB Progress (4): 426/782 kB | 11 kB | 8.3/98 kB | 4.1/49 kB Progress (4): 426/782 kB | 11 kB | 8.3/98 kB | 5.5/49 kB Progress (4): 442/782 kB | 11 kB | 8.3/98 kB | 5.5/49 kB Progress (4): 442/782 kB | 11 kB | 8.3/98 kB | 6.9/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 152 kB/s) 2024-09-05T01:04:51.202 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 442/782 kB | 9.7/98 kB | 6.9/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-05T01:04:51.214 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 442/782 kB | 9.7/98 kB | 8.3/49 kB Progress (3): 442/782 kB | 11/98 kB | 8.3/49 kB Progress (3): 442/782 kB | 11/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 12/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 14/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 15/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 16/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 18/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 19/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 21/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 22/98 kB | 9.7/49 kB Progress (3): 442/782 kB | 23/98 kB | 9.7/49 kB Progress (4): 442/782 kB | 23/98 kB | 9.7/49 kB | 1.4/205 kB Progress (4): 459/782 kB | 23/98 kB | 9.7/49 kB | 1.4/205 kB Progress (4): 459/782 kB | 23/98 kB | 9.7/49 kB | 2.5/205 kB Progress (4): 459/782 kB | 25/98 kB | 9.7/49 kB | 2.5/205 kB Progress (4): 459/782 kB | 25/98 kB | 11/49 kB | 2.5/205 kB Progress (4): 459/782 kB | 26/98 kB | 11/49 kB | 2.5/205 kB Progress (4): 459/782 kB | 26/98 kB | 11/49 kB | 3.9/205 kB Progress (4): 475/782 kB | 26/98 kB | 11/49 kB | 3.9/205 kB Progress (4): 475/782 kB | 26/98 kB | 11/49 kB | 5.2/205 kB Progress (4): 475/782 kB | 26/98 kB | 11/49 kB | 6.6/205 kB Progress (4): 475/782 kB | 26/98 kB | 11/49 kB | 8.0/205 kB Progress (4): 475/782 kB | 26/98 kB | 11/49 kB | 9.4/205 kB Progress (4): 491/782 kB | 26/98 kB | 11/49 kB | 9.4/205 kB Progress (4): 491/782 kB | 26/98 kB | 12/49 kB | 9.4/205 kB Progress (4): 491/782 kB | 26/98 kB | 12/49 kB | 11/205 kB Progress (4): 491/782 kB | 27/98 kB | 12/49 kB | 11/205 kB Progress (4): 491/782 kB | 27/98 kB | 12/49 kB | 12/205 kB Progress (4): 491/782 kB | 27/98 kB | 14/49 kB | 12/205 kB Progress (4): 508/782 kB | 27/98 kB | 14/49 kB | 12/205 kB Progress (4): 508/782 kB | 29/98 kB | 14/49 kB | 12/205 kB Progress (4): 508/782 kB | 29/98 kB | 15/49 kB | 12/205 kB Progress (4): 508/782 kB | 29/98 kB | 15/49 kB | 14/205 kB Progress (4): 508/782 kB | 30/98 kB | 15/49 kB | 14/205 kB Progress (4): 508/782 kB | 30/98 kB | 16/49 kB | 14/205 kB Progress (4): 508/782 kB | 30/98 kB | 16/49 kB | 15/205 kB Progress (4): 524/782 kB | 30/98 kB | 16/49 kB | 15/205 kB Progress (4): 524/782 kB | 32/98 kB | 16/49 kB | 15/205 kB Progress (4): 524/782 kB | 32/98 kB | 16/49 kB | 16/205 kB Progress (4): 524/782 kB | 32/98 kB | 18/49 kB | 16/205 kB Progress (4): 524/782 kB | 33/98 kB | 18/49 kB | 16/205 kB Progress (4): 524/782 kB | 33/98 kB | 19/49 kB | 16/205 kB Progress (4): 524/782 kB | 33/98 kB | 19/49 kB | 18/205 kB Progress (4): 524/782 kB | 33/98 kB | 21/49 kB | 18/205 kB Progress (4): 541/782 kB | 33/98 kB | 21/49 kB | 18/205 kB Progress (4): 541/782 kB | 34/98 kB | 21/49 kB | 18/205 kB Progress (4): 541/782 kB | 34/98 kB | 21/49 kB | 19/205 kB Progress (4): 541/782 kB | 34/98 kB | 22/49 kB | 19/205 kB Progress (4): 541/782 kB | 36/98 kB | 22/49 kB | 19/205 kB Progress (4): 541/782 kB | 36/98 kB | 23/49 kB | 19/205 kB Progress (4): 541/782 kB | 37/98 kB | 23/49 kB | 19/205 kB Progress (4): 557/782 kB | 37/98 kB | 23/49 kB | 19/205 kB Progress (4): 557/782 kB | 37/98 kB | 25/49 kB | 19/205 kB Progress (4): 557/782 kB | 37/98 kB | 25/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 25/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 26/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 27/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 29/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 30/49 kB | 35/205 kB Progress (4): 557/782 kB | 38/98 kB | 30/49 kB | 52/205 kB Progress (4): 573/782 kB | 38/98 kB | 30/49 kB | 52/205 kB Progress (4): 573/782 kB | 38/98 kB | 32/49 kB | 52/205 kB Progress (4): 573/782 kB | 38/98 kB | 33/49 kB | 52/205 kB Progress (4): 573/782 kB | 38/98 kB | 34/49 kB | 52/205 kB Progress (4): 573/782 kB | 38/98 kB | 36/49 kB | 52/205 kB Progress (4): 590/782 kB | 38/98 kB | 36/49 kB | 52/205 kB Progress (4): 606/782 kB | 38/98 kB | 36/49 kB | 52/205 kB Progress (4): 623/782 kB | 38/98 kB | 36/49 kB | 52/205 kB Progress (4): 639/782 kB | 38/98 kB | 36/49 kB | 52/205 kB Progress (4): 639/782 kB | 40/98 kB | 36/49 kB | 52/205 kB Progress (4): 639/782 kB | 41/98 kB | 36/49 kB | 52/205 kB Progress (4): 639/782 kB | 43/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 43/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 44/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 45/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 47/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 48/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 49/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 51/98 kB | 36/49 kB | 52/205 kB Progress (4): 655/782 kB | 51/98 kB | 37/49 kB | 52/205 kB Progress (4): 672/782 kB | 51/98 kB | 37/49 kB | 52/205 kB Progress (4): 672/782 kB | 51/98 kB | 38/49 kB | 52/205 kB Progress (4): 672/782 kB | 51/98 kB | 40/49 kB | 52/205 kB Progress (4): 672/782 kB | 51/98 kB | 41/49 kB | 52/205 kB Progress (4): 672/782 kB | 52/98 kB | 41/49 kB | 52/205 kB Progress (4): 688/782 kB | 52/98 kB | 41/49 kB | 52/205 kB Progress (4): 688/782 kB | 52/98 kB | 43/49 kB | 52/205 kB Progress (4): 688/782 kB | 54/98 kB | 43/49 kB | 52/205 kB Progress (4): 688/782 kB | 54/98 kB | 44/49 kB | 52/205 kB Progress (4): 688/782 kB | 55/98 kB | 44/49 kB | 52/205 kB Progress (4): 688/782 kB | 55/98 kB | 45/49 kB | 52/205 kB Progress (4): 688/782 kB | 56/98 kB | 45/49 kB | 52/205 kB Progress (4): 688/782 kB | 56/98 kB | 47/49 kB | 52/205 kB Progress (4): 704/782 kB | 56/98 kB | 47/49 kB | 52/205 kB Progress (4): 704/782 kB | 56/98 kB | 48/49 kB | 52/205 kB Progress (4): 704/782 kB | 58/98 kB | 48/49 kB | 52/205 kB Progress (4): 704/782 kB | 58/98 kB | 49 kB | 52/205 kB Progress (4): 704/782 kB | 59/98 kB | 49 kB | 52/205 kB Progress (4): 704/782 kB | 61/98 kB | 49 kB | 52/205 kB Progress (4): 704/782 kB | 62/98 kB | 49 kB | 52/205 kB Progress (4): 721/782 kB | 62/98 kB | 49 kB | 52/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 566 kB/s) 2024-09-05T01:04:51.214 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-05T01:04:51.216 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 737/782 kB | 62/98 kB | 52/205 kB Progress (3): 754/782 kB | 62/98 kB | 52/205 kB Progress (3): 770/782 kB | 62/98 kB | 52/205 kB Progress (3): 782 kB | 62/98 kB | 52/205 kB Progress (4): 782 kB | 62/98 kB | 52/205 kB | 1.4/30 kB Progress (4): 782 kB | 62/98 kB | 52/205 kB | 2.8/30 kB Progress (4): 782 kB | 62/98 kB | 52/205 kB | 4.1/30 kB Progress (4): 782 kB | 62/98 kB | 52/205 kB | 5.5/30 kB Progress (4): 782 kB | 62/98 kB | 52/205 kB | 6.9/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 8.7 MB/s) 2024-09-05T01:04:51.217 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 78/98 kB | 52/205 kB | 6.9/30 kB Progress (3): 78/98 kB | 52/205 kB | 8.3/30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-05T01:04:51.221 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 78/98 kB | 52/205 kB | 9.7/30 kB Progress (3): 78/98 kB | 52/205 kB | 11/30 kB Progress (3): 78/98 kB | 52/205 kB | 12/30 kB Progress (3): 78/98 kB | 68/205 kB | 12/30 kB Progress (3): 78/98 kB | 68/205 kB | 14/30 kB Progress (3): 78/98 kB | 68/205 kB | 15/30 kB Progress (3): 78/98 kB | 68/205 kB | 16/30 kB Progress (3): 78/98 kB | 84/205 kB | 16/30 kB Progress (3): 78/98 kB | 84/205 kB | 17/30 kB Progress (3): 78/98 kB | 84/205 kB | 19/30 kB Progress (3): 78/98 kB | 97/205 kB | 19/30 kB Progress (3): 78/98 kB | 97/205 kB | 20/30 kB Progress (3): 78/98 kB | 113/205 kB | 20/30 kB Progress (3): 78/98 kB | 113/205 kB | 21/30 kB Progress (3): 78/98 kB | 113/205 kB | 23/30 kB Progress (3): 78/98 kB | 129/205 kB | 23/30 kB Progress (3): 78/98 kB | 129/205 kB | 24/30 kB Progress (3): 78/98 kB | 129/205 kB | 25/30 kB Progress (3): 78/98 kB | 129/205 kB | 27/30 kB Progress (3): 78/98 kB | 129/205 kB | 28/30 kB Progress (3): 78/98 kB | 146/205 kB | 28/30 kB Progress (3): 78/98 kB | 146/205 kB | 30/30 kB Progress (3): 78/98 kB | 146/205 kB | 30 kB Progress (3): 78/98 kB | 162/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 321 kB/s) 2024-09-05T01:04:51.221 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-05T01:04:51.223 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 78/98 kB | 179/205 kB Progress (2): 95/98 kB | 179/205 kB Progress (2): 98 kB | 179/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 981 kB/s) 2024-09-05T01:04:51.223 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-05T01:04:51.229 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 195/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-05T01:04:51.229 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-05T01:04:51.238 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/798 kB Progress (2): 16/798 kB | 16/81 kB Progress (2): 33/798 kB | 16/81 kB Progress (2): 49/798 kB | 16/81 kB Progress (2): 49/798 kB | 33/81 kB Progress (2): 63/798 kB | 33/81 kB Progress (2): 79/798 kB | 33/81 kB Progress (2): 96/798 kB | 33/81 kB Progress (2): 112/798 kB | 33/81 kB Progress (2): 112/798 kB | 49/81 kB Progress (2): 128/798 kB | 49/81 kB Progress (2): 145/798 kB | 49/81 kB Progress (3): 145/798 kB | 49/81 kB | 13 kB Progress (3): 161/798 kB | 49/81 kB | 13 kB Progress (3): 177/798 kB | 49/81 kB | 13 kB Progress (3): 177/798 kB | 66/81 kB | 13 kB Progress (3): 194/798 kB | 66/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 120 kB/s) 2024-09-05T01:04:51.238 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-05T01:04:51.247 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 210/798 kB | 66/81 kB Progress (2): 227/798 kB | 66/81 kB Progress (2): 243/798 kB | 66/81 kB Progress (2): 259/798 kB | 66/81 kB Progress (2): 276/798 kB | 66/81 kB Progress (3): 276/798 kB | 66/81 kB | 16/182 kB Progress (3): 292/798 kB | 66/81 kB | 16/182 kB Progress (3): 309/798 kB | 66/81 kB | 16/182 kB Progress (3): 309/798 kB | 66/81 kB | 32/182 kB Progress (3): 325/798 kB | 66/81 kB | 32/182 kB Progress (3): 341/798 kB | 66/81 kB | 32/182 kB Progress (3): 341/798 kB | 66/81 kB | 49/182 kB Progress (3): 341/798 kB | 66/81 kB | 49/182 kB Progress (3): 358/798 kB | 66/81 kB | 49/182 kB Progress (3): 374/798 kB | 66/81 kB | 49/182 kB Progress (3): 374/798 kB | 66/81 kB | 65/182 kB Progress (3): 390/798 kB | 66/81 kB | 65/182 kB Progress (3): 407/798 kB | 66/81 kB | 65/182 kB Progress (3): 423/798 kB | 66/81 kB | 65/182 kB Progress (3): 440/798 kB | 66/81 kB | 65/182 kB Progress (3): 440/798 kB | 66/81 kB | 81/182 kB Progress (3): 456/798 kB | 66/81 kB | 81/182 kB Progress (3): 472/798 kB | 66/81 kB | 81/182 kB Progress (3): 489/798 kB | 66/81 kB | 81/182 kB Progress (3): 489/798 kB | 66/81 kB | 98/182 kB Progress (3): 505/798 kB | 66/81 kB | 98/182 kB Progress (3): 522/798 kB | 66/81 kB | 98/182 kB Progress (4): 522/798 kB | 66/81 kB | 98/182 kB | 16/151 kB Progress (4): 522/798 kB | 66/81 kB | 114/182 kB | 16/151 kB Progress (4): 538/798 kB | 66/81 kB | 114/182 kB | 16/151 kB Progress (4): 538/798 kB | 66/81 kB | 114/182 kB | 33/151 kB Progress (4): 554/798 kB | 66/81 kB | 114/182 kB | 33/151 kB Progress (4): 554/798 kB | 66/81 kB | 114/182 kB | 49/151 kB Progress (4): 571/798 kB | 66/81 kB | 114/182 kB | 49/151 kB Progress (4): 571/798 kB | 66/81 kB | 114/182 kB | 62/151 kB Progress (4): 587/798 kB | 66/81 kB | 114/182 kB | 62/151 kB Progress (4): 587/798 kB | 66/81 kB | 114/182 kB | 79/151 kB Progress (4): 587/798 kB | 81 kB | 114/182 kB | 79/151 kB Progress (4): 587/798 kB | 81 kB | 114/182 kB | 95/151 kB Progress (4): 603/798 kB | 81 kB | 114/182 kB | 95/151 kB Progress (4): 603/798 kB | 81 kB | 114/182 kB | 111/151 kB Progress (4): 620/798 kB | 81 kB | 114/182 kB | 111/151 kB Progress (4): 620/798 kB | 81 kB | 114/182 kB | 128/151 kB Progress (4): 636/798 kB | 81 kB | 114/182 kB | 128/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 677 kB/s) 2024-09-05T01:04:51.247 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-05T01:04:51.249 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 636/798 kB | 114/182 kB | 144/151 kB Progress (3): 653/798 kB | 114/182 kB | 144/151 kB Progress (3): 653/798 kB | 114/182 kB | 151 kB Progress (3): 669/798 kB | 114/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-05T01:04:51.249 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 685/798 kB | 114/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-05T01:04:51.251 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 702/798 kB | 114/182 kB Progress (2): 718/798 kB | 114/182 kB Progress (2): 735/798 kB | 114/182 kB Progress (2): 751/798 kB | 114/182 kB Progress (2): 767/798 kB | 114/182 kB Progress (2): 784/798 kB | 114/182 kB Progress (2): 784/798 kB | 130/182 kB Progress (2): 798 kB | 130/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.4 MB/s) 2024-09-05T01:04:51.251 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-05T01:04:51.253 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 147/182 kB Progress (1): 163/182 kB Progress (1): 180/182 kB Progress (1): 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-09-05T01:04:51.253 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-05T01:04:51.257 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 212 kB/s) 2024-09-05T01:04:51.257 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-05T01:04:51.276 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Progress (2): 13 kB | 15/30 kB Progress (3): 13 kB | 15/30 kB | 16/385 kB Progress (4): 13 kB | 15/30 kB | 16/385 kB | 16/75 kB Progress (4): 13 kB | 30 kB | 16/385 kB | 16/75 kB Progress (4): 13 kB | 30 kB | 33/385 kB | 16/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 89 kB/s) 2024-09-05T01:04:51.277 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (4): 30 kB | 33/385 kB | 16/75 kB | 16/780 kB Progress (4): 30 kB | 33/385 kB | 33/75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 203 kB/s) 2024-09-05T01:04:51.277 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-05T01:04:51.277 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 49/385 kB | 33/75 kB | 16/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-05T01:04:51.278 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 49/385 kB | 49/75 kB | 16/780 kB Progress (3): 65/385 kB | 49/75 kB | 16/780 kB Progress (3): 65/385 kB | 66/75 kB | 16/780 kB Progress (3): 65/385 kB | 75 kB | 16/780 kB Progress (3): 82/385 kB | 75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 500 kB/s) 2024-09-05T01:04:51.278 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-05T01:04:51.285 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 98/385 kB | 16/780 kB Progress (2): 98/385 kB | 33/780 kB Progress (2): 114/385 kB | 33/780 kB Progress (2): 131/385 kB | 33/780 kB Progress (2): 147/385 kB | 33/780 kB Progress (2): 164/385 kB | 33/780 kB Progress (2): 164/385 kB | 49/780 kB Progress (2): 180/385 kB | 49/780 kB Progress (2): 196/385 kB | 49/780 kB Progress (2): 213/385 kB | 49/780 kB Progress (2): 229/385 kB | 49/780 kB Progress (2): 245/385 kB | 49/780 kB Progress (2): 262/385 kB | 49/780 kB Progress (2): 278/385 kB | 49/780 kB Progress (2): 295/385 kB | 49/780 kB Progress (2): 311/385 kB | 49/780 kB Progress (2): 327/385 kB | 49/780 kB Progress (2): 344/385 kB | 49/780 kB Progress (2): 360/385 kB | 49/780 kB Progress (2): 376/385 kB | 49/780 kB Progress (2): 385 kB | 49/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-05T01:04:51.285 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-05T01:04:51.302 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 64/780 kB Progress (1): 80/780 kB Progress (1): 97/780 kB Progress (1): 113/780 kB Progress (1): 129/780 kB Progress (2): 129/780 kB | 15/501 kB Progress (2): 146/780 kB | 15/501 kB Progress (2): 146/780 kB | 31/501 kB Progress (2): 146/780 kB | 48/501 kB Progress (2): 146/780 kB | 64/501 kB Progress (2): 162/780 kB | 64/501 kB Progress (2): 162/780 kB | 81/501 kB Progress (2): 162/780 kB | 95/501 kB Progress (2): 162/780 kB | 111/501 kB Progress (2): 179/780 kB | 111/501 kB Progress (2): 179/780 kB | 128/501 kB Progress (2): 179/780 kB | 144/501 kB Progress (2): 179/780 kB | 161/501 kB Progress (2): 179/780 kB | 177/501 kB Progress (2): 179/780 kB | 193/501 kB Progress (3): 179/780 kB | 193/501 kB | 16/354 kB Progress (3): 179/780 kB | 210/501 kB | 16/354 kB Progress (3): 179/780 kB | 210/501 kB | 33/354 kB Progress (3): 179/780 kB | 226/501 kB | 33/354 kB Progress (3): 179/780 kB | 226/501 kB | 49/354 kB Progress (3): 179/780 kB | 243/501 kB | 49/354 kB Progress (3): 179/780 kB | 243/501 kB | 66/354 kB Progress (3): 179/780 kB | 259/501 kB | 66/354 kB Progress (3): 179/780 kB | 259/501 kB | 82/354 kB Progress (3): 179/780 kB | 275/501 kB | 82/354 kB Progress (3): 179/780 kB | 275/501 kB | 98/354 kB Progress (3): 179/780 kB | 292/501 kB | 98/354 kB Progress (3): 179/780 kB | 292/501 kB | 115/354 kB Progress (3): 179/780 kB | 308/501 kB | 115/354 kB Progress (3): 179/780 kB | 308/501 kB | 131/354 kB Progress (3): 179/780 kB | 324/501 kB | 131/354 kB Progress (3): 179/780 kB | 324/501 kB | 147/354 kB Progress (3): 179/780 kB | 341/501 kB | 147/354 kB Progress (4): 179/780 kB | 341/501 kB | 147/354 kB | 16/329 kB Progress (4): 179/780 kB | 341/501 kB | 164/354 kB | 16/329 kB Progress (4): 179/780 kB | 357/501 kB | 164/354 kB | 16/329 kB Progress (4): 179/780 kB | 357/501 kB | 164/354 kB | 32/329 kB Progress (4): 179/780 kB | 357/501 kB | 164/354 kB | 49/329 kB Progress (4): 179/780 kB | 357/501 kB | 180/354 kB | 49/329 kB Progress (4): 195/780 kB | 357/501 kB | 180/354 kB | 49/329 kB Progress (4): 195/780 kB | 374/501 kB | 180/354 kB | 49/329 kB Progress (4): 195/780 kB | 374/501 kB | 180/354 kB | 65/329 kB Progress (4): 195/780 kB | 374/501 kB | 197/354 kB | 65/329 kB Progress (4): 211/780 kB | 374/501 kB | 197/354 kB | 65/329 kB Progress (4): 211/780 kB | 390/501 kB | 197/354 kB | 65/329 kB Progress (4): 211/780 kB | 390/501 kB | 197/354 kB | 81/329 kB Progress (4): 211/780 kB | 390/501 kB | 213/354 kB | 81/329 kB Progress (4): 211/780 kB | 390/501 kB | 213/354 kB | 98/329 kB Progress (4): 211/780 kB | 406/501 kB | 213/354 kB | 98/329 kB Progress (4): 228/780 kB | 406/501 kB | 213/354 kB | 98/329 kB Progress (4): 228/780 kB | 406/501 kB | 229/354 kB | 98/329 kB Progress (4): 228/780 kB | 406/501 kB | 229/354 kB | 114/329 kB Progress (4): 228/780 kB | 423/501 kB | 229/354 kB | 114/329 kB Progress (4): 228/780 kB | 423/501 kB | 229/354 kB | 130/329 kB Progress (4): 228/780 kB | 423/501 kB | 246/354 kB | 130/329 kB Progress (4): 244/780 kB | 423/501 kB | 246/354 kB | 130/329 kB Progress (4): 244/780 kB | 439/501 kB | 246/354 kB | 130/329 kB Progress (4): 244/780 kB | 439/501 kB | 246/354 kB | 147/329 kB Progress (4): 261/780 kB | 439/501 kB | 246/354 kB | 147/329 kB Progress (4): 261/780 kB | 439/501 kB | 262/354 kB | 147/329 kB Progress (4): 261/780 kB | 439/501 kB | 262/354 kB | 163/329 kB Progress (4): 261/780 kB | 456/501 kB | 262/354 kB | 163/329 kB Progress (4): 261/780 kB | 456/501 kB | 274/354 kB | 163/329 kB Progress (4): 261/780 kB | 456/501 kB | 274/354 kB | 180/329 kB Progress (4): 261/780 kB | 472/501 kB | 274/354 kB | 180/329 kB Progress (4): 277/780 kB | 472/501 kB | 274/354 kB | 180/329 kB Progress (4): 277/780 kB | 472/501 kB | 291/354 kB | 180/329 kB Progress (4): 277/780 kB | 472/501 kB | 291/354 kB | 196/329 kB Progress (4): 277/780 kB | 488/501 kB | 291/354 kB | 196/329 kB Progress (4): 277/780 kB | 488/501 kB | 291/354 kB | 212/329 kB Progress (4): 277/780 kB | 501 kB | 291/354 kB | 212/329 kB Progress (4): 293/780 kB | 501 kB | 291/354 kB | 212/329 kB Progress (4): 293/780 kB | 501 kB | 291/354 kB | 229/329 kB Progress (4): 310/780 kB | 501 kB | 291/354 kB | 229/329 kB Progress (4): 310/780 kB | 501 kB | 291/354 kB | 245/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.9 MB/s) 2024-09-05T01:04:51.302 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-05T01:04:51.307 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 326/780 kB | 291/354 kB | 245/329 kB Progress (3): 326/780 kB | 291/354 kB | 262/329 kB Progress (3): 326/780 kB | 291/354 kB | 278/329 kB Progress (3): 342/780 kB | 291/354 kB | 278/329 kB Progress (3): 342/780 kB | 291/354 kB | 294/329 kB Progress (3): 359/780 kB | 291/354 kB | 294/329 kB Progress (3): 375/780 kB | 291/354 kB | 294/329 kB Progress (3): 392/780 kB | 291/354 kB | 294/329 kB Progress (3): 408/780 kB | 291/354 kB | 294/329 kB Progress (3): 424/780 kB | 291/354 kB | 294/329 kB Progress (3): 424/780 kB | 307/354 kB | 294/329 kB Progress (3): 424/780 kB | 324/354 kB | 294/329 kB Progress (3): 424/780 kB | 340/354 kB | 294/329 kB Progress (3): 424/780 kB | 354 kB | 294/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-05T01:04:51.307 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-05T01:04:51.313 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 424/780 kB | 311/329 kB Progress (3): 424/780 kB | 311/329 kB | 16/41 kB Progress (3): 424/780 kB | 327/329 kB | 16/41 kB Progress (3): 424/780 kB | 327/329 kB | 33/41 kB Progress (3): 424/780 kB | 329 kB | 33/41 kB Progress (3): 424/780 kB | 329 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 226 kB/s) 2024-09-05T01:04:51.313 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-09-05T01:04:51.313 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-05T01:04:51.313 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-05T01:04:51.317 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 441/780 kB Progress (1): 457/780 kB Progress (1): 473/780 kB Progress (1): 490/780 kB Progress (1): 506/780 kB Progress (1): 523/780 kB Progress (1): 539/780 kB Progress (1): 555/780 kB Progress (1): 572/780 kB Progress (1): 588/780 kB Progress (1): 605/780 kB Progress (1): 621/780 kB Progress (1): 637/780 kB Progress (1): 654/780 kB Progress (1): 670/780 kB Progress (1): 686/780 kB Progress (1): 703/780 kB Progress (1): 719/780 kB Progress (1): 736/780 kB Progress (1): 752/780 kB Progress (1): 768/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-09-05T01:04:51.317 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-05T01:04:51.317 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 34 kB/s) 2024-09-05T01:04:51.317 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-05T01:04:51.325 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 66/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (2): 111/586 kB | 14 kB Progress (2): 127/586 kB | 14 kB Progress (2): 144/586 kB | 14 kB Progress (2): 160/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 73 kB/s) 2024-09-05T01:04:51.325 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-05T01:04:51.332 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (2): 340/586 kB | 16/211 kB Progress (2): 357/586 kB | 16/211 kB Progress (2): 357/586 kB | 31/211 kB Progress (2): 373/586 kB | 31/211 kB Progress (2): 373/586 kB | 48/211 kB Progress (2): 389/586 kB | 48/211 kB Progress (2): 389/586 kB | 64/211 kB Progress (2): 406/586 kB | 64/211 kB Progress (2): 406/586 kB | 81/211 kB Progress (2): 422/586 kB | 81/211 kB Progress (2): 422/586 kB | 97/211 kB Progress (2): 439/586 kB | 97/211 kB Progress (2): 439/586 kB | 113/211 kB Progress (2): 455/586 kB | 113/211 kB Progress (3): 455/586 kB | 113/211 kB | 16/106 kB Progress (3): 455/586 kB | 130/211 kB | 16/106 kB Progress (3): 471/586 kB | 130/211 kB | 16/106 kB Progress (3): 471/586 kB | 130/211 kB | 33/106 kB Progress (3): 471/586 kB | 143/211 kB | 33/106 kB Progress (3): 488/586 kB | 143/211 kB | 33/106 kB Progress (4): 488/586 kB | 143/211 kB | 33/106 kB | 6.8 kB Progress (4): 488/586 kB | 143/211 kB | 49/106 kB | 6.8 kB Progress (4): 504/586 kB | 143/211 kB | 49/106 kB | 6.8 kB Progress (4): 504/586 kB | 143/211 kB | 66/106 kB | 6.8 kB Progress (4): 521/586 kB | 143/211 kB | 66/106 kB | 6.8 kB Progress (4): 521/586 kB | 143/211 kB | 82/106 kB | 6.8 kB Progress (4): 537/586 kB | 143/211 kB | 82/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 33 kB/s) 2024-09-05T01:04:51.332 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-05T01:04:51.333 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 553/586 kB | 143/211 kB | 82/106 kB Progress (3): 553/586 kB | 143/211 kB | 98/106 kB Progress (3): 553/586 kB | 143/211 kB | 106 kB Progress (3): 570/586 kB | 143/211 kB | 106 kB Progress (3): 586 kB | 143/211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 518 kB/s) 2024-09-05T01:04:51.333 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-05T01:04:51.333 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.9 MB/s) 2024-09-05T01:04:51.333 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-05T01:04:51.337 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 159/211 kB Progress (1): 176/211 kB Progress (1): 192/211 kB Progress (1): 208/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-09-05T01:04:51.337 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-05T01:04:51.348 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (2): 177/245 kB | 16/16 kB Progress (3): 177/245 kB | 16/16 kB | 16/205 kB Progress (3): 194/245 kB | 16/16 kB | 16/205 kB Progress (3): 194/245 kB | 16 kB | 16/205 kB Progress (3): 210/245 kB | 16 kB | 16/205 kB Progress (3): 210/245 kB | 16 kB | 33/205 kB Progress (3): 226/245 kB | 16 kB | 33/205 kB Progress (3): 226/245 kB | 16 kB | 49/205 kB Progress (4): 226/245 kB | 16 kB | 49/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 75 kB/s) 2024-09-05T01:04:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 243/245 kB | 49/205 kB | 15 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-05T01:04:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 245 kB | 49/205 kB | 15 kB Progress (3): 245 kB | 66/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 69 kB/s) 2024-09-05T01:04:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-05T01:04:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 245 kB | 82/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-05T01:04:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-05T01:04:51.352 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 98/205 kB Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (2): 180/205 kB | 6.4 kB Progress (2): 197/205 kB | 6.4 kB Progress (2): 205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-05T01:04:51.352 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-05T01:04:51.352 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 914 kB/s) 2024-09-05T01:04:51.364 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 103 kB/s) 2024-09-05T01:04:51.365 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 17 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 73 kB/s) 2024-09-05T01:04:51.365 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 96 kB/s) 2024-09-05T01:04:51.371 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 115/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 760 kB/s) 2024-09-05T01:04:51.395 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:51.395 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-05T01:04:51.401 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-05T01:04:51.418 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-09-05T01:04:51.420 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-05T01:04:51.435 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-05T01:04:51.437 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-05T01:04:51.453 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-05T01:04:51.457 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-05T01:04:51.471 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-05T01:04:51.476 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-05T01:04:51.498 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 79/153 kB Progress (1): 95/153 kB Progress (1): 111/153 kB Progress (1): 128/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.0 MB/s) 2024-09-05T01:04:51.498 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-05T01:04:51.519 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-05T01:04:51.595 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:51.595 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-05T01:04:51.600 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-05T01:04:51.619 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 133 kB/s) 2024-09-05T01:04:51.622 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-05T01:04:51.659 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 608 kB/s) 2024-09-05T01:04:51.664 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-05T01:04:51.696 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 266 kB/s) 2024-09-05T01:04:51.700 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-05T01:04:51.725 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.0 MB/s) 2024-09-05T01:04:51.730 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-05T01:04:51.781 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 116 kB/s) 2024-09-05T01:04:51.786 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-05T01:04:51.807 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 146 kB/s) 2024-09-05T01:04:51.814 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-05T01:04:51.833 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 34 kB/s) 2024-09-05T01:04:51.837 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-05T01:04:51.858 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 125 kB/s) 2024-09-05T01:04:51.862 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-05T01:04:51.879 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 829 kB/s) 2024-09-05T01:04:51.884 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-05T01:04:51.902 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-09-05T01:04:51.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-05T01:04:51.925 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 522 kB/s) 2024-09-05T01:04:51.926 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-05T01:04:51.943 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 465 kB/s) 2024-09-05T01:04:51.949 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-05T01:04:51.966 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 471 kB/s) 2024-09-05T01:04:51.972 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-05T01:04:51.988 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-05T01:04:52.004 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-05T01:04:52.022 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 268 kB/s) 2024-09-05T01:04:52.030 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-05T01:04:52.047 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-09-05T01:04:52.059 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-05T01:04:52.075 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-05T01:04:52.083 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-05T01:04:52.100 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.0 MB/s) 2024-09-05T01:04:52.101 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-05T01:04:52.101 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-05T01:04:52.101 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-05T01:04:52.102 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-05T01:04:52.102 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-05T01:04:52.116 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-05T01:04:52.116 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-05T01:04:52.117 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/41 kB Progress (1): 32/41 kB Progress (2): 32/41 kB | 8.5 kB Progress (2): 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-05T01:04:52.117 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-05T01:04:52.117 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-05T01:04:52.120 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/55 kB Progress (1): 32/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-05T01:04:52.134 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (2): 164/269 kB | 16/327 kB Progress (2): 180/269 kB | 16/327 kB Progress (2): 180/269 kB | 33/327 kB Progress (2): 197/269 kB | 33/327 kB Progress (2): 197/269 kB | 49/327 kB Progress (2): 213/269 kB | 49/327 kB Progress (2): 213/269 kB | 63/327 kB Progress (2): 229/269 kB | 63/327 kB Progress (2): 229/269 kB | 79/327 kB Progress (2): 246/269 kB | 79/327 kB Progress (2): 246/269 kB | 95/327 kB Progress (3): 246/269 kB | 95/327 kB | 16/587 kB Progress (3): 262/269 kB | 95/327 kB | 16/587 kB Progress (3): 262/269 kB | 112/327 kB | 16/587 kB Progress (3): 262/269 kB | 112/327 kB | 33/587 kB Progress (3): 269 kB | 112/327 kB | 33/587 kB Progress (3): 269 kB | 112/327 kB | 49/587 kB Progress (3): 269 kB | 128/327 kB | 49/587 kB Progress (3): 269 kB | 128/327 kB | 64/587 kB Progress (3): 269 kB | 144/327 kB | 64/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 7.9 MB/s) 2024-09-05T01:04:52.139 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 144/327 kB | 81/587 kB Progress (2): 161/327 kB | 81/587 kB Progress (2): 161/327 kB | 97/587 kB Progress (2): 177/327 kB | 97/587 kB Progress (2): 177/327 kB | 113/587 kB Progress (2): 194/327 kB | 113/587 kB Progress (2): 194/327 kB | 130/587 kB Progress (2): 210/327 kB | 130/587 kB Progress (2): 210/327 kB | 146/587 kB Progress (2): 226/327 kB | 146/587 kB Progress (2): 226/327 kB | 163/587 kB Progress (2): 243/327 kB | 163/587 kB Progress (2): 243/327 kB | 179/587 kB Progress (2): 259/327 kB | 179/587 kB Progress (2): 259/327 kB | 195/587 kB Progress (2): 276/327 kB | 195/587 kB Progress (2): 276/327 kB | 212/587 kB Progress (2): 292/327 kB | 212/587 kB Progress (2): 292/327 kB | 228/587 kB Progress (2): 308/327 kB | 228/587 kB Progress (2): 308/327 kB | 245/587 kB Progress (2): 325/327 kB | 245/587 kB Progress (2): 325/327 kB | 261/587 kB Progress (2): 327 kB | 261/587 kB Progress (2): 327 kB | 277/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.8 MB/s) 2024-09-05T01:04:52.143 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 294/587 kB Progress (1): 310/587 kB Progress (1): 326/587 kB Progress (1): 343/587 kB Progress (1): 359/587 kB Progress (1): 376/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 425/587 kB Progress (1): 441/587 kB Progress (1): 458/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 507/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 556/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-05T01:04:52.187 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-05T01:04:52.187 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:52.187 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-05T01:04:52.192 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-05T01:04:52.207 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-05T01:04:52.209 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-05T01:04:52.225 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-09-05T01:04:52.227 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-05T01:04:52.242 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-05T01:04:52.244 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-05T01:04:52.259 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-05T01:04:52.263 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-05T01:04:52.277 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-05T01:04:52.280 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-05T01:04:52.296 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-05T01:04:52.298 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-05T01:04:52.317 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 910 kB/s) 2024-09-05T01:04:52.322 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-05T01:04:52.338 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-05T01:04:52.341 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-05T01:04:52.356 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-05T01:04:52.361 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-05T01:04:52.376 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-05T01:04:52.379 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-05T01:04:52.394 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 706 kB/s) 2024-09-05T01:04:52.399 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-05T01:04:52.416 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.0 MB/s) 2024-09-05T01:04:52.420 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-05T01:04:52.437 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-09-05T01:04:52.442 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-05T01:04:52.457 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 66 kB/s) 2024-09-05T01:04:52.461 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-05T01:04:52.479 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-09-05T01:04:52.483 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-05T01:04:52.500 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-05T01:04:52.505 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-05T01:04:52.521 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-05T01:04:52.528 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-05T01:04:52.543 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-05T01:04:52.550 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-05T01:04:52.565 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-05T01:04:52.568 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-05T01:04:52.584 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-05T01:04:52.588 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-05T01:04:52.605 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-09-05T01:04:52.612 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-05T01:04:52.627 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-05T01:04:52.630 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-05T01:04:52.645 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-05T01:04:52.658 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-05T01:04:52.675 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 796 kB/s) 2024-09-05T01:04:52.676 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-05T01:04:52.676 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-05T01:04:52.677 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-05T01:04:52.677 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-05T01:04:52.677 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-05T01:04:52.692 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (2): 4.2 kB | 32/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-09-05T01:04:52.692 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 32/122 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-05T01:04:52.694 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 32/122 kB | 33/55 kB Progress (2): 49/122 kB | 33/55 kB Progress (2): 49/122 kB | 49/55 kB Progress (2): 65/122 kB | 49/55 kB Progress (2): 65/122 kB | 55 kB Progress (2): 81/122 kB | 55 kB Progress (2): 98/122 kB | 55 kB Progress (3): 98/122 kB | 55 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-09-05T01:04:52.695 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-05T01:04:52.695 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 114/122 kB | 16/27 kB Progress (2): 114/122 kB | 27 kB Progress (2): 122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.5 MB/s) 2024-09-05T01:04:52.695 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-05T01:04:52.695 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-05T01:04:52.709 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/267 kB Progress (1): 31/267 kB Progress (1): 48/267 kB Progress (1): 64/267 kB Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (2): 112/267 kB | 16/23 kB Progress (2): 112/267 kB | 23 kB Progress (2): 129/267 kB | 23 kB Progress (2): 145/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 691 kB/s) 2024-09-05T01:04:52.713 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (2): 211/267 kB | 16/334 kB Progress (2): 227/267 kB | 16/334 kB Progress (2): 244/267 kB | 16/334 kB Progress (2): 244/267 kB | 32/334 kB Progress (2): 260/267 kB | 32/334 kB Progress (2): 267 kB | 32/334 kB Progress (2): 267 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.4 MB/s) 2024-09-05T01:04:52.717 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 65/334 kB Progress (1): 81/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (2): 180/334 kB | 4.7 kB Progress (2): 196/334 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 116 kB/s) 2024-09-05T01:04:52.721 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 7.3 MB/s) 2024-09-05T01:04:53.000 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-05T01:04:53.003 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-05T01:04:54.101 INFO:tasks.workunit.client.0.smithi099.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-05T01:04:54.102 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:54.102 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-05T01:04:54.104 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-05T01:04:54.104 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:54.104 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-05T01:04:54.109 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-05T01:04:54.109 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-05T01:04:54.270 INFO:tasks.workunit.client.0.smithi099.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-05T01:04:54.270 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:54.270 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-05T01:04:54.275 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-05T01:04:54.292 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 347 kB/s) 2024-09-05T01:04:54.296 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-05T01:04:54.311 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-05T01:04:54.315 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-05T01:04:54.330 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-05T01:04:54.333 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-05T01:04:54.350 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-05T01:04:54.353 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-05T01:04:54.371 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 184 kB/s) 2024-09-05T01:04:54.375 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-05T01:04:54.390 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-05T01:04:54.394 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-05T01:04:54.409 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-05T01:04:54.413 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-05T01:04:54.429 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 137 kB/s) 2024-09-05T01:04:54.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-05T01:04:54.446 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-05T01:04:54.449 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-05T01:04:54.470 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 86 kB/s) 2024-09-05T01:04:54.473 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-05T01:04:54.490 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-09-05T01:04:54.493 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-05T01:04:54.517 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 98 kB/s) 2024-09-05T01:04:54.519 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-05T01:04:54.536 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-09-05T01:04:54.538 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-05T01:04:54.554 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-09-05T01:04:54.557 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-05T01:04:54.572 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-05T01:04:54.575 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-05T01:04:54.593 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 509 kB/s) 2024-09-05T01:04:54.595 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-05T01:04:54.612 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-05T01:04:54.616 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-05T01:04:54.632 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-05T01:04:54.636 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-05T01:04:54.652 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-05T01:04:54.656 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-05T01:04:54.672 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-09-05T01:04:54.677 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-05T01:04:54.691 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-05T01:04:54.692 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-05T01:04:54.707 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-05T01:04:54.709 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-05T01:04:54.723 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.4 MB/s) 2024-09-05T01:04:54.726 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-05T01:04:54.740 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-05T01:04:54.742 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-05T01:04:54.758 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 904 kB/s) 2024-09-05T01:04:54.764 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-05T01:04:54.780 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 197 kB/s) 2024-09-05T01:04:54.783 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-05T01:04:54.798 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-05T01:04:54.802 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-05T01:04:54.819 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 466 kB/s) 2024-09-05T01:04:54.825 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-05T01:04:54.840 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-09-05T01:04:54.846 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-05T01:04:54.862 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 131 kB/s) 2024-09-05T01:04:54.869 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-05T01:04:54.888 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 168 kB/s) 2024-09-05T01:04:54.895 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-05T01:04:54.913 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-05T01:04:54.917 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-05T01:04:54.933 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-09-05T01:04:54.940 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-05T01:04:54.957 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 746 kB/s) 2024-09-05T01:04:54.961 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-05T01:04:54.978 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-09-05T01:04:54.983 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-05T01:04:54.999 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 369 kB/s) 2024-09-05T01:04:55.004 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-05T01:04:55.026 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.4 MB/s) 2024-09-05T01:04:55.033 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-05T01:04:55.059 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 667 kB/s) 2024-09-05T01:04:55.063 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-05T01:04:55.081 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-09-05T01:04:55.087 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-05T01:04:55.103 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-05T01:04:55.106 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-05T01:04:55.123 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 283 kB/s) 2024-09-05T01:04:55.128 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-05T01:04:55.144 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-05T01:04:55.149 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-05T01:04:55.166 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-05T01:04:55.173 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-05T01:04:55.190 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 250 kB/s) 2024-09-05T01:04:55.197 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-05T01:04:55.213 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-09-05T01:04:55.218 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-05T01:04:55.235 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-09-05T01:04:55.241 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-05T01:04:55.259 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-05T01:04:55.263 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-05T01:04:55.280 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 748 kB/s) 2024-09-05T01:04:55.284 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-05T01:04:55.307 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 815 kB/s) 2024-09-05T01:04:55.313 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-05T01:04:55.328 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-05T01:04:55.332 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-05T01:04:55.348 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-05T01:04:55.352 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-05T01:04:55.367 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-05T01:04:55.371 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-05T01:04:55.386 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-09-05T01:04:55.392 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-05T01:04:55.411 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 384 kB/s) 2024-09-05T01:04:55.417 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-05T01:04:55.437 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.1 MB/s) 2024-09-05T01:04:55.441 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-05T01:04:55.459 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 37/78 kB Progress (1): 53/78 kB Progress (1): 69/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-05T01:04:55.467 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-05T01:04:55.484 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-09-05T01:04:55.490 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-05T01:04:55.506 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-05T01:04:55.511 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-05T01:04:55.528 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 251 kB/s) 2024-09-05T01:04:55.531 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-05T01:04:55.548 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-09-05T01:04:55.552 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-05T01:04:55.569 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-05T01:04:55.575 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-05T01:04:55.594 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 125 kB/s) 2024-09-05T01:04:55.606 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-05T01:04:55.637 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.9 MB/s) 2024-09-05T01:04:55.638 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-05T01:04:55.638 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-05T01:04:55.639 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-05T01:04:55.639 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-05T01:04:55.640 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-05T01:04:55.657 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 14 kB Progress (2): 26 kB | 14 kB Progress (3): 26 kB | 14 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 715 kB/s) 2024-09-05T01:04:55.657 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-05T01:04:55.658 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-05T01:04:55.658 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 33/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-05T01:04:55.660 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 49/118 kB Progress (1): 66/118 kB Progress (1): 82/118 kB Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Progress (2): 118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.6 MB/s) 2024-09-05T01:04:55.660 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-05T01:04:55.661 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 389 kB/s) 2024-09-05T01:04:55.661 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-05T01:04:55.673 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 66/171 kB Progress (1): 82/171 kB Progress (1): 98/171 kB Progress (1): 115/171 kB Progress (1): 131/171 kB Progress (1): 147/171 kB Progress (1): 164/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 4.9 MB/s) 2024-09-05T01:04:55.673 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-05T01:04:55.675 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/61 kB Progress (1): 32/61 kB Progress (2): 32/61 kB | 16/146 kB Progress (2): 49/61 kB | 16/146 kB Progress (2): 61 kB | 16/146 kB Progress (2): 61 kB | 32/146 kB Progress (3): 61 kB | 32/146 kB | 16/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-09-05T01:04:55.676 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-05T01:04:55.679 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 49/146 kB | 16/501 kB Progress (2): 65/146 kB | 16/501 kB Progress (2): 65/146 kB | 33/501 kB Progress (2): 81/146 kB | 33/501 kB Progress (3): 81/146 kB | 33/501 kB | 16/136 kB Progress (3): 97/146 kB | 33/501 kB | 16/136 kB Progress (3): 97/146 kB | 33/501 kB | 32/136 kB Progress (3): 97/146 kB | 49/501 kB | 32/136 kB Progress (3): 97/146 kB | 49/501 kB | 49/136 kB Progress (3): 113/146 kB | 49/501 kB | 49/136 kB Progress (3): 113/146 kB | 66/501 kB | 49/136 kB Progress (3): 113/146 kB | 66/501 kB | 65/136 kB Progress (3): 130/146 kB | 66/501 kB | 65/136 kB Progress (3): 130/146 kB | 81/501 kB | 65/136 kB Progress (3): 130/146 kB | 81/501 kB | 81/136 kB Progress (3): 146 kB | 81/501 kB | 81/136 kB Progress (3): 146 kB | 97/501 kB | 81/136 kB Progress (3): 146 kB | 97/501 kB | 98/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.7 MB/s) 2024-09-05T01:04:55.679 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 114/501 kB | 98/136 kB Progress (2): 114/501 kB | 114/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-05T01:04:55.680 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 114/501 kB | 130/136 kB Progress (2): 130/501 kB | 130/136 kB Progress (2): 130/501 kB | 136 kB Progress (2): 147/501 kB | 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.4 MB/s) 2024-09-05T01:04:55.688 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 163/501 kB Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-09-05T01:04:55.689 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/58 kB Progress (1): 33/58 kB Progress (1): 49/58 kB Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.2 MB/s) 2024-09-05T01:04:55.693 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 80/124 kB Progress (1): 96/124 kB Progress (1): 113/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-09-05T01:04:55.768 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 19 MB/s) 2024-09-05T01:04:55.845 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:55.845 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-05T01:04:55.848 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-05T01:04:55.874 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 179 kB/s) 2024-09-05T01:04:55.876 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-05T01:04:55.896 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 245 kB/s) 2024-09-05T01:04:55.898 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-05T01:04:55.914 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.6/45 kB Progress (1): 18/45 kB Progress (1): 34/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-05T01:04:55.916 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-05T01:04:55.936 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-09-05T01:04:55.939 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-05T01:04:55.979 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 130 kB/s) 2024-09-05T01:04:55.982 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-05T01:04:56.038 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 70 kB/s) 2024-09-05T01:04:56.042 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-05T01:04:56.059 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-09-05T01:04:56.063 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-05T01:04:56.079 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 391 kB/s) 2024-09-05T01:04:56.083 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-05T01:04:56.101 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.2 MB/s) 2024-09-05T01:04:56.108 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-05T01:04:56.123 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-05T01:04:56.127 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-05T01:04:56.141 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-05T01:04:56.145 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-05T01:04:56.165 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 391 kB/s) 2024-09-05T01:04:56.168 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-05T01:04:56.193 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.1 MB/s) 2024-09-05T01:04:56.202 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-05T01:04:56.223 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.7 MB/s) 2024-09-05T01:04:56.223 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-05T01:04:56.224 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-05T01:04:56.224 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-05T01:04:56.224 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-05T01:04:56.224 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-05T01:04:56.250 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 15/211 kB Progress (3): 16/79 kB | 15/211 kB | 16/26 kB Progress (4): 16/79 kB | 15/211 kB | 16/26 kB | 0/1.0 MB Progress (4): 33/79 kB | 15/211 kB | 16/26 kB | 0/1.0 MB Progress (4): 33/79 kB | 15/211 kB | 26 kB | 0/1.0 MB Progress (4): 33/79 kB | 31/211 kB | 26 kB | 0/1.0 MB Progress (4): 49/79 kB | 31/211 kB | 26 kB | 0/1.0 MB Progress (4): 49/79 kB | 31/211 kB | 26 kB | 0/1.0 MB Progress (4): 49/79 kB | 48/211 kB | 26 kB | 0/1.0 MB Progress (4): 66/79 kB | 48/211 kB | 26 kB | 0/1.0 MB Progress (4): 66/79 kB | 48/211 kB | 26 kB | 0/1.0 MB Progress (4): 66/79 kB | 64/211 kB | 26 kB | 0/1.0 MB Progress (4): 79 kB | 64/211 kB | 26 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.0 MB/s) 2024-09-05T01:04:56.250 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-05T01:04:56.250 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 79 kB | 81/211 kB | 0/1.0 MB Progress (3): 79 kB | 81/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 3.1 MB/s) 2024-09-05T01:04:56.250 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-05T01:04:56.253 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 97/211 kB | 0.1/1.0 MB Progress (2): 97/211 kB | 0.1/1.0 MB Progress (2): 110/211 kB | 0.1/1.0 MB Progress (2): 110/211 kB | 0.1/1.0 MB Progress (2): 126/211 kB | 0.1/1.0 MB Progress (2): 126/211 kB | 0.1/1.0 MB Progress (2): 142/211 kB | 0.1/1.0 MB Progress (2): 142/211 kB | 0.1/1.0 MB Progress (2): 159/211 kB | 0.1/1.0 MB Progress (2): 159/211 kB | 0.1/1.0 MB Progress (2): 175/211 kB | 0.1/1.0 MB Progress (2): 175/211 kB | 0.2/1.0 MB Progress (2): 192/211 kB | 0.2/1.0 MB Progress (2): 192/211 kB | 0.2/1.0 MB Progress (2): 192/211 kB | 0.2/1.0 MB Progress (2): 208/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 7.0 MB/s) 2024-09-05T01:04:56.262 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (2): 0.5/1.0 MB | 16/58 kB Progress (2): 0.5/1.0 MB | 16/58 kB Progress (2): 0.5/1.0 MB | 16/58 kB Progress (2): 0.6/1.0 MB | 16/58 kB Progress (2): 0.6/1.0 MB | 16/58 kB Progress (2): 0.6/1.0 MB | 32/58 kB Progress (2): 0.6/1.0 MB | 32/58 kB Progress (2): 0.6/1.0 MB | 49/58 kB Progress (2): 0.6/1.0 MB | 58 kB Progress (2): 0.6/1.0 MB | 58 kB Progress (2): 0.6/1.0 MB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 1.5 MB/s) 2024-09-05T01:04:56.271 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/267 kB Progress (2): 0.8/1.0 MB | 16/267 kB Progress (2): 0.8/1.0 MB | 31/267 kB Progress (2): 0.8/1.0 MB | 31/267 kB Progress (2): 0.8/1.0 MB | 31/267 kB Progress (2): 0.8/1.0 MB | 48/267 kB Progress (2): 0.8/1.0 MB | 48/267 kB Progress (2): 0.8/1.0 MB | 64/267 kB Progress (2): 0.8/1.0 MB | 79/267 kB Progress (2): 0.8/1.0 MB | 79/267 kB Progress (2): 0.8/1.0 MB | 96/267 kB Progress (3): 0.8/1.0 MB | 96/267 kB | 16/116 kB Progress (3): 0.8/1.0 MB | 112/267 kB | 16/116 kB Progress (3): 0.9/1.0 MB | 112/267 kB | 16/116 kB Progress (3): 0.9/1.0 MB | 128/267 kB | 16/116 kB Progress (3): 0.9/1.0 MB | 128/267 kB | 32/116 kB Progress (3): 0.9/1.0 MB | 128/267 kB | 32/116 kB Progress (3): 0.9/1.0 MB | 145/267 kB | 32/116 kB Progress (3): 0.9/1.0 MB | 145/267 kB | 49/116 kB Progress (3): 0.9/1.0 MB | 161/267 kB | 49/116 kB Progress (3): 0.9/1.0 MB | 161/267 kB | 49/116 kB Progress (3): 0.9/1.0 MB | 178/267 kB | 49/116 kB Progress (3): 0.9/1.0 MB | 178/267 kB | 65/116 kB Progress (3): 0.9/1.0 MB | 194/267 kB | 65/116 kB Progress (3): 0.9/1.0 MB | 194/267 kB | 65/116 kB Progress (3): 0.9/1.0 MB | 194/267 kB | 81/116 kB Progress (3): 0.9/1.0 MB | 210/267 kB | 81/116 kB Progress (3): 0.9/1.0 MB | 210/267 kB | 81/116 kB Progress (3): 0.9/1.0 MB | 227/267 kB | 81/116 kB Progress (3): 0.9/1.0 MB | 227/267 kB | 98/116 kB Progress (3): 0.9/1.0 MB | 243/267 kB | 98/116 kB Progress (3): 0.9/1.0 MB | 243/267 kB | 98/116 kB Progress (3): 0.9/1.0 MB | 260/267 kB | 98/116 kB Progress (3): 0.9/1.0 MB | 260/267 kB | 114/116 kB Progress (3): 0.9/1.0 MB | 267 kB | 114/116 kB Progress (3): 0.9/1.0 MB | 267 kB | 116 kB Progress (3): 0.9/1.0 MB | 267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.8 MB/s) 2024-09-05T01:04:56.271 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 1.0/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 2.5 MB/s) 2024-09-05T01:04:56.272 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 21 MB/s) 2024-09-05T01:04:56.453 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-05T01:04:56.481 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:04:56.481 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] BUILD SUCCESS 2024-09-05T01:04:56.482 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:04:56.482 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Total time: 8.716 s 2024-09-05T01:04:56.482 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Finished at: 2024-09-05T01:04:56Z 2024-09-05T01:04:56.482 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:04:56.544 INFO:tasks.workunit.client.0.smithi099.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-05T01:04:56.551 INFO:tasks.workunit.client.0.smithi099.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-05T01:04:57.702 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Scanning for projects... 2024-09-05T01:04:57.779 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:57.779 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-05T01:04:57.779 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jcksum 1.0 2024-09-05T01:04:57.779 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] from pom.xml 2024-09-05T01:04:57.779 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-05T01:04:58.041 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:58.042 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-05T01:04:58.170 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-05T01:04:58.170 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:58.170 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-05T01:04:58.267 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-05T01:04:58.267 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:58.267 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-05T01:04:58.269 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-05T01:04:58.269 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:58.269 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-05T01:04:58.274 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-05T01:04:58.274 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:58.274 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-05T01:04:58.550 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-05T01:04:58.785 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-05T01:04:58.996 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 22 kB/s) 2024-09-05T01:04:59.005 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-05T01:04:59.025 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-05T01:04:59.029 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-05T01:04:59.051 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 134 kB/s) 2024-09-05T01:04:59.055 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-05T01:04:59.081 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 132 kB/s) 2024-09-05T01:04:59.081 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-05T01:04:59.101 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 160 kB/s) 2024-09-05T01:04:59.103 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-05T01:04:59.122 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 84 kB/s) 2024-09-05T01:04:59.125 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-05T01:04:59.143 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 157 kB/s) 2024-09-05T01:04:59.149 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-05T01:04:59.175 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 17/27 kB Progress (1): 19/27 kB Progress (1): 20/27 kB Progress (1): 21/27 kB Progress (1): 23/27 kB Progress (1): 24/27 kB Progress (1): 25/27 kB Progress (1): 27/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-09-05T01:04:59.176 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-05T01:04:59.177 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-05T01:04:59.177 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-05T01:04:59.177 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-05T01:04:59.178 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-05T01:04:59.226 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/169 kB Progress (1): 32/169 kB Progress (1): 49/169 kB Progress (1): 65/169 kB Progress (1): 81/169 kB Progress (1): 98/169 kB Progress (1): 114/169 kB Progress (1): 130/169 kB Progress (1): 147/169 kB Progress (1): 163/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.4 MB/s) 2024-09-05T01:04:59.254 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/189 kB Progress (2): 2.8/103 kB | 1.4/189 kB Progress (2): 2.8/103 kB | 2.8/189 kB Progress (2): 4.1/103 kB | 2.8/189 kB Progress (2): 4.1/103 kB | 4.1/189 kB Progress (2): 5.5/103 kB | 4.1/189 kB Progress (2): 5.5/103 kB | 5.5/189 kB Progress (2): 6.9/103 kB | 5.5/189 kB Progress (2): 6.9/103 kB | 6.9/189 kB Progress (2): 8.3/103 kB | 6.9/189 kB Progress (2): 8.3/103 kB | 8.3/189 kB Progress (2): 9.7/103 kB | 8.3/189 kB Progress (2): 9.7/103 kB | 9.7/189 kB Progress (2): 11/103 kB | 9.7/189 kB Progress (2): 11/103 kB | 11/189 kB Progress (2): 12/103 kB | 11/189 kB Progress (2): 12/103 kB | 12/189 kB Progress (2): 14/103 kB | 12/189 kB Progress (2): 14/103 kB | 14/189 kB Progress (2): 15/103 kB | 14/189 kB Progress (2): 15/103 kB | 15/189 kB Progress (2): 16/103 kB | 15/189 kB Progress (2): 16/103 kB | 16/189 kB Progress (2): 32/103 kB | 16/189 kB Progress (2): 32/103 kB | 32/189 kB Progress (2): 32/103 kB | 49/189 kB Progress (2): 49/103 kB | 49/189 kB Progress (2): 49/103 kB | 65/189 kB Progress (2): 65/103 kB | 65/189 kB Progress (2): 65/103 kB | 81/189 kB Progress (2): 81/103 kB | 81/189 kB Progress (2): 81/103 kB | 98/189 kB Progress (3): 81/103 kB | 98/189 kB | 1.4/7.7 kB Progress (3): 98/103 kB | 98/189 kB | 1.4/7.7 kB Progress (3): 98/103 kB | 98/189 kB | 2.8/7.7 kB Progress (3): 98/103 kB | 114/189 kB | 2.8/7.7 kB Progress (3): 98/103 kB | 114/189 kB | 4.1/7.7 kB Progress (3): 103 kB | 114/189 kB | 4.1/7.7 kB Progress (3): 103 kB | 114/189 kB | 5.5/7.7 kB Progress (3): 103 kB | 114/189 kB | 6.9/7.7 kB Progress (3): 103 kB | 130/189 kB | 6.9/7.7 kB Progress (3): 103 kB | 130/189 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-05T01:04:59.255 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 147/189 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 98 kB/s) 2024-09-05T01:04:59.258 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.3 MB/s) 2024-09-05T01:04:59.275 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/18 kB Progress (1): 2.8/18 kB Progress (1): 4.1/18 kB Progress (1): 5.5/18 kB Progress (1): 6.9/18 kB Progress (1): 8.3/18 kB Progress (1): 9.7/18 kB Progress (1): 11/18 kB Progress (1): 12/18 kB Progress (1): 14/18 kB Progress (1): 15/18 kB Progress (1): 16/18 kB Progress (1): 17/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 176 kB/s) 2024-09-05T01:04:59.292 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:04:59.292 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------- 2024-09-05T01:04:59.292 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] T E S T S 2024-09-05T01:04:59.292 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------- 2024-09-05T01:04:59.860 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-05T01:04:59.955 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjects.java: starting test run: 2024-09-05T01:04:59.955 INFO:tasks.workunit.client.0.smithi099.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-05T01:04:59.955 INFO:tasks.workunit.client.0.smithi099.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-05T01:04:59.955 INFO:tasks.workunit.client.0.smithi099.stdout: EndpointUrl=http://smithi099.front.sepia.ceph.com:80 2024-09-05T01:04:59.956 INFO:tasks.workunit.client.0.smithi099.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-05T01:05:00.052 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Environment Variables Read 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: S3 Client Initialized 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.455 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.456 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.456 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-09-05T01:05:00.456 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-09-05T01:05:00.456 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generated Big Files 2024-09-05T01:05:00.854 INFO:tasks.workunit.client.0.smithi099.stdout:HeadBucketResponse() 2024-09-05T01:05:00.854 INFO:tasks.workunit.client.0.smithi099.stdout:sheik is ready 2024-09-05T01:05:00.854 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Test Bucket Created 2024-09-05T01:05:00.954 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-05T01:05:01.256 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-05T01:05:01.656 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-05T01:05:02.057 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-05T01:05:02.358 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-05T01:05:02.659 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-05T01:05:02.960 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-05T01:05:03.361 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-05T01:05:03.962 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-05T01:05:04.964 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-05T01:05:10.877 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-05T01:05:15.587 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-05T01:05:50.420 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-0b 2024-09-05T01:05:50.420 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-8b 2024-09-05T01:05:50.422 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-200b 2024-09-05T01:05:50.423 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-21983b 2024-09-05T01:05:50.424 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-5519b 2024-09-05T01:05:50.425 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-204329b 2024-09-05T01:05:50.427 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-256k 2024-09-05T01:05:50.428 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-1m 2024-09-05T01:05:50.432 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-1038757b 2024-09-05T01:05:50.448 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-0b 2024-09-05T01:05:50.649 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:50.749 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-8b 2024-09-05T01:05:50.850 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:50.950 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-200b 2024-09-05T01:05:51.150 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:51.250 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-21983b 2024-09-05T01:05:51.350 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:51.451 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-5519b 2024-09-05T01:05:51.651 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:51.751 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-204329b 2024-09-05T01:05:51.951 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:52.152 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-256k 2024-09-05T01:05:52.452 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:52.552 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-1m 2024-09-05T01:05:53.153 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:53.354 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-05T01:05:54.054 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-09-05T01:05:54.255 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-05T01:05:57.960 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-05T01:06:02.466 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-05T01:07:05.242 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 125.3 s -- in io.ceph.jcksum.PutObjects 2024-09-05T01:07:05.263 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:07:05.264 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Results: 2024-09-05T01:07:05.264 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:07:05.264 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-05T01:07:05.264 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-09-05T01:07:05.266 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:07:05.266 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] BUILD SUCCESS 2024-09-05T01:07:05.266 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:07:05.267 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Total time: 02:07 min 2024-09-05T01:07:05.267 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Finished at: 2024-09-05T01:07:05Z 2024-09-05T01:07:05.268 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-05T01:07:05.287 INFO:tasks.workunit.client.0.smithi099.stderr:+ exit 2024-09-05T01:07:05.288 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T01:07:05.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T01:07:05.338 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-05T01:07:05.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T01:07:05.709 DEBUG:teuthology.parallel:result is None 2024-09-05T01:07:05.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:07:05.724 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:07:05.724 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:07:05.773 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:07:05.773 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T01:07:05.784 INFO:tasks.workunit:Pulling workunits from ref ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T01:07:05.785 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T01:07:05.785 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:07:05.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:07:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-05T01:07:05.821 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:07:05.869 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-05T01:07:05.869 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-05T01:07:05.917 INFO:tasks.workunit:timeout=3h 2024-09-05T01:07:05.917 INFO:tasks.workunit:cleanup=True 2024-09-05T01:07:05.917 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T01:07:05.967 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T01:08:01.968 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 99% (12627/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-05T01:08:02.896 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'ede1507024117d16395cd6d958c594ff4aaf4da5'. 2024-09-05T01:08:02.896 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.896 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T01:08:02.896 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T01:08:02.898 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:08:02.898 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at ede15070241 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-09-05T01:08:02.904 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T01:08:02.949 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T01:08:02.953 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:08:02.953 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T01:08:03.001 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T01:08:03.049 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T01:08:03.086 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:08:03.087 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:08:03.087 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T01:08:03.133 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:08:03.136 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:08:03.136 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T01:08:03.188 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-05T01:08:03.189 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-05T01:08:03.190 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-05T01:08:03.240 INFO:tasks.workunit.client.0.smithi099.stdout:INFO: fully qualified domain name: smithi099.front.sepia.ceph.com 2024-09-05T01:08:03.241 INFO:tasks.workunit.client.0.smithi099.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-05T01:08:03.241 INFO:tasks.workunit.client.0.smithi099.stdout:== TESTING VERSIONED BUCKET == 2024-09-05T01:08:06.482 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-05T01:08:06.686 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-09-05T01:08:06.692 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-05T01:08:06.726 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-09-05T01:08:06.727 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-09-05T01:08:06.727 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-09-05T01:08:06.985 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-09-05T01:08:06.990 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-09-05T01:08:07.731 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.2 2024-09-05T01:08:08.765 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-09-05T01:08:08.767 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached boto3-1.35.12-py3-none-any.whl.metadata (6.6 kB) 2024-09-05T01:08:09.310 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.36.0,>=1.35.12 (from boto3) 2024-09-05T01:08:09.311 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached botocore-1.35.12-py3-none-any.whl.metadata (5.7 kB) 2024-09-05T01:08:09.373 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-05T01:08:09.374 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-05T01:08:09.421 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-05T01:08:09.422 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-05T01:08:09.474 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:08:09.476 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-05T01:08:09.582 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:08:09.583 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-05T01:08:09.777 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:08:09.778 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-05T01:08:09.782 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached boto3-1.35.12-py3-none-any.whl (139 kB) 2024-09-05T01:08:09.783 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached botocore-1.35.12-py3-none-any.whl (12.5 MB) 2024-09-05T01:08:09.793 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-05T01:08:09.794 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-05T01:08:09.795 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-05T01:08:09.796 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-05T01:08:09.797 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-05T01:08:09.864 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-05T01:08:11.018 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.35.12 botocore-1.35.12 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-05T01:08:11.618 INFO:tasks.workunit.client.0.smithi099.stdout:INFO: creating user 2024-09-05T01:08:11.990 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-09-05T01:08:11.990 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "testid", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "M. Tester", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "tester@ceph.com", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "testid", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "0555b35654ad1656d804", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T01:08:11.982909Z" 2024-09-05T01:08:11.991 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:11.992 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-09-05T01:08:11.993 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-09-05T01:08:11.994 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-09-05T01:08:11.982857Z", 2024-09-05T01:08:11.994 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-09-05T01:08:11.994 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-09-05T01:08:11.994 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-09-05T01:08:11.994 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-09-05T01:08:12.485 INFO:tasks.workunit.client.0.smithi099.stderr:5+0 records in 2024-09-05T01:08:12.486 INFO:tasks.workunit.client.0.smithi099.stderr:5+0 records out 2024-09-05T01:08:12.486 INFO:tasks.workunit.client.0.smithi099.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0241551 s, 217 MB/s 2024-09-05T01:08:51.125 INFO:tasks.workunit.client.0.smithi099.stdout:bucket nams is reupload-bkt-124872 2024-09-05T01:08:51.125 INFO:tasks.workunit.client.0.smithi099.stdout:endpoint is http://smithi099.front.sepia.ceph.com:80 2024-09-05T01:08:51.125 INFO:tasks.workunit.client.0.smithi099.stdout:start UploadId=2~QwjctW2JqP0DE7GFgnnJ2ktDAO1lxa1 2024-09-05T01:08:51.125 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.125 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 2} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1} 2024-09-05T01:08:51.126 INFO:tasks.workunit.client.0.smithi099.stdout:aborting multipart upload, parts=[{'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 1}, {'ETag': '"f953b0cd40ad6e54a517ae28de513bee"', 'PartNumber': 2}] 2024-09-05T01:08:53.136 INFO:tasks.workunit.client.0.smithi099.stdout:radosgw-admin bucket radoslist: 2024-09-05T01:08:53.222 INFO:tasks.workunit.client.0.smithi099.stdout:rados ls: 2024-09-05T01:08:53.318 INFO:tasks.workunit.client.0.smithi099.stdout:== PASSED == 2024-09-05T01:08:53.319 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T01:08:53.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T01:08:53.374 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-05T01:08:53.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T01:08:53.803 DEBUG:teuthology.parallel:result is None 2024-09-05T01:08:53.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:08:53.815 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:08:53.815 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:08:53.862 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:08:53.862 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-05T01:08:53.876 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-05T01:08:53.876 INFO:tasks.ragweed:Downloading ragweed... 2024-09-05T01:08:53.876 INFO:tasks.ragweed:Using branch 'pr-56597' for ragweed 2024-09-05T01:08:53.876 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b pr-56597 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-05T01:08:53.909 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-05T01:08:53.962 INFO:teuthology.orchestra.run.smithi099.stderr:fatal: Remote branch pr-56597 not found in upstream origin 2024-09-05T01:08:53.963 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-05T01:08:53.964 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-05T01:08:53.964 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-05T01:08:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-05T01:08:54.214 INFO:tasks.ragweed:Creating rgw users... 2024-09-05T01:08:54.214 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-05T01:08:54.214 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key ONNFJOWSJOFGZSXENWMA --secret 2LOCVEZ2YwdSlIDrclVYSxBnR22keq4iEbTgamLYrw5BT0mFgmTbPg== --email ragweed.client.0+test@test.test --system false 2024-09-05T01:08:54.304 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:08:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:08:54.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 realm 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.349+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.353+0000 7f0bf9e369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:08:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.353+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.353+0000 7f0bf9e369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:08:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.353+0000 7f0bf9e369c0 20 searching for the correct realm 2024-09-05T01:08:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.357+0000 7f0bf813d640 0 -- 172.21.15.99:0/1577342967 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0be003fc00 msgr2=0x7f0be0029420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:08:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.365+0000 7f0bf713b640 0 -- 172.21.15.99:0/1577342967 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x55dd4a14d0b0 msgr2=0x55dd4a14f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:08:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:08:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:08:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:08:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:08:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:08:54.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:08:54.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 zone default found 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 4 Realm: () 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 zonegroup default 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 started sync module instance, tier type = 2024-09-05T01:08:54.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.373+0000 7f0bf9e369c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=0 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=1 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=2 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=3 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=4 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=5 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=6 2024-09-05T01:08:54.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 20 add_watcher() i=7 2024-09-05T01:08:54.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.389+0000 7f0bf9e369c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0aadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 5 note: GC not initialized 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0aacfe1640 20 reqs_thread_entry: start 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 init_complete bucket index max shards: 11 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 Filter name: none 2024-09-05T01:08:54.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0a267fc640 20 reqs_thread_entry: start 2024-09-05T01:08:54.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-05T01:08:54.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 10 cache get: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA : miss 2024-09-05T01:08:54.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.393+0000 7f0bf9e369c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA info.flags=0x0 2024-09-05T01:08:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 adding default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA to cache LRU end 2024-09-05T01:08:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 cache get: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA : hit (negative entry) 2024-09-05T01:08:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 cache get: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA : hit (negative entry) 2024-09-05T01:08:54.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-05T01:08:54.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-05T01:08:54.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.397+0000 7f0bf9e369c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-05T01:08:54.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.401+0000 7f0ad67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725910 cookie 94408919048464 notifier 5940 bl.length()=675 2024-09-05T01:08:54.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.401+0000 7f0ad67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-05T01:08:54.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.401+0000 7f0ad67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-05T01:08:54.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-05T01:08:54.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0bf9e369c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0bf9e369c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-05T01:08:54.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0ad67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725897 cookie 94408919017296 notifier 5940 bl.length()=202 2024-09-05T01:08:54.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0ad67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-05T01:08:54.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.405+0000 7f0ad67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0bf9e369c0 10 cache put: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA info.flags=0x7 2024-09-05T01:08:54.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0bf9e369c0 10 moving default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA to cache LRU end 2024-09-05T01:08:54.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0bf9e369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ONNFJOWSJOFGZSXENWMA, ofs0, ns] 2024-09-05T01:08:54.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0ad6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725940 cookie 94408919044864 notifier 5940 bl.length()=190 2024-09-05T01:08:54.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0ad6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA info.flags=0x7 2024-09-05T01:08:54.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.413+0000 7f0ad6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ONNFJOWSJOFGZSXENWMA to cache LRU end 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "ragweed.client.0", 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:08:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "ragweed.client.0", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "ONNFJOWSJOFGZSXENWMA", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "2LOCVEZ2YwdSlIDrclVYSxBnR22keq4iEbTgamLYrw5BT0mFgmTbPg==", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:08:54.401656Z" 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:08:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:08:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:08:54.401633Z", 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:08:54.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.417+0000 7f0aadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:08:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.421+0000 7f0bf9e369c0 20 remove_watcher() i=0 2024-09-05T01:08:54.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.421+0000 7f0bf9e369c0 2 removed watcher, disabling cache 2024-09-05T01:08:54.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.421+0000 7f0bf9e369c0 20 remove_watcher() i=1 2024-09-05T01:08:54.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.425+0000 7f0bf9e369c0 20 remove_watcher() i=2 2024-09-05T01:08:54.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.425+0000 7f0bf9e369c0 20 remove_watcher() i=3 2024-09-05T01:08:54.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.429+0000 7f0bf9e369c0 20 remove_watcher() i=4 2024-09-05T01:08:54.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.429+0000 7f0bf9e369c0 20 remove_watcher() i=5 2024-09-05T01:08:54.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.429+0000 7f0bf9e369c0 20 remove_watcher() i=6 2024-09-05T01:08:54.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.433+0000 7f0bf9e369c0 20 remove_watcher() i=7 2024-09-05T01:08:54.442 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-05T01:08:54.443 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key YOJWLIINFFMCGGNBCHHV --secret fgZp/XdcgTqotzjwWsqTBuC0G/hZIwJRTWCaSLgUBrGYg/GxDQMibw== --email sysuser.client.0+test@test.test --system true 2024-09-05T01:08:54.481 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:08:54.481 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:08:54.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.517+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 realm 2024-09-05T01:08:54.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:08:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:08:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:08:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.521+0000 7fd2f90da9c0 20 searching for the correct realm 2024-09-05T01:08:54.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.529+0000 7fd2f73e1640 0 -- 172.21.15.99:0/1403038739 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55f5e8dd4dd0 msgr2=0x55f5e8dd7290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:08:54.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.537+0000 7fd2f6be0640 0 -- 172.21.15.99:0/1403038739 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd2f0128970 msgr2=0x7fd2f00f68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 zone default found 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 4 Realm: () 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 zonegroup default 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.541+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.545+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.545+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.545+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.545+0000 7fd2f90da9c0 20 started sync module instance, tier type = 2024-09-05T01:08:54.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.545+0000 7fd2f90da9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:08:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=0 2024-09-05T01:08:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=1 2024-09-05T01:08:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=2 2024-09-05T01:08:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=3 2024-09-05T01:08:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=4 2024-09-05T01:08:54.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=5 2024-09-05T01:08:54.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=6 2024-09-05T01:08:54.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 20 add_watcher() i=7 2024-09-05T01:08:54.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.557+0000 7fd2f90da9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd1ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 5 note: GC not initialized 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd127fff640 20 reqs_thread_entry: start 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 Filter name: none 2024-09-05T01:08:54.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd125ffb640 20 reqs_thread_entry: start 2024-09-05T01:08:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-05T01:08:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache get: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV : miss 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:08:54.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV info.flags=0x0 2024-09-05T01:08:54.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 adding default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV to cache LRU end 2024-09-05T01:08:54.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache get: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV : hit (negative entry) 2024-09-05T01:08:54.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.561+0000 7fd2f90da9c0 10 cache get: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV : hit (negative entry) 2024-09-05T01:08:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-05T01:08:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd2f90da9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-05T01:08:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd2f90da9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-05T01:08:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd1da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725898 cookie 94514662170704 notifier 5663 bl.length()=675 2024-09-05T01:08:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd1da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-05T01:08:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.565+0000 7fd1da7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-05T01:08:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.569+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-05T01:08:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.569+0000 7fd2f90da9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.569+0000 7fd2f90da9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-05T01:08:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.573+0000 7fd1d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725911 cookie 94514662182528 notifier 5663 bl.length()=202 2024-09-05T01:08:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.573+0000 7fd1d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-05T01:08:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.573+0000 7fd1d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-05T01:08:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd2f90da9c0 10 cache put: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV info.flags=0x7 2024-09-05T01:08:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd2f90da9c0 10 moving default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV to cache LRU end 2024-09-05T01:08:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd2f90da9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:YOJWLIINFFMCGGNBCHHV, ofs0, ns] 2024-09-05T01:08:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd1d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725912 cookie 94514662182528 notifier 5663 bl.length()=190 2024-09-05T01:08:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd1d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV info.flags=0x7 2024-09-05T01:08:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.577+0000 7fd1d9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YOJWLIINFFMCGGNBCHHV to cache LRU end 2024-09-05T01:08:54.576 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:08:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "sysuser.client.0", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "sysuser.client.0", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "YOJWLIINFFMCGGNBCHHV", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "fgZp/XdcgTqotzjwWsqTBuC0G/hZIwJRTWCaSLgUBrGYg/GxDQMibw==", 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:08:54.568911Z" 2024-09-05T01:08:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "system": true, 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:08:54.568901Z", 2024-09-05T01:08:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:08:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:08:54.580 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:08:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:08:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.581+0000 7fd1ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:08:54.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.585+0000 7fd2f90da9c0 20 remove_watcher() i=0 2024-09-05T01:08:54.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.585+0000 7fd2f90da9c0 2 removed watcher, disabling cache 2024-09-05T01:08:54.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.585+0000 7fd2f90da9c0 20 remove_watcher() i=1 2024-09-05T01:08:54.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.589+0000 7fd2f90da9c0 20 remove_watcher() i=2 2024-09-05T01:08:54.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.589+0000 7fd2f90da9c0 20 remove_watcher() i=3 2024-09-05T01:08:54.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.593+0000 7fd2f90da9c0 20 remove_watcher() i=4 2024-09-05T01:08:54.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.593+0000 7fd2f90da9c0 20 remove_watcher() i=5 2024-09-05T01:08:54.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.593+0000 7fd2f90da9c0 20 remove_watcher() i=6 2024-09-05T01:08:54.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:08:54.597+0000 7fd2f90da9c0 20 remove_watcher() i=7 2024-09-05T01:08:54.604 INFO:tasks.ragweed:Configuring ragweed... 2024-09-05T01:08:54.605 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:08:54.605 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-05T01:08:54.650 INFO:tasks.ragweed:Configuring boto... 2024-09-05T01:08:54.650 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:08:54.650 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-05T01:08:54.702 DEBUG:teuthology.orchestra.run.smithi099:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-05T01:08:54.881 INFO:teuthology.orchestra.run.smithi099.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-05T01:08:55.056 INFO:teuthology.orchestra.run.smithi099.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-05T01:08:55.586 INFO:teuthology.orchestra.run.smithi099.stdout:py installdeps: -rrequirements.txt 2024-09-05T01:08:58.168 INFO:teuthology.orchestra.run.smithi099.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-05T01:09:00.407 INFO:teuthology.orchestra.run.smithi099.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=22da8c64b27111890345068736298f1217561c4d703ad2cbb48de94227a672a9,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-05T01:09:00.407 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test-pre: PYTHONHASHSEED='3185292114' 2024-09-05T01:09:00.407 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-05T01:09:00.574 INFO:teuthology.orchestra.run.smithi099.stdout:============================= test session starts ============================== 2024-09-05T01:09:00.575 INFO:teuthology.orchestra.run.smithi099.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-05T01:09:00.575 INFO:teuthology.orchestra.run.smithi099.stdout:cachedir: .tox/py/.pytest_cache 2024-09-05T01:09:00.575 INFO:teuthology.orchestra.run.smithi099.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-05T01:09:00.737 INFO:teuthology.orchestra.run.smithi099.stdout:collecting ... collected 9 items 2024-09-05T01:09:00.737 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:09:05.065 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-05T01:09:08.786 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-05T01:09:12.349 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-05T01:09:16.946 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-05T01:09:20.440 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-05T01:09:31.419 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-05T01:09:40.058 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-05T01:09:49.055 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-05T01:10:04.814 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout:=============================== warnings summary =============================== 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: import imp 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-05T01:10:04.815 INFO:teuthology.orchestra.run.smithi099.stdout:=================== 9 passed, 1 warning in 64.24s (0:01:04) ==================== 2024-09-05T01:10:04.868 INFO:teuthology.orchestra.run.smithi099.stdout:___________________________________ summary ____________________________________ 2024-09-05T01:10:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: py: commands succeeded 2024-09-05T01:10:04.868 INFO:teuthology.orchestra.run.smithi099.stdout: congratulations :) 2024-09-05T01:10:04.902 INFO:tasks.ragweed:Cleaning up boto... 2024-09-05T01:10:04.903 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-05T01:10:04.910 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-05T01:10:04.990 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:10:04.990 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:10:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 realm 2024-09-05T01:10:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:10:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.246+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.250+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:10:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.250+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.250+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:10:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.250+0000 7f7af1dff9c0 20 searching for the correct realm 2024-09-05T01:10:05.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.254+0000 7f7af0106640 0 -- 172.21.15.99:0/3983946318 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7ad8017030 msgr2=0x7f7ad8054320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:10:05.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.470+0000 7f7af0106640 0 -- 172.21.15.99:0/3983946318 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7ad8017030 msgr2=0x7f7ad8054320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:10:05.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.478+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:10:05.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 zone default found 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 4 Realm: () 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 zonegroup default 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.482+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.486+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.486+0000 7f7af1dff9c0 20 started sync module instance, tier type = 2024-09-05T01:10:05.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.486+0000 7f7af1dff9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:10:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=0 2024-09-05T01:10:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=1 2024-09-05T01:10:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=2 2024-09-05T01:10:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=3 2024-09-05T01:10:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=4 2024-09-05T01:10:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=5 2024-09-05T01:10:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=6 2024-09-05T01:10:05.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 20 add_watcher() i=7 2024-09-05T01:10:05.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.510+0000 7f7af1dff9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:10:05.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.514+0000 7f79a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:10:05.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.514+0000 7f7af1dff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:10:05.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.514+0000 7f7af1dff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:10:05.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f79a57e2640 20 reqs_thread_entry: start 2024-09-05T01:10:05.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f7af1dff9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:10:05.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f7af1dff9c0 20 Filter name: none 2024-09-05T01:10:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f799e7fc640 20 reqs_thread_entry: start 2024-09-05T01:10:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-05T01:10:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.606+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-05T01:10:05.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-05T01:10:05.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-05T01:10:05.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 : miss 2024-09-05T01:10:05.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 info.flags=0x17 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 to cache LRU end 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 2024-09-05T01:10:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-05T01:10:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-05T01:10:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.610+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-05T01:10:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.614+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-05T01:10:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.614+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-05T01:10:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.614+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-05T01:10:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.614+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-05T01:10:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-05T01:10:05.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-05T01:10:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 10 manifest: total_size = 15940 2024-09-05T01:10:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5360737146472862007 2024-09-05T01:10:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.618+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.1 2024-09-05T01:10:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=15940 stripe_ofs=15940 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5360737146472862007 2024-09-05T01:10:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.n52wD4oJi8KUV6wBpJlsZgIjC1DiTBG_0 2024-09-05T01:10:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5360737146472862007 2024-09-05T01:10:05.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.626+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-05T01:10:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 10 manifest: total_size = 7412 2024-09-05T01:10:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3583638071865055093 2024-09-05T01:10:05.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.630+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.2 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=7412 stripe_ofs=7412 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3583638071865055093 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.POL2xrRwwG6FhFmA_de0NibmSzzKhZu_0 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3583638071865055093 2024-09-05T01:10:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-05T01:10:05.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.634+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.638+0000 7f7af1dff9c0 10 manifest: total_size = 15908 2024-09-05T01:10:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.638+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6965215702217022954 2024-09-05T01:10:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.638+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.638+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.638+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.2 2024-09-05T01:10:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=15908 stripe_ofs=15908 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6965215702217022954 2024-09-05T01:10:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.pl650VNxkNk4uxWQqXRjD_Y-MqCo-oD_0 2024-09-05T01:10:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6965215702217022954 2024-09-05T01:10:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.642+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-05T01:10:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 10 manifest: total_size = 13085 2024-09-05T01:10:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15652254066488290558 2024-09-05T01:10:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.3 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=13085 stripe_ofs=13085 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15652254066488290558 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.LAedQ0kvOVTKuUuXHLa9E_fZRkxjkho_0 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.646+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15652254066488290558 2024-09-05T01:10:05.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5204a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 10 manifest: total_size = 13072 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16621685333194820943 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5204a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.650+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.4 2024-09-05T01:10:05.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=13072 stripe_ofs=13072 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16621685333194820943 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.O8_VIa7wLQjYEwoJSFuXVZWeqJYA07B_0 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.654+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16621685333194820943 2024-09-05T01:10:05.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.658+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.658+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-05T01:10:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.662+0000 7f7af1dff9c0 10 manifest: total_size = 4948 2024-09-05T01:10:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.662+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13978116125858224168 2024-09-05T01:10:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.662+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x56118f5c08a8 s->prefetch_data=0 2024-09-05T01:10:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.662+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5c08a8 2024-09-05T01:10:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.662+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.4 2024-09-05T01:10:05.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=4948 stripe_ofs=4948 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13978116125858224168 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.xsi_RSaeSTCcLXo-wbjepHOCfIYQM0k_0 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.666+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13978116125858224168 2024-09-05T01:10:05.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-05T01:10:05.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 10 manifest: total_size = 12814 2024-09-05T01:10:05.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10658245198731629351 2024-09-05T01:10:05.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54d518 2024-09-05T01:10:05.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.670+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.5 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=12814 stripe_ofs=12814 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10658245198731629351 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.WYf4p-9h1G_LGjCVRi19KVbtOd5bHat_0 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:05.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.674+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10658245198731629351 2024-09-05T01:10:05.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-05T01:10:05.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 10 manifest: total_size = 5418 2024-09-05T01:10:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3978121913462792569 2024-09-05T01:10:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54d518 2024-09-05T01:10:05.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.678+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.7 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5418 stripe_ofs=5418 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3978121913462792569 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.kxDrRm38kJTZJ816SS4GJjoHZyl4Lvq_0 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.682+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3978121913462792569 2024-09-05T01:10:05.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-05T01:10:05.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 10 manifest: total_size = 38488 2024-09-05T01:10:05.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500997209762498296 2024-09-05T01:10:05.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x56118f54d518 s->prefetch_data=0 2024-09-05T01:10:05.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54d518 2024-09-05T01:10:05.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.686+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4.8 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=38488 stripe_ofs=38488 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500997209762498296 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.hx0Wj36YMeAZP7GS0fBRGMhuebA_UN1_0 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-05T01:10:05.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.694+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500997209762498296 2024-09-05T01:10:05.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-05T01:10:05.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:05.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:05.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:05.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.698+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:05.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.702+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-05T01:10:05.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.702+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.702+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-05T01:10:05.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.702+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-05T01:10:05.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.702+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-05T01:10:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.706+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-05T01:10:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.706+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-05T01:10:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.706+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94633418891392 notifier 5991 bl.length()=162 2024-09-05T01:10:05.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.710+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 from cache 2024-09-05T01:10:05.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.710+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4, ofs0, ns] 2024-09-05T01:10:05.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.710+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94633418908512 notifier 5991 bl.length()=219 2024-09-05T01:10:05.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.722+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 : miss 2024-09-05T01:10:05.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.722+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.722+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.722+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 info.flags=0x0 2024-09-05T01:10:05.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.722+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4 to cache LRU end 2024-09-05T01:10:05.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 : miss 2024-09-05T01:10:05.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 info.flags=0x17 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 to cache LRU end 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.726+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 2024-09-05T01:10:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo 2024-09-05T01:10:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56118f556ed8 s->prefetch_data=0 2024-09-05T01:10:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 10 manifest: total_size = 18874368 2024-09-05T01:10:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15236986691882653649 2024-09-05T01:10:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805d9c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x56118f556ed8 s->prefetch_data=0 2024-09-05T01:10:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f556ed8 2024-09-05T01:10:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.738+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11.10 2024-09-05T01:10:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:05.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15236986691882653649 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.1 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.2 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.3 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.4 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.742+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15236986691882653649 2024-09-05T01:10:05.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.746+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:05.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.746+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:05.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.746+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-05T01:10:05.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.750+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:05.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.750+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:05.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.750+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:05.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.750+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:05.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.750+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:05.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.754+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-05T01:10:05.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.754+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.754+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-05T01:10:05.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.754+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-05T01:10:05.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.754+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-05T01:10:05.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.758+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-05T01:10:05.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.758+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-05T01:10:05.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.758+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94633418889456 notifier 5991 bl.length()=191 2024-09-05T01:10:05.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.762+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 from cache 2024-09-05T01:10:05.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.762+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11, ofs0, ns] 2024-09-05T01:10:05.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.762+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94633418901600 notifier 5991 bl.length()=249 2024-09-05T01:10:05.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.770+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 : miss 2024-09-05T01:10:05.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.770+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.770+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.770+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 info.flags=0x0 2024-09-05T01:10:05.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.770+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11 to cache LRU end 2024-09-05T01:10:05.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.774+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 : miss 2024-09-05T01:10:05.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.774+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 info.flags=0x17 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 to cache LRU end 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.778+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5411b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56118f5521b8 s->prefetch_data=0 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 10 manifest: total_size = 74198 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16694781775375984546 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5411b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x56118f5521b8 s->prefetch_data=0 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f5521b8 2024-09-05T01:10:05.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.786+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12.10 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-05T01:10:05.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16694781775375984546 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.1 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.2 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.3 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.4 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.794+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16694781775375984546 2024-09-05T01:10:05.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:05.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:05.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo 2024-09-05T01:10:05.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:05.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:05.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:05.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:05.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.798+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:05.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.802+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-05T01:10:05.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.802+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.802+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-05T01:10:05.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.802+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-05T01:10:05.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.802+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-05T01:10:05.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.806+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-05T01:10:05.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.806+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-05T01:10:05.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.806+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 94633418893744 notifier 5991 bl.length()=198 2024-09-05T01:10:05.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.810+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 from cache 2024-09-05T01:10:05.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.810+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12, ofs0, ns] 2024-09-05T01:10:05.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.814+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94633418889456 notifier 5991 bl.length()=256 2024-09-05T01:10:05.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.822+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 : miss 2024-09-05T01:10:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.822+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.822+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.822+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 info.flags=0x0 2024-09-05T01:10:05.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.822+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12 to cache LRU end 2024-09-05T01:10:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 : miss 2024-09-05T01:10:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 info.flags=0x17 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 to cache LRU end 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.830+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 2024-09-05T01:10:05.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo[peZGa9k7QKpHnNro95wQIh98Gx7anap] 2024-09-05T01:10:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5bf6e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56118f54ffe8 s->prefetch_data=0 2024-09-05T01:10:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to hps05d7z7ie41ccu5pbibtq12xn226vl 2024-09-05T01:10:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 20 get_obj_state_impl: setting s->olh_tag to by9tgt52u60bmuawb71gxam0awrem3cz 2024-09-05T01:10:05.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.838+0000 7f7af1dff9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=by9tgt52u60bmuawb71gxam0awrem3cz 2024-09-05T01:10:05.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.842+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-05T01:10:05.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 olh_log_entry: epoch=3 op=3 key=foo[peZGa9k7QKpHnNro95wQIh98Gx7anap] 2024-09-05T01:10:05.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5bf6e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:peZGa9k7QKpHnNro95wQIh98Gx7anap_foo state=0x56118f555b48 s->prefetch_data=0 2024-09-05T01:10:05.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 10 manifest: total_size = 886297 2024-09-05T01:10:05.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.482269032258279181 2024-09-05T01:10:05.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5bf6e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:peZGa9k7QKpHnNro95wQIh98Gx7anap_foo state=0x56118f555b48 s->prefetch_data=0 2024-09-05T01:10:05.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555b48 2024-09-05T01:10:05.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.846+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-05T01:10:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.482269032258279181 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.1 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.2 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-05T01:10:05.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.3 2024-09-05T01:10:05.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-05T01:10:05.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.4 2024-09-05T01:10:05.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-05T01:10:05.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.850+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.482269032258279181 2024-09-05T01:10:05.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.854+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo[peZGa9k7QKpHnNro95wQIh98Gx7anap] 2024-09-05T01:10:05.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.858+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5bf6e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x56118f54ffe8 s->prefetch_data=0 2024-09-05T01:10:05.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.858+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.862+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10.10 2024-09-05T01:10:05.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.862+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:05.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.862+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:05.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.866+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:05.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.866+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:05.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.866+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:05.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.866+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:05.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.866+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:05.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-05T01:10:05.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-05T01:10:05.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-05T01:10:05.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-05T01:10:05.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-05T01:10:05.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.870+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-05T01:10:05.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.874+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94633418893744 notifier 5991 bl.length()=193 2024-09-05T01:10:05.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.878+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 from cache 2024-09-05T01:10:05.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.878+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10, ofs0, ns] 2024-09-05T01:10:05.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.878+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94633418910848 notifier 5991 bl.length()=251 2024-09-05T01:10:05.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.890+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 : miss 2024-09-05T01:10:05.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.890+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.890+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.890+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 info.flags=0x0 2024-09-05T01:10:05.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.890+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10 to cache LRU end 2024-09-05T01:10:05.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 : miss 2024-09-05T01:10:05.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 info.flags=0x17 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 to cache LRU end 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.894+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 2024-09-05T01:10:05.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.902+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo 2024-09-05T01:10:05.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.902+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2720 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56118f54feb8 s->prefetch_data=0 2024-09-05T01:10:05.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.906+0000 7f7af1dff9c0 10 manifest: total_size = 886297 2024-09-05T01:10:05.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.906+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10183154386455481755 2024-09-05T01:10:05.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.906+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2720 obj=test-client.0-r-test-multipart-simple.1:foo state=0x56118f54feb8 s->prefetch_data=0 2024-09-05T01:10:05.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.906+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54feb8 2024-09-05T01:10:05.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.906+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9.10 2024-09-05T01:10:05.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-05T01:10:05.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-05T01:10:05.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10183154386455481755 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.1 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-05T01:10:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.2 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.3 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.4 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.910+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10183154386455481755 2024-09-05T01:10:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-05T01:10:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:05.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.914+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:05.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.918+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-05T01:10:05.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.918+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.922+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-05T01:10:05.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.922+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-05T01:10:05.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.922+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-05T01:10:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.922+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-05T01:10:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.922+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-05T01:10:05.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.926+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94633418901600 notifier 5991 bl.length()=183 2024-09-05T01:10:05.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.930+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 from cache 2024-09-05T01:10:05.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.930+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9, ofs0, ns] 2024-09-05T01:10:05.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.930+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94633418901600 notifier 5991 bl.length()=240 2024-09-05T01:10:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.942+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 : miss 2024-09-05T01:10:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.942+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.942+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.942+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 info.flags=0x0 2024-09-05T01:10:05.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.942+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9 to cache LRU end 2024-09-05T01:10:05.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 : miss 2024-09-05T01:10:05.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 info.flags=0x17 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 to cache LRU end 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:05.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 2024-09-05T01:10:05.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.950+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-05T01:10:05.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.954+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-05T01:10:05.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.954+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-05T01:10:05.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-05T01:10:05.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-05T01:10:05.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-05T01:10:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-05T01:10:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-05T01:10:05.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-05T01:10:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-05T01:10:05.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.958+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-05T01:10:05.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-05T01:10:05.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5514b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 10 manifest: total_size = 22651 2024-09-05T01:10:05.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _fSQYzeyn46WkiuxXEpaBL4CfcKdKvOJ 2024-09-05T01:10:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5514b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:05.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.962+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.0 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _fSQYzeyn46WkiuxXEpaBL4CfcKdKvOJ 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.klgllJbceEG6UZp9ZuOzIHxLFmQLe68_0 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-05T01:10:05.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.966+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _fSQYzeyn46WkiuxXEpaBL4CfcKdKvOJ 2024-09-05T01:10:05.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.970+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-05T01:10:05.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.970+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5514b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.970+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:05.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.974+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _AwKWe1oh4MnuLKv844Why5PdIHYh-Vk 2024-09-05T01:10:05.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.974+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5514b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.974+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:05.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.974+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.2 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _AwKWe1oh4MnuLKv844Why5PdIHYh-Vk 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vnbgahXgd7pgErSuH6VhK5OLcR7SCMg_0 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _AwKWe1oh4MnuLKv844Why5PdIHYh-Vk 2024-09-05T01:10:05.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.978+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-05T01:10:05.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:05.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10088861936559393297 2024-09-05T01:10:05.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:05.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.982+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.3 2024-09-05T01:10:05.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10088861936559393297 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vQ7_nopfdghOLajorIzAcwQzuBpyRzR_0 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.986+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10088861936559393297 2024-09-05T01:10:05.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-05T01:10:05.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:05.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _nxQ89Z2yWKkCMv8jGFc7sUjEMOhaLgD 2024-09-05T01:10:05.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:05.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.990+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.5 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _nxQ89Z2yWKkCMv8jGFc7sUjEMOhaLgD 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.AvZ7ef-n-BvrobKs1iwbzyk-wP9CLgV_0 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-05T01:10:05.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:05.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.994+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _nxQ89Z2yWKkCMv8jGFc7sUjEMOhaLgD 2024-09-05T01:10:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-05T01:10:05.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:05.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _xlj2KJnOLsX8T8wsGDSULWgxQd2SwBT 2024-09-05T01:10:05.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:05.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:05.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:05.998+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.5 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _xlj2KJnOLsX8T8wsGDSULWgxQd2SwBT 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.uERGW9tqtbK3HFtIpi62yFF2YiIBdB9_0 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _xlj2KJnOLsX8T8wsGDSULWgxQd2SwBT 2024-09-05T01:10:06.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.006+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80a42b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f7af1dff9c0 10 manifest: total_size = 22651 2024-09-05T01:10:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4129416303264031892 2024-09-05T01:10:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80a42b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.5 2024-09-05T01:10:06.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.010+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4129416303264031892 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.o-Bv5CGcGcf4ZabBZA3f4-6AXBrk4F7_0 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.014+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4129416303264031892 2024-09-05T01:10:06.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-05T01:10:06.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae007af80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:06.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _E7VOEF4eiM0P8nzp0u8S0J9FSeCTfic 2024-09-05T01:10:06.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae007af80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.018+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.7 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _E7VOEF4eiM0P8nzp0u8S0J9FSeCTfic 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.KxXtmeSzhbft4NrbOIpgc1pDQIkj0BM_0 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _E7VOEF4eiM0P8nzp0u8S0J9FSeCTfic 2024-09-05T01:10:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.026+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-05T01:10:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11124631860956160393 2024-09-05T01:10:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.030+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.7 2024-09-05T01:10:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11124631860956160393 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.lMhwU9AOTraPxrYesThfzO--yxl2MLe_0 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.034+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11124631860956160393 2024-09-05T01:10:06.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2520 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 10 manifest: total_size = 22651 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6144351570603768781 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2520 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.038+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.7 2024-09-05T01:10:06.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6144351570603768781 2024-09-05T01:10:06.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.o-Bv5CGcGcf4ZabBZA3f4-6AXBrk4F7_0 2024-09-05T01:10:06.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-05T01:10:06.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6144351570603768781 2024-09-05T01:10:06.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-05T01:10:06.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:06.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9605514229856008163 2024-09-05T01:10:06.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.046+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.8 2024-09-05T01:10:06.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9605514229856008163 2024-09-05T01:10:06.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.lMhwU9AOTraPxrYesThfzO--yxl2MLe_0 2024-09-05T01:10:06.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-05T01:10:06.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9605514229856008163 2024-09-05T01:10:06.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.054+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80fafc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f7af1dff9c0 10 manifest: total_size = 22651 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _MSu-Unzofn7nt336uxLitAZwAUi4CSa 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80fafc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.058+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.8 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _MSu-Unzofn7nt336uxLitAZwAUi4CSa 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.hzr0GnFgDeIGSTvfv7rMzFTKkaRhd7f_0 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.062+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _MSu-Unzofn7nt336uxLitAZwAUi4CSa 2024-09-05T01:10:06.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-05T01:10:06.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 10 manifest: total_size = 5242880 2024-09-05T01:10:06.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13860053386438999487 2024-09-05T01:10:06.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x56118f54fda8 s->prefetch_data=0 2024-09-05T01:10:06.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54fda8 2024-09-05T01:10:06.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.066+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15.9 2024-09-05T01:10:06.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13860053386438999487 2024-09-05T01:10:06.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vQ7_nopfdghOLajorIzAcwQzuBpyRzR_0 2024-09-05T01:10:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-05T01:10:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.074+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13860053386438999487 2024-09-05T01:10:06.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-05T01:10:06.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.078+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.082+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-05T01:10:06.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.082+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.086+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-05T01:10:06.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.086+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-05T01:10:06.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.086+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-05T01:10:06.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.086+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-05T01:10:06.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.086+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-05T01:10:06.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.090+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94633418893744 notifier 5991 bl.length()=189 2024-09-05T01:10:06.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.094+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 from cache 2024-09-05T01:10:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.094+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15, ofs0, ns] 2024-09-05T01:10:06.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.094+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94633418910848 notifier 5991 bl.length()=247 2024-09-05T01:10:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.106+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 : miss 2024-09-05T01:10:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.106+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.106+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.106+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 info.flags=0x0 2024-09-05T01:10:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.106+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15 to cache LRU end 2024-09-05T01:10:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 : miss 2024-09-05T01:10:06.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 info.flags=0x17 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 to cache LRU end 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 2024-09-05T01:10:06.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.110+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-05T01:10:06.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.114+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-05T01:10:06.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.114+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-05T01:10:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.114+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-05T01:10:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.114+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-05T01:10:06.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.114+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-05T01:10:06.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-05T01:10:06.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-05T01:10:06.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-05T01:10:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-05T01:10:06.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-05T01:10:06.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.118+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-05T01:10:06.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c11a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 10 manifest: total_size = 45360 2024-09-05T01:10:06.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _C7n8HT4KMEgdqq8aDhNWRydjftKEmbN 2024-09-05T01:10:06.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c11a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.122+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.0 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _C7n8HT4KMEgdqq8aDhNWRydjftKEmbN 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.u1VUGUMcHKEcg8bPMnp1gZXTPeNYCZi_0 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.126+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _C7n8HT4KMEgdqq8aDhNWRydjftKEmbN 2024-09-05T01:10:06.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-05T01:10:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to __tt0u8oY0nfck3e2Grz9q5rIF8zqi2U 2024-09-05T01:10:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.130+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.2 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: __tt0u8oY0nfck3e2Grz9q5rIF8zqi2U 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.Hajri9YGaBLlmThwOmFQ7QftQRn-RNa_0 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.Hajri9YGaBLlmThwOmFQ7QftQRn-RNa_1 2024-09-05T01:10:06.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-05T01:10:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.134+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: __tt0u8oY0nfck3e2Grz9q5rIF8zqi2U 2024-09-05T01:10:06.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.138+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-05T01:10:06.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.138+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.142+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.142+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4475935799551089626 2024-09-05T01:10:06.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.142+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.142+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.142+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.3 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4475935799551089626 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.1 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.2 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.3 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.146+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4475935799551089626 2024-09-05T01:10:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54d190 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _5csROZQbFsooY8goYmTHHYIZPigE_Sd 2024-09-05T01:10:06.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54d190 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.5 2024-09-05T01:10:06.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.150+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-05T01:10:06.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5csROZQbFsooY8goYmTHHYIZPigE_Sd 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.fQPKGGwarp9B_PiPm42uq1bA6v8cvTW_0 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.fQPKGGwarp9B_PiPm42uq1bA6v8cvTW_1 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-05T01:10:06.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.154+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _5csROZQbFsooY8goYmTHHYIZPigE_Sd 2024-09-05T01:10:06.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-05T01:10:06.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _7rV3EEYip-dcMHoigWmc-s_RhWAPaIG 2024-09-05T01:10:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.158+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.5 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _7rV3EEYip-dcMHoigWmc-s_RhWAPaIG 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.YJ6_RLjl3ZAolBfUdkEuNuomLPh0E8B_0 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.YJ6_RLjl3ZAolBfUdkEuNuomLPh0E8B_1 2024-09-05T01:10:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-05T01:10:06.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _7rV3EEYip-dcMHoigWmc-s_RhWAPaIG 2024-09-05T01:10:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.166+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-05T01:10:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 10 manifest: total_size = 45360 2024-09-05T01:10:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5707781085993080936 2024-09-05T01:10:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.170+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.5 2024-09-05T01:10:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-05T01:10:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5707781085993080936 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.1 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.2 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.3 2024-09-05T01:10:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-05T01:10:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.174+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5707781085993080936 2024-09-05T01:10:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-05T01:10:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _-vo__BHAhNefio7ThU8x1_0VVtz_VcR 2024-09-05T01:10:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.178+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.7 2024-09-05T01:10:06.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _-vo__BHAhNefio7ThU8x1_0VVtz_VcR 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.nu1Yd8-rePnG34ntFq-LqFJyxK24nLy_0 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.nu1Yd8-rePnG34ntFq-LqFJyxK24nLy_1 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.186+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _-vo__BHAhNefio7ThU8x1_0VVtz_VcR 2024-09-05T01:10:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-05T01:10:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8287307433883874622 2024-09-05T01:10:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.190+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.7 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8287307433883874622 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.1 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.2 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.3 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.194+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8287307433883874622 2024-09-05T01:10:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-05T01:10:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae003be70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 10 manifest: total_size = 45360 2024-09-05T01:10:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13707966863178081194 2024-09-05T01:10:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae003be70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.198+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.7 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13707966863178081194 2024-09-05T01:10:06.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.1 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.2 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.3 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.206+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13707966863178081194 2024-09-05T01:10:06.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-05T01:10:06.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f551db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6222190009468008677 2024-09-05T01:10:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f551db0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.210+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.8 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6222190009468008677 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.1 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.2 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.3 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.214+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6222190009468008677 2024-09-05T01:10:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.218+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-05T01:10:06.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.218+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.222+0000 7f7af1dff9c0 10 manifest: total_size = 45360 2024-09-05T01:10:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.222+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to _4dzndw2vrvyMPlRSTjaTLmuuvDBvLN6 2024-09-05T01:10:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.222+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.222+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.222+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.8 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _4dzndw2vrvyMPlRSTjaTLmuuvDBvLN6 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.mTUJfUl8cWeL-A3iK48FvGc8E_Ev7H3_0 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-05T01:10:06.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.226+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _4dzndw2vrvyMPlRSTjaTLmuuvDBvLN6 2024-09-05T01:10:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-05T01:10:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17481851516998467727 2024-09-05T01:10:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x56118f555898 s->prefetch_data=0 2024-09-05T01:10:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f555898 2024-09-05T01:10:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.230+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16.9 2024-09-05T01:10:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17481851516998467727 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.1 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.2 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.3 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.238+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17481851516998467727 2024-09-05T01:10:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-05T01:10:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.242+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.246+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-05T01:10:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.246+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-05T01:10:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-05T01:10:06.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-05T01:10:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-05T01:10:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-05T01:10:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.250+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94633418896240 notifier 5991 bl.length()=199 2024-09-05T01:10:06.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.258+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 from cache 2024-09-05T01:10:06.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.258+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16, ofs0, ns] 2024-09-05T01:10:06.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.258+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94633418893744 notifier 5991 bl.length()=257 2024-09-05T01:10:06.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.270+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 : miss 2024-09-05T01:10:06.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.270+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.270+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.270+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 info.flags=0x0 2024-09-05T01:10:06.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.270+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16 to cache LRU end 2024-09-05T01:10:06.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 : miss 2024-09-05T01:10:06.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 info.flags=0x17 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 to cache LRU end 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.278+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 2024-09-05T01:10:06.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.282+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-05T01:10:06.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.282+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-05T01:10:06.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.286+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-05T01:10:06.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54dab0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12254539166388788464 2024-09-05T01:10:06.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54dab0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f55fed8 2024-09-05T01:10:06.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.290+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14.3 2024-09-05T01:10:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12254539166388788464 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.1 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.2 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-05T01:10:06.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.3 2024-09-05T01:10:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-05T01:10:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12254539166388788464 2024-09-05T01:10:06.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-05T01:10:06.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.298+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54aa20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.302+0000 7f7af1dff9c0 10 manifest: total_size = 1087 2024-09-05T01:10:06.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.302+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18000657430471178240 2024-09-05T01:10:06.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.302+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54aa20 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.302+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f55fed8 2024-09-05T01:10:06.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.302+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14.5 2024-09-05T01:10:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-05T01:10:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-05T01:10:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-05T01:10:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-05T01:10:06.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18000657430471178240 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.1 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.2 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.3 2024-09-05T01:10:06.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-05T01:10:06.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18000657430471178240 2024-09-05T01:10:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.306+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-05T01:10:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54ba50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 10 manifest: total_size = 11534336 2024-09-05T01:10:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3521803568740206760 2024-09-05T01:10:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54ba50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x56118f55fed8 s->prefetch_data=0 2024-09-05T01:10:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f55fed8 2024-09-05T01:10:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.310+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14.7 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3521803568740206760 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.1 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.2 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.3 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.314+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3521803568740206760 2024-09-05T01:10:06.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.318+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.318+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-05T01:10:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.318+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.322+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.322+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.322+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.322+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.322+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.326+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-05T01:10:06.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.326+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.326+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-05T01:10:06.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.326+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-05T01:10:06.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.326+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-05T01:10:06.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.330+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-05T01:10:06.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.330+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-05T01:10:06.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.330+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94633418904160 notifier 5991 bl.length()=194 2024-09-05T01:10:06.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.334+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 from cache 2024-09-05T01:10:06.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.334+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14, ofs0, ns] 2024-09-05T01:10:06.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.334+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94633418893744 notifier 5991 bl.length()=252 2024-09-05T01:10:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.346+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 : miss 2024-09-05T01:10:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.346+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.346+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.346+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 info.flags=0x0 2024-09-05T01:10:06.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.346+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14 to cache LRU end 2024-09-05T01:10:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 : miss 2024-09-05T01:10:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-05T01:10:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 info.flags=0x17 2024-09-05T01:10:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 to cache LRU end 2024-09-05T01:10:06.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.350+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 2024-09-05T01:10:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.354+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-05T01:10:06.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.358+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-05T01:10:06.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.358+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-05T01:10:06.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54d190 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 10 manifest: total_size = 10485760 2024-09-05T01:10:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16255708623802208783 2024-09-05T01:10:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f54d190 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f554b38 2024-09-05T01:10:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.362+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13.3 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16255708623802208783 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.tW6CEBVw07S3FvQ0CaSJimCQgoa8uJK_0 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.tW6CEBVw07S3FvQ0CaSJimCQgoa8uJK_1 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.370+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16255708623802208783 2024-09-05T01:10:06.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-05T01:10:06.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c26c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56118f55faa8 s->prefetch_data=0 2024-09-05T01:10:06.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 10 manifest: total_size = 649292 2024-09-05T01:10:06.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2170491625195277061 2024-09-05T01:10:06.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c26c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x56118f55faa8 s->prefetch_data=0 2024-09-05T01:10:06.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f55faa8 2024-09-05T01:10:06.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.374+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13.5 2024-09-05T01:10:06.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2170491625195277061 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.9AMjpInNsDmMTqTwhqkkjTSGYonF67m_0 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.378+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2170491625195277061 2024-09-05T01:10:06.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56118f55faa8 s->prefetch_data=0 2024-09-05T01:10:06.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-05T01:10:06.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 10 manifest: total_size = 10485760 2024-09-05T01:10:06.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2566247111333826164 2024-09-05T01:10:06.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x56118f55faa8 s->prefetch_data=0 2024-09-05T01:10:06.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f55faa8 2024-09-05T01:10:06.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.382+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13.7 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2566247111333826164 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.kT3Zm728dvhDTVXuPIxuGcC3UoJqgwr_0 2024-09-05T01:10:06.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-05T01:10:06.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.kT3Zm728dvhDTVXuPIxuGcC3UoJqgwr_1 2024-09-05T01:10:06.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-05T01:10:06.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.386+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2566247111333826164 2024-09-05T01:10:06.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.390+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-05T01:10:06.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.390+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.390+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.394+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.394+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.394+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.394+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.394+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.398+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-05T01:10:06.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.398+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.398+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-05T01:10:06.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.398+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-05T01:10:06.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.398+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-05T01:10:06.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.402+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-05T01:10:06.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.402+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-05T01:10:06.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.402+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94633418893744 notifier 5991 bl.length()=184 2024-09-05T01:10:06.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.410+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 from cache 2024-09-05T01:10:06.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.410+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13, ofs0, ns] 2024-09-05T01:10:06.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.410+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94633418889456 notifier 5991 bl.length()=242 2024-09-05T01:10:06.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.418+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 : miss 2024-09-05T01:10:06.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.418+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.418+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.418+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 info.flags=0x0 2024-09-05T01:10:06.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.418+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13 to cache LRU end 2024-09-05T01:10:06.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 : miss 2024-09-05T01:10:06.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-05T01:10:06.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 info.flags=0x17 2024-09-05T01:10:06.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 to cache LRU end 2024-09-05T01:10:06.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.426+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 2024-09-05T01:10:06.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.430+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got ___ 2024-09-05T01:10:06.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.430+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-05T01:10:06.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.434+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ 2024-09-05T01:10:06.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.434+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got obj 2024-09-05T01:10:06.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c1e30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 10 manifest: total_size = 0 2024-09-05T01:10:06.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5534985219422429808 2024-09-05T01:10:06.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c1e30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f554b38 2024-09-05T01:10:06.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.438+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6.2 2024-09-05T01:10:06.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.442+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c1e30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f7af1dff9c0 10 manifest: total_size = 0 2024-09-05T01:10:06.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2231518769082251461 2024-09-05T01:10:06.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c1e30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f554b38 2024-09-05T01:10:06.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6.3 2024-09-05T01:10:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.446+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-05T01:10:06.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 10 manifest: total_size = 0 2024-09-05T01:10:06.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15440488950167465941 2024-09-05T01:10:06.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f554b38 2024-09-05T01:10:06.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.450+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6.6 2024-09-05T01:10:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.454+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-05T01:10:06.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.454+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f7af1dff9c0 10 manifest: total_size = 0 2024-09-05T01:10:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13514838101537106318 2024-09-05T01:10:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80a4100 obj=test-client.0-r-test-small-obj-data.1:obj state=0x56118f554b38 s->prefetch_data=0 2024-09-05T01:10:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f554b38 2024-09-05T01:10:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6.8 2024-09-05T01:10:06.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.458+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-05T01:10:06.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.462+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.462+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=obj 2024-09-05T01:10:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.466+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.470+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-05T01:10:06.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.470+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-05T01:10:06.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-05T01:10:06.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-05T01:10:06.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-05T01:10:06.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-05T01:10:06.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.474+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94633418889456 notifier 5991 bl.length()=181 2024-09-05T01:10:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.482+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 from cache 2024-09-05T01:10:06.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.482+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6, ofs0, ns] 2024-09-05T01:10:06.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.482+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94633418889456 notifier 5991 bl.length()=238 2024-09-05T01:10:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.494+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 : miss 2024-09-05T01:10:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.494+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.494+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.494+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 info.flags=0x0 2024-09-05T01:10:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.494+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6 to cache LRU end 2024-09-05T01:10:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 : miss 2024-09-05T01:10:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-05T01:10:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 info.flags=0x17 2024-09-05T01:10:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 to cache LRU end 2024-09-05T01:10:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.498+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 2024-09-05T01:10:06.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.502+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got ___ 2024-09-05T01:10:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.502+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-05T01:10:06.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.506+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ 2024-09-05T01:10:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.506+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got obj 2024-09-05T01:10:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2230 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 10 manifest: total_size = 527 2024-09-05T01:10:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001367318395975513 2024-09-05T01:10:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2230 obj=test-client.0-r-test-small-obj-data.2:___ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54edb8 2024-09-05T01:10:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.510+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7.2 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001367318395975513 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.Pd4Mc0JzzNK7CEg-qiG19Y_-AjRcsu8_0 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.514+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001367318395975513 2024-09-05T01:10:06.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.518+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-05T01:10:06.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.518+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2230 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.522+0000 7f7af1dff9c0 10 manifest: total_size = 38 2024-09-05T01:10:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.522+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11575496361987943604 2024-09-05T01:10:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.522+0000 7f7af1dff9c0 20 get_obj_state: octx=0x56118f5c2230 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.522+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54edb8 2024-09-05T01:10:06.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.522+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7.3 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11575496361987943604 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.7k_WJ-uQ3IaHw3ik2LunTKTeTrHlYzs_0 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.526+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11575496361987943604 2024-09-05T01:10:06.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-05T01:10:06.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae003be70 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 10 manifest: total_size = 524288 2024-09-05T01:10:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5150567859213767056 2024-09-05T01:10:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae003be70 obj=test-client.0-r-test-small-obj-data.2:__ state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54edb8 2024-09-05T01:10:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.530+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7.6 2024-09-05T01:10:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5150567859213767056 2024-09-05T01:10:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.H6z-5Wy5gcUgIjOZpYv7RWrMNcg5yCu_0 2024-09-05T01:10:06.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:06.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.534+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5150567859213767056 2024-09-05T01:10:06.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.538+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-05T01:10:06.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.538+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.542+0000 7f7af1dff9c0 10 manifest: total_size = 2078 2024-09-05T01:10:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.542+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7578588400178707669 2024-09-05T01:10:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.542+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad80041f0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x56118f54edb8 s->prefetch_data=0 2024-09-05T01:10:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.542+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54edb8 2024-09-05T01:10:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.542+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7.8 2024-09-05T01:10:06.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7578588400178707669 2024-09-05T01:10:06.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.PsfIK4ef5eeYWDZxwzllg6JiE1JZTgD_0 2024-09-05T01:10:06.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:06.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.546+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7578588400178707669 2024-09-05T01:10:06.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=obj 2024-09-05T01:10:06.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.550+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.554+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-05T01:10:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.554+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-05T01:10:06.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-05T01:10:06.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-05T01:10:06.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-05T01:10:06.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-05T01:10:06.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.558+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94633418889456 notifier 5991 bl.length()=181 2024-09-05T01:10:06.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.566+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 from cache 2024-09-05T01:10:06.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.566+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7, ofs0, ns] 2024-09-05T01:10:06.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.566+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 94633418889456 notifier 5991 bl.length()=238 2024-09-05T01:10:06.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.578+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 : miss 2024-09-05T01:10:06.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.578+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.578+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.578+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 info.flags=0x0 2024-09-05T01:10:06.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.578+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7 to cache LRU end 2024-09-05T01:10:06.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 : miss 2024-09-05T01:10:06.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 info.flags=0x17 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 to cache LRU end 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T01:10:06.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.582+0000 7f7af1dff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 2024-09-05T01:10:06.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.586+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got ___ 2024-09-05T01:10:06.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.586+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-05T01:10:06.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.586+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got __ 2024-09-05T01:10:06.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.590+0000 7f7af1dff9c0 10 cls_bucket_list_unordered: got obj 2024-09-05T01:10:06.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80c1840 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 10 manifest: total_size = 1035 2024-09-05T01:10:06.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15444068161255193630 2024-09-05T01:10:06.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae80c1840 obj=test-client.0-r-test-small-obj-data.3:___ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54ebd8 2024-09-05T01:10:06.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.594+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8.2 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15444068161255193630 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.HcEErA8zVxxaw0mC4brunZgWWcObrHl_0 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.598+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15444068161255193630 2024-09-05T01:10:06.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.602+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-05T01:10:06.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.602+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae0024980 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.602+0000 7f7af1dff9c0 10 manifest: total_size = 55 2024-09-05T01:10:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.602+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12344406964333775863 2024-09-05T01:10:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.606+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae0024980 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.606+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54ebd8 2024-09-05T01:10:06.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.606+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8.3 2024-09-05T01:10:06.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12344406964333775863 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.wcv1C3q03KgAXnoymr0DcpeJPG10cEN_0 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.610+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12344406964333775863 2024-09-05T01:10:06.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-05T01:10:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 10 manifest: total_size = 55 2024-09-05T01:10:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7136433473784685290 2024-09-05T01:10:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ad805a0e0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54ebd8 2024-09-05T01:10:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.614+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8.6 2024-09-05T01:10:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7136433473784685290 2024-09-05T01:10:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.zCQ4Ib0AMnmtb7Sqfm3vs5kgR45m0O7_0 2024-09-05T01:10:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-05T01:10:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.618+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7136433473784685290 2024-09-05T01:10:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f79ce7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-05T01:10:06.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae0024980 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 10 manifest: total_size = 4134 2024-09-05T01:10:06.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13355130790663199936 2024-09-05T01:10:06.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 20 get_obj_state: octx=0x7f7ae0024980 obj=test-client.0-r-test-small-obj-data.3:obj state=0x56118f54ebd8 s->prefetch_data=0 2024-09-05T01:10:06.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 20 prepare_atomic_modification: state is not atomic. state=0x56118f54ebd8 2024-09-05T01:10:06.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.622+0000 7f7af1dff9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8.8 2024-09-05T01:10:06.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13355130790663199936 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.UF89HM9M-3agaPvbJS4FuGJkbi-8q9N_0 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-05T01:10:06.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.630+0000 7f7af1dff9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13355130790663199936 2024-09-05T01:10:06.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f79ceffd640 20 handle_completion(): completion ok for obj=obj 2024-09-05T01:10:06.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 20 list_objects_ordered: starting attempt 1 2024-09-05T01:10:06.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-05T01:10:06.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-05T01:10:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-05T01:10:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-05T01:10:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-05T01:10:06.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.634+0000 7f7af1dff9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8])"; uploads.size()=0; is_truncated=0 2024-09-05T01:10:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.642+0000 7f7af1dff9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-05T01:10:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.642+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.642+0000 7f7af1dff9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-05T01:10:06.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.642+0000 7f7af1dff9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-05T01:10:06.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.642+0000 7f7af1dff9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-05T01:10:06.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.646+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-05T01:10:06.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.646+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-05T01:10:06.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.646+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94633418889456 notifier 5991 bl.length()=181 2024-09-05T01:10:06.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.650+0000 7f7af1dff9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 from cache 2024-09-05T01:10:06.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.650+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8, ofs0, ns] 2024-09-05T01:10:06.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.654+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 94633418889456 notifier 5991 bl.length()=238 2024-09-05T01:10:06.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.662+0000 7f7af1dff9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 : miss 2024-09-05T01:10:06.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.662+0000 7f7af1dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.662+0000 7f7af1dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.662+0000 7f7af1dff9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 info.flags=0x0 2024-09-05T01:10:06.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.662+0000 7f7af1dff9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8 to cache LRU end 2024-09-05T01:10:06.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.666+0000 7f7af1dff9c0 10 removing key index: ONNFJOWSJOFGZSXENWMA 2024-09-05T01:10:06.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.670+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:ONNFJOWSJOFGZSXENWMA, ofs0, ns] 2024-09-05T01:10:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.670+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94633418889456 notifier 5991 bl.length()=170 2024-09-05T01:10:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.674+0000 7f7af1dff9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-05T01:10:06.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.678+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-05T01:10:06.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.678+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94633418893744 notifier 5991 bl.length()=182 2024-09-05T01:10:06.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.682+0000 7f7af1dff9c0 10 removing user buckets index 2024-09-05T01:10:06.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.682+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-05T01:10:06.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.686+0000 7f79ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94633418904160 notifier 5991 bl.length()=173 2024-09-05T01:10:06.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.686+0000 7f7af1dff9c0 10 removing user index: ragweed.client.0 2024-09-05T01:10:06.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.690+0000 7f7af1dff9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-05T01:10:06.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.690+0000 7f7af1dff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-05T01:10:06.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.690+0000 7f79ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94633418901600 notifier 5991 bl.length()=165 2024-09-05T01:10:06.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.702+0000 7f79a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:10:06.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.706+0000 7f7af1dff9c0 20 remove_watcher() i=0 2024-09-05T01:10:06.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.706+0000 7f7af1dff9c0 2 removed watcher, disabling cache 2024-09-05T01:10:06.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.710+0000 7f7af1dff9c0 20 remove_watcher() i=1 2024-09-05T01:10:06.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.714+0000 7f7af1dff9c0 20 remove_watcher() i=2 2024-09-05T01:10:06.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.714+0000 7f7af1dff9c0 20 remove_watcher() i=3 2024-09-05T01:10:06.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.718+0000 7f7af1dff9c0 20 remove_watcher() i=4 2024-09-05T01:10:06.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.718+0000 7f7af1dff9c0 20 remove_watcher() i=5 2024-09-05T01:10:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.722+0000 7f7af1dff9c0 20 remove_watcher() i=6 2024-09-05T01:10:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.722+0000 7f7af1dff9c0 20 remove_watcher() i=7 2024-09-05T01:10:06.741 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-05T01:10:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:10:06.822 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:10:06.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.866+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 realm 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:10:06.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:10:06.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.870+0000 7f8de84899c0 20 searching for the correct realm 2024-09-05T01:10:06.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.874+0000 7f8de6790640 0 -- 172.21.15.99:0/3919105144 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8ddc008070 msgr2=0x7f8ddc0635e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:10:06.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.886+0000 7f8de6790640 0 -- 172.21.15.99:0/3919105144 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8cb0080880 msgr2=0x7f8cb0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.890+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 zone default found 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 4 Realm: () 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:10:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:10:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:10:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 zonegroup default 2024-09-05T01:10:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:10:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 started sync module instance, tier type = 2024-09-05T01:10:06.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.894+0000 7f8de84899c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:10:06.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=0 2024-09-05T01:10:06.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=1 2024-09-05T01:10:06.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=2 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=3 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=4 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=5 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=6 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 20 add_watcher() i=7 2024-09-05T01:10:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.910+0000 7f8de84899c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:10:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.914+0000 7f8c977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:10:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.914+0000 7f8de84899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:10:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.914+0000 7f8de84899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:10:06.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8c967fc640 20 reqs_thread_entry: start 2024-09-05T01:10:06.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 20 init_complete bucket index max shards: 11 2024-09-05T01:10:06.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 20 Filter name: none 2024-09-05T01:10:06.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8c07fff640 20 reqs_thread_entry: start 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 20 rados->read ofs=0 len=0 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-05T01:10:06.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:10:06.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.994+0000 7f8de84899c0 10 removing key index: YOJWLIINFFMCGGNBCHHV 2024-09-05T01:10:06.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.998+0000 7f8de84899c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:YOJWLIINFFMCGGNBCHHV, ofs0, ns] 2024-09-05T01:10:06.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:06.998+0000 7f8cc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 94479578987584 notifier 6009 bl.length()=170 2024-09-05T01:10:06.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.002+0000 7f8de84899c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-05T01:10:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.002+0000 7f8de84899c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-05T01:10:07.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.006+0000 7f8cc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94479578987584 notifier 6009 bl.length()=182 2024-09-05T01:10:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.006+0000 7f8de84899c0 10 removing user buckets index 2024-09-05T01:10:07.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.010+0000 7f8de84899c0 10 removing user index: sysuser.client.0 2024-09-05T01:10:07.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.010+0000 7f8de84899c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-05T01:10:07.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.010+0000 7f8de84899c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-05T01:10:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.010+0000 7f8cc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94479578996928 notifier 6009 bl.length()=165 2024-09-05T01:10:07.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.014+0000 7f8c977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:10:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.018+0000 7f8de84899c0 20 remove_watcher() i=0 2024-09-05T01:10:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.018+0000 7f8de84899c0 2 removed watcher, disabling cache 2024-09-05T01:10:07.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.022+0000 7f8de84899c0 20 remove_watcher() i=1 2024-09-05T01:10:07.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.026+0000 7f8de84899c0 20 remove_watcher() i=2 2024-09-05T01:10:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.026+0000 7f8de84899c0 20 remove_watcher() i=3 2024-09-05T01:10:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.030+0000 7f8de84899c0 20 remove_watcher() i=4 2024-09-05T01:10:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.030+0000 7f8de84899c0 20 remove_watcher() i=5 2024-09-05T01:10:07.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.030+0000 7f8de84899c0 20 remove_watcher() i=6 2024-09-05T01:10:07.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:10:07.034+0000 7f8de84899c0 20 remove_watcher() i=7 2024-09-05T01:10:07.045 INFO:tasks.ragweed:Removing ragweed... 2024-09-05T01:10:07.045 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-05T01:10:07.138 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T01:10:07.150 INFO:tasks.workunit:Pulling workunits from ref ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T01:10:07.150 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T01:10:07.150 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:10:07.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:10:07.157 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-05T01:10:07.158 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:10:07.203 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-05T01:10:07.203 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-05T01:10:07.251 INFO:tasks.workunit:timeout=3h 2024-09-05T01:10:07.251 INFO:tasks.workunit:cleanup=True 2024-09-05T01:10:07.252 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T01:10:07.301 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T01:11:04.422 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'ede1507024117d16395cd6d958c594ff4aaf4da5'. 2024-09-05T01:11:04.423 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.423 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T01:11:04.423 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T01:11:04.423 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T01:11:04.423 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at ede15070241 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-09-05T01:11:04.429 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T01:11:04.476 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T01:11:04.479 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:11:04.479 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T01:11:04.535 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T01:11:04.589 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T01:11:04.634 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:11:04.635 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:11:04.635 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T01:11:04.680 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:11:04.683 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:11:04.684 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T01:11:04.736 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-05T01:11:04.737 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-05T01:11:04.737 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-05T01:11:04.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ ulimit -c 0 2024-09-05T01:11:04.788 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-05T01:11:04.789 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T01:11:04.789 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T01:11:07.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-09-05T01:11:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T01:11:07.746 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-09-05T01:11:08.141 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-05T01:11:08.338 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-09-05T01:11:08.344 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-05T01:11:08.381 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-09-05T01:11:08.382 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-09-05T01:11:08.382 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-09-05T01:11:08.664 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-09-05T01:11:08.670 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-09-05T01:11:09.660 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.2 2024-09-05T01:11:09.731 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install boto3 2024-09-05T01:11:10.719 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-09-05T01:11:10.720 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached boto3-1.35.12-py3-none-any.whl.metadata (6.6 kB) 2024-09-05T01:11:11.221 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.36.0,>=1.35.12 (from boto3) 2024-09-05T01:11:11.222 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached botocore-1.35.12-py3-none-any.whl.metadata (5.7 kB) 2024-09-05T01:11:11.279 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-05T01:11:11.280 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-05T01:11:11.328 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-05T01:11:11.329 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-05T01:11:11.392 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:11:11.393 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-05T01:11:11.534 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:11:11.536 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-05T01:11:11.675 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T01:11:11.677 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-05T01:11:11.681 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached boto3-1.35.12-py3-none-any.whl (139 kB) 2024-09-05T01:11:11.682 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached botocore-1.35.12-py3-none-any.whl (12.5 MB) 2024-09-05T01:11:11.694 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-05T01:11:11.695 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-05T01:11:11.697 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-05T01:11:11.698 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-05T01:11:11.700 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-05T01:11:11.772 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-05T01:11:13.098 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.35.12 botocore-1.35.12 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-05T01:11:13.277 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-05T01:11:13.413 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-05T01:11:13.451 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:13.451 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:13.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 realm 2024-09-05T01:11:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:13.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.496+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.500+0000 7f054c6419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:13.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.500+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.500+0000 7f054c6419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:13.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.500+0000 7f054c6419c0 20 searching for the correct realm 2024-09-05T01:11:13.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.504+0000 7f0549946640 0 -- 172.21.15.99:0/2070875589 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x555601137fb0 msgr2=0x55560113a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:13.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.512+0000 7f0549946640 0 -- 172.21.15.99:0/2070875589 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f0414080ad0 msgr2=0x7f0414082f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.516+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:13.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 zone default found 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 4 Realm: () 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 zonegroup default 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 started sync module instance, tier type = 2024-09-05T01:11:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.520+0000 7f054c6419c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=0 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=1 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=2 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=3 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=4 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=5 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=6 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 20 add_watcher() i=7 2024-09-05T01:11:13.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.536+0000 7f054c6419c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:13.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f0400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 5 note: GC not initialized 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f037b7fe640 20 reqs_thread_entry: start 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 Filter name: none 2024-09-05T01:11:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f03797fa640 20 reqs_thread_entry: start 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-05T01:11:13.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-05T01:11:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-05T01:11:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-05T01:11:13.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.540+0000 7f054c6419c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f054c6419c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f054c6419c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f054c6419c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f042dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 93827873682352 notifier 6027 bl.length()=569 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f042dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-05T01:11:13.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.544+0000 7f042dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f054c6419c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f054c6419c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f054c6419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f042d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 93827873678096 notifier 6027 bl.length()=180 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f042d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-05T01:11:13.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f042d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-05T01:11:13.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.548+0000 7f0400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:13.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.552+0000 7f054c6419c0 20 remove_watcher() i=0 2024-09-05T01:11:13.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.552+0000 7f054c6419c0 2 removed watcher, disabling cache 2024-09-05T01:11:13.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.556+0000 7f054c6419c0 20 remove_watcher() i=1 2024-09-05T01:11:13.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.556+0000 7f054c6419c0 20 remove_watcher() i=2 2024-09-05T01:11:13.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.560+0000 7f054c6419c0 20 remove_watcher() i=3 2024-09-05T01:11:13.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.560+0000 7f054c6419c0 20 remove_watcher() i=4 2024-09-05T01:11:13.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.564+0000 7f054c6419c0 20 remove_watcher() i=5 2024-09-05T01:11:13.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.564+0000 7f054c6419c0 20 remove_watcher() i=6 2024-09-05T01:11:13.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:13.564+0000 7f054c6419c0 20 remove_watcher() i=7 2024-09-05T01:11:14.220 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard add 2024-09-05T01:11:14.220 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:14.221 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:11:14.252 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:14.253 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:14.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.300+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 realm 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:14.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:14.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.304+0000 7f8e2b1719c0 20 searching for the correct realm 2024-09-05T01:11:14.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.312+0000 7f8e29478640 0 -- 172.21.15.99:0/1717140359 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55f573a03d70 msgr2=0x55f573a06230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:14.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.320+0000 7f8e28c77640 0 -- 172.21.15.99:0/1717140359 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f8e20010440 msgr2=0x7f8e200108a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:14.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.324+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 zone default found 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 4 Realm: () 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 zonegroup default 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 started sync module instance, tier type = 2024-09-05T01:11:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.328+0000 7f8e2b1719c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:14.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=0 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=1 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=2 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=3 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=4 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=5 2024-09-05T01:11:14.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=6 2024-09-05T01:11:14.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 20 add_watcher() i=7 2024-09-05T01:11:14.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.344+0000 7f8e2b1719c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:14.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8cdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 5 note: GC not initialized 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8cddfe3640 20 reqs_thread_entry: start 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 20 Filter name: none 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8c4f7fe640 20 reqs_thread_entry: start 2024-09-05T01:11:14.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.348+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:14.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:14.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:14.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:14.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:14.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.352+0000 7f8e2b1719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:14.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.356+0000 7f8cdefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.360+0000 7f8e2b1719c0 20 remove_watcher() i=0 2024-09-05T01:11:14.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.360+0000 7f8e2b1719c0 2 removed watcher, disabling cache 2024-09-05T01:11:14.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.364+0000 7f8e2b1719c0 20 remove_watcher() i=1 2024-09-05T01:11:14.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.364+0000 7f8e2b1719c0 20 remove_watcher() i=2 2024-09-05T01:11:14.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.368+0000 7f8e2b1719c0 20 remove_watcher() i=3 2024-09-05T01:11:14.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.368+0000 7f8e2b1719c0 20 remove_watcher() i=4 2024-09-05T01:11:14.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.372+0000 7f8e2b1719c0 20 remove_watcher() i=5 2024-09-05T01:11:14.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.372+0000 7f8e2b1719c0 20 remove_watcher() i=6 2024-09-05T01:11:14.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.372+0000 7f8e2b1719c0 20 remove_watcher() i=7 2024-09-05T01:11:14.384 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:14.384 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:14.384 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-05T01:11:14.384 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:14.384 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-05T01:11:14.413 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:14.414 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:14.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 realm 2024-09-05T01:11:14.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:14.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.460+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.464+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.464+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.464+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:14.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.464+0000 7f9a0f76d9c0 20 searching for the correct realm 2024-09-05T01:11:14.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.472+0000 7f9a0da74640 0 -- 172.21.15.99:0/3071333322 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55b6e268cf70 msgr2=0x55b6e268f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.480+0000 7f9a0ca72640 0 -- 172.21.15.99:0/3071333322 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x55b6e2694a20 msgr2=0x55b6e2696e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 zone default found 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 4 Realm: () 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:14.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 zonegroup default 2024-09-05T01:11:14.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 started sync module instance, tier type = 2024-09-05T01:11:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.484+0000 7f9a0f76d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:14.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=0 2024-09-05T01:11:14.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=1 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=2 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=3 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=4 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=5 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=6 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 20 add_watcher() i=7 2024-09-05T01:11:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.500+0000 7f9a0f76d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:14.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f98c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 5 note: GC not initialized 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f98c2fe5640 20 reqs_thread_entry: start 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 Filter name: none 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f98c0fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:11:14.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:14.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:11:14.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.504+0000 7f9a0f76d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:11:14.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:11:14.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:14.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:14.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:14.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:14.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:14.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.508+0000 7f9a0f76d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:14.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.512+0000 7f98c3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.516+0000 7f9a0f76d9c0 20 remove_watcher() i=0 2024-09-05T01:11:14.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.516+0000 7f9a0f76d9c0 2 removed watcher, disabling cache 2024-09-05T01:11:14.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.516+0000 7f9a0f76d9c0 20 remove_watcher() i=1 2024-09-05T01:11:14.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.520+0000 7f9a0f76d9c0 20 remove_watcher() i=2 2024-09-05T01:11:14.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.520+0000 7f9a0f76d9c0 20 remove_watcher() i=3 2024-09-05T01:11:14.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.524+0000 7f9a0f76d9c0 20 remove_watcher() i=4 2024-09-05T01:11:14.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.524+0000 7f9a0f76d9c0 20 remove_watcher() i=5 2024-09-05T01:11:14.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.524+0000 7f9a0f76d9c0 20 remove_watcher() i=6 2024-09-05T01:11:14.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.528+0000 7f9a0f76d9c0 20 remove_watcher() i=7 2024-09-05T01:11:14.537 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard list 2024-09-05T01:11:14.561 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:14.561 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:14.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 realm 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.608+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:14.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.612+0000 7fe13f6419c0 20 searching for the correct realm 2024-09-05T01:11:14.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.616+0000 7fe13d147640 0 -- 172.21.15.99:0/942079825 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fe138018040 msgr2=0x7fe13805fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.624+0000 7fe13d147640 0 -- 172.21.15.99:0/942079825 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fe1380613f0 msgr2=0x7fe138067ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:14.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 zone default found 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 4 Realm: () 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 zonegroup default 2024-09-05T01:11:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.632+0000 7fe13f6419c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.636+0000 7fe13f6419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.636+0000 7fe13f6419c0 20 started sync module instance, tier type = 2024-09-05T01:11:14.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.636+0000 7fe13f6419c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:14.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=0 2024-09-05T01:11:14.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=1 2024-09-05T01:11:14.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=2 2024-09-05T01:11:14.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=3 2024-09-05T01:11:14.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=4 2024-09-05T01:11:14.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=5 2024-09-05T01:11:14.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.648+0000 7fe13f6419c0 20 add_watcher() i=6 2024-09-05T01:11:14.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 20 add_watcher() i=7 2024-09-05T01:11:14.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:14.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fdff3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 5 note: GC not initialized 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fdff2fe5640 20 reqs_thread_entry: start 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fe13f6419c0 20 Filter name: none 2024-09-05T01:11:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.652+0000 7fdff0fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:14.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.664+0000 7fdff3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:14.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.668+0000 7fe13f6419c0 20 remove_watcher() i=0 2024-09-05T01:11:14.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.668+0000 7fe13f6419c0 2 removed watcher, disabling cache 2024-09-05T01:11:14.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.672+0000 7fe13f6419c0 20 remove_watcher() i=1 2024-09-05T01:11:14.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.672+0000 7fe13f6419c0 20 remove_watcher() i=2 2024-09-05T01:11:14.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.676+0000 7fe13f6419c0 20 remove_watcher() i=3 2024-09-05T01:11:14.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.676+0000 7fe13f6419c0 20 remove_watcher() i=4 2024-09-05T01:11:14.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.676+0000 7fe13f6419c0 20 remove_watcher() i=5 2024-09-05T01:11:14.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.680+0000 7fe13f6419c0 20 remove_watcher() i=6 2024-09-05T01:11:14.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.680+0000 7fe13f6419c0 20 remove_watcher() i=7 2024-09-05T01:11:14.695 INFO:tasks.workunit.client.0.smithi099.stderr:bucket name a-bucket 2024-09-05T01:11:14.695 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard process 2024-09-05T01:11:14.695 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:14.695 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard process 2024-09-05T01:11:14.715 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:14.715 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:14.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.760+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 realm 2024-09-05T01:11:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:14.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.764+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.768+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:14.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.768+0000 7fd6020029c0 20 searching for the correct realm 2024-09-05T01:11:14.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.772+0000 7fd600309640 0 -- 172.21.15.99:0/526915639 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd5f40de040 msgr2=0x7fd5f40de420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:14.988+0000 7fd600309640 0 -- 172.21.15.99:0/526915639 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd5f40de040 msgr2=0x7fd5f40de420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:14.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:14.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:14.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.000+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:14.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:14.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 20 zone default found 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 4 Realm: () 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:15.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:15.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.004+0000 7fd6020029c0 20 zonegroup default 2024-09-05T01:11:15.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:15.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:15.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:15.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 started sync module instance, tier type = 2024-09-05T01:11:15.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.008+0000 7fd6020029c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:15.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=0 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=1 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=2 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=3 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=4 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=5 2024-09-05T01:11:15.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=6 2024-09-05T01:11:15.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 20 add_watcher() i=7 2024-09-05T01:11:15.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.032+0000 7fd6020029c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:15.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:15.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd6020029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:15.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd6020029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:15.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd6020029c0 5 note: GC not initialized 2024-09-05T01:11:15.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd4b4fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:15.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd6020029c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:15.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.036+0000 7fd6020029c0 20 Filter name: none 2024-09-05T01:11:15.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.040+0000 7fd42e7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:15.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.040+0000 7fd6020029c0 20 processing logshard = reshard.0000000000 2024-09-05T01:11:15.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.044+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-05T01:11:15.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.044+0000 7fd6020029c0 20 processing logshard = reshard.0000000001 2024-09-05T01:11:15.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.048+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-05T01:11:15.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.048+0000 7fd6020029c0 20 processing logshard = reshard.0000000002 2024-09-05T01:11:15.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.052+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-05T01:11:15.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.052+0000 7fd6020029c0 20 processing logshard = reshard.0000000003 2024-09-05T01:11:15.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.060+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-05T01:11:15.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.060+0000 7fd6020029c0 20 processing logshard = reshard.0000000004 2024-09-05T01:11:15.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.064+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-05T01:11:15.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.064+0000 7fd6020029c0 20 processing logshard = reshard.0000000005 2024-09-05T01:11:15.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.068+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-05T01:11:15.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.068+0000 7fd6020029c0 20 processing logshard = reshard.0000000006 2024-09-05T01:11:15.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.072+0000 7fd6020029c0 20 process_entry resharding a-bucket 2024-09-05T01:11:15.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.072+0000 7fd6020029c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:11:15.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.072+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-05T01:11:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:11:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:11:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:15.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:15.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:15.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.076+0000 7fd6020029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:15.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd6020029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd6020029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd6020029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd6020029c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd4deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94789688259968 notifier 5792 bl.length()=827 2024-09-05T01:11:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd4deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd4deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.088+0000 7fd4deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.092+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:15.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.092+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:15.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.092+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:15.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.092+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:15.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:15.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:15.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:15.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:15.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.0 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.104+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.108+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.4 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.108+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.5 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.108+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.6 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.108+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.7 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.108+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.8 2024-09-05T01:11:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.112+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.9 2024-09-05T01:11:15.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.112+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.10 2024-09-05T01:11:15.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.112+0000 7fd6020029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:15.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.112+0000 7fd6020029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:15.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd6020029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd6020029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd6020029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd6020029c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:15.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd4deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94789688259968 notifier 5792 bl.length()=827 2024-09-05T01:11:15.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd4deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd4deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.116+0000 7fd4deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.120+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:15.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.120+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:15.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.120+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:15.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.120+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:15.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.124+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.0 2024-09-05T01:11:15.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.124+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1 2024-09-05T01:11:15.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.124+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2 2024-09-05T01:11:15.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.124+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3 2024-09-05T01:11:15.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.124+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.4 2024-09-05T01:11:15.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.5 2024-09-05T01:11:15.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.6 2024-09-05T01:11:15.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.7 2024-09-05T01:11:15.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.8 2024-09-05T01:11:15.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.9 2024-09-05T01:11:15.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.10 2024-09-05T01:11:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.128+0000 7fd6020029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd6020029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd6020029c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd6020029c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd6020029c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:15.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd4de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94789688259968 notifier 5792 bl.length()=795 2024-09-05T01:11:15.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd4de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:15.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd4de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:15.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.132+0000 7fd4de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:15.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.136+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:15.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.136+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:15.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.136+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:15.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.136+0000 7fd6020029c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:15.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.140+0000 7fd6020029c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-05T01:11:15.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.144+0000 7fd6020029c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-05T01:11:15.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.148+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-05T01:11:15.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.148+0000 7fd6020029c0 20 processing logshard = reshard.0000000007 2024-09-05T01:11:15.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.156+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-05T01:11:15.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.156+0000 7fd6020029c0 20 processing logshard = reshard.0000000008 2024-09-05T01:11:15.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.160+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-05T01:11:15.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.160+0000 7fd6020029c0 20 processing logshard = reshard.0000000009 2024-09-05T01:11:15.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.168+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-05T01:11:15.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.168+0000 7fd6020029c0 20 processing logshard = reshard.0000000010 2024-09-05T01:11:15.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.172+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-05T01:11:15.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.172+0000 7fd6020029c0 20 processing logshard = reshard.0000000011 2024-09-05T01:11:15.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.176+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-05T01:11:15.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.176+0000 7fd6020029c0 20 processing logshard = reshard.0000000012 2024-09-05T01:11:15.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.184+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-05T01:11:15.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.184+0000 7fd6020029c0 20 processing logshard = reshard.0000000013 2024-09-05T01:11:15.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.188+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-05T01:11:15.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.188+0000 7fd6020029c0 20 processing logshard = reshard.0000000014 2024-09-05T01:11:15.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.192+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-05T01:11:15.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.192+0000 7fd6020029c0 20 processing logshard = reshard.0000000015 2024-09-05T01:11:15.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.200+0000 7fd6020029c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-05T01:11:15.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.200+0000 7fd4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:15.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.204+0000 7fd6020029c0 20 remove_watcher() i=0 2024-09-05T01:11:15.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.204+0000 7fd6020029c0 2 removed watcher, disabling cache 2024-09-05T01:11:15.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.208+0000 7fd6020029c0 20 remove_watcher() i=1 2024-09-05T01:11:15.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.208+0000 7fd6020029c0 20 remove_watcher() i=2 2024-09-05T01:11:15.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.212+0000 7fd6020029c0 20 remove_watcher() i=3 2024-09-05T01:11:15.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.216+0000 7fd6020029c0 20 remove_watcher() i=4 2024-09-05T01:11:15.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.216+0000 7fd6020029c0 20 remove_watcher() i=5 2024-09-05T01:11:15.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.220+0000 7fd6020029c0 20 remove_watcher() i=6 2024-09-05T01:11:15.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:15.220+0000 7fd6020029c0 20 remove_watcher() i=7 2024-09-05T01:11:20.240 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:11:20.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:20.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:20.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.319+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 realm 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:20.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:20.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.323+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.327+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:20.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.327+0000 7fa7d721d9c0 20 searching for the correct realm 2024-09-05T01:11:20.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.331+0000 7fa7d5524640 0 -- 172.21.15.99:0/2444036143 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55ebc49631d0 msgr2=0x55ebc4965670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:20.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.339+0000 7fa7cffff640 0 -- 172.21.15.99:0/2444036143 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55ebc49569a0 msgr2=0x55ebc4958e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:20.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:20.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:20.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 zone default found 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 4 Realm: () 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 zonegroup default 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 started sync module instance, tier type = 2024-09-05T01:11:20.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.347+0000 7fa7d721d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=0 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=1 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=2 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=3 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=4 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=5 2024-09-05T01:11:20.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.363+0000 7fa7d721d9c0 20 add_watcher() i=6 2024-09-05T01:11:20.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 add_watcher() i=7 2024-09-05T01:11:20.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:20.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:20.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:20.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 5 note: GC not initialized 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa689fe3640 20 reqs_thread_entry: start 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 Filter name: none 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa5fb7fe640 20 reqs_thread_entry: start 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.367+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:20.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:20.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:20.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:20.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:20.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:20.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.371+0000 7fa7d721d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:20.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.375+0000 7fa68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:20.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.379+0000 7fa7d721d9c0 20 remove_watcher() i=0 2024-09-05T01:11:20.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.379+0000 7fa7d721d9c0 2 removed watcher, disabling cache 2024-09-05T01:11:20.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.383+0000 7fa7d721d9c0 20 remove_watcher() i=1 2024-09-05T01:11:20.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.383+0000 7fa7d721d9c0 20 remove_watcher() i=2 2024-09-05T01:11:20.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.387+0000 7fa7d721d9c0 20 remove_watcher() i=3 2024-09-05T01:11:20.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.387+0000 7fa7d721d9c0 20 remove_watcher() i=4 2024-09-05T01:11:20.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.391+0000 7fa7d721d9c0 20 remove_watcher() i=5 2024-09-05T01:11:20.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.391+0000 7fa7d721d9c0 20 remove_watcher() i=6 2024-09-05T01:11:20.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:20.391+0000 7fa7d721d9c0 20 remove_watcher() i=7 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard add non empty bucket 2024-09-05T01:11:20.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:21.074 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:11:21.107 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:21.107 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:21.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 realm 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:21.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.155+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.159+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.159+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.159+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:21.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.159+0000 7fcc0346d9c0 20 searching for the correct realm 2024-09-05T01:11:21.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.163+0000 7fcc01774640 0 -- 172.21.15.99:0/2800520506 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fcbf4008050 msgr2=0x7fcbf4062cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.171+0000 7fcc01774640 0 -- 172.21.15.99:0/2800520506 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fcacc080930 msgr2=0x7fcacc082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:21.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 zone default found 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 4 Realm: () 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 zonegroup default 2024-09-05T01:11:21.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.179+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.183+0000 7fcc0346d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.183+0000 7fcc0346d9c0 20 started sync module instance, tier type = 2024-09-05T01:11:21.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.183+0000 7fcc0346d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:21.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=0 2024-09-05T01:11:21.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=1 2024-09-05T01:11:21.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=2 2024-09-05T01:11:21.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=3 2024-09-05T01:11:21.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=4 2024-09-05T01:11:21.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=5 2024-09-05T01:11:21.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=6 2024-09-05T01:11:21.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 20 add_watcher() i=7 2024-09-05T01:11:21.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.195+0000 7fcc0346d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:21.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcab6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 5 note: GC not initialized 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcab5fe3640 20 reqs_thread_entry: start 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 20 Filter name: none 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fca277fe640 20 reqs_thread_entry: start 2024-09-05T01:11:21.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.199+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:21.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.203+0000 7fcc0346d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:21.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.207+0000 7fcab6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.211+0000 7fcc0346d9c0 20 remove_watcher() i=0 2024-09-05T01:11:21.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.211+0000 7fcc0346d9c0 2 removed watcher, disabling cache 2024-09-05T01:11:21.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.215+0000 7fcc0346d9c0 20 remove_watcher() i=1 2024-09-05T01:11:21.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.215+0000 7fcc0346d9c0 20 remove_watcher() i=2 2024-09-05T01:11:21.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.219+0000 7fcc0346d9c0 20 remove_watcher() i=3 2024-09-05T01:11:21.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.219+0000 7fcc0346d9c0 20 remove_watcher() i=4 2024-09-05T01:11:21.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.223+0000 7fcc0346d9c0 20 remove_watcher() i=5 2024-09-05T01:11:21.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.223+0000 7fcc0346d9c0 20 remove_watcher() i=6 2024-09-05T01:11:21.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.223+0000 7fcc0346d9c0 20 remove_watcher() i=7 2024-09-05T01:11:21.236 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:21.236 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:21.237 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-05T01:11:21.237 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:21.237 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-05T01:11:21.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:21.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:21.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 realm 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.311+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.315+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:21.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.315+0000 7f9e10a2e9c0 20 searching for the correct realm 2024-09-05T01:11:21.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.319+0000 7f9e0ed35640 0 -- 172.21.15.99:0/2826222337 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x556b80de8040 msgr2=0x556b80dea460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:21.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.327+0000 7f9e0ed35640 0 -- 172.21.15.99:0/2826222337 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f9cd8080930 msgr2=0x7f9cd8082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:21.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:21.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.331+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 zone default found 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 4 Realm: () 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:21.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 zonegroup default 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 started sync module instance, tier type = 2024-09-05T01:11:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.335+0000 7f9e10a2e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=0 2024-09-05T01:11:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=1 2024-09-05T01:11:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=2 2024-09-05T01:11:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=3 2024-09-05T01:11:21.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=4 2024-09-05T01:11:21.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=5 2024-09-05T01:11:21.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=6 2024-09-05T01:11:21.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 20 add_watcher() i=7 2024-09-05T01:11:21.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.351+0000 7f9e10a2e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 5 note: GC not initialized 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9c3f7fe640 20 reqs_thread_entry: start 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 Filter name: none 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9c3d7fa640 20 reqs_thread_entry: start 2024-09-05T01:11:21.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:11:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.355+0000 7f9e10a2e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:21.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9e10a2e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:21.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.359+0000 7f9cc4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.367+0000 7f9e10a2e9c0 20 remove_watcher() i=0 2024-09-05T01:11:21.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.367+0000 7f9e10a2e9c0 2 removed watcher, disabling cache 2024-09-05T01:11:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.367+0000 7f9e10a2e9c0 20 remove_watcher() i=1 2024-09-05T01:11:21.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.371+0000 7f9e10a2e9c0 20 remove_watcher() i=2 2024-09-05T01:11:21.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.371+0000 7f9e10a2e9c0 20 remove_watcher() i=3 2024-09-05T01:11:21.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.375+0000 7f9e10a2e9c0 20 remove_watcher() i=4 2024-09-05T01:11:21.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.375+0000 7f9e10a2e9c0 20 remove_watcher() i=5 2024-09-05T01:11:21.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.375+0000 7f9e10a2e9c0 20 remove_watcher() i=6 2024-09-05T01:11:21.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.379+0000 7f9e10a2e9c0 20 remove_watcher() i=7 2024-09-05T01:11:21.389 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard list 2024-09-05T01:11:21.413 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:21.413 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:21.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.455+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 realm 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.459+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.463+0000 7f7a823659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:21.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.463+0000 7f7a823659c0 20 searching for the correct realm 2024-09-05T01:11:21.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.467+0000 7f7a8066c640 0 -- 172.21.15.99:0/1992408801 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7a74030070 msgr2=0x7f7a74062220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.475+0000 7f7a7f66a640 0 -- 172.21.15.99:0/1992408801 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x558e438515d0 msgr2=0x558e438539c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:21.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.479+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 zone default found 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 4 Realm: () 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 zonegroup default 2024-09-05T01:11:21.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 started sync module instance, tier type = 2024-09-05T01:11:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.483+0000 7f7a823659c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:21.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=0 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=1 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=2 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=3 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=4 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=5 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=6 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 20 add_watcher() i=7 2024-09-05T01:11:21.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.499+0000 7f7a823659c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:21.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7a823659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7a823659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7a823659c0 5 note: GC not initialized 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7934fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7a823659c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f7a823659c0 20 Filter name: none 2024-09-05T01:11:21.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.503+0000 7f78ae7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:21.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.511+0000 7f7935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.519+0000 7f7a823659c0 20 remove_watcher() i=0 2024-09-05T01:11:21.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.519+0000 7f7a823659c0 2 removed watcher, disabling cache 2024-09-05T01:11:21.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.519+0000 7f7a823659c0 20 remove_watcher() i=1 2024-09-05T01:11:21.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.523+0000 7f7a823659c0 20 remove_watcher() i=2 2024-09-05T01:11:21.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.523+0000 7f7a823659c0 20 remove_watcher() i=3 2024-09-05T01:11:21.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.527+0000 7f7a823659c0 20 remove_watcher() i=4 2024-09-05T01:11:21.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.527+0000 7f7a823659c0 20 remove_watcher() i=5 2024-09-05T01:11:21.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.527+0000 7f7a823659c0 20 remove_watcher() i=6 2024-09-05T01:11:21.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.531+0000 7f7a823659c0 20 remove_watcher() i=7 2024-09-05T01:11:21.541 INFO:tasks.workunit.client.0.smithi099.stderr:bucket name a-bucket 2024-09-05T01:11:21.541 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard process non empty bucket 2024-09-05T01:11:21.541 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:21.541 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard process 2024-09-05T01:11:21.566 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:21.567 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:21.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.611+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 realm 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:21.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.615+0000 7f0e7bc389c0 20 searching for the correct realm 2024-09-05T01:11:21.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.623+0000 7f0e7973e640 0 -- 172.21.15.99:0/736667817 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f0e740e0070 msgr2=0x7f0e740e0b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.627+0000 7f0e7973e640 0 -- 172.21.15.99:0/736667817 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f0e74004040 msgr2=0x7f0e740e0450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 zone default found 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 4 Realm: () 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 zonegroup default 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.635+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 started sync module instance, tier type = 2024-09-05T01:11:21.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.639+0000 7f0e7bc389c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=0 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=1 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=2 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=3 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=4 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=5 2024-09-05T01:11:21.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=6 2024-09-05T01:11:21.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 add_watcher() i=7 2024-09-05T01:11:21.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:21.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0d2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.655+0000 7f0e7bc389c0 5 note: GC not initialized 2024-09-05T01:11:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.659+0000 7f0d2efe5640 20 reqs_thread_entry: start 2024-09-05T01:11:21.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.659+0000 7f0e7bc389c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:21.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.659+0000 7f0e7bc389c0 20 Filter name: none 2024-09-05T01:11:21.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.659+0000 7f0d2cfe1640 20 reqs_thread_entry: start 2024-09-05T01:11:21.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.659+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000000 2024-09-05T01:11:21.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.663+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-05T01:11:21.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.663+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000001 2024-09-05T01:11:21.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.667+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-05T01:11:21.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.667+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000002 2024-09-05T01:11:21.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.671+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-05T01:11:21.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.671+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000003 2024-09-05T01:11:21.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.675+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-05T01:11:21.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.675+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000004 2024-09-05T01:11:21.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.683+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-05T01:11:21.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.683+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000005 2024-09-05T01:11:21.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.687+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-05T01:11:21.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.687+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000006 2024-09-05T01:11:21.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 20 process_entry resharding a-bucket 2024-09-05T01:11:21.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:11:21.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-05T01:11:21.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:11:21.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:11:21.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.691+0000 7f0e7bc389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:21.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0e7bc389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0e7bc389c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0e7bc389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0e7bc389c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:21.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0d4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 93959198965440 notifier 5876 bl.length()=827 2024-09-05T01:11:21.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0d4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0d4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.703+0000 7f0d4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.707+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:21.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.707+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:21.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.707+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:21.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.707+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:21.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:11:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:11:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:21.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:21.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:21.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:21.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.719+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:21.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:21.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:21.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:21.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:21.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.723+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:21.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.727+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:21.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.727+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:21.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.727+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:21.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.727+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:21.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.731+0000 7f0e7bc389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:21.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.731+0000 7f0e7bc389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:21.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0e7bc389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0e7bc389c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0e7bc389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0e7bc389c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0d4bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 93959198965440 notifier 5876 bl.length()=827 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0d4bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0d4bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.735+0000 7f0d4bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.739+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:21.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.739+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:21.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.739+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:21.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.739+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:21.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:21.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.0 2024-09-05T01:11:21.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:21.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.1 2024-09-05T01:11:21.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:21.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.2 2024-09-05T01:11:21.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:21.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.3 2024-09-05T01:11:21.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:21.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.743+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.4 2024-09-05T01:11:21.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:21.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.5 2024-09-05T01:11:21.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:21.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.6 2024-09-05T01:11:21.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:21.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.7 2024-09-05T01:11:21.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:21.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.8 2024-09-05T01:11:21.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:21.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.747+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.9 2024-09-05T01:11:21.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:21.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.10 2024-09-05T01:11:21.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:21.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.1.11 2024-09-05T01:11:21.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:21.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.751+0000 7f0e7bc389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:11:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0e7bc389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0e7bc389c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0e7bc389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0e7bc389c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:11:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0d5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 93959198965440 notifier 5876 bl.length()=795 2024-09-05T01:11:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0d5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:11:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0d5cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:11:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.755+0000 7f0d5cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:11:21.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.759+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:11:21.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.759+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:11:21.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.759+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:11:21.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.759+0000 7f0e7bc389c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:11:21.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.763+0000 7f0e7bc389c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-05T01:11:21.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.763+0000 7f0e7bc389c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-05T01:11:21.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.771+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-05T01:11:21.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.771+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000007 2024-09-05T01:11:21.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.775+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-05T01:11:21.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.775+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000008 2024-09-05T01:11:21.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.779+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-05T01:11:21.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.779+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000009 2024-09-05T01:11:21.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.787+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-05T01:11:21.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.787+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000010 2024-09-05T01:11:21.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.791+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-05T01:11:21.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.791+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000011 2024-09-05T01:11:21.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.795+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-05T01:11:21.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.795+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000012 2024-09-05T01:11:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.799+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-05T01:11:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.799+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000013 2024-09-05T01:11:21.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.807+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-05T01:11:21.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.807+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000014 2024-09-05T01:11:21.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.811+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-05T01:11:21.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.811+0000 7f0e7bc389c0 20 processing logshard = reshard.0000000015 2024-09-05T01:11:21.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.815+0000 7f0e7bc389c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-05T01:11:21.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.819+0000 7f0d2ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.823+0000 7f0e7bc389c0 20 remove_watcher() i=0 2024-09-05T01:11:21.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.823+0000 7f0e7bc389c0 2 removed watcher, disabling cache 2024-09-05T01:11:21.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.823+0000 7f0e7bc389c0 20 remove_watcher() i=1 2024-09-05T01:11:21.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.827+0000 7f0e7bc389c0 20 remove_watcher() i=2 2024-09-05T01:11:21.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.831+0000 7f0e7bc389c0 20 remove_watcher() i=3 2024-09-05T01:11:21.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.831+0000 7f0e7bc389c0 20 remove_watcher() i=4 2024-09-05T01:11:21.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.835+0000 7f0e7bc389c0 20 remove_watcher() i=5 2024-09-05T01:11:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.835+0000 7f0e7bc389c0 20 remove_watcher() i=6 2024-09-05T01:11:21.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.835+0000 7f0e7bc389c0 20 remove_watcher() i=7 2024-09-05T01:11:21.854 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:11:21.884 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:21.885 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:21.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 realm 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.931+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:21.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.935+0000 7f2564fac9c0 20 searching for the correct realm 2024-09-05T01:11:21.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.939+0000 7f25632b3640 0 -- 172.21.15.99:0/3686079435 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f25580ea3f0 msgr2=0x7f25580ea810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.947+0000 7f2562ab2640 0 -- 172.21.15.99:0/3686079435 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f255c07a5e0 msgr2=0x7f255c0790b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:21.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.955+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:21.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 zone default found 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 4 Realm: () 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 zonegroup default 2024-09-05T01:11:21.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:21.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 started sync module instance, tier type = 2024-09-05T01:11:21.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.959+0000 7f2564fac9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=0 2024-09-05T01:11:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=1 2024-09-05T01:11:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=2 2024-09-05T01:11:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=3 2024-09-05T01:11:21.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=4 2024-09-05T01:11:21.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=5 2024-09-05T01:11:21.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=6 2024-09-05T01:11:21.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 20 add_watcher() i=7 2024-09-05T01:11:21.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.975+0000 7f2564fac9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:21.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f24197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 5 note: GC not initialized 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2393fff640 20 reqs_thread_entry: start 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 Filter name: none 2024-09-05T01:11:21.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2391ffb640 20 reqs_thread_entry: start 2024-09-05T01:11:21.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.979+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:21.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:11:21.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:21.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:11:21.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.983+0000 7f2564fac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:21.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.987+0000 7f24197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:21.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.991+0000 7f2564fac9c0 20 remove_watcher() i=0 2024-09-05T01:11:21.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.991+0000 7f2564fac9c0 2 removed watcher, disabling cache 2024-09-05T01:11:21.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.991+0000 7f2564fac9c0 20 remove_watcher() i=1 2024-09-05T01:11:21.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.995+0000 7f2564fac9c0 20 remove_watcher() i=2 2024-09-05T01:11:21.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.995+0000 7f2564fac9c0 20 remove_watcher() i=3 2024-09-05T01:11:21.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.999+0000 7f2564fac9c0 20 remove_watcher() i=4 2024-09-05T01:11:21.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:21.999+0000 7f2564fac9c0 20 remove_watcher() i=5 2024-09-05T01:11:21.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:22.003+0000 7f2564fac9c0 20 remove_watcher() i=6 2024-09-05T01:11:22.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:22.003+0000 7f2564fac9c0 20 remove_watcher() i=7 2024-09-05T01:11:22.012 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:22.012 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:22.013 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-05T01:11:22.013 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:22.013 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-05T01:11:22.013 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:24.060 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-05T01:11:24.093 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:24.093 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:24.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.139+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 realm 2024-09-05T01:11:24.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:24.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:24.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.143+0000 7f7446c819c0 20 searching for the correct realm 2024-09-05T01:11:24.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.151+0000 7f7444f88640 0 -- 172.21.15.99:0/1326466454 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f74380ce040 msgr2=0x7f74380ce420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.155+0000 7f7444f88640 0 -- 172.21.15.99:0/1326466454 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f730c080930 msgr2=0x7f730c082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:24.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:24.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 zone default found 2024-09-05T01:11:24.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 4 Realm: () 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 zonegroup default 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.163+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.167+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.167+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.167+0000 7f7446c819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.167+0000 7f7446c819c0 20 started sync module instance, tier type = 2024-09-05T01:11:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.167+0000 7f7446c819c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:24.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=0 2024-09-05T01:11:24.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=1 2024-09-05T01:11:24.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=2 2024-09-05T01:11:24.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=3 2024-09-05T01:11:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=4 2024-09-05T01:11:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=5 2024-09-05T01:11:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.183+0000 7f7446c819c0 20 add_watcher() i=6 2024-09-05T01:11:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 20 add_watcher() i=7 2024-09-05T01:11:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:24.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f72fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 5 note: GC not initialized 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f72f9fdb640 20 reqs_thread_entry: start 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f7446c819c0 20 Filter name: none 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.187+0000 7f726b7fe640 20 reqs_thread_entry: start 2024-09-05T01:11:24.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:24.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.191+0000 7f7446c819c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.195+0000 7f7446c819c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.195+0000 7f7446c819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:24.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.195+0000 7f72fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.199+0000 7f7446c819c0 20 remove_watcher() i=0 2024-09-05T01:11:24.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.199+0000 7f7446c819c0 2 removed watcher, disabling cache 2024-09-05T01:11:24.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.203+0000 7f7446c819c0 20 remove_watcher() i=1 2024-09-05T01:11:24.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.207+0000 7f7446c819c0 20 remove_watcher() i=2 2024-09-05T01:11:24.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.207+0000 7f7446c819c0 20 remove_watcher() i=3 2024-09-05T01:11:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.211+0000 7f7446c819c0 20 remove_watcher() i=4 2024-09-05T01:11:24.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.211+0000 7f7446c819c0 20 remove_watcher() i=5 2024-09-05T01:11:24.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.211+0000 7f7446c819c0 20 remove_watcher() i=6 2024-09-05T01:11:24.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.211+0000 7f7446c819c0 20 remove_watcher() i=7 2024-09-05T01:11:24.224 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:24.224 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:24.224 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-init-index id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:11:24.224 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:24.225 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-05T01:11:24.256 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:24.257 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:24.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.299+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 realm 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:24.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.303+0000 7f2afbeba9c0 20 searching for the correct realm 2024-09-05T01:11:24.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.311+0000 7f2afa1c1640 0 -- 172.21.15.99:0/162474851 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f2af0104c20 msgr2=0x7f2af00da400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.315+0000 7f2afa1c1640 0 -- 172.21.15.99:0/162474851 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f29c4080900 msgr2=0x7f29c4082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:24.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:24.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 zone default found 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 4 Realm: () 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 zonegroup default 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.323+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 started sync module instance, tier type = 2024-09-05T01:11:24.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.327+0000 7f2afbeba9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:24.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=0 2024-09-05T01:11:24.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=1 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=2 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=3 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=4 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=5 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=6 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 20 add_watcher() i=7 2024-09-05T01:11:24.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f2afbeba9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:24.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.343+0000 7f29affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 5 note: GC not initialized 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f29aefe5640 20 reqs_thread_entry: start 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 Filter name: none 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f29acfe1640 20 reqs_thread_entry: start 2024-09-05T01:11:24.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 : miss 2024-09-05T01:11:24.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:24.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.347+0000 7f2afbeba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 2024-09-05T01:11:24.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.351+0000 7f2afbeba9c0 -1 Injecting error=-5 at location=init_index 2024-09-05T01:11:24.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.351+0000 7f2afbeba9c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-05T01:11:24.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.355+0000 7f29affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.359+0000 7f2afbeba9c0 20 remove_watcher() i=0 2024-09-05T01:11:24.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.359+0000 7f2afbeba9c0 2 removed watcher, disabling cache 2024-09-05T01:11:24.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.359+0000 7f2afbeba9c0 20 remove_watcher() i=1 2024-09-05T01:11:24.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.363+0000 7f2afbeba9c0 20 remove_watcher() i=2 2024-09-05T01:11:24.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.363+0000 7f2afbeba9c0 20 remove_watcher() i=3 2024-09-05T01:11:24.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.367+0000 7f2afbeba9c0 20 remove_watcher() i=4 2024-09-05T01:11:24.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.367+0000 7f2afbeba9c0 20 remove_watcher() i=5 2024-09-05T01:11:24.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.371+0000 7f2afbeba9c0 20 remove_watcher() i=6 2024-09-05T01:11:24.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.371+0000 7f2afbeba9c0 20 remove_watcher() i=7 2024-09-05T01:11:24.382 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-05T01:11:24.409 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:24.409 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:24.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.451+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 realm 2024-09-05T01:11:24.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:24.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:24.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.455+0000 7f33e470c9c0 20 searching for the correct realm 2024-09-05T01:11:24.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.459+0000 7f33e2a13640 0 -- 172.21.15.99:0/1445055931 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f33d802b040 msgr2=0x7f33d802a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.675+0000 7f33e2a13640 0 -- 172.21.15.99:0/1445055931 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f33d802b040 msgr2=0x7f33d802a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:24.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 zone default found 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 4 Realm: () 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:24.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 zonegroup default 2024-09-05T01:11:24.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.687+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.691+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.691+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.691+0000 7f33e470c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.691+0000 7f33e470c9c0 20 started sync module instance, tier type = 2024-09-05T01:11:24.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.691+0000 7f33e470c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=0 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=1 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=2 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=3 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=4 2024-09-05T01:11:24.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=5 2024-09-05T01:11:24.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=6 2024-09-05T01:11:24.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 20 add_watcher() i=7 2024-09-05T01:11:24.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.715+0000 7f33e470c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:24.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.719+0000 7f3298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:24.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:24.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 5 note: GC not initialized 2024-09-05T01:11:24.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f32137fe640 20 reqs_thread_entry: start 2024-09-05T01:11:24.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:24.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 Filter name: none 2024-09-05T01:11:24.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f32117fa640 20 reqs_thread_entry: start 2024-09-05T01:11:24.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.723+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:24.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.727+0000 7f33e470c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:24.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.731+0000 7f3298fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.735+0000 7f33e470c9c0 20 remove_watcher() i=0 2024-09-05T01:11:24.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.735+0000 7f33e470c9c0 2 removed watcher, disabling cache 2024-09-05T01:11:24.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.739+0000 7f33e470c9c0 20 remove_watcher() i=1 2024-09-05T01:11:24.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.739+0000 7f33e470c9c0 20 remove_watcher() i=2 2024-09-05T01:11:24.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.743+0000 7f33e470c9c0 20 remove_watcher() i=3 2024-09-05T01:11:24.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.743+0000 7f33e470c9c0 20 remove_watcher() i=4 2024-09-05T01:11:24.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.747+0000 7f33e470c9c0 20 remove_watcher() i=5 2024-09-05T01:11:24.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.747+0000 7f33e470c9c0 20 remove_watcher() i=6 2024-09-05T01:11:24.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.747+0000 7f33e470c9c0 20 remove_watcher() i=7 2024-09-05T01:11:24.761 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:24.762 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:24.762 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-init-index id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:11:24.762 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:24.865 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:11:24.901 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:24.901 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:24.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.947+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 realm 2024-09-05T01:11:24.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:24.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:24.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.951+0000 7f04e9ff19c0 20 searching for the correct realm 2024-09-05T01:11:24.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.959+0000 7f04e7af7640 0 -- 172.21.15.99:0/1345115425 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f04e0076c20 msgr2=0x7f04e005bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.963+0000 7f04e7af7640 0 -- 172.21.15.99:0/1345115425 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f04e000e070 msgr2=0x7f04e0046a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:24.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 zone default found 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 4 Realm: () 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 zonegroup default 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.971+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.975+0000 7f04e9ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:24.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.975+0000 7f04e9ff19c0 20 started sync module instance, tier type = 2024-09-05T01:11:24.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.975+0000 7f04e9ff19c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:24.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=0 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=1 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=2 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=3 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=4 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=5 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.987+0000 7f04e9ff19c0 20 add_watcher() i=6 2024-09-05T01:11:24.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 20 add_watcher() i=7 2024-09-05T01:11:24.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:24.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f039dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:24.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:24.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:24.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 5 note: GC not initialized 2024-09-05T01:11:24.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f039cfe1640 20 reqs_thread_entry: start 2024-09-05T01:11:24.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.991+0000 7f04e9ff19c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 20 Filter name: none 2024-09-05T01:11:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f03167fc640 20 reqs_thread_entry: start 2024-09-05T01:11:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-05T01:11:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:24.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-05T01:11:24.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-05T01:11:24.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 : miss 2024-09-05T01:11:24.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:24.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:24.995+0000 7f04e9ff19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 2024-09-05T01:11:25.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.003+0000 7f04e9ff19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.003+0000 7f04e9ff19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.003+0000 7f04e9ff19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.003+0000 7f04e9ff19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19, ofs0, ns] 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f03c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94729435440896 notifier 5963 bl.length()=911 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f03c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f03c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f03c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_sources= new_sources= 2024-09-05T01:11:25.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential sources added=[] removed=[] 2024-09-05T01:11:25.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_dests= new_dests= 2024-09-05T01:11:25.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.007+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential dests added=[] removed=[] 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.0 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.0 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.1 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.1 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.2 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.2 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.3 2024-09-05T01:11:25.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.3 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.4 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.4 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.5 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.5 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.6 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.6 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.7 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.7 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.8 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.8 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.9 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.9 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.10 2024-09-05T01:11:25.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.10 2024-09-05T01:11:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.11 2024-09-05T01:11:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1.11 2024-09-05T01:11:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.0 2024-09-05T01:11:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.015+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1 2024-09-05T01:11:25.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.019+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.2 2024-09-05T01:11:25.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.019+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.3 2024-09-05T01:11:25.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.019+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.4 2024-09-05T01:11:25.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.019+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.5 2024-09-05T01:11:25.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.019+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.6 2024-09-05T01:11:25.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.023+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.7 2024-09-05T01:11:25.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.023+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.8 2024-09-05T01:11:25.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.023+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.9 2024-09-05T01:11:25.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.023+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.10 2024-09-05T01:11:25.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.027+0000 7f04e9ff19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:25.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.027+0000 7f04e9ff19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19, ofs0, ns] 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f03c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94729435440896 notifier 5963 bl.length()=911 2024-09-05T01:11:25.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f03c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f03c67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f03c67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_sources= new_sources= 2024-09-05T01:11:25.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential sources added=[] removed=[] 2024-09-05T01:11:25.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_dests= new_dests= 2024-09-05T01:11:25.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.031+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential dests added=[] removed=[] 2024-09-05T01:11:25.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.035+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.0 2024-09-05T01:11:25.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.1 2024-09-05T01:11:25.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.2 2024-09-05T01:11:25.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.3 2024-09-05T01:11:25.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.4 2024-09-05T01:11:25.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.5 2024-09-05T01:11:25.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.6 2024-09-05T01:11:25.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.7 2024-09-05T01:11:25.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.8 2024-09-05T01:11:25.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.9 2024-09-05T01:11:25.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.039+0000 7f04e9ff19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19.10 2024-09-05T01:11:25.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:25.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 2024-09-05T01:11:25.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f04e9ff19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19, ofs0, ns] 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f03c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94729435440896 notifier 5963 bl.length()=879 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f03c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 info.flags=0x17 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f03c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 to cache LRU end 2024-09-05T01:11:25.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.043+0000 7f03c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:25.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.047+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_sources= new_sources= 2024-09-05T01:11:25.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.047+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential sources added=[] removed=[] 2024-09-05T01:11:25.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.047+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): orig_dests= new_dests= 2024-09-05T01:11:25.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.047+0000 7f04e9ff19c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19]): potential dests added=[] removed=[] 2024-09-05T01:11:25.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.051+0000 7f04e9ff19c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-05T01:11:25.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.055+0000 7f039dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:25.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.059+0000 7f04e9ff19c0 20 remove_watcher() i=0 2024-09-05T01:11:25.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.059+0000 7f04e9ff19c0 2 removed watcher, disabling cache 2024-09-05T01:11:25.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.059+0000 7f04e9ff19c0 20 remove_watcher() i=1 2024-09-05T01:11:25.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.063+0000 7f04e9ff19c0 20 remove_watcher() i=2 2024-09-05T01:11:25.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.067+0000 7f04e9ff19c0 20 remove_watcher() i=3 2024-09-05T01:11:25.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.067+0000 7f04e9ff19c0 20 remove_watcher() i=4 2024-09-05T01:11:25.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.067+0000 7f04e9ff19c0 20 remove_watcher() i=5 2024-09-05T01:11:25.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.071+0000 7f04e9ff19c0 20 remove_watcher() i=6 2024-09-05T01:11:25.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.071+0000 7f04e9ff19c0 20 remove_watcher() i=7 2024-09-05T01:11:25.083 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-05T01:11:25.109 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:25.109 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:25.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.155+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 realm 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:25.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:25.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.159+0000 7fb3f4aea9c0 20 searching for the correct realm 2024-09-05T01:11:25.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.163+0000 7fb3f1def640 0 -- 172.21.15.99:0/3858154727 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fb3ec008040 msgr2=0x7fb3ec04e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:25.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.379+0000 7fb3f25f0640 0 -- 172.21.15.99:0/3858154727 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb3e40be050 msgr2=0x7fb3e40fbd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:25.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:25.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.391+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:25.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 zone default found 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 4 Realm: () 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 zonegroup default 2024-09-05T01:11:25.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:25.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 started sync module instance, tier type = 2024-09-05T01:11:25.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.395+0000 7fb3f4aea9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=0 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=1 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=2 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=3 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=4 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=5 2024-09-05T01:11:25.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.419+0000 7fb3f4aea9c0 20 add_watcher() i=6 2024-09-05T01:11:25.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.423+0000 7fb3f4aea9c0 20 add_watcher() i=7 2024-09-05T01:11:25.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.423+0000 7fb3f4aea9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:25.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:25.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:25.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:25.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 5 note: GC not initialized 2024-09-05T01:11:25.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb2237fe640 20 reqs_thread_entry: start 2024-09-05T01:11:25.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:25.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 Filter name: none 2024-09-05T01:11:25.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb2217fa640 20 reqs_thread_entry: start 2024-09-05T01:11:25.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:25.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.427+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:25.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:25.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:25.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:25.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:25.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.431+0000 7fb3f4aea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:25.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.435+0000 7fb2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:25.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.439+0000 7fb3f4aea9c0 20 remove_watcher() i=0 2024-09-05T01:11:25.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.439+0000 7fb3f4aea9c0 2 removed watcher, disabling cache 2024-09-05T01:11:25.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.443+0000 7fb3f4aea9c0 20 remove_watcher() i=1 2024-09-05T01:11:25.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.447+0000 7fb3f4aea9c0 20 remove_watcher() i=2 2024-09-05T01:11:25.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.447+0000 7fb3f4aea9c0 20 remove_watcher() i=3 2024-09-05T01:11:25.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.451+0000 7fb3f4aea9c0 20 remove_watcher() i=4 2024-09-05T01:11:25.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.451+0000 7fb3f4aea9c0 20 remove_watcher() i=5 2024-09-05T01:11:25.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.451+0000 7fb3f4aea9c0 20 remove_watcher() i=6 2024-09-05T01:11:25.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:25.455+0000 7fb3f4aea9c0 20 remove_watcher() i=7 2024-09-05T01:11:25.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:25.468 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:25.468 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-init-index id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:11:25.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:26.455 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-05T01:11:26.456 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:28.597 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-05T01:11:28.630 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:28.630 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:28.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 realm 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.679+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.683+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:28.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.683+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.683+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:28.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.683+0000 7fafa3d0e9c0 20 searching for the correct realm 2024-09-05T01:11:28.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.687+0000 7fafa2015640 0 -- 172.21.15.99:0/2964711303 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7faf9805bca0 msgr2=0x7faf980629d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:28.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.903+0000 7fafa2015640 0 -- 172.21.15.99:0/2964711303 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7faf9805bca0 msgr2=0x7faf980629d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:28.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:28.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:28.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 zone default found 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 4 Realm: () 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 zonegroup default 2024-09-05T01:11:28.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.915+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:28.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 started sync module instance, tier type = 2024-09-05T01:11:28.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.919+0000 7fafa3d0e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:28.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=0 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=1 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=2 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=3 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=4 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=5 2024-09-05T01:11:28.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.947+0000 7fafa3d0e9c0 20 add_watcher() i=6 2024-09-05T01:11:28.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.951+0000 7fafa3d0e9c0 20 add_watcher() i=7 2024-09-05T01:11:28.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.951+0000 7fafa3d0e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:28.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fae537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:28.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:28.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:28.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 5 note: GC not initialized 2024-09-05T01:11:28.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fae527fc640 20 reqs_thread_entry: start 2024-09-05T01:11:28.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:28.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 Filter name: none 2024-09-05T01:11:28.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fadc3fff640 20 reqs_thread_entry: start 2024-09-05T01:11:28.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:28.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.955+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.959+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:28.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.959+0000 7fafa3d0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:28.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.959+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.959+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:28.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.959+0000 7fafa3d0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:28.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.963+0000 7fafa3d0e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:28.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.963+0000 7fafa3d0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:28.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.963+0000 7fae537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:28.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.967+0000 7fafa3d0e9c0 20 remove_watcher() i=0 2024-09-05T01:11:28.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.967+0000 7fafa3d0e9c0 2 removed watcher, disabling cache 2024-09-05T01:11:28.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.971+0000 7fafa3d0e9c0 20 remove_watcher() i=1 2024-09-05T01:11:28.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.971+0000 7fafa3d0e9c0 20 remove_watcher() i=2 2024-09-05T01:11:28.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.975+0000 7fafa3d0e9c0 20 remove_watcher() i=3 2024-09-05T01:11:28.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.975+0000 7fafa3d0e9c0 20 remove_watcher() i=4 2024-09-05T01:11:28.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.979+0000 7fafa3d0e9c0 20 remove_watcher() i=5 2024-09-05T01:11:28.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.979+0000 7fafa3d0e9c0 20 remove_watcher() i=6 2024-09-05T01:11:28.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:28.983+0000 7fafa3d0e9c0 20 remove_watcher() i=7 2024-09-05T01:11:28.995 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:28.995 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:28.996 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-init-index id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:11:28.996 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:28.996 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-05T01:11:29.031 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:29.031 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:29.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 realm 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.079+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.083+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:29.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.083+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.083+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:29.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.083+0000 7fa07e2da9c0 20 searching for the correct realm 2024-09-05T01:11:29.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.087+0000 7fa07b5df640 0 -- 172.21.15.99:0/1022415241 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fa06c018070 msgr2=0x7fa06c064ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:29.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.303+0000 7fa07bde0640 0 -- 172.21.15.99:0/1022415241 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fa074010440 msgr2=0x7fa074010880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:29.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:29.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:29.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:29.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.319+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 zone default found 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 4 Realm: () 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 zonegroup default 2024-09-05T01:11:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 started sync module instance, tier type = 2024-09-05T01:11:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.323+0000 7fa07e2da9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:29.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=0 2024-09-05T01:11:29.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=1 2024-09-05T01:11:29.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=2 2024-09-05T01:11:29.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=3 2024-09-05T01:11:29.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=4 2024-09-05T01:11:29.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=5 2024-09-05T01:11:29.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.355+0000 7fa07e2da9c0 20 add_watcher() i=6 2024-09-05T01:11:29.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.359+0000 7fa07e2da9c0 20 add_watcher() i=7 2024-09-05T01:11:29.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.359+0000 7fa07e2da9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:29.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.363+0000 7f9f327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:29.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:29.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:29.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 5 note: GC not initialized 2024-09-05T01:11:29.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7f9f317e2640 20 reqs_thread_entry: start 2024-09-05T01:11:29.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:29.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 Filter name: none 2024-09-05T01:11:29.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7f9f2a7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:29.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-05T01:11:29.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:29.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-05T01:11:29.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-05T01:11:29.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 : miss 2024-09-05T01:11:29.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 info.flags=0x17 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 to cache LRU end 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:29.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.367+0000 7fa07e2da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 2024-09-05T01:11:29.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.371+0000 7fa07e2da9c0 -1 Injecting error=-95 at location=init_index 2024-09-05T01:11:29.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.371+0000 7fa07e2da9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-05T01:11:29.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 info.flags=0x17 2024-09-05T01:11:29.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 to cache LRU end 2024-09-05T01:11:29.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:29.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20, ofs0, ns] 2024-09-05T01:11:29.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7f9f5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94632504164448 notifier 6330 bl.length()=911 2024-09-05T01:11:29.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7f9f5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 info.flags=0x17 2024-09-05T01:11:29.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7f9f5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 to cache LRU end 2024-09-05T01:11:29.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7f9f5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:29.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): orig_sources= new_sources= 2024-09-05T01:11:29.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): potential sources added=[] removed=[] 2024-09-05T01:11:29.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): orig_dests= new_dests= 2024-09-05T01:11:29.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.383+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): potential dests added=[] removed=[] 2024-09-05T01:11:29.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.0 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.0 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.1 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.1 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.2 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.2 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.3 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.3 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.4 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.4 2024-09-05T01:11:29.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.5 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.5 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.6 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.6 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.7 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.7 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.8 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.8 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.9 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.9 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.10 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.10 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.11 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1.11 2024-09-05T01:11:29.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.0 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.1 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.2 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.3 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.4 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.391+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.5 2024-09-05T01:11:29.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.395+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.6 2024-09-05T01:11:29.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.395+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.7 2024-09-05T01:11:29.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.395+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.8 2024-09-05T01:11:29.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.395+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.9 2024-09-05T01:11:29.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.399+0000 7fa07e2da9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20.10 2024-09-05T01:11:29.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.403+0000 7fa07e2da9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 : hit (requested=0x17, cached=0x17) 2024-09-05T01:11:29.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.403+0000 7fa07e2da9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 2024-09-05T01:11:29.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7fa07e2da9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 info.flags=0x17 2024-09-05T01:11:29.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7fa07e2da9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 to cache LRU end 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7fa07e2da9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7fa07e2da9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20, ofs0, ns] 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7f9f5a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94632504164448 notifier 6330 bl.length()=879 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7f9f5a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 info.flags=0x17 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7f9f5a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 to cache LRU end 2024-09-05T01:11:29.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.407+0000 7f9f5a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:29.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.411+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): orig_sources= new_sources= 2024-09-05T01:11:29.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.411+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): potential sources added=[] removed=[] 2024-09-05T01:11:29.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.411+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): orig_dests= new_dests= 2024-09-05T01:11:29.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.411+0000 7fa07e2da9c0 20 handle_bi_update(): bucket=:error-at-init-index[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20]): potential dests added=[] removed=[] 2024-09-05T01:11:29.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.415+0000 7fa07e2da9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-05T01:11:29.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.419+0000 7f9f327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:29.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.427+0000 7fa07e2da9c0 20 remove_watcher() i=0 2024-09-05T01:11:29.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.427+0000 7fa07e2da9c0 2 removed watcher, disabling cache 2024-09-05T01:11:29.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.427+0000 7fa07e2da9c0 20 remove_watcher() i=1 2024-09-05T01:11:29.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.431+0000 7fa07e2da9c0 20 remove_watcher() i=2 2024-09-05T01:11:29.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.435+0000 7fa07e2da9c0 20 remove_watcher() i=3 2024-09-05T01:11:29.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.439+0000 7fa07e2da9c0 20 remove_watcher() i=4 2024-09-05T01:11:29.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.443+0000 7fa07e2da9c0 20 remove_watcher() i=5 2024-09-05T01:11:29.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.443+0000 7fa07e2da9c0 20 remove_watcher() i=6 2024-09-05T01:11:29.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.447+0000 7fa07e2da9c0 20 remove_watcher() i=7 2024-09-05T01:11:29.463 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-05T01:11:29.494 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:29.494 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:29.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.539+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 realm 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:29.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:29.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:29.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:29.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.543+0000 7fa34b7ee9c0 20 searching for the correct realm 2024-09-05T01:11:29.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.547+0000 7fa349af5640 0 -- 172.21.15.99:0/494632594 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa340008040 msgr2=0x7fa34000b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:29.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.763+0000 7fa349af5640 0 -- 172.21.15.99:0/494632594 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa340008040 msgr2=0x7fa34000b7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:30.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:30.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.775+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 zone default found 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 4 Realm: () 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 zonegroup default 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 started sync module instance, tier type = 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.779+0000 7fa34b7ee9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=0 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=1 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=2 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=3 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=4 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=5 2024-09-05T01:11:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=6 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 20 add_watcher() i=7 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.803+0000 7fa34b7ee9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.807+0000 7fa1ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 5 note: GC not initialized 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa1fe7e4640 20 reqs_thread_entry: start 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 Filter name: none 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa16ffff640 20 reqs_thread_entry: start 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.811+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.815+0000 7fa34b7ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.819+0000 7fa1ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.823+0000 7fa34b7ee9c0 20 remove_watcher() i=0 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.823+0000 7fa34b7ee9c0 2 removed watcher, disabling cache 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.827+0000 7fa34b7ee9c0 20 remove_watcher() i=1 2024-09-05T01:11:30.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.831+0000 7fa34b7ee9c0 20 remove_watcher() i=2 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.831+0000 7fa34b7ee9c0 20 remove_watcher() i=3 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.835+0000 7fa34b7ee9c0 20 remove_watcher() i=4 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.835+0000 7fa34b7ee9c0 20 remove_watcher() i=5 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.835+0000 7fa34b7ee9c0 20 remove_watcher() i=6 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:29.839+0000 7fa34b7ee9c0 20 remove_watcher() i=7 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-init-index id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-05T01:11:30.621 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:30.787 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at init_index 2024-09-05T01:11:30.787 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:32.966 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-05T01:11:32.998 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:32.999 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:33.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.043+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 realm 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.047+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.051+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.051+0000 7f18d248c9c0 20 searching for the correct realm 2024-09-05T01:11:33.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.055+0000 7f18d0793640 0 -- 172.21.15.99:0/1304554409 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x564ce495ca40 msgr2=0x564ce495eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.063+0000 7f18cf791640 0 -- 172.21.15.99:0/1304554409 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x564ce4950360 msgr2=0x564ce4952750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.067+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 zone default found 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 4 Realm: () 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 zonegroup default 2024-09-05T01:11:33.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 started sync module instance, tier type = 2024-09-05T01:11:33.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.071+0000 7f18d248c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=0 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=1 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=2 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=3 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=4 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=5 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=6 2024-09-05T01:11:33.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 20 add_watcher() i=7 2024-09-05T01:11:33.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.087+0000 7f18d248c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:33.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f1785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 5 note: GC not initialized 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f1784fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:33.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 Filter name: none 2024-09-05T01:11:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f16fe7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.091+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:33.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.095+0000 7f18d248c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:33.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.099+0000 7f1785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.103+0000 7f18d248c9c0 20 remove_watcher() i=0 2024-09-05T01:11:33.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.103+0000 7f18d248c9c0 2 removed watcher, disabling cache 2024-09-05T01:11:33.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.103+0000 7f18d248c9c0 20 remove_watcher() i=1 2024-09-05T01:11:33.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.107+0000 7f18d248c9c0 20 remove_watcher() i=2 2024-09-05T01:11:33.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.107+0000 7f18d248c9c0 20 remove_watcher() i=3 2024-09-05T01:11:33.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.111+0000 7f18d248c9c0 20 remove_watcher() i=4 2024-09-05T01:11:33.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.111+0000 7f18d248c9c0 20 remove_watcher() i=5 2024-09-05T01:11:33.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.111+0000 7f18d248c9c0 20 remove_watcher() i=6 2024-09-05T01:11:33.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.115+0000 7f18d248c9c0 20 remove_watcher() i=7 2024-09-05T01:11:33.126 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.126 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:33.126 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-init-indext id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:11:33.126 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.127 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-05T01:11:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:33.158 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:33.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 realm 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.211+0000 7f871e0369c0 20 searching for the correct realm 2024-09-05T01:11:33.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.215+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:33.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.431+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:33.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:33.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:33.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zone default found 2024-09-05T01:11:33.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Realm: () 2024-09-05T01:11:33.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:33.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zonegroup default 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.451+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started sync module instance, tier type = 2024-09-05T01:11:33.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:33.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=0 2024-09-05T01:11:33.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=1 2024-09-05T01:11:33.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=2 2024-09-05T01:11:33.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=3 2024-09-05T01:11:33.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=4 2024-09-05T01:11:33.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=5 2024-09-05T01:11:33.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=6 2024-09-05T01:11:33.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.475+0000 7f871e0369c0 20 add_watcher() i=7 2024-09-05T01:11:33.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.475+0000 7f871e0369c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:33.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f85d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:33.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:33.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 5 note: GC not initialized 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f85d0fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 Filter name: none 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f854a7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-05T01:11:33.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-05T01:11:33.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-05T01:11:33.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : miss 2024-09-05T01:11:33.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:11:33.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:11:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.483+0000 7f871e0369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:11:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f871e0369c0 time 2024-09-05T01:11:33.489100+0000 2024-09-05T01:11:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:11:33.484 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87219102eb] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:11:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f871e0369c0 thread_name:radosgw-admin 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f871e0369c0 time 2024-09-05T01:11:33.489100+0000 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87219102eb] 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:11:33.486 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.487 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:11:33.487 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:11:33.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f872078f520] 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8721910345] 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.507 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f871e0369c0 thread_name:radosgw-admin 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.508 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f872078f520] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8721910345] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.509 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.512 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb9307d390 auth_method 0 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.513 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:11:33.183+0000 7f871b33b640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: dump: 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6369 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: get_monmap_and_config success 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:11:33.183+0000 7f871e0369c0 4 set_mon_vals no callback set 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: dump: 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: shutdown 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) unregister_commands rotate-key 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.516 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.517 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.518 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: starting msgr at 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: starting objecter 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests hook 0x55bb92fbfed0 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: setting wanted keys 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: calling monclient init 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.519 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key hook 0x55bb93134908 2024-09-05T01:11:33.520 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb92fee020 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb92ff3fa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb9307d390 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.647851s 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb92fee020 auth_method 0 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.521 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb9307d390 auth_method 0 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.522 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:11:33.187+0000 7f871bb3c640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:11:33.187+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb92ff3fa0 auth_method 0 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: dump: 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.523 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: dump: 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:11:33.187+0000 7f8609e0b640 4 set_mon_vals no callback set 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:11:33.187+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6372 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.525 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:11:33.187+0000 7f871e0369c0 1 librados: init done 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient: get_auth_request con 0x55bb9315c160 auth_method 0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:11:33.187+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f8604070ae0 auth_method 0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:11:33.191+0000 7f871bb3c640 10 monclient: get_auth_request con 0x55bb9317f010 auth_method 0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:11:33.191+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb93183200 auth_method 0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:11:33.195+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.526 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.527 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.528 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bb9318b8f0 EEXIST 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.529 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x55bb93186710 EEXIST 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb931afaa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.530 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb931af3d0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931addb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.657627s 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb931af3d0 auth_method 0 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931afaa0 auth_method 0 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.531 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:11:33.195+0000 7f871bb3c640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.532 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: dump: 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.533 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: dump: 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.534 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6375 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:11:33.195+0000 7f871cb3e640 4 set_mon_vals no callback set 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.535 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: get_monmap_and_config 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.536 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.537 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f85f4070a20 auth_method 0 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.538 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.539 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe75f8b5e8 EEXIST 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931d3500 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb93203bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb931fed60 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.661762s 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb93203bb0 auth_method 0 2024-09-05T01:11:33.540 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb931fed60 auth_method 0 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.541 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931d3500 auth_method 0 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_done global_id 6378 payload 274 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:11:33.199+0000 7f871c33d640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.542 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: dump: 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.543 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6378 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: dump: 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.544 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: get_monmap_and_config success 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:11:33.199+0000 7f871e0369c0 4 set_mon_vals no callback set 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: shutdown 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.546 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: starting msgr at 2024-09-05T01:11:33.547 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: starting objecter 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bb931fe2c0 EEXIST 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: setting wanted keys 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: calling monclient init 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.548 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:11:33.203+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:11:33.203+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x55bb931b1a08 EEXIST 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:11:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931d3500 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb931fed60 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb93203bb0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.664784s 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb93203bb0 auth_method 0 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb931fed60 auth_method 0 2024-09-05T01:11:33.550 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931d3500 auth_method 0 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-05T01:11:33.551 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:11:33.203+0000 7f871c33d640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: dump: 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.552 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: dump: 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.553 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6381 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:11:33.203+0000 7f85faffd640 4 set_mon_vals no callback set 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:11:33.203+0000 7f871e0369c0 1 librados: init done 2024-09-05T01:11:33.554 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cr dump hook 0x55bb93211978 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:11:33.207+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f85e4070ae0 auth_method 0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:11:33.207+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb9321df90 auth_method 0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 realm 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:11:33.207+0000 7f871e0369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.555 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:11:33.207+0000 7f871bb3c640 10 monclient: get_auth_request con 0x55bb932221c0 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:11:33.211+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb93225a20 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 searching for the correct realm 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:11:33.211+0000 7f871c33d640 10 monclient: get_auth_request con 0x55bb9322a720 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:11:33.211+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f8714061770 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:11:33.215+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f870c01f060 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:11:33.215+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f87100edb70 auth_method 0 2024-09-05T01:11:33.556 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:11:33.215+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:11:33.419+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f87100edb70 auth_method 0 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:11:33.423+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f871406a310 auth_method 0 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:11:33.431+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:11:33.431+0000 7f85f97fa640 1 client.6381.objecter ms_handle_reset 0x7f87100edb70 session 0x7f87100d1040 osd.4 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:11:33.431+0000 7f85f97fa640 10 monclient: _renew_subs 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:11:33.431+0000 7f85f97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:11:33.431+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f85e4080880 auth_method 0 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:33.557 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zone default found 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Realm: () 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:11:33.447+0000 7f871e0369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zonegroup default 2024-09-05T01:11:33.558 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started sync module instance, tier type = 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=0 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=1 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=2 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=3 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=4 2024-09-05T01:11:33.559 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=5 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=6 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:11:33.475+0000 7f871e0369c0 20 add_watcher() i=7 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:11:33.475+0000 7f871e0369c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.560 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:11:33.479+0000 7f85d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:11:33.479+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache list hook 0x55bb931f43d0 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache inspect hook 0x55bb931f43d0 2024-09-05T01:11:33.561 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache erase hook 0x55bb931f43d0 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache zap hook 0x55bb931f43d0 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 note: GC not initialized 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:11:33.479+0000 7f85d0fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace show hook 0x7f871400c040 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace history hook 0x7f871400c040 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace active hook 0x7f871400c040 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace active_short hook 0x7f871400c040 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 Filter name: none 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:11:33.479+0000 7f854a7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.562 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : miss 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:11:33.483+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f871e0369c0 time 2024-09-05T01:11:33.489100+0000 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:11:33.563 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87219102eb] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.564 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f871e0369c0 thread_name:radosgw-admin 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f872078f520] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8721910345] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.565 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:11:33.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:11:33.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:11:33.568 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:11:33.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:11:33.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:11:33.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:11:33.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 7f854a7fc640 / http_manager 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85d0fe1640 / http_manager 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85d1fe3640 / rgw_dt_lg_renew 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85f97fa640 / ms_dispatch 2024-09-05T01:11:33.573 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85faffd640 / io_context_pool 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f86017fa640 / ms_dispatch 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f8603fff640 / ms_dispatch 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f8609e0b640 / io_context_pool 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871b33b640 / msgr-worker-2 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871bb3c640 / msgr-worker-1 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871c33d640 / msgr-worker-0 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871cb3e640 / io_context_pool 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871e0369c0 / radosgw-admin 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.82195.log 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:11:33.574 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb9307d390 auth_method 0 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-05T01:11:33.575 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:11:33.183+0000 7f871b33b640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:11:33.183+0000 7f871b33b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: dump: 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.576 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6369 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: get_monmap_and_config success 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:11:33.183+0000 7f871e0369c0 4 set_mon_vals no callback set 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:11:33.183+0000 7f8609e0b640 10 monclient: dump: 2024-09-05T01:11:33.577 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: shutdown 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) unregister_commands rotate-key 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.578 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.579 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding auth protocol: cephx 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: crc 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb9313a3a0) adding con mode: secure 2024-09-05T01:11:33.580 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: starting msgr at 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: starting objecter 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests hook 0x55bb92fbfed0 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: setting wanted keys 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:11:33.183+0000 7f871e0369c0 1 librados: calling monclient init 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding auth protocol: cephx 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.581 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: crc 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 AuthRegistry(0x55bb931347c0) adding con mode: secure 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:11:33.183+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:11:33.183+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key hook 0x55bb93134908 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.582 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb92fee020 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb92ff3fa0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb9307d390 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:11:33.183+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.647851s 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb92fee020 auth_method 0 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:11:33.183+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.583 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:11:33.183+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb9307d390 auth_method 0 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.584 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:11:33.187+0000 7f871bb3c640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:11:33.187+0000 7f871bb3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:11:33.187+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb92ff3fa0 auth_method 0 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: dump: 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.585 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:11:33.187+0000 7f8603fff640 10 monclient: dump: 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.586 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:11:33.187+0000 7f8609e0b640 4 set_mon_vals no callback set 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:11:33.187+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6372 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:11:33.187+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:11:33.187+0000 7f871e0369c0 1 librados: init done 2024-09-05T01:11:33.587 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:11:33.187+0000 7f8603fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:11:33.187+0000 7f871c33d640 10 monclient: get_auth_request con 0x55bb9315c160 auth_method 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:11:33.187+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f8604070ae0 auth_method 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:11:33.191+0000 7f871bb3c640 10 monclient: get_auth_request con 0x55bb9317f010 auth_method 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:11:33.191+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb93183200 auth_method 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:11:33.195+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.588 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding auth protocol: cephx 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.589 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: crc 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb93187ea0) adding con mode: secure 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bb9318b8f0 EEXIST 2024-09-05T01:11:33.590 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding auth protocol: cephx 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.591 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: crc 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 AuthRegistry(0x55bb931865c8) adding con mode: secure 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:11:33.195+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x55bb93186710 EEXIST 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb931afaa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb931af3d0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931addb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.592 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.657627s 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb931af3d0 auth_method 0 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931afaa0 auth_method 0 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.593 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:11:33.195+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient(hunting): handle_auth_done global_id 6375 payload 824 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:11:33.195+0000 7f871bb3c640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:11:33.195+0000 7f871bb3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: dump: 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.594 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.595 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:11:33.195+0000 7f86017fa640 10 monclient: dump: 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:11:33.195+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6375 2024-09-05T01:11:33.596 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:11:33.195+0000 7f871cb3e640 4 set_mon_vals no callback set 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:11:33.195+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:11:33.199+0000 7f86017fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: get_monmap_and_config 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.597 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.598 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding auth protocol: cephx 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: crc 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931cf440) adding con mode: secure 2024-09-05T01:11:33.599 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f85f4070a20 auth_method 0 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding auth protocol: cephx 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.600 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: crc 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b4a0) adding con mode: secure 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe75f8b5e8 EEXIST 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931d3500 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb93203bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb931fed60 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.601 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.661762s 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb93203bb0 auth_method 0 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb931fed60 auth_method 0 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.602 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:11:33.199+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931d3500 auth_method 0 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:11:33.199+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient(hunting): handle_auth_done global_id 6378 payload 274 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:11:33.199+0000 7f871c33d640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.603 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:11:33.199+0000 7f871c33d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: dump: 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.604 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6378 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:11:33.199+0000 7f85faffd640 10 monclient: dump: 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.605 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: get_monmap_and_config success 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:11:33.199+0000 7f871e0369c0 4 set_mon_vals no callback set 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: shutdown 2024-09-05T01:11:33.606 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: build_initial_monmap 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 build_initial for_mkfs: 0 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: monmap: 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:11:33.607 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding auth protocol: cephx 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.608 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: crc 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931f5ed0) adding con mode: secure 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:11:33.199+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: starting msgr at 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: starting objecter 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command objecter_requests cmddesc objecter_requests hook 0x55bb931fe2c0 EEXIST 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: setting wanted keys 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:11:33.199+0000 7f871e0369c0 1 librados: calling monclient init 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:11:33.199+0000 7f871e0369c0 10 monclient: init 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.609 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding auth protocol: cephx 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: crc 2024-09-05T01:11:33.610 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:11:33.199+0000 7f871e0369c0 5 AuthRegistry(0x55bb931b18c0) adding con mode: secure 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:11:33.203+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:11:33.203+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command rotate-key cmddesc rotate-key hook 0x55bb931b1a08 EEXIST 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _reopen_session rank -1 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-b con 0x55bb931d3500 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-c con 0x55bb931fed60 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): picked mon.noname-a con 0x55bb93203bb0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:11:33.611 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): _renew_subs 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient(hunting): authenticate will time out at 2344.664784s 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): get_auth_request con 0x55bb93203bb0 auth_method 0 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): get_auth_request con 0x55bb931fed60 auth_method 0 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.612 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:11:33.203+0000 7f871b33b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): get_auth_request con 0x55bb931d3500 auth_method 0 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:11:33.203+0000 7f871bb3c640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient(hunting): handle_auth_done global_id 6381 payload 824 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient: _finish_hunting 0 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:11:33.203+0000 7f871c33d640 1 monclient: found mon.noname-a 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:11:33.203+0000 7f871c33d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:11:33.613 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: dump: 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: _finish_auth 0 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: _check_auth_tickets 2024-09-05T01:11:33.614 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:11:33.203+0000 7f85f97fa640 10 monclient: dump: 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:11:33.615 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 monclient: authenticate success, global_id 6381 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:11:33.203+0000 7f85faffd640 4 set_mon_vals no callback set 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _renew_subs 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:11:33.203+0000 7f871e0369c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:11:33.203+0000 7f871e0369c0 1 librados: init done 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:11:33.203+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cr dump hook 0x55bb93211978 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.616 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:11:33.207+0000 7f85f97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:11:33.207+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f85e4070ae0 auth_method 0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:11:33.207+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb9321df90 auth_method 0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 realm 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:11:33.207+0000 7f871e0369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:11:33.207+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:11:33.207+0000 7f871bb3c640 10 monclient: get_auth_request con 0x55bb932221c0 auth_method 0 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.617 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:11:33.211+0000 7f871b33b640 10 monclient: get_auth_request con 0x55bb93225a20 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:11:33.211+0000 7f871e0369c0 20 searching for the correct realm 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:11:33.211+0000 7f871c33d640 10 monclient: get_auth_request con 0x55bb9322a720 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:11:33.211+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f8714061770 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:11:33.215+0000 7f871b33b640 10 monclient: get_auth_request con 0x7f870c01f060 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:11:33.215+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f87100edb70 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:11:33.215+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:11:33.419+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f87100edb70 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:11:33.423+0000 7f871bb3c640 10 monclient: get_auth_request con 0x7f871406a310 auth_method 0 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:11:33.431+0000 7f871c33d640 0 -- 172.21.15.99:0/2674676045 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f87100edb70 msgr2=0x7f87100e5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:11:33.431+0000 7f85f97fa640 1 client.6381.objecter ms_handle_reset 0x7f87100edb70 session 0x7f87100d1040 osd.4 2024-09-05T01:11:33.618 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:11:33.431+0000 7f85f97fa640 10 monclient: _renew_subs 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:11:33.431+0000 7f85f97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:11:33.431+0000 7f871c33d640 10 monclient: get_auth_request con 0x7f85e4080880 auth_method 0 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:11:33.443+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.619 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zone default found 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Realm: () 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:11:33.447+0000 7f871e0369c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:11:33.447+0000 7f871e0369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 zonegroup default 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.620 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:11:33.447+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started sync module instance, tier type = 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:11:33.451+0000 7f871e0369c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=0 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=1 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=2 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=3 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=4 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=5 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:11:33.471+0000 7f871e0369c0 20 add_watcher() i=6 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:11:33.475+0000 7f871e0369c0 20 add_watcher() i=7 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:11:33.475+0000 7f871e0369c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:33.621 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding auth protocol: cephx 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.622 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: crc 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 AuthRegistry(0x7ffe75f8b980) adding con mode: secure 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:11:33.479+0000 7f85d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:11:33.479+0000 7f871e0369c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache list hook 0x55bb931f43d0 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache inspect hook 0x55bb931f43d0 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache erase hook 0x55bb931f43d0 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command cache zap hook 0x55bb931f43d0 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 note: GC not initialized 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:11:33.479+0000 7f85d0fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:33.623 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace show hook 0x7f871400c040 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace history hook 0x7f871400c040 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace active hook 0x7f871400c040 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:11:33.479+0000 7f871e0369c0 5 asok(0x55bb92f292b0) register_command sync trace active_short hook 0x7f871400c040 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 Filter name: none 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:11:33.479+0000 7f854a7fc640 20 reqs_thread_entry: start 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-05T01:11:33.624 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:11:33.479+0000 7f871e0369c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : miss 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:11:33.479+0000 7f871e0369c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:11:33.483+0000 7f871e0369c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:11:33.483+0000 7f871e0369c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f871e0369c0 time 2024-09-05T01:11:33.489100+0000 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.625 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f87219102eb] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:11:33.487+0000 7f871e0369c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f871e0369c0 thread_name:radosgw-admin 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.626 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f872078f520] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8721910345] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f872191049f] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bb9173c681] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421cb2) [0x55bb92199cb2] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bb91751afd] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8720776d90] 2024-09-05T01:11:33.627 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:11:33.628 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:11:33.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:11:33.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:11:33.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:11:33.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:11:33.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:11:33.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f854a7fc640 / http_manager 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85d0fe1640 / http_manager 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85d1fe3640 / rgw_dt_lg_renew 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85f97fa640 / ms_dispatch 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f85faffd640 / io_context_pool 2024-09-05T01:11:33.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f86017fa640 / ms_dispatch 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f8603fff640 / ms_dispatch 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f8609e0b640 / io_context_pool 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871b33b640 / msgr-worker-2 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871bb3c640 / msgr-worker-1 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871c33d640 / msgr-worker-0 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871cb3e640 / io_context_pool 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f871e0369c0 / radosgw-admin 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:11:33.492478Z_f9991f88-727c-4902-be72-551b6ee21b4a/log 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:11:33.636 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-05T01:11:33.641 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:33.641 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:33.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.567+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 realm 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.571+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.575+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.575+0000 7f808637b9c0 20 searching for the correct realm 2024-09-05T01:11:33.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.579+0000 7f8084682640 0 -- 172.21.15.99:0/3215401967 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8078019040 msgr2=0x7f807807dfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.583+0000 7f8084682640 0 -- 172.21.15.99:0/3215401967 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7f4c080900 msgr2=0x7f7f4c082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.591+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 zone default found 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 4 Realm: () 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 zonegroup default 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 started sync module instance, tier type = 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.595+0000 7f808637b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=0 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=1 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=2 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=3 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=4 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=5 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=6 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 20 add_watcher() i=7 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.611+0000 7f808637b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:33.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f7f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 5 note: GC not initialized 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f7f38fe1640 20 reqs_thread_entry: start 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 Filter name: none 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f7eb27fc640 20 reqs_thread_entry: start 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:33.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.615+0000 7f808637b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.619+0000 7f808637b9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.619+0000 7f808637b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.623+0000 7f7f39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.627+0000 7f808637b9c0 20 remove_watcher() i=0 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.627+0000 7f808637b9c0 2 removed watcher, disabling cache 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.627+0000 7f808637b9c0 20 remove_watcher() i=1 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.631+0000 7f808637b9c0 20 remove_watcher() i=2 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.631+0000 7f808637b9c0 20 remove_watcher() i=3 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.635+0000 7f808637b9c0 20 remove_watcher() i=4 2024-09-05T01:11:33.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.635+0000 7f808637b9c0 20 remove_watcher() i=5 2024-09-05T01:11:33.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.635+0000 7f808637b9c0 20 remove_watcher() i=6 2024-09-05T01:11:33.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.639+0000 7f808637b9c0 20 remove_watcher() i=7 2024-09-05T01:11:33.649 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.649 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:11:33.649 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-init-indext id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:11:33.649 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:11:33.749 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:11:33.784 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:11:33.784 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:11:33.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.827+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 realm 2024-09-05T01:11:33.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:11:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:33.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:33.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:11:33.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.831+0000 7f91edda49c0 20 searching for the correct realm 2024-09-05T01:11:33.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:33.835+0000 7f91eb0a9640 0 -- 172.21.15.99:0/1482495236 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f91e4039980 msgr2=0x7f91e4029410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:11:34.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.047+0000 7f91eb8aa640 0 -- 172.21.15.99:0/1482495236 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f91dc124c20 msgr2=0x7f91dc0f76a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:11:34.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.063+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:34.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:11:34.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:11:34.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 zone default found 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 4 Realm: () 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 zonegroup default 2024-09-05T01:11:34.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:34.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:34.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.067+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.071+0000 7f91edda49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:11:34.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.071+0000 7f91edda49c0 20 started sync module instance, tier type = 2024-09-05T01:11:34.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.071+0000 7f91edda49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:11:34.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=0 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=1 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=2 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=3 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=4 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=5 2024-09-05T01:11:34.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=6 2024-09-05T01:11:34.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 20 add_watcher() i=7 2024-09-05T01:11:34.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.095+0000 7f91edda49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:11:34.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.099+0000 7f909d7f2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:34.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.099+0000 7f91edda49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:11:34.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.099+0000 7f91edda49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:11:34.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.099+0000 7f91edda49c0 5 note: GC not initialized 2024-09-05T01:11:34.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f9017fff640 20 reqs_thread_entry: start 2024-09-05T01:11:34.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:11:34.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 Filter name: none 2024-09-05T01:11:34.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f9015ffb640 20 reqs_thread_entry: start 2024-09-05T01:11:34.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-05T01:11:34.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:11:34.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-05T01:11:34.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-05T01:11:34.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : miss 2024-09-05T01:11:34.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 rados->read ofs=0 len=0 2024-09-05T01:11:34.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:11:34.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:11:34.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:11:34.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:11:34.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:11:34.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.103+0000 7f91edda49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:11:34.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.107+0000 7f91edda49c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to be held by another RGW process; skipping for now 2024-09-05T01:11:34.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.107+0000 7f909d7f2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:11:34.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.115+0000 7f91edda49c0 20 remove_watcher() i=0 2024-09-05T01:11:34.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.115+0000 7f91edda49c0 2 removed watcher, disabling cache 2024-09-05T01:11:34.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.115+0000 7f91edda49c0 20 remove_watcher() i=1 2024-09-05T01:11:34.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.119+0000 7f91edda49c0 20 remove_watcher() i=2 2024-09-05T01:11:34.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.123+0000 7f91edda49c0 20 remove_watcher() i=3 2024-09-05T01:11:34.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.123+0000 7f91edda49c0 20 remove_watcher() i=4 2024-09-05T01:11:34.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.127+0000 7f91edda49c0 20 remove_watcher() i=5 2024-09-05T01:11:34.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.127+0000 7f91edda49c0 20 remove_watcher() i=6 2024-09-05T01:11:34.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:11:34.127+0000 7f91edda49c0 20 remove_watcher() i=7 2024-09-05T01:11:34.142 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:12:04.174 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:12:04.210 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:04.210 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:04.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.254+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 realm 2024-09-05T01:12:04.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:04.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:04.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:04.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.258+0000 7f20b960f9c0 20 searching for the correct realm 2024-09-05T01:12:04.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.262+0000 7f20b7916640 0 -- 172.21.15.99:0/2263756733 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f20ac0e8910 msgr2=0x7f20ac0da3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:04.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.478+0000 7f20b7916640 0 -- 172.21.15.99:0/2263756733 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f20ac0e8910 msgr2=0x7f20ac0da3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:04.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:04.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:04.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:04.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:04.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.490+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:04.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 zone default found 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 4 Realm: () 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 zonegroup default 2024-09-05T01:12:04.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.494+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.498+0000 7f20b960f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.498+0000 7f20b960f9c0 20 started sync module instance, tier type = 2024-09-05T01:12:04.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.498+0000 7f20b960f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=0 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=1 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=2 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=3 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=4 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=5 2024-09-05T01:12:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.518+0000 7f20b960f9c0 20 add_watcher() i=6 2024-09-05T01:12:04.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.522+0000 7f20b960f9c0 20 add_watcher() i=7 2024-09-05T01:12:04.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.522+0000 7f20b960f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:04.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f1f6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:04.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f20b960f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:04.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f20b960f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:04.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f20b960f9c0 5 note: GC not initialized 2024-09-05T01:12:04.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f1f6d7e2640 20 reqs_thread_entry: start 2024-09-05T01:12:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f20b960f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f20b960f9c0 20 Filter name: none 2024-09-05T01:12:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.526+0000 7f1f667fc640 20 reqs_thread_entry: start 2024-09-05T01:12:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-05T01:12:04.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:12:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-05T01:12:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-05T01:12:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : miss 2024-09-05T01:12:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.530+0000 7f20b960f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f20b960f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f20b960f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f20b960f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f20b960f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21, ofs0, ns] 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f1f9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 94804710711712 notifier 6435 bl.length()=913 2024-09-05T01:12:04.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f1f9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f1f9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.542+0000 7f1f9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.546+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_sources= new_sources= 2024-09-05T01:12:04.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.546+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential sources added=[] removed=[] 2024-09-05T01:12:04.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.546+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_dests= new_dests= 2024-09-05T01:12:04.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.546+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential dests added=[] removed=[] 2024-09-05T01:12:04.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.0 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.0 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.1 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.1 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.2 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.2 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.3 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.3 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.4 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.4 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.5 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.5 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.6 2024-09-05T01:12:04.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.6 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.7 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.7 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.8 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.8 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.9 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.9 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.10 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.10 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.11 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1.11 2024-09-05T01:12:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.554+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.0 2024-09-05T01:12:04.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.558+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1 2024-09-05T01:12:04.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.558+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.2 2024-09-05T01:12:04.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.558+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.3 2024-09-05T01:12:04.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.558+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.4 2024-09-05T01:12:04.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.558+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.5 2024-09-05T01:12:04.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.562+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.6 2024-09-05T01:12:04.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.562+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.7 2024-09-05T01:12:04.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.566+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.8 2024-09-05T01:12:04.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.566+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.9 2024-09-05T01:12:04.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.566+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.10 2024-09-05T01:12:04.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.574+0000 7f20b960f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:04.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.574+0000 7f20b960f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:12:04.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21, ofs0, ns] 2024-09-05T01:12:04.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f1f9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94804710711712 notifier 6435 bl.length()=913 2024-09-05T01:12:04.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f1f9affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f1f9affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f1f9affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_sources= new_sources= 2024-09-05T01:12:04.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential sources added=[] removed=[] 2024-09-05T01:12:04.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_dests= new_dests= 2024-09-05T01:12:04.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.578+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential dests added=[] removed=[] 2024-09-05T01:12:04.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.0 2024-09-05T01:12:04.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.1 2024-09-05T01:12:04.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.2 2024-09-05T01:12:04.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.3 2024-09-05T01:12:04.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.4 2024-09-05T01:12:04.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.586+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.5 2024-09-05T01:12:04.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.590+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.6 2024-09-05T01:12:04.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.590+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.7 2024-09-05T01:12:04.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.590+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.8 2024-09-05T01:12:04.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.590+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.9 2024-09-05T01:12:04.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.590+0000 7f20b960f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21.10 2024-09-05T01:12:04.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:04.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.594+0000 7f20b960f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21, ofs0, ns] 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f1f9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94804710711712 notifier 6435 bl.length()=881 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f1f9a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 info.flags=0x17 2024-09-05T01:12:04.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f1f9a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 to cache LRU end 2024-09-05T01:12:04.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f1f9a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:04.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_sources= new_sources= 2024-09-05T01:12:04.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential sources added=[] removed=[] 2024-09-05T01:12:04.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): orig_dests= new_dests= 2024-09-05T01:12:04.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.598+0000 7f20b960f9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21]): potential dests added=[] removed=[] 2024-09-05T01:12:04.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.606+0000 7f20b960f9c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:04.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.606+0000 7f1f6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:04.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.614+0000 7f20b960f9c0 20 remove_watcher() i=0 2024-09-05T01:12:04.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.614+0000 7f20b960f9c0 2 removed watcher, disabling cache 2024-09-05T01:12:04.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.614+0000 7f20b960f9c0 20 remove_watcher() i=1 2024-09-05T01:12:04.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.618+0000 7f20b960f9c0 20 remove_watcher() i=2 2024-09-05T01:12:04.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.618+0000 7f20b960f9c0 20 remove_watcher() i=3 2024-09-05T01:12:04.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.622+0000 7f20b960f9c0 20 remove_watcher() i=4 2024-09-05T01:12:04.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.622+0000 7f20b960f9c0 20 remove_watcher() i=5 2024-09-05T01:12:04.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.622+0000 7f20b960f9c0 20 remove_watcher() i=6 2024-09-05T01:12:04.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.626+0000 7f20b960f9c0 20 remove_watcher() i=7 2024-09-05T01:12:04.639 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-05T01:12:04.666 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:04.666 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:04.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.710+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 realm 2024-09-05T01:12:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:04.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:04.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:04.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.714+0000 7f4e5c6289c0 20 searching for the correct realm 2024-09-05T01:12:04.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.722+0000 7f4e5a92f640 0 -- 172.21.15.99:0/548940739 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4e44089050 msgr2=0x7f4e4405bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:04.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.730+0000 7f4e5a92f640 0 -- 172.21.15.99:0/548940739 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4d24080900 msgr2=0x7f4d24082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.734+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 zone default found 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 4 Realm: () 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:04.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:04.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 zonegroup default 2024-09-05T01:12:04.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 started sync module instance, tier type = 2024-09-05T01:12:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.738+0000 7f4e5c6289c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:04.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=0 2024-09-05T01:12:04.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=1 2024-09-05T01:12:04.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=2 2024-09-05T01:12:04.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=3 2024-09-05T01:12:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=4 2024-09-05T01:12:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=5 2024-09-05T01:12:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=6 2024-09-05T01:12:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 20 add_watcher() i=7 2024-09-05T01:12:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.754+0000 7f4e5c6289c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:04.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 5 note: GC not initialized 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4c8b7fe640 20 reqs_thread_entry: start 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 Filter name: none 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4c897fa640 20 reqs_thread_entry: start 2024-09-05T01:12:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:12:04.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.758+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:12:04.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:04.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-05T01:12:04.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:04.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-05T01:12:04.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.762+0000 7f4e5c6289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:04.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.766+0000 7f4d10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:04.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.770+0000 7f4e5c6289c0 20 remove_watcher() i=0 2024-09-05T01:12:04.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.770+0000 7f4e5c6289c0 2 removed watcher, disabling cache 2024-09-05T01:12:04.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.770+0000 7f4e5c6289c0 20 remove_watcher() i=1 2024-09-05T01:12:04.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.774+0000 7f4e5c6289c0 20 remove_watcher() i=2 2024-09-05T01:12:04.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.774+0000 7f4e5c6289c0 20 remove_watcher() i=3 2024-09-05T01:12:04.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.778+0000 7f4e5c6289c0 20 remove_watcher() i=4 2024-09-05T01:12:04.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.778+0000 7f4e5c6289c0 20 remove_watcher() i=5 2024-09-05T01:12:04.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.782+0000 7f4e5c6289c0 20 remove_watcher() i=6 2024-09-05T01:12:04.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:04.782+0000 7f4e5c6289c0 20 remove_watcher() i=7 2024-09-05T01:12:04.794 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:04.794 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:04.794 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-init-indext id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:12:04.795 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:05.678 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-05T01:12:05.679 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:07.846 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-05T01:12:07.878 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:07.878 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:07.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.922+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 realm 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.926+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:07.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.930+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:07.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.930+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.930+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:07.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.930+0000 7f041570a9c0 20 searching for the correct realm 2024-09-05T01:12:07.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:07.934+0000 7f0413a11640 0 -- 172.21.15.99:0/1804027770 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0408018070 msgr2=0x7f04080761a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:08.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.150+0000 7f0413a11640 0 -- 172.21.15.99:0/1804027770 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0408018070 msgr2=0x7f04080761a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.162+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 zone default found 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 4 Realm: () 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 zonegroup default 2024-09-05T01:12:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 started sync module instance, tier type = 2024-09-05T01:12:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.166+0000 7f041570a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:08.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=0 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=1 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=2 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=3 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=4 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=5 2024-09-05T01:12:08.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.190+0000 7f041570a9c0 20 add_watcher() i=6 2024-09-05T01:12:08.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.194+0000 7f041570a9c0 20 add_watcher() i=7 2024-09-05T01:12:08.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.194+0000 7f041570a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:08.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f02c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:08.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:08.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 5 note: GC not initialized 2024-09-05T01:12:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f02c8fe1640 20 reqs_thread_entry: start 2024-09-05T01:12:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 Filter name: none 2024-09-05T01:12:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f02427fc640 20 reqs_thread_entry: start 2024-09-05T01:12:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.198+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.202+0000 7f041570a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.206+0000 7f02c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.210+0000 7f041570a9c0 20 remove_watcher() i=0 2024-09-05T01:12:08.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.210+0000 7f041570a9c0 2 removed watcher, disabling cache 2024-09-05T01:12:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.210+0000 7f041570a9c0 20 remove_watcher() i=1 2024-09-05T01:12:08.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.214+0000 7f041570a9c0 20 remove_watcher() i=2 2024-09-05T01:12:08.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.218+0000 7f041570a9c0 20 remove_watcher() i=3 2024-09-05T01:12:08.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.218+0000 7f041570a9c0 20 remove_watcher() i=4 2024-09-05T01:12:08.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.218+0000 7f041570a9c0 20 remove_watcher() i=5 2024-09-05T01:12:08.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.222+0000 7f041570a9c0 20 remove_watcher() i=6 2024-09-05T01:12:08.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.222+0000 7f041570a9c0 20 remove_watcher() i=7 2024-09-05T01:12:08.238 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:08.238 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:08.239 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:08.239 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:08.239 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-05T01:12:08.275 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:08.275 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:08.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 realm 2024-09-05T01:12:08.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:08.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.322+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.326+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.326+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.326+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:08.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.326+0000 7f6d2ba409c0 20 searching for the correct realm 2024-09-05T01:12:08.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.330+0000 7f6d29d47640 0 -- 172.21.15.99:0/2730637771 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6d200d6bc0 msgr2=0x7f6d200d5480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.338+0000 7f6d29546640 0 -- 172.21.15.99:0/2730637771 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f6d1c061fe0 msgr2=0x7f6d1c069830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:08.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 zone default found 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 4 Realm: () 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 zonegroup default 2024-09-05T01:12:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.346+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.350+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.350+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.350+0000 7f6d2ba409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.350+0000 7f6d2ba409c0 20 started sync module instance, tier type = 2024-09-05T01:12:08.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.350+0000 7f6d2ba409c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:08.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=0 2024-09-05T01:12:08.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=1 2024-09-05T01:12:08.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=2 2024-09-05T01:12:08.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=3 2024-09-05T01:12:08.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=4 2024-09-05T01:12:08.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=5 2024-09-05T01:12:08.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.362+0000 7f6d2ba409c0 20 add_watcher() i=6 2024-09-05T01:12:08.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6d2ba409c0 20 add_watcher() i=7 2024-09-05T01:12:08.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6d2ba409c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:08.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6bdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6d2ba409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:08.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6d2ba409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:08.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.366+0000 7f6d2ba409c0 5 note: GC not initialized 2024-09-05T01:12:08.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6bde7e4640 20 reqs_thread_entry: start 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 Filter name: none 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6b4ffff640 20 reqs_thread_entry: start 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 : miss 2024-09-05T01:12:08.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:08.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.370+0000 7f6d2ba409c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 2024-09-05T01:12:08.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.378+0000 7f6d2ba409c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-05T01:12:08.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.378+0000 7f6d2ba409c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-05T01:12:08.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.386+0000 7f6bdf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.390+0000 7f6d2ba409c0 20 remove_watcher() i=0 2024-09-05T01:12:08.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.390+0000 7f6d2ba409c0 2 removed watcher, disabling cache 2024-09-05T01:12:08.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.390+0000 7f6d2ba409c0 20 remove_watcher() i=1 2024-09-05T01:12:08.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.394+0000 7f6d2ba409c0 20 remove_watcher() i=2 2024-09-05T01:12:08.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.394+0000 7f6d2ba409c0 20 remove_watcher() i=3 2024-09-05T01:12:08.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.398+0000 7f6d2ba409c0 20 remove_watcher() i=4 2024-09-05T01:12:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.398+0000 7f6d2ba409c0 20 remove_watcher() i=5 2024-09-05T01:12:08.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.398+0000 7f6d2ba409c0 20 remove_watcher() i=6 2024-09-05T01:12:08.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.402+0000 7f6d2ba409c0 20 remove_watcher() i=7 2024-09-05T01:12:08.413 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-05T01:12:08.440 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:08.440 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:08.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 realm 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.486+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.490+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.490+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.490+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:08.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.490+0000 7fb47bf199c0 20 searching for the correct realm 2024-09-05T01:12:08.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.494+0000 7fb479a1f640 0 -- 172.21.15.99:0/1771530822 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb474077040 msgr2=0x7fb47405f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:08.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.502+0000 7fb479a1f640 0 -- 172.21.15.99:0/1771530822 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fb474060d90 msgr2=0x7fb47407a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:08.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:08.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 zone default found 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 4 Realm: () 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:08.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:08.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 zonegroup default 2024-09-05T01:12:08.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 started sync module instance, tier type = 2024-09-05T01:12:08.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.510+0000 7fb47bf199c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:08.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=0 2024-09-05T01:12:08.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=1 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=2 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=3 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=4 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=5 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=6 2024-09-05T01:12:08.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 20 add_watcher() i=7 2024-09-05T01:12:08.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.526+0000 7fb47bf199c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:08.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb32b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 5 note: GC not initialized 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb32a7fc640 20 reqs_thread_entry: start 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:08.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 Filter name: none 2024-09-05T01:12:08.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb29bfff640 20 reqs_thread_entry: start 2024-09-05T01:12:08.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.530+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.534+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.534+0000 7fb47bf199c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.534+0000 7fb47bf199c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.534+0000 7fb47bf199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.534+0000 7fb32b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.538+0000 7fb47bf199c0 20 remove_watcher() i=0 2024-09-05T01:12:08.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.538+0000 7fb47bf199c0 2 removed watcher, disabling cache 2024-09-05T01:12:08.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.542+0000 7fb47bf199c0 20 remove_watcher() i=1 2024-09-05T01:12:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.542+0000 7fb47bf199c0 20 remove_watcher() i=2 2024-09-05T01:12:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.546+0000 7fb47bf199c0 20 remove_watcher() i=3 2024-09-05T01:12:08.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.546+0000 7fb47bf199c0 20 remove_watcher() i=4 2024-09-05T01:12:08.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.550+0000 7fb47bf199c0 20 remove_watcher() i=5 2024-09-05T01:12:08.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.550+0000 7fb47bf199c0 20 remove_watcher() i=6 2024-09-05T01:12:08.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.550+0000 7fb47bf199c0 20 remove_watcher() i=7 2024-09-05T01:12:08.562 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:08.563 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:08.563 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:08.563 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:08.661 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:12:08.696 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:08.696 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:08.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.738+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 realm 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.742+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.746+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:08.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.746+0000 7f0a872509c0 20 searching for the correct realm 2024-09-05T01:12:08.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.750+0000 7f0a85557640 0 -- 172.21.15.99:0/1491426098 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x556ac6e39c90 msgr2=0x556ac6e3c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.758+0000 7f0a84555640 0 -- 172.21.15.99:0/1491426098 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x556ac6e2d490 msgr2=0x556ac6e2f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:08.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:08.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.762+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 zone default found 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 4 Realm: () 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:08.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 zonegroup default 2024-09-05T01:12:08.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 started sync module instance, tier type = 2024-09-05T01:12:08.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.766+0000 7f0a872509c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=0 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=1 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=2 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=3 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=4 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=5 2024-09-05T01:12:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=6 2024-09-05T01:12:08.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 20 add_watcher() i=7 2024-09-05T01:12:08.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.782+0000 7f0a872509c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f093afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:08.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 5 note: GC not initialized 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0939fe3640 20 reqs_thread_entry: start 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 Filter name: none 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f08ab7fe640 20 reqs_thread_entry: start 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 : miss 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.786+0000 7f0a872509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 2024-09-05T01:12:08.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22, ofs0, ns] 2024-09-05T01:12:08.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f095bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 93917091705392 notifier 6522 bl.length()=925 2024-09-05T01:12:08.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f095bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f095bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f095bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_sources= new_sources= 2024-09-05T01:12:08.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential sources added=[] removed=[] 2024-09-05T01:12:08.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_dests= new_dests= 2024-09-05T01:12:08.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.798+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential dests added=[] removed=[] 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.0 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.0 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.1 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.1 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.2 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.2 2024-09-05T01:12:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.3 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.3 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.4 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.4 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.5 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.5 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.6 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.6 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.7 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.7 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.8 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.8 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.9 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.9 2024-09-05T01:12:08.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.10 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.10 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.11 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1.11 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.0 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1 2024-09-05T01:12:08.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.2 2024-09-05T01:12:08.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.810+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.3 2024-09-05T01:12:08.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.4 2024-09-05T01:12:08.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.5 2024-09-05T01:12:08.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.6 2024-09-05T01:12:08.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.7 2024-09-05T01:12:08.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.8 2024-09-05T01:12:08.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.814+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.9 2024-09-05T01:12:08.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.818+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.10 2024-09-05T01:12:08.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.822+0000 7f0a872509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:08.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.822+0000 7f0a872509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 2024-09-05T01:12:08.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22, ofs0, ns] 2024-09-05T01:12:08.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f095b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 93917091705392 notifier 6522 bl.length()=925 2024-09-05T01:12:08.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f095b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f095b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f095b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_sources= new_sources= 2024-09-05T01:12:08.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential sources added=[] removed=[] 2024-09-05T01:12:08.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_dests= new_dests= 2024-09-05T01:12:08.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.826+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential dests added=[] removed=[] 2024-09-05T01:12:08.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.0 2024-09-05T01:12:08.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.1 2024-09-05T01:12:08.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.2 2024-09-05T01:12:08.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.3 2024-09-05T01:12:08.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.4 2024-09-05T01:12:08.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.5 2024-09-05T01:12:08.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.6 2024-09-05T01:12:08.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.834+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.7 2024-09-05T01:12:08.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.8 2024-09-05T01:12:08.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.9 2024-09-05T01:12:08.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22.10 2024-09-05T01:12:08.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:08.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 2024-09-05T01:12:08.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.838+0000 7f0a872509c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22, ofs0, ns] 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f095b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 93917091705392 notifier 6522 bl.length()=893 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f095b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 info.flags=0x17 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f095b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 to cache LRU end 2024-09-05T01:12:08.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f095b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:08.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_sources= new_sources= 2024-09-05T01:12:08.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential sources added=[] removed=[] 2024-09-05T01:12:08.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): orig_dests= new_dests= 2024-09-05T01:12:08.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.842+0000 7f0a872509c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22]): potential dests added=[] removed=[] 2024-09-05T01:12:08.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.846+0000 7f0a872509c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:08.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.850+0000 7f093afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.854+0000 7f0a872509c0 20 remove_watcher() i=0 2024-09-05T01:12:08.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.854+0000 7f0a872509c0 2 removed watcher, disabling cache 2024-09-05T01:12:08.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.854+0000 7f0a872509c0 20 remove_watcher() i=1 2024-09-05T01:12:08.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.858+0000 7f0a872509c0 20 remove_watcher() i=2 2024-09-05T01:12:08.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.858+0000 7f0a872509c0 20 remove_watcher() i=3 2024-09-05T01:12:08.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.862+0000 7f0a872509c0 20 remove_watcher() i=4 2024-09-05T01:12:08.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.862+0000 7f0a872509c0 20 remove_watcher() i=5 2024-09-05T01:12:08.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.866+0000 7f0a872509c0 20 remove_watcher() i=6 2024-09-05T01:12:08.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.866+0000 7f0a872509c0 20 remove_watcher() i=7 2024-09-05T01:12:08.878 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-05T01:12:08.904 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:08.905 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:08.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.946+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 realm 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.950+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.954+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:08.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.954+0000 7eff7be229c0 20 searching for the correct realm 2024-09-05T01:12:08.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.958+0000 7eff79928640 0 -- 172.21.15.99:0/2809035890 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7eff74021070 msgr2=0x7eff7405e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.966+0000 7eff79928640 0 -- 172.21.15.99:0/2809035890 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7eff7405fa10 msgr2=0x7eff74060a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 zone default found 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 4 Realm: () 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:08.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 zonegroup default 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.970+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.974+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.974+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.974+0000 7eff7be229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:08.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.974+0000 7eff7be229c0 20 started sync module instance, tier type = 2024-09-05T01:12:08.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.974+0000 7eff7be229c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:08.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=0 2024-09-05T01:12:08.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=1 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=2 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=3 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=4 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=5 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=6 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 20 add_watcher() i=7 2024-09-05T01:12:08.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7eff7be229c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:08.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.990+0000 7efe2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:08.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:08.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:08.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 5 note: GC not initialized 2024-09-05T01:12:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7efe2a7fc640 20 reqs_thread_entry: start 2024-09-05T01:12:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 Filter name: none 2024-09-05T01:12:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7efd9bfff640 20 reqs_thread_entry: start 2024-09-05T01:12:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:08.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.994+0000 7eff7be229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:08.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:08.998+0000 7efe2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.002+0000 7eff7be229c0 20 remove_watcher() i=0 2024-09-05T01:12:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.002+0000 7eff7be229c0 2 removed watcher, disabling cache 2024-09-05T01:12:09.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.006+0000 7eff7be229c0 20 remove_watcher() i=1 2024-09-05T01:12:09.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.006+0000 7eff7be229c0 20 remove_watcher() i=2 2024-09-05T01:12:09.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.010+0000 7eff7be229c0 20 remove_watcher() i=3 2024-09-05T01:12:09.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.010+0000 7eff7be229c0 20 remove_watcher() i=4 2024-09-05T01:12:09.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.010+0000 7eff7be229c0 20 remove_watcher() i=5 2024-09-05T01:12:09.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.014+0000 7eff7be229c0 20 remove_watcher() i=6 2024-09-05T01:12:09.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:09.014+0000 7eff7be229c0 20 remove_watcher() i=7 2024-09-05T01:12:09.026 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:09.026 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:09.026 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:12:09.026 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:09.937 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-05T01:12:09.937 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:12.066 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-05T01:12:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:12.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.142+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 realm 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:12.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.146+0000 7f31d47029c0 20 searching for the correct realm 2024-09-05T01:12:12.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.154+0000 7f31d2208640 0 -- 172.21.15.99:0/2499164646 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f31cc0c6420 msgr2=0x7f31cc0c6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:12.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.162+0000 7f31d2208640 0 -- 172.21.15.99:0/2499164646 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f31cc0d7040 msgr2=0x7f31cc0aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:12.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:12.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:12.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:12.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:12.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:12.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:12.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.166+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 zone default found 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 4 Realm: () 2024-09-05T01:12:12.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 zonegroup default 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 started sync module instance, tier type = 2024-09-05T01:12:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.170+0000 7f31d47029c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=0 2024-09-05T01:12:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=1 2024-09-05T01:12:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=2 2024-09-05T01:12:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=3 2024-09-05T01:12:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=4 2024-09-05T01:12:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=5 2024-09-05T01:12:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=6 2024-09-05T01:12:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 20 add_watcher() i=7 2024-09-05T01:12:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.186+0000 7f31d47029c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:12.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f3088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 5 note: GC not initialized 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f30037fe640 20 reqs_thread_entry: start 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 Filter name: none 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f30017fa640 20 reqs_thread_entry: start 2024-09-05T01:12:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:12.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.190+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.194+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.194+0000 7f31d47029c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.194+0000 7f31d47029c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.194+0000 7f31d47029c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:12.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.194+0000 7f3088fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.202+0000 7f31d47029c0 20 remove_watcher() i=0 2024-09-05T01:12:12.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.202+0000 7f31d47029c0 2 removed watcher, disabling cache 2024-09-05T01:12:12.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.202+0000 7f31d47029c0 20 remove_watcher() i=1 2024-09-05T01:12:12.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.206+0000 7f31d47029c0 20 remove_watcher() i=2 2024-09-05T01:12:12.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.206+0000 7f31d47029c0 20 remove_watcher() i=3 2024-09-05T01:12:12.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.210+0000 7f31d47029c0 20 remove_watcher() i=4 2024-09-05T01:12:12.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.210+0000 7f31d47029c0 20 remove_watcher() i=5 2024-09-05T01:12:12.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.210+0000 7f31d47029c0 20 remove_watcher() i=6 2024-09-05T01:12:12.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.214+0000 7f31d47029c0 20 remove_watcher() i=7 2024-09-05T01:12:12.225 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:12.225 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:12.225 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:12.225 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:12.225 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-05T01:12:12.261 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:12.261 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:12.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 realm 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.306+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.310+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.310+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.310+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:12.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.310+0000 7ff2430bb9c0 20 searching for the correct realm 2024-09-05T01:12:12.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.314+0000 7ff2413c2640 0 -- 172.21.15.99:0/3787258063 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x557a63b22220 msgr2=0x557a63b246e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:12.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.326+0000 7ff240bc1640 0 -- 172.21.15.99:0/3787258063 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7ff2380c1020 msgr2=0x7ff2381144e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:12.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:12.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 zone default found 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 4 Realm: () 2024-09-05T01:12:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 zonegroup default 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.330+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.334+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.334+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.334+0000 7ff2430bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.334+0000 7ff2430bb9c0 20 started sync module instance, tier type = 2024-09-05T01:12:12.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.334+0000 7ff2430bb9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=0 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=1 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=2 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=3 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=4 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=5 2024-09-05T01:12:12.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.346+0000 7ff2430bb9c0 20 add_watcher() i=6 2024-09-05T01:12:12.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff2430bb9c0 20 add_watcher() i=7 2024-09-05T01:12:12.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff2430bb9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:12.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff0f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff2430bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:12.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff2430bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:12.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.350+0000 7ff2430bb9c0 5 note: GC not initialized 2024-09-05T01:12:12.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff0f5fe3640 20 reqs_thread_entry: start 2024-09-05T01:12:12.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 Filter name: none 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff0677fe640 20 reqs_thread_entry: start 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 : miss 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:12.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.354+0000 7ff2430bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 2024-09-05T01:12:12.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.362+0000 7ff2430bb9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-05T01:12:12.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23, ofs0, ns] 2024-09-05T01:12:12.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464306 cookie 93984147011424 notifier 6248 bl.length()=925 2024-09-05T01:12:12.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_sources= new_sources= 2024-09-05T01:12:12.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential sources added=[] removed=[] 2024-09-05T01:12:12.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_dests= new_dests= 2024-09-05T01:12:12.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.366+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential dests added=[] removed=[] 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.0 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.0 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.1 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.1 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.2 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.2 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.3 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.3 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.4 2024-09-05T01:12:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.4 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.5 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.5 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.6 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.6 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.7 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.7 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.8 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.8 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.9 2024-09-05T01:12:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.9 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.10 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.10 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.11 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1.11 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.0 2024-09-05T01:12:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.378+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1 2024-09-05T01:12:12.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.382+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.2 2024-09-05T01:12:12.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.382+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.3 2024-09-05T01:12:12.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.382+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.4 2024-09-05T01:12:12.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.382+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.5 2024-09-05T01:12:12.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.386+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.6 2024-09-05T01:12:12.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.386+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.7 2024-09-05T01:12:12.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.386+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.8 2024-09-05T01:12:12.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.386+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.9 2024-09-05T01:12:12.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.390+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.10 2024-09-05T01:12:12.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.394+0000 7ff2430bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:12.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.394+0000 7ff2430bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 2024-09-05T01:12:12.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23, ofs0, ns] 2024-09-05T01:12:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 93984147011424 notifier 6248 bl.length()=925 2024-09-05T01:12:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_sources= new_sources= 2024-09-05T01:12:12.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential sources added=[] removed=[] 2024-09-05T01:12:12.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_dests= new_dests= 2024-09-05T01:12:12.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.398+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential dests added=[] removed=[] 2024-09-05T01:12:12.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.406+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.0 2024-09-05T01:12:12.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.406+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.1 2024-09-05T01:12:12.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.406+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.2 2024-09-05T01:12:12.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.406+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.3 2024-09-05T01:12:12.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.4 2024-09-05T01:12:12.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.5 2024-09-05T01:12:12.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.6 2024-09-05T01:12:12.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.7 2024-09-05T01:12:12.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.8 2024-09-05T01:12:12.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.410+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.9 2024-09-05T01:12:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23.10 2024-09-05T01:12:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 2024-09-05T01:12:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff2430bb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23, ofs0, ns] 2024-09-05T01:12:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff1177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 93984147011424 notifier 6248 bl.length()=893 2024-09-05T01:12:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff1177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 info.flags=0x17 2024-09-05T01:12:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff1177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 to cache LRU end 2024-09-05T01:12:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.414+0000 7ff1177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.418+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_sources= new_sources= 2024-09-05T01:12:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.418+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential sources added=[] removed=[] 2024-09-05T01:12:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.418+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): orig_dests= new_dests= 2024-09-05T01:12:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.418+0000 7ff2430bb9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23]): potential dests added=[] removed=[] 2024-09-05T01:12:12.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.426+0000 7ff2430bb9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:12.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.434+0000 7ff0f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.438+0000 7ff2430bb9c0 20 remove_watcher() i=0 2024-09-05T01:12:12.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.438+0000 7ff2430bb9c0 2 removed watcher, disabling cache 2024-09-05T01:12:12.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.438+0000 7ff2430bb9c0 20 remove_watcher() i=1 2024-09-05T01:12:12.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.442+0000 7ff2430bb9c0 20 remove_watcher() i=2 2024-09-05T01:12:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.442+0000 7ff2430bb9c0 20 remove_watcher() i=3 2024-09-05T01:12:12.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.446+0000 7ff2430bb9c0 20 remove_watcher() i=4 2024-09-05T01:12:12.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.446+0000 7ff2430bb9c0 20 remove_watcher() i=5 2024-09-05T01:12:12.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.446+0000 7ff2430bb9c0 20 remove_watcher() i=6 2024-09-05T01:12:12.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.450+0000 7ff2430bb9c0 20 remove_watcher() i=7 2024-09-05T01:12:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-05T01:12:12.489 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:12.489 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:12.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 realm 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.534+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.538+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.538+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.538+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:12.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.538+0000 7f9a5f4459c0 20 searching for the correct realm 2024-09-05T01:12:12.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.542+0000 7f9a5d74c640 0 -- 172.21.15.99:0/1619903145 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f9a5006c620 msgr2=0x7f9a500625a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:12.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.758+0000 7f9a5d74c640 0 -- 172.21.15.99:0/1619903145 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f9a5006c620 msgr2=0x7f9a500625a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:12.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:12.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 zone default found 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 4 Realm: () 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 zonegroup default 2024-09-05T01:12:12.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.770+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:12.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 started sync module instance, tier type = 2024-09-05T01:12:12.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.774+0000 7f9a5f4459c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=0 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=1 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=2 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=3 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=4 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=5 2024-09-05T01:12:12.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.794+0000 7f9a5f4459c0 20 add_watcher() i=6 2024-09-05T01:12:12.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.798+0000 7f9a5f4459c0 20 add_watcher() i=7 2024-09-05T01:12:12.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.798+0000 7f9a5f4459c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:12.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9912fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:12.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:12.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 5 note: GC not initialized 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9911fe3640 20 reqs_thread_entry: start 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 Filter name: none 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f98837fe640 20 reqs_thread_entry: start 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:12.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.802+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.806+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.806+0000 7f9a5f4459c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:12.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.806+0000 7f9a5f4459c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:12.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.806+0000 7f9a5f4459c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:12.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.806+0000 7f9912fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:12.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.814+0000 7f9a5f4459c0 20 remove_watcher() i=0 2024-09-05T01:12:12.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.814+0000 7f9a5f4459c0 2 removed watcher, disabling cache 2024-09-05T01:12:12.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.814+0000 7f9a5f4459c0 20 remove_watcher() i=1 2024-09-05T01:12:12.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.818+0000 7f9a5f4459c0 20 remove_watcher() i=2 2024-09-05T01:12:12.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.818+0000 7f9a5f4459c0 20 remove_watcher() i=3 2024-09-05T01:12:12.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.822+0000 7f9a5f4459c0 20 remove_watcher() i=4 2024-09-05T01:12:12.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.822+0000 7f9a5f4459c0 20 remove_watcher() i=5 2024-09-05T01:12:12.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.822+0000 7f9a5f4459c0 20 remove_watcher() i=6 2024-09-05T01:12:12.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:12.826+0000 7f9a5f4459c0 20 remove_watcher() i=7 2024-09-05T01:12:12.838 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:12.838 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:12.838 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-05T01:12:12.838 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:13.803 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-05T01:12:13.803 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:15.986 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-05T01:12:16.018 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:16.018 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:16.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 realm 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.066+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.070+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.070+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.070+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.070+0000 7f80052c79c0 20 searching for the correct realm 2024-09-05T01:12:16.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.078+0000 7f80035ce640 0 -- 172.21.15.99:0/2118013310 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7ff8015070 msgr2=0x7f7ff8015450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.086+0000 7f80025cc640 0 -- 172.21.15.99:0/2118013310 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x563f13b7c780 msgr2=0x563f13b7eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 zone default found 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 4 Realm: () 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 zonegroup default 2024-09-05T01:12:16.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.094+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.098+0000 7f80052c79c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=0 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=1 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=2 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=3 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=4 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=5 2024-09-05T01:12:16.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=6 2024-09-05T01:12:16.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 20 add_watcher() i=7 2024-09-05T01:12:16.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.114+0000 7f80052c79c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f7eb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 5 note: GC not initialized 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f7e33fff640 20 reqs_thread_entry: start 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 Filter name: none 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f7e31ffb640 20 reqs_thread_entry: start 2024-09-05T01:12:16.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.118+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:16.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.122+0000 7f80052c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:16.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.126+0000 7f7eb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.130+0000 7f80052c79c0 20 remove_watcher() i=0 2024-09-05T01:12:16.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.130+0000 7f80052c79c0 2 removed watcher, disabling cache 2024-09-05T01:12:16.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.134+0000 7f80052c79c0 20 remove_watcher() i=1 2024-09-05T01:12:16.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.138+0000 7f80052c79c0 20 remove_watcher() i=2 2024-09-05T01:12:16.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.138+0000 7f80052c79c0 20 remove_watcher() i=3 2024-09-05T01:12:16.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.142+0000 7f80052c79c0 20 remove_watcher() i=4 2024-09-05T01:12:16.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.142+0000 7f80052c79c0 20 remove_watcher() i=5 2024-09-05T01:12:16.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.142+0000 7f80052c79c0 20 remove_watcher() i=6 2024-09-05T01:12:16.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.146+0000 7f80052c79c0 20 remove_watcher() i=7 2024-09-05T01:12:16.157 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.157 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:16.157 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:16.157 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.157 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-05T01:12:16.189 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:16.189 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:16.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 realm 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 searching for the correct realm 2024-09-05T01:12:16.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.242+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f92dc067160 msgr2=0x7f92dc05f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.254+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f92dc05f5b0 msgr2=0x7f92dc093270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zone default found 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Realm: () 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zonegroup default 2024-09-05T01:12:16.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=0 2024-09-05T01:12:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=1 2024-09-05T01:12:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=2 2024-09-05T01:12:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=3 2024-09-05T01:12:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=4 2024-09-05T01:12:16.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=5 2024-09-05T01:12:16.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=6 2024-09-05T01:12:16.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.494+0000 7f92e4af09c0 20 add_watcher() i=7 2024-09-05T01:12:16.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.494+0000 7f92e4af09c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f9198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 note: GC not initialized 2024-09-05T01:12:16.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f91137fe640 20 reqs_thread_entry: start 2024-09-05T01:12:16.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 Filter name: none 2024-09-05T01:12:16.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f91117fa640 20 reqs_thread_entry: start 2024-09-05T01:12:16.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-05T01:12:16.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-05T01:12:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-05T01:12:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : miss 2024-09-05T01:12:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:16.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:16.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:16.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:16.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:16.509 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f92e4af09c0 time 2024-09-05T01:12:16.515696+0000 2024-09-05T01:12:16.510 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f92e83ca2eb] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:12:16.511 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f92e4af09c0 thread_name:radosgw-admin 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.510+0000 7f92e4af09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f92e4af09c0 time 2024-09-05T01:12:16.515696+0000 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f92e83ca2eb] 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:12:16.512 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.513 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:12:16.513 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:12:16.513 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.521 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f92e7249520] 2024-09-05T01:12:16.521 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f92e83ca345] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:12:16.522 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.514+0000 7f92e4af09c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f92e4af09c0 thread_name:radosgw-admin 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f92e7249520] 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f92e83ca345] 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.523 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.524 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_done global_id 6284 payload 274 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:12:16.214+0000 7f92e25f6640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551dc94ee0 auth_method 0 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: dump: 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: dump: 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6284 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: get_monmap_and_config success 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 4 set_mon_vals no callback set 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: shutdown 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) unregister_commands rotate-key 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.527 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.528 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.529 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: starting msgr at 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: starting objecter 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests hook 0x56551dddd060 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: setting wanted keys 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: calling monclient init 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.530 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key hook 0x56551ddd8c98 2024-09-05T01:12:16.531 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dc940f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551dc94ee0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551dd1de00 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.678514s 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dc94ee0 auth_method 0 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.532 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551dd1de00 auth_method 0 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:12:16.214+0000 7f92e1df5640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.533 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551dc940f0 auth_method 0 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: dump: 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.534 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: dump: 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:12:16.214+0000 7f91d0608640 4 set_mon_vals no callback set 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6287 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: init done 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:12:16.218+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91c8070ae0 auth_method 0 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:12:16.218+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551de004f0 auth_method 0 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:12:16.218+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551de23450 auth_method 0 2024-09-05T01:12:16.536 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:12:16.222+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551de277b0 auth_method 0 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.537 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.538 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56551de30090 EEXIST 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.539 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x56551de2ae40 EEXIST 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551de54240 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551de53b70 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551de52550 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.540 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.688432s 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551de53b70 auth_method 0 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551de52550 auth_method 0 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.541 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551de54240 auth_method 0 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:12:16.226+0000 7f92e2df7640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: dump: 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.542 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: dump: 2024-09-05T01:12:16.543 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6290 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:12:16.226+0000 7f92e35f8640 4 set_mon_vals no callback set 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.544 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: get_monmap_and_config 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.545 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.546 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91bc070a20 auth_method 0 2024-09-05T01:12:16.547 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.548 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff105721d8 EEXIST 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551dea8000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dea3440 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551de99b10 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.549 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.692823s 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551dea8000 auth_method 0 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551de99b10 auth_method 0 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.550 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dea3440 auth_method 0 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_done global_id 6293 payload 274 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:12:16.230+0000 7f92e2df7640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: dump: 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.551 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6293 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: get_monmap_and_config success 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 4 set_mon_vals no callback set 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.552 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: dump: 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: shutdown 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.553 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.554 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: starting msgr at 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: starting objecter 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56551de766a0 EEXIST 2024-09-05T01:12:16.555 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: setting wanted keys 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: calling monclient init 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.556 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x56551de561a8 EEXIST 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551de99b10 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551dea3440 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dea8000 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.557 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.695318s 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551de99b10 auth_method 0 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dea3440 auth_method 0 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.558 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551dea8000 auth_method 0 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_done global_id 6296 payload 824 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:12:16.230+0000 7f92e1df5640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: dump: 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.559 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: dump: 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.560 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:12:16.234+0000 7f91c5ffb640 4 set_mon_vals no callback set 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6296 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 1 librados: init done 2024-09-05T01:12:16.561 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cr dump hook 0x56551de9cd38 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:12:16.234+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551dec1e00 auth_method 0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:12:16.234+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91ac070b10 auth_method 0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 realm 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.562 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:12:16.238+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551dec6030 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:12:16.238+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551dec9900 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 searching for the correct realm 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:12:16.238+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551dece690 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:12:16.238+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc067160 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:12:16.242+0000 7f92e1df5640 10 monclient: get_auth_request con 0x7f92d40ec030 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:12:16.242+0000 7f92e2df7640 10 monclient: get_auth_request con 0x7f92d800a040 auth_method 0 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:12:16.242+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f92dc067160 msgr2=0x7f92dc05f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:16.563 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:12:16.242+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x7f92dc067160 session 0x7f92dc016040 osd.7 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:12:16.242+0000 7f91b3fff640 10 monclient: _renew_subs 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:12:16.242+0000 7f91b3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:12:16.242+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91ac080930 auth_method 0 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:12:16.246+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc05f5b0 auth_method 0 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:12:16.254+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f92dc05f5b0 msgr2=0x7f92dc093270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:12:16.254+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x7f92dc05f5b0 session 0x7f92dc05f440 osd.6 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:12:16.254+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc067160 auth_method 0 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:12:16.254+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x56551dece690 session 0x56551dece010 osd.3 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:12:16.458+0000 7f92e2df7640 10 monclient: get_auth_request con 0x7f91ac085ff0 auth_method 0 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.564 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zone default found 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Realm: () 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.565 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zonegroup default 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=0 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=1 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=2 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=3 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=4 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=5 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=6 2024-09-05T01:12:16.566 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:12:16.494+0000 7f92e4af09c0 20 add_watcher() i=7 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:12:16.494+0000 7f92e4af09c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.567 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:12:16.498+0000 7f9198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache list hook 0x56551de98ef0 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache inspect hook 0x56551de98ef0 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache erase hook 0x56551de98ef0 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache zap hook 0x56551de98ef0 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 note: GC not initialized 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:12:16.498+0000 7f91137fe640 20 reqs_thread_entry: start 2024-09-05T01:12:16.568 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace show hook 0x7f92d8060040 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace history hook 0x7f92d8060040 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace active hook 0x7f92d8060040 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace active_short hook 0x7f92d8060040 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 Filter name: none 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:12:16.498+0000 7f91117fa640 20 reqs_thread_entry: start 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : miss 2024-09-05T01:12:16.569 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:12:16.510+0000 7f92e4af09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f92e4af09c0 time 2024-09-05T01:12:16.515696+0000 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f92e83ca2eb] 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.570 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:12:16.514+0000 7f92e4af09c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f92e4af09c0 thread_name:radosgw-admin 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f92e7249520] 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:12:16.571 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f92e83ca345] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:12:16.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:12:16.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:12:16.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:12:16.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:12:16.576 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:12:16.577 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:12:16.578 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91117fa640 / http_manager 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91137fe640 / http_manager 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f9198fe1640 / rgw_dt_lg_renew 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91b3fff640 / ms_dispatch 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91c5ffb640 / io_context_pool 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91c7fff640 / ms_dispatch 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91cee05640 / ms_dispatch 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91d0608640 / io_context_pool 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e1df5640 / msgr-worker-2 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e25f6640 / msgr-worker-1 2024-09-05T01:12:16.579 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e2df7640 / msgr-worker-0 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e35f8640 / io_context_pool 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e4af09c0 / radosgw-admin 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.90455.log 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:12:16.210+0000 7f92e25f6640 10 monclient(hunting): handle_auth_done global_id 6284 payload 274 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:12:16.214+0000 7f92e25f6640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.580 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551dc94ee0 auth_method 0 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: dump: 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.581 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:12:16.214+0000 7f91d0608640 10 monclient: dump: 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.582 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6284 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: get_monmap_and_config success 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 4 set_mon_vals no callback set 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: shutdown 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) unregister_commands rotate-key 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.583 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding auth protocol: cephx 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.584 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: crc 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddddbe0) adding con mode: secure 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: starting msgr at 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: starting objecter 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests hook 0x56551dddd060 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: setting wanted keys 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: calling monclient init 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding auth protocol: cephx 2024-09-05T01:12:16.585 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: crc 2024-09-05T01:12:16.586 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 AuthRegistry(0x56551ddd8b50) adding con mode: secure 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key hook 0x56551ddd8c98 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dc940f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551dc94ee0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551dd1de00 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.678514s 2024-09-05T01:12:16.587 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dc94ee0 auth_method 0 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551dd1de00 auth_method 0 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:12:16.214+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient(hunting): handle_auth_done global_id 6287 payload 824 2024-09-05T01:12:16.588 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:12:16.214+0000 7f92e1df5640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:12:16.214+0000 7f92e1df5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:12:16.214+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551dc940f0 auth_method 0 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: dump: 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.589 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:12:16.214+0000 7f91cee05640 10 monclient: dump: 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.590 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:12:16.214+0000 7f91d0608640 4 set_mon_vals no callback set 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6287 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:12:16.214+0000 7f92e4af09c0 1 librados: init done 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.591 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:12:16.218+0000 7f91cee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:12:16.218+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91c8070ae0 auth_method 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:12:16.218+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551de004f0 auth_method 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:12:16.218+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551de23450 auth_method 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:12:16.222+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551de277b0 auth_method 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding auth protocol: cephx 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.593 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: crc 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2c680) adding con mode: secure 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56551de30090 EEXIST 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding auth protocol: cephx 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.594 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: crc 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:12:16.222+0000 7f92e4af09c0 5 AuthRegistry(0x56551de2acf8) adding con mode: secure 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x56551de2ae40 EEXIST 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551de54240 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.595 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551de53b70 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551de52550 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.688432s 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551de53b70 auth_method 0 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551de52550 auth_method 0 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.596 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:12:16.226+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551de54240 auth_method 0 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:12:16.226+0000 7f92e2df7640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.597 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:12:16.226+0000 7f92e2df7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: dump: 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.598 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:12:16.226+0000 7f91c7fff640 10 monclient: dump: 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.599 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6290 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:12:16.226+0000 7f92e35f8640 4 set_mon_vals no callback set 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:12:16.226+0000 7f91c7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: get_monmap_and_config 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.600 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding auth protocol: cephx 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.601 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: crc 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:12:16.226+0000 7f92e4af09c0 5 AuthRegistry(0x56551de73b40) adding con mode: secure 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:12:16.226+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91bc070a20 auth_method 0 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding auth protocol: cephx 2024-09-05T01:12:16.602 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: crc 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572090) adding con mode: secure 2024-09-05T01:12:16.603 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff105721d8 EEXIST 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551dea8000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dea3440 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551de99b10 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.692823s 2024-09-05T01:12:16.604 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551dea8000 auth_method 0 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551de99b10 auth_method 0 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dea3440 auth_method 0 2024-09-05T01:12:16.605 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): handle_auth_done global_id 6293 payload 274 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:12:16.230+0000 7f92e2df7640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: dump: 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.606 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6293 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: get_monmap_and_config success 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 4 set_mon_vals no callback set 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.607 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:12:16.230+0000 7f91c5ffb640 10 monclient: dump: 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: shutdown 2024-09-05T01:12:16.608 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: build_initial_monmap 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 build_initial for_mkfs: 0 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: monmap: 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.609 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding auth protocol: cephx 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: crc 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de99fc0) adding con mode: secure 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.610 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: starting msgr at 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: starting objecter 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56551de766a0 EEXIST 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: setting wanted keys 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 1 librados: calling monclient init 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: init 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding auth protocol: cephx 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.611 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: crc 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 AuthRegistry(0x56551de56060) adding con mode: secure 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command rotate-key cmddesc rotate-key hook 0x56551de561a8 EEXIST 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _reopen_session rank -1 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-a con 0x56551de99b10 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-c con 0x56551dea3440 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): picked mon.noname-b con 0x56551dea8000 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:12:16.612 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): _renew_subs 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:12:16.230+0000 7f92e4af09c0 10 monclient(hunting): authenticate will time out at 2387.695318s 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request con 0x56551de99b10 auth_method 0 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request con 0x56551dea3440 auth_method 0 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.613 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:12:16.230+0000 7f92e25f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request con 0x56551dea8000 auth_method 0 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:12:16.230+0000 7f92e2df7640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient(hunting): handle_auth_done global_id 6296 payload 824 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient: _finish_hunting 0 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:12:16.230+0000 7f92e1df5640 1 monclient: found mon.noname-c 2024-09-05T01:12:16.614 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:12:16.230+0000 7f92e1df5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: dump: 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.615 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: _finish_auth 0 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: _check_auth_tickets 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:12:16.234+0000 7f91b3fff640 10 monclient: dump: 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:12:16.616 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:12:16.234+0000 7f91c5ffb640 4 set_mon_vals no callback set 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 5 monclient: authenticate success, global_id 6296 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _renew_subs 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 1 librados: init done 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cr dump hook 0x56551de9cd38 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.617 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:12:16.234+0000 7f91b3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:12:16.234+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551dec1e00 auth_method 0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:12:16.234+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91ac070b10 auth_method 0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 realm 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:12:16.234+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.618 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:12:16.238+0000 7f92e25f6640 10 monclient: get_auth_request con 0x56551dec6030 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:12:16.238+0000 7f92e1df5640 10 monclient: get_auth_request con 0x56551dec9900 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:12:16.238+0000 7f92e4af09c0 20 searching for the correct realm 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:12:16.238+0000 7f92e2df7640 10 monclient: get_auth_request con 0x56551dece690 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:12:16.238+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc067160 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:12:16.242+0000 7f92e1df5640 10 monclient: get_auth_request con 0x7f92d40ec030 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:12:16.242+0000 7f92e2df7640 10 monclient: get_auth_request con 0x7f92d800a040 auth_method 0 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:12:16.242+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f92dc067160 msgr2=0x7f92dc05f440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:12:16.242+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x7f92dc067160 session 0x7f92dc016040 osd.7 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:12:16.242+0000 7f91b3fff640 10 monclient: _renew_subs 2024-09-05T01:12:16.619 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:12:16.242+0000 7f91b3fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:12:16.242+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f91ac080930 auth_method 0 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:12:16.246+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc05f5b0 auth_method 0 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:12:16.254+0000 7f92e25f6640 0 -- 172.21.15.99:0/953174309 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f92dc05f5b0 msgr2=0x7f92dc093270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:12:16.254+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x7f92dc05f5b0 session 0x7f92dc05f440 osd.6 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:12:16.254+0000 7f92e25f6640 10 monclient: get_auth_request con 0x7f92dc067160 auth_method 0 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:12:16.254+0000 7f91b3fff640 1 client.6296.objecter ms_handle_reset 0x56551dece690 session 0x56551dece010 osd.3 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:12:16.458+0000 7f92e2df7640 10 monclient: get_auth_request con 0x7f91ac085ff0 auth_method 0 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.620 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:12:16.462+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zone default found 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Realm: () 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 zonegroup default 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.621 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:12:16.466+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:12:16.470+0000 7f92e4af09c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=0 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=1 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=2 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=3 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=4 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=5 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:12:16.490+0000 7f92e4af09c0 20 add_watcher() i=6 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:12:16.494+0000 7f92e4af09c0 20 add_watcher() i=7 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:12:16.494+0000 7f92e4af09c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.622 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding auth protocol: cephx 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.623 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: crc 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 AuthRegistry(0x7fff10572570) adding con mode: secure 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:12:16.498+0000 7f9198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache list hook 0x56551de98ef0 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache inspect hook 0x56551de98ef0 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache erase hook 0x56551de98ef0 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command cache zap hook 0x56551de98ef0 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 note: GC not initialized 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:12:16.498+0000 7f91137fe640 20 reqs_thread_entry: start 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace show hook 0x7f92d8060040 2024-09-05T01:12:16.624 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace history hook 0x7f92d8060040 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace active hook 0x7f92d8060040 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 5 asok(0x56551dbcb2b0) register_command sync trace active_short hook 0x7f92d8060040 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 Filter name: none 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:12:16.498+0000 7f91117fa640 20 reqs_thread_entry: start 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:12:16.498+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : miss 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.625 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:12:16.502+0000 7f92e4af09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:12:16.510+0000 7f92e4af09c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f92e4af09c0 time 2024-09-05T01:12:16.515696+0000 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f92e83ca2eb] 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.626 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:12:16.514+0000 7f92e4af09c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f92e4af09c0 thread_name:radosgw-admin 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f92e7249520] 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f92e83ca345] 2024-09-05T01:12:16.627 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f92e83ca49f] 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56551ab9f681] 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x1421df8) [0x56551b5fcdf8] 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56551abb4afd] 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f92e7230d90] 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:12:16.628 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:12:16.629 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:12:16.630 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:12:16.631 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:12:16.632 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:12:16.633 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:12:16.634 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91117fa640 / http_manager 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91137fe640 / http_manager 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f9198fe1640 / rgw_dt_lg_renew 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91b3fff640 / ms_dispatch 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91c5ffb640 / io_context_pool 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91c7fff640 / ms_dispatch 2024-09-05T01:12:16.635 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91cee05640 / ms_dispatch 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f91d0608640 / io_context_pool 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e1df5640 / msgr-worker-2 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e25f6640 / msgr-worker-1 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e2df7640 / msgr-worker-0 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e35f8640 / io_context_pool 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: 7f92e4af09c0 / radosgw-admin 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:12:16.518186Z_3d9b0392-e258-4215-b0fc-d3ae9b74e7d2/log 2024-09-05T01:12:16.636 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.594+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.594+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.594+0000 7f2e26d519c0 20 realm 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.594+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.598+0000 7f2e26d519c0 20 searching for the correct realm 2024-09-05T01:12:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.606+0000 7f2e24857640 0 -- 172.21.15.99:0/68186268 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f2e1c00b940 msgr2=0x7f2e1c025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.610+0000 7f2e24857640 0 -- 172.21.15.99:0/68186268 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f2e1c040910 msgr2=0x7f2e1c032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 zone default found 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 4 Realm: () 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 zonegroup default 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.618+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.622+0000 7f2e26d519c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=0 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=1 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=2 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=3 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=4 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=5 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=6 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 20 add_watcher() i=7 2024-09-05T01:12:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.638+0000 7f2e26d519c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 5 note: GC not initialized 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2cd9fe3640 20 reqs_thread_entry: start 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 Filter name: none 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2c4b7fe640 20 reqs_thread_entry: start 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:16.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.642+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.646+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.646+0000 7f2e26d519c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.646+0000 7f2e26d519c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.646+0000 7f2e26d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:16.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.650+0000 7f2cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.654+0000 7f2e26d519c0 20 remove_watcher() i=0 2024-09-05T01:12:16.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.654+0000 7f2e26d519c0 2 removed watcher, disabling cache 2024-09-05T01:12:16.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.654+0000 7f2e26d519c0 20 remove_watcher() i=1 2024-09-05T01:12:16.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.658+0000 7f2e26d519c0 20 remove_watcher() i=2 2024-09-05T01:12:16.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.658+0000 7f2e26d519c0 20 remove_watcher() i=3 2024-09-05T01:12:16.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.662+0000 7f2e26d519c0 20 remove_watcher() i=4 2024-09-05T01:12:16.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.662+0000 7f2e26d519c0 20 remove_watcher() i=5 2024-09-05T01:12:16.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.666+0000 7f2e26d519c0 20 remove_watcher() i=6 2024-09-05T01:12:16.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.666+0000 7f2e26d519c0 20 remove_watcher() i=7 2024-09-05T01:12:16.678 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.678 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:16.678 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:16.678 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:16.777 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:12:16.812 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:16.812 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:16.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.854+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 realm 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:16.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:16.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.858+0000 7f7e691ad9c0 20 searching for the correct realm 2024-09-05T01:12:16.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.866+0000 7f7e674b4640 0 -- 172.21.15.99:0/3472482462 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7e500ce040 msgr2=0x7f7e50137040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.870+0000 7f7e674b4640 0 -- 172.21.15.99:0/3472482462 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7d30080960 msgr2=0x7f7d30082d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.878+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 zone default found 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 4 Realm: () 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 zonegroup default 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 started sync module instance, tier type = 2024-09-05T01:12:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.882+0000 7f7e691ad9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=0 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=1 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=2 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=3 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=4 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=5 2024-09-05T01:12:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=6 2024-09-05T01:12:16.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 20 add_watcher() i=7 2024-09-05T01:12:16.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.898+0000 7f7e691ad9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:16.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7d1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 5 note: GC not initialized 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7c97fff640 20 reqs_thread_entry: start 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 Filter name: none 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7c95ffb640 20 reqs_thread_entry: start 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-05T01:12:16.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-05T01:12:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-05T01:12:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : miss 2024-09-05T01:12:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.902+0000 7f7e691ad9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:16.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7e691ad9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to be held by another RGW process; skipping for now 2024-09-05T01:12:16.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.906+0000 7f7d1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:16.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.914+0000 7f7e691ad9c0 20 remove_watcher() i=0 2024-09-05T01:12:16.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.914+0000 7f7e691ad9c0 2 removed watcher, disabling cache 2024-09-05T01:12:16.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.914+0000 7f7e691ad9c0 20 remove_watcher() i=1 2024-09-05T01:12:16.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.918+0000 7f7e691ad9c0 20 remove_watcher() i=2 2024-09-05T01:12:16.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.918+0000 7f7e691ad9c0 20 remove_watcher() i=3 2024-09-05T01:12:16.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.922+0000 7f7e691ad9c0 20 remove_watcher() i=4 2024-09-05T01:12:16.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.922+0000 7f7e691ad9c0 20 remove_watcher() i=5 2024-09-05T01:12:16.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.922+0000 7f7e691ad9c0 20 remove_watcher() i=6 2024-09-05T01:12:16.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:16.926+0000 7f7e691ad9c0 20 remove_watcher() i=7 2024-09-05T01:12:16.936 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:12:46.968 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:12:47.004 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:47.004 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:47.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.049+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.049+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.049+0000 7f5bb94659c0 20 realm 2024-09-05T01:12:47.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.049+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:47.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:47.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:47.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.053+0000 7f5bb94659c0 20 searching for the correct realm 2024-09-05T01:12:47.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.057+0000 7f5bb776c640 0 -- 172.21.15.99:0/2167916413 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5bac008040 msgr2=0x7f5bac00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:47.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.273+0000 7f5bb776c640 0 -- 172.21.15.99:0/2167916413 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5bac008040 msgr2=0x7f5bac00b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.285+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:47.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 zone default found 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 4 Realm: () 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 zonegroup default 2024-09-05T01:12:47.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 started sync module instance, tier type = 2024-09-05T01:12:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.289+0000 7f5bb94659c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=0 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=1 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=2 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=3 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=4 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=5 2024-09-05T01:12:47.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.313+0000 7f5bb94659c0 20 add_watcher() i=6 2024-09-05T01:12:47.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.317+0000 7f5bb94659c0 20 add_watcher() i=7 2024-09-05T01:12:47.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.317+0000 7f5bb94659c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:47.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.321+0000 7f5a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:47.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.321+0000 7f5bb94659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:47.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.321+0000 7f5bb94659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:47.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.321+0000 7f5bb94659c0 5 note: GC not initialized 2024-09-05T01:12:47.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f59e7fff640 20 reqs_thread_entry: start 2024-09-05T01:12:47.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:47.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 Filter name: none 2024-09-05T01:12:47.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f59e5ffb640 20 reqs_thread_entry: start 2024-09-05T01:12:47.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-05T01:12:47.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:47.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-05T01:12:47.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-05T01:12:47.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : miss 2024-09-05T01:12:47.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:47.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:47.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.325+0000 7f5bb94659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:47.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5bb94659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5bb94659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5bb94659c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5bb94659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24, ofs0, ns] 2024-09-05T01:12:47.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94044270081776 notifier 6350 bl.length()=925 2024-09-05T01:12:47.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.337+0000 7f5a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.341+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_sources= new_sources= 2024-09-05T01:12:47.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.341+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential sources added=[] removed=[] 2024-09-05T01:12:47.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.341+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_dests= new_dests= 2024-09-05T01:12:47.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.341+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential dests added=[] removed=[] 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.0 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.0 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.1 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.1 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.2 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.2 2024-09-05T01:12:47.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.3 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.3 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.4 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.4 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.5 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.5 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.6 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.6 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.7 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.7 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.8 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.8 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.9 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.9 2024-09-05T01:12:47.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.10 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.10 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.11 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1.11 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.0 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.353+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1 2024-09-05T01:12:47.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.357+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.2 2024-09-05T01:12:47.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.357+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.3 2024-09-05T01:12:47.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.357+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.4 2024-09-05T01:12:47.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.357+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.5 2024-09-05T01:12:47.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.361+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.6 2024-09-05T01:12:47.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.361+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.7 2024-09-05T01:12:47.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.361+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.8 2024-09-05T01:12:47.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.361+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.9 2024-09-05T01:12:47.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.361+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.10 2024-09-05T01:12:47.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.369+0000 7f5bb94659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:47.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.369+0000 7f5bb94659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24, ofs0, ns] 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94044270081776 notifier 6350 bl.length()=925 2024-09-05T01:12:47.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_sources= new_sources= 2024-09-05T01:12:47.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential sources added=[] removed=[] 2024-09-05T01:12:47.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_dests= new_dests= 2024-09-05T01:12:47.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.373+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential dests added=[] removed=[] 2024-09-05T01:12:47.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.381+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.0 2024-09-05T01:12:47.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.381+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.1 2024-09-05T01:12:47.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.381+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.2 2024-09-05T01:12:47.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.381+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.3 2024-09-05T01:12:47.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.381+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.4 2024-09-05T01:12:47.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.385+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.5 2024-09-05T01:12:47.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.385+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.6 2024-09-05T01:12:47.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.385+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.7 2024-09-05T01:12:47.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.385+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.8 2024-09-05T01:12:47.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.385+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.9 2024-09-05T01:12:47.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24.10 2024-09-05T01:12:47.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:47.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 2024-09-05T01:12:47.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.389+0000 7f5bb94659c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24, ofs0, ns] 2024-09-05T01:12:47.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5a99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94044270081776 notifier 6350 bl.length()=893 2024-09-05T01:12:47.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5a99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 info.flags=0x17 2024-09-05T01:12:47.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5a99ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 to cache LRU end 2024-09-05T01:12:47.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5a99ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:47.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_sources= new_sources= 2024-09-05T01:12:47.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential sources added=[] removed=[] 2024-09-05T01:12:47.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): orig_dests= new_dests= 2024-09-05T01:12:47.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.393+0000 7f5bb94659c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24]): potential dests added=[] removed=[] 2024-09-05T01:12:47.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.401+0000 7f5bb94659c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:47.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.401+0000 7f5a6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:47.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.409+0000 7f5bb94659c0 20 remove_watcher() i=0 2024-09-05T01:12:47.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.409+0000 7f5bb94659c0 2 removed watcher, disabling cache 2024-09-05T01:12:47.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.409+0000 7f5bb94659c0 20 remove_watcher() i=1 2024-09-05T01:12:47.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.413+0000 7f5bb94659c0 20 remove_watcher() i=2 2024-09-05T01:12:47.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.413+0000 7f5bb94659c0 20 remove_watcher() i=3 2024-09-05T01:12:47.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.417+0000 7f5bb94659c0 20 remove_watcher() i=4 2024-09-05T01:12:47.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.417+0000 7f5bb94659c0 20 remove_watcher() i=5 2024-09-05T01:12:47.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.421+0000 7f5bb94659c0 20 remove_watcher() i=6 2024-09-05T01:12:47.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.421+0000 7f5bb94659c0 20 remove_watcher() i=7 2024-09-05T01:12:47.440 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-05T01:12:47.472 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:47.472 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:47.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 realm 2024-09-05T01:12:47.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:47.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.517+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.521+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:47.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.521+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.521+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:47.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.521+0000 7fe6ad27b9c0 20 searching for the correct realm 2024-09-05T01:12:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.525+0000 7fe6ab582640 0 -- 172.21.15.99:0/1540365726 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5634be3cc210 msgr2=0x5634be3ce6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:47.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.537+0000 7fe6aad81640 0 -- 172.21.15.99:0/1540365726 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fe6a40a93d0 msgr2=0x7fe6a40a9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:47.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:47.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.541+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 zone default found 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 4 Realm: () 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 zonegroup default 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:47.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 started sync module instance, tier type = 2024-09-05T01:12:47.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.545+0000 7fe6ad27b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:47.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=0 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=1 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=2 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=3 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=4 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=5 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=6 2024-09-05T01:12:47.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 20 add_watcher() i=7 2024-09-05T01:12:47.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.561+0000 7fe6ad27b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:47.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe5617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 5 note: GC not initialized 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe4dbfff640 20 reqs_thread_entry: start 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 Filter name: none 2024-09-05T01:12:47.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe4d9ffb640 20 reqs_thread_entry: start 2024-09-05T01:12:47.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:47.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.565+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:47.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:47.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-05T01:12:47.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:47.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-05T01:12:47.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.569+0000 7fe6ad27b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:47.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.573+0000 7fe5617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:47.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.577+0000 7fe6ad27b9c0 20 remove_watcher() i=0 2024-09-05T01:12:47.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.577+0000 7fe6ad27b9c0 2 removed watcher, disabling cache 2024-09-05T01:12:47.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.577+0000 7fe6ad27b9c0 20 remove_watcher() i=1 2024-09-05T01:12:47.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.581+0000 7fe6ad27b9c0 20 remove_watcher() i=2 2024-09-05T01:12:47.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.581+0000 7fe6ad27b9c0 20 remove_watcher() i=3 2024-09-05T01:12:47.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.585+0000 7fe6ad27b9c0 20 remove_watcher() i=4 2024-09-05T01:12:47.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.585+0000 7fe6ad27b9c0 20 remove_watcher() i=5 2024-09-05T01:12:47.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.589+0000 7fe6ad27b9c0 20 remove_watcher() i=6 2024-09-05T01:12:47.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:47.589+0000 7fe6ad27b9c0 20 remove_watcher() i=7 2024-09-05T01:12:47.602 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:47.602 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:47.602 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:12:47.602 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:48.486 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-05T01:12:48.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:50.641 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-05T01:12:50.674 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:50.674 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:50.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.717+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:50.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 realm 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:50.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:50.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:50.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.721+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:50.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.725+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:50.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.725+0000 7f5ec80019c0 20 searching for the correct realm 2024-09-05T01:12:50.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.725+0000 7f5ec5b07640 0 -- 172.21.15.99:0/1323732891 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x55576a94fb80 msgr2=0x7f5eb8124390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:50.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:50.937+0000 7f5ec5b07640 0 -- 172.21.15.99:0/1323732891 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x55576a950950 msgr2=0x7f5eb8118ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:51.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:51.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:51.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:51.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 zone default found 2024-09-05T01:12:51.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 4 Realm: () 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 zonegroup default 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.161+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.165+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.165+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.165+0000 7f5ec80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.165+0000 7f5ec80019c0 20 started sync module instance, tier type = 2024-09-05T01:12:51.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.165+0000 7f5ec80019c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=0 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=1 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=2 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=3 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=4 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=5 2024-09-05T01:12:51.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.189+0000 7f5ec80019c0 20 add_watcher() i=6 2024-09-05T01:12:51.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.193+0000 7f5ec80019c0 20 add_watcher() i=7 2024-09-05T01:12:51.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.193+0000 7f5ec80019c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:51.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5d777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:51.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:51.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:51.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 5 note: GC not initialized 2024-09-05T01:12:51.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5d767fc640 20 reqs_thread_entry: start 2024-09-05T01:12:51.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:51.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 20 Filter name: none 2024-09-05T01:12:51.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ce7fff640 20 reqs_thread_entry: start 2024-09-05T01:12:51.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.197+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:51.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:51.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:51.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:51.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.201+0000 7f5ec80019c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.205+0000 7f5ec80019c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:51.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.205+0000 7f5ec80019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:51.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.205+0000 7f5d777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:51.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.209+0000 7f5ec80019c0 20 remove_watcher() i=0 2024-09-05T01:12:51.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.209+0000 7f5ec80019c0 2 removed watcher, disabling cache 2024-09-05T01:12:51.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.213+0000 7f5ec80019c0 20 remove_watcher() i=1 2024-09-05T01:12:51.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.213+0000 7f5ec80019c0 20 remove_watcher() i=2 2024-09-05T01:12:51.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.217+0000 7f5ec80019c0 20 remove_watcher() i=3 2024-09-05T01:12:51.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.217+0000 7f5ec80019c0 20 remove_watcher() i=4 2024-09-05T01:12:51.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.221+0000 7f5ec80019c0 20 remove_watcher() i=5 2024-09-05T01:12:51.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.221+0000 7f5ec80019c0 20 remove_watcher() i=6 2024-09-05T01:12:51.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.225+0000 7f5ec80019c0 20 remove_watcher() i=7 2024-09-05T01:12:51.238 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:51.239 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:51.239 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:51.239 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:51.239 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-05T01:12:51.272 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:51.272 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:51.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.313+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 realm 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:51.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.317+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.321+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:51.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.321+0000 7f8edcefb9c0 20 searching for the correct realm 2024-09-05T01:12:51.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.321+0000 7f8edb202640 0 -- 172.21.15.99:0/2977510209 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8ed004c060 msgr2=0x7f8ed006e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:51.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.537+0000 7f8edb202640 0 -- 172.21.15.99:0/2977510209 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8ed004c060 msgr2=0x7f8ed006e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:51.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:51.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.549+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:51.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:51.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 zone default found 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 4 Realm: () 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 zonegroup default 2024-09-05T01:12:51.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.553+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.557+0000 7f8edcefb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.557+0000 7f8edcefb9c0 20 started sync module instance, tier type = 2024-09-05T01:12:51.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.557+0000 7f8edcefb9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:51.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=0 2024-09-05T01:12:51.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=1 2024-09-05T01:12:51.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=2 2024-09-05T01:12:51.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=3 2024-09-05T01:12:51.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=4 2024-09-05T01:12:51.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=5 2024-09-05T01:12:51.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.577+0000 7f8edcefb9c0 20 add_watcher() i=6 2024-09-05T01:12:51.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.581+0000 7f8edcefb9c0 20 add_watcher() i=7 2024-09-05T01:12:51.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.581+0000 7f8edcefb9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:51.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.585+0000 7f8d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:51.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.585+0000 7f8edcefb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:51.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.585+0000 7f8edcefb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:51.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 5 note: GC not initialized 2024-09-05T01:12:51.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8d0bfff640 20 reqs_thread_entry: start 2024-09-05T01:12:51.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 Filter name: none 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8d09ffb640 20 reqs_thread_entry: start 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:51.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:12:51.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:12:51.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 : miss 2024-09-05T01:12:51.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:51.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.589+0000 7f8edcefb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 2024-09-05T01:12:51.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.601+0000 7f8edcefb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:51.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.601+0000 7f8edcefb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:51.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.601+0000 7f8edcefb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:51.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.601+0000 7f8edcefb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25, ofs0, ns] 2024-09-05T01:12:51.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.605+0000 7f8dbdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 93846985111216 notifier 6741 bl.length()=939 2024-09-05T01:12:51.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.605+0000 7f8dbdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:51.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.605+0000 7f8dbdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:51.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.605+0000 7f8dbdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:51.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_sources= new_sources= 2024-09-05T01:12:51.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential sources added=[] removed=[] 2024-09-05T01:12:51.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_dests= new_dests= 2024-09-05T01:12:51.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential dests added=[] removed=[] 2024-09-05T01:12:51.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-05T01:12:51.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8edcefb9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-05T01:12:51.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.609+0000 7f8d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:51.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.617+0000 7f8edcefb9c0 20 remove_watcher() i=0 2024-09-05T01:12:51.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.617+0000 7f8edcefb9c0 2 removed watcher, disabling cache 2024-09-05T01:12:51.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.617+0000 7f8edcefb9c0 20 remove_watcher() i=1 2024-09-05T01:12:51.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.621+0000 7f8edcefb9c0 20 remove_watcher() i=2 2024-09-05T01:12:51.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.621+0000 7f8edcefb9c0 20 remove_watcher() i=3 2024-09-05T01:12:51.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.625+0000 7f8edcefb9c0 20 remove_watcher() i=4 2024-09-05T01:12:51.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.625+0000 7f8edcefb9c0 20 remove_watcher() i=5 2024-09-05T01:12:51.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.625+0000 7f8edcefb9c0 20 remove_watcher() i=6 2024-09-05T01:12:51.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.629+0000 7f8edcefb9c0 20 remove_watcher() i=7 2024-09-05T01:12:51.643 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-05T01:12:51.670 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:51.670 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:51.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.713+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 realm 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:51.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.717+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.921+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:51.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.921+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:51.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.925+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:51.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.925+0000 7f13f6c419c0 20 searching for the correct realm 2024-09-05T01:12:51.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:51.929+0000 7f13f4f48640 0 -- 172.21.15.99:0/1872069655 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f13e8035070 msgr2=0x7f13e8036910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:52.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.145+0000 7f13f4f48640 0 -- 172.21.15.99:0/1872069655 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f13e8035070 msgr2=0x7f13e8036910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:52.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:52.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:52.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.157+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:52.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 zone default found 2024-09-05T01:12:52.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 4 Realm: () 2024-09-05T01:12:52.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:52.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:52.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:52.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 zonegroup default 2024-09-05T01:12:52.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 started sync module instance, tier type = 2024-09-05T01:12:52.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.161+0000 7f13f6c419c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=0 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=1 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=2 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=3 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=4 2024-09-05T01:12:52.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=5 2024-09-05T01:12:52.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=6 2024-09-05T01:12:52.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 20 add_watcher() i=7 2024-09-05T01:12:52.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.185+0000 7f13f6c419c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:52.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.189+0000 7f12aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:52.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:52.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:52.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 5 note: GC not initialized 2024-09-05T01:12:52.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f12a9fdb640 20 reqs_thread_entry: start 2024-09-05T01:12:52.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:52.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 Filter name: none 2024-09-05T01:12:52.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f121b7fe640 20 reqs_thread_entry: start 2024-09-05T01:12:52.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:52.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.193+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:12:52.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:52.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:52.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:12:52.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.197+0000 7f13f6c419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:52.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.201+0000 7f12aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:52.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.205+0000 7f13f6c419c0 20 remove_watcher() i=0 2024-09-05T01:12:52.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.205+0000 7f13f6c419c0 2 removed watcher, disabling cache 2024-09-05T01:12:52.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.209+0000 7f13f6c419c0 20 remove_watcher() i=1 2024-09-05T01:12:52.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.209+0000 7f13f6c419c0 20 remove_watcher() i=2 2024-09-05T01:12:52.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.213+0000 7f13f6c419c0 20 remove_watcher() i=3 2024-09-05T01:12:52.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.213+0000 7f13f6c419c0 20 remove_watcher() i=4 2024-09-05T01:12:52.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.217+0000 7f13f6c419c0 20 remove_watcher() i=5 2024-09-05T01:12:52.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.217+0000 7f13f6c419c0 20 remove_watcher() i=6 2024-09-05T01:12:52.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.217+0000 7f13f6c419c0 20 remove_watcher() i=7 2024-09-05T01:12:52.234 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:52.234 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:52.234 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:52.234 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:52.353 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:12:52.390 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:52.390 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:52.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.433+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.433+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.433+0000 7fe99ef259c0 20 realm 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.433+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:52.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:52.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.437+0000 7fe99ef259c0 20 searching for the correct realm 2024-09-05T01:12:52.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.441+0000 7fe99d22c640 0 -- 172.21.15.99:0/470727674 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe984068300 msgr2=0x7fe98406eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:52.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.449+0000 7fe99d22c640 0 -- 172.21.15.99:0/470727674 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe868080900 msgr2=0x7fe868082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:52.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.457+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:52.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 zone default found 2024-09-05T01:12:52.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 4 Realm: () 2024-09-05T01:12:52.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 zonegroup default 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 started sync module instance, tier type = 2024-09-05T01:12:52.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.461+0000 7fe99ef259c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=0 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=1 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=2 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=3 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=4 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=5 2024-09-05T01:12:52.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=6 2024-09-05T01:12:52.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 20 add_watcher() i=7 2024-09-05T01:12:52.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.477+0000 7fe99ef259c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:52.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe852fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 5 note: GC not initialized 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe851fe3640 20 reqs_thread_entry: start 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 Filter name: none 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe7c37fe640 20 reqs_thread_entry: start 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-05T01:12:52.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:52.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:12:52.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:12:52.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 : miss 2024-09-05T01:12:52.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.481+0000 7fe99ef259c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:12:52.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:52.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 2024-09-05T01:12:52.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.485+0000 7fe99ef259c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:12:52.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.497+0000 7fe99ef259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25, ofs0, ns] 2024-09-05T01:12:52.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe8737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94385324504192 notifier 6777 bl.length()=939 2024-09-05T01:12:52.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe8737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe8737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe8737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_sources= new_sources= 2024-09-05T01:12:52.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential sources added=[] removed=[] 2024-09-05T01:12:52.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_dests= new_dests= 2024-09-05T01:12:52.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.501+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential dests added=[] removed=[] 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.0 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.0 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.1 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.1 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.2 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.2 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.3 2024-09-05T01:12:52.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.3 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.4 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.4 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.5 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.5 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.6 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.6 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.7 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.7 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.8 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.8 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.9 2024-09-05T01:12:52.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.9 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.10 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.10 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.11 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2.11 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.0 2024-09-05T01:12:52.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.1 2024-09-05T01:12:52.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.513+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2 2024-09-05T01:12:52.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.3 2024-09-05T01:12:52.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.4 2024-09-05T01:12:52.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.5 2024-09-05T01:12:52.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.6 2024-09-05T01:12:52.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.7 2024-09-05T01:12:52.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.517+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.8 2024-09-05T01:12:52.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.521+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.9 2024-09-05T01:12:52.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.521+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.10 2024-09-05T01:12:52.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.525+0000 7fe99ef259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:52.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.525+0000 7fe99ef259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 2024-09-05T01:12:52.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25, ofs0, ns] 2024-09-05T01:12:52.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe873fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94385324504192 notifier 6777 bl.length()=939 2024-09-05T01:12:52.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe873fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe873fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe873fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_sources= new_sources= 2024-09-05T01:12:52.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential sources added=[] removed=[] 2024-09-05T01:12:52.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_dests= new_dests= 2024-09-05T01:12:52.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.529+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential dests added=[] removed=[] 2024-09-05T01:12:52.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.0 2024-09-05T01:12:52.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.1 2024-09-05T01:12:52.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.2 2024-09-05T01:12:52.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.3 2024-09-05T01:12:52.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.4 2024-09-05T01:12:52.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.537+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.5 2024-09-05T01:12:52.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.6 2024-09-05T01:12:52.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.7 2024-09-05T01:12:52.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.8 2024-09-05T01:12:52.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.9 2024-09-05T01:12:52.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25.10 2024-09-05T01:12:52.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:52.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.541+0000 7fe99ef259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 2024-09-05T01:12:52.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25, ofs0, ns] 2024-09-05T01:12:52.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe8737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94385324504192 notifier 6777 bl.length()=907 2024-09-05T01:12:52.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe8737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 info.flags=0x17 2024-09-05T01:12:52.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe8737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 to cache LRU end 2024-09-05T01:12:52.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe8737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:52.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_sources= new_sources= 2024-09-05T01:12:52.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential sources added=[] removed=[] 2024-09-05T01:12:52.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): orig_dests= new_dests= 2024-09-05T01:12:52.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.545+0000 7fe99ef259c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25]): potential dests added=[] removed=[] 2024-09-05T01:12:52.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.553+0000 7fe99ef259c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:52.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.553+0000 7fe852fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:52.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.561+0000 7fe99ef259c0 20 remove_watcher() i=0 2024-09-05T01:12:52.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.561+0000 7fe99ef259c0 2 removed watcher, disabling cache 2024-09-05T01:12:52.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.561+0000 7fe99ef259c0 20 remove_watcher() i=1 2024-09-05T01:12:52.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.565+0000 7fe99ef259c0 20 remove_watcher() i=2 2024-09-05T01:12:52.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.565+0000 7fe99ef259c0 20 remove_watcher() i=3 2024-09-05T01:12:52.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.569+0000 7fe99ef259c0 20 remove_watcher() i=4 2024-09-05T01:12:52.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.569+0000 7fe99ef259c0 20 remove_watcher() i=5 2024-09-05T01:12:52.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.569+0000 7fe99ef259c0 20 remove_watcher() i=6 2024-09-05T01:12:52.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.573+0000 7fe99ef259c0 20 remove_watcher() i=7 2024-09-05T01:12:52.586 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-05T01:12:52.613 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:52.613 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:52.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.653+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 realm 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:52.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:52.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:52.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.657+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:52.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.865+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:52.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.865+0000 7f76cbbe29c0 20 searching for the correct realm 2024-09-05T01:12:52.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:52.873+0000 7f76c9ee9640 0 -- 172.21.15.99:0/3736232917 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f76c0017030 msgr2=0x7f76c0082ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:53.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.089+0000 7f76c9ee9640 0 -- 172.21.15.99:0/3736232917 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f76c0017030 msgr2=0x7f76c0082ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:53.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:53.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.101+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:53.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 zone default found 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 4 Realm: () 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 zonegroup default 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:53.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:53.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:53.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 started sync module instance, tier type = 2024-09-05T01:12:53.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.105+0000 7f76cbbe29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=0 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=1 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=2 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=3 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=4 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=5 2024-09-05T01:12:53.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=6 2024-09-05T01:12:53.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 20 add_watcher() i=7 2024-09-05T01:12:53.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.133+0000 7f76cbbe29c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:53.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.137+0000 7f757f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:53.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.137+0000 7f76cbbe29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:53.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.137+0000 7f76cbbe29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:53.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.137+0000 7f76cbbe29c0 5 note: GC not initialized 2024-09-05T01:12:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f757e7e4640 20 reqs_thread_entry: start 2024-09-05T01:12:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 Filter name: none 2024-09-05T01:12:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f74effff640 20 reqs_thread_entry: start 2024-09-05T01:12:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:53.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:53.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.141+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.145+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:53.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.145+0000 7f76cbbe29c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:53.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.145+0000 7f76cbbe29c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:53.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.145+0000 7f76cbbe29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:53.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.149+0000 7f757f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:53.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.153+0000 7f76cbbe29c0 20 remove_watcher() i=0 2024-09-05T01:12:53.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.153+0000 7f76cbbe29c0 2 removed watcher, disabling cache 2024-09-05T01:12:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.157+0000 7f76cbbe29c0 20 remove_watcher() i=1 2024-09-05T01:12:53.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.157+0000 7f76cbbe29c0 20 remove_watcher() i=2 2024-09-05T01:12:53.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.161+0000 7f76cbbe29c0 20 remove_watcher() i=3 2024-09-05T01:12:53.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.161+0000 7f76cbbe29c0 20 remove_watcher() i=4 2024-09-05T01:12:53.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.165+0000 7f76cbbe29c0 20 remove_watcher() i=5 2024-09-05T01:12:53.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.165+0000 7f76cbbe29c0 20 remove_watcher() i=6 2024-09-05T01:12:53.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:53.169+0000 7f76cbbe29c0 20 remove_watcher() i=7 2024-09-05T01:12:53.182 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:53.182 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:53.182 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:12:53.182 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:54.113 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-05T01:12:54.114 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:56.307 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-05T01:12:56.341 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:56.341 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:56.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.389+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 realm 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.393+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.397+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:56.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.397+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.397+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:56.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.397+0000 7f4f0e08a9c0 20 searching for the correct realm 2024-09-05T01:12:56.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.401+0000 7f4f0c391640 0 -- 172.21.15.99:0/994772765 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4f00118040 msgr2=0x7f4f000fd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:56.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.617+0000 7f4f0c391640 0 -- 172.21.15.99:0/994772765 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4f00118040 msgr2=0x7f4f000fd650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:56.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:56.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:56.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:56.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:56.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:56.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:56.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.629+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:56.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 zone default found 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 4 Realm: () 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:56.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:56.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 zonegroup default 2024-09-05T01:12:56.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.633+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.637+0000 7f4f0e08a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.637+0000 7f4f0e08a9c0 20 started sync module instance, tier type = 2024-09-05T01:12:56.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.637+0000 7f4f0e08a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:56.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=0 2024-09-05T01:12:56.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=1 2024-09-05T01:12:56.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=2 2024-09-05T01:12:56.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=3 2024-09-05T01:12:56.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=4 2024-09-05T01:12:56.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=5 2024-09-05T01:12:56.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.657+0000 7f4f0e08a9c0 20 add_watcher() i=6 2024-09-05T01:12:56.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.661+0000 7f4f0e08a9c0 20 add_watcher() i=7 2024-09-05T01:12:56.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.661+0000 7f4f0e08a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4f0e08a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4f0e08a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4f0e08a9c0 5 note: GC not initialized 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4dc0fe1640 20 reqs_thread_entry: start 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.665+0000 7f4f0e08a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 Filter name: none 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4d3a7fc640 20 reqs_thread_entry: start 2024-09-05T01:12:56.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:56.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:56.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:56.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.669+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.673+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:56.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.673+0000 7f4f0e08a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.673+0000 7f4f0e08a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:56.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.673+0000 7f4f0e08a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:56.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.677+0000 7f4dc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:56.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.681+0000 7f4f0e08a9c0 20 remove_watcher() i=0 2024-09-05T01:12:56.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.681+0000 7f4f0e08a9c0 2 removed watcher, disabling cache 2024-09-05T01:12:56.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.681+0000 7f4f0e08a9c0 20 remove_watcher() i=1 2024-09-05T01:12:56.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.685+0000 7f4f0e08a9c0 20 remove_watcher() i=2 2024-09-05T01:12:56.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.689+0000 7f4f0e08a9c0 20 remove_watcher() i=3 2024-09-05T01:12:56.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.689+0000 7f4f0e08a9c0 20 remove_watcher() i=4 2024-09-05T01:12:56.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.689+0000 7f4f0e08a9c0 20 remove_watcher() i=5 2024-09-05T01:12:56.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.693+0000 7f4f0e08a9c0 20 remove_watcher() i=6 2024-09-05T01:12:56.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.693+0000 7f4f0e08a9c0 20 remove_watcher() i=7 2024-09-05T01:12:56.704 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:56.704 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:56.704 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:12:56.704 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:56.704 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-05T01:12:56.743 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:56.743 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:56.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.789+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 realm 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:56.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:56.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.793+0000 7f8abb9109c0 20 searching for the correct realm 2024-09-05T01:12:56.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.801+0000 7f8ab9c17640 0 -- 172.21.15.99:0/2307725420 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5559de8ec260 msgr2=0x5559de8ee720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:56.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.805+0000 7f8ab9c17640 0 -- 172.21.15.99:0/2307725420 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x5559de8dfaa0 msgr2=0x5559de8e1f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:56.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:56.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:56.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:56.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:56.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 zone default found 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 4 Realm: () 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 zonegroup default 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.813+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:56.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 started sync module instance, tier type = 2024-09-05T01:12:56.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.817+0000 7f8abb9109c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=0 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=1 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=2 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=3 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=4 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=5 2024-09-05T01:12:56.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=6 2024-09-05T01:12:56.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 20 add_watcher() i=7 2024-09-05T01:12:56.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.833+0000 7f8abb9109c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:56.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f896ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:56.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:56.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:56.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 5 note: GC not initialized 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f896efe5640 20 reqs_thread_entry: start 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 Filter name: none 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f896cfe1640 20 reqs_thread_entry: start 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-05T01:12:56.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 : miss 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:56.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:56.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 info.flags=0x17 2024-09-05T01:12:56.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 to cache LRU end 2024-09-05T01:12:56.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:12:56.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:56.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.837+0000 7f8abb9109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.849+0000 7f8abb9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 info.flags=0x17 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.849+0000 7f8abb9109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 to cache LRU end 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.849+0000 7f8abb9109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.849+0000 7f8abb9109c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26, ofs0, ns] 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f899cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464290 cookie 93844474352576 notifier 6834 bl.length()=939 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f899cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 info.flags=0x17 2024-09-05T01:12:56.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f899cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 to cache LRU end 2024-09-05T01:12:56.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f899cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): orig_sources= new_sources= 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): potential sources added=[] removed=[] 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): orig_dests= new_dests= 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): potential dests added=[] removed=[] 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-05T01:12:56.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.853+0000 7f8abb9109c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-05T01:12:56.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.0 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.0 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.1 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.1 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.2 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.2 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.3 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.3 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.4 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.4 2024-09-05T01:12:56.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.5 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.5 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.6 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.6 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.7 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.7 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.8 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.8 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.9 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.9 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.10 2024-09-05T01:12:56.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.10 2024-09-05T01:12:56.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.11 2024-09-05T01:12:56.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1.11 2024-09-05T01:12:56.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.0 2024-09-05T01:12:56.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.1 2024-09-05T01:12:56.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.2 2024-09-05T01:12:56.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.3 2024-09-05T01:12:56.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.861+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.4 2024-09-05T01:12:56.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.865+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.5 2024-09-05T01:12:56.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.865+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.6 2024-09-05T01:12:56.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.865+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.7 2024-09-05T01:12:56.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.865+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.8 2024-09-05T01:12:56.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.869+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.9 2024-09-05T01:12:56.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.869+0000 7f8abb9109c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26.10 2024-09-05T01:12:56.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.877+0000 7f8abb9109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 : hit (requested=0x17, cached=0x17) 2024-09-05T01:12:56.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.877+0000 7f8abb9109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 2024-09-05T01:12:56.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 info.flags=0x17 2024-09-05T01:12:56.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 to cache LRU end 2024-09-05T01:12:56.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:56.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26, ofs0, ns] 2024-09-05T01:12:56.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f898bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464291 cookie 93844474352576 notifier 6834 bl.length()=907 2024-09-05T01:12:56.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f898bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 info.flags=0x17 2024-09-05T01:12:56.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f898bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 to cache LRU end 2024-09-05T01:12:56.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f898bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:12:56.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): orig_sources= new_sources= 2024-09-05T01:12:56.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): potential sources added=[] removed=[] 2024-09-05T01:12:56.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): orig_dests= new_dests= 2024-09-05T01:12:56.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.881+0000 7f8abb9109c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26]): potential dests added=[] removed=[] 2024-09-05T01:12:56.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.889+0000 7f8abb9109c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-05T01:12:56.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.893+0000 7f896ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:56.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.897+0000 7f8abb9109c0 20 remove_watcher() i=0 2024-09-05T01:12:56.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.897+0000 7f8abb9109c0 2 removed watcher, disabling cache 2024-09-05T01:12:56.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.901+0000 7f8abb9109c0 20 remove_watcher() i=1 2024-09-05T01:12:57.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.901+0000 7f8abb9109c0 20 remove_watcher() i=2 2024-09-05T01:12:57.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.905+0000 7f8abb9109c0 20 remove_watcher() i=3 2024-09-05T01:12:57.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.905+0000 7f8abb9109c0 20 remove_watcher() i=4 2024-09-05T01:12:57.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.909+0000 7f8abb9109c0 20 remove_watcher() i=5 2024-09-05T01:12:57.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.909+0000 7f8abb9109c0 20 remove_watcher() i=6 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.909+0000 7f8abb9109c0 20 remove_watcher() i=7 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:56.997+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 realm 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:12:57.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.001+0000 7fd0624df9c0 20 searching for the correct realm 2024-09-05T01:12:57.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.005+0000 7fd0607e6640 0 -- 172.21.15.99:0/2729145376 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd0540ffc80 msgr2=0x7fd0540f5b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:12:57.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.221+0000 7fd0607e6640 0 -- 172.21.15.99:0/2729145376 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd0540ffc80 msgr2=0x7fd0540f5b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.233+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:12:57.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:12:57.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 zone default found 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 4 Realm: () 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 zonegroup default 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:12:57.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 started sync module instance, tier type = 2024-09-05T01:12:57.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.237+0000 7fd0624df9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=0 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=1 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=2 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=3 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=4 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=5 2024-09-05T01:12:57.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.261+0000 7fd0624df9c0 20 add_watcher() i=6 2024-09-05T01:12:57.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.265+0000 7fd0624df9c0 20 add_watcher() i=7 2024-09-05T01:12:57.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.265+0000 7fd0624df9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:12:57.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fcf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:57.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:12:57.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:12:57.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 5 note: GC not initialized 2024-09-05T01:12:57.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fcf14fe1640 20 reqs_thread_entry: start 2024-09-05T01:12:57.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:12:57.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 20 Filter name: none 2024-09-05T01:12:57.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fce8e7fc640 20 reqs_thread_entry: start 2024-09-05T01:12:57.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.269+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:57.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:57.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:57.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:12:57.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.273+0000 7fd0624df9c0 20 rados->read ofs=0 len=0 2024-09-05T01:12:57.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.277+0000 7fd0624df9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:12:57.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.277+0000 7fd0624df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:12:57.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.281+0000 7fcf15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:12:57.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.285+0000 7fd0624df9c0 20 remove_watcher() i=0 2024-09-05T01:12:57.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.285+0000 7fd0624df9c0 2 removed watcher, disabling cache 2024-09-05T01:12:57.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.285+0000 7fd0624df9c0 20 remove_watcher() i=1 2024-09-05T01:12:57.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.289+0000 7fd0624df9c0 20 remove_watcher() i=2 2024-09-05T01:12:57.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.293+0000 7fd0624df9c0 20 remove_watcher() i=3 2024-09-05T01:12:57.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.293+0000 7fd0624df9c0 20 remove_watcher() i=4 2024-09-05T01:12:57.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.297+0000 7fd0624df9c0 20 remove_watcher() i=5 2024-09-05T01:12:57.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.297+0000 7fd0624df9c0 20 remove_watcher() i=6 2024-09-05T01:12:57.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:12:57.297+0000 7fd0624df9c0 20 remove_watcher() i=7 2024-09-05T01:12:57.310 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:57.311 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:12:57.311 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-05T01:12:57.311 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:12:58.292 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-05T01:12:58.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.419 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-05T01:13:00.453 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:00.453 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:00.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.501+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 realm 2024-09-05T01:13:00.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:00.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:00.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.505+0000 7f74d6dff9c0 20 searching for the correct realm 2024-09-05T01:13:00.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.509+0000 7f74d5106640 0 -- 172.21.15.99:0/1554230377 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f74c8024c20 msgr2=0x7f74c803b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:00.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.517+0000 7f74d4104640 0 -- 172.21.15.99:0/1554230377 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x55c1cd3cb1d0 msgr2=0x55c1cd3cd5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.525+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:00.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 zone default found 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 4 Realm: () 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 zonegroup default 2024-09-05T01:13:00.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 started sync module instance, tier type = 2024-09-05T01:13:00.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.529+0000 7f74d6dff9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:00.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=0 2024-09-05T01:13:00.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=1 2024-09-05T01:13:00.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=2 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=3 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=4 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=5 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=6 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 20 add_watcher() i=7 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.545+0000 7f74d6dff9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:00.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f738b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:00.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:00.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:00.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 5 note: GC not initialized 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f738a7e4640 20 reqs_thread_entry: start 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 20 Filter name: none 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f73837fe640 20 reqs_thread_entry: start 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.549+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:00.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:00.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:00.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:00.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:00.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.553+0000 7f74d6dff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:00.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.557+0000 7f738b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:00.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.561+0000 7f74d6dff9c0 20 remove_watcher() i=0 2024-09-05T01:13:00.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.561+0000 7f74d6dff9c0 2 removed watcher, disabling cache 2024-09-05T01:13:00.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.561+0000 7f74d6dff9c0 20 remove_watcher() i=1 2024-09-05T01:13:00.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.565+0000 7f74d6dff9c0 20 remove_watcher() i=2 2024-09-05T01:13:00.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.569+0000 7f74d6dff9c0 20 remove_watcher() i=3 2024-09-05T01:13:00.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.569+0000 7f74d6dff9c0 20 remove_watcher() i=4 2024-09-05T01:13:00.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.569+0000 7f74d6dff9c0 20 remove_watcher() i=5 2024-09-05T01:13:00.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.573+0000 7f74d6dff9c0 20 remove_watcher() i=6 2024-09-05T01:13:00.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.573+0000 7f74d6dff9c0 20 remove_watcher() i=7 2024-09-05T01:13:00.582 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.582 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:00.582 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:00.582 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.583 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-05T01:13:00.614 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:00.614 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:00.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 realm 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:00.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:00.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 searching for the correct realm 2024-09-05T01:13:00.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.669+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:00.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.885+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:00.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:00.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zone default found 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Realm: () 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zonegroup default 2024-09-05T01:13:00.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:00.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started sync module instance, tier type = 2024-09-05T01:13:00.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=0 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=1 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=2 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=3 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=4 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=5 2024-09-05T01:13:00.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=6 2024-09-05T01:13:00.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.929+0000 7f70b7eb39c0 20 add_watcher() i=7 2024-09-05T01:13:00.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.929+0000 7f70b7eb39c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:00.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.933+0000 7f6f677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:00.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:00.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:00.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 note: GC not initialized 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.933+0000 7f6f667fc640 20 reqs_thread_entry: start 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 Filter name: none 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f6ed7fff640 20 reqs_thread_entry: start 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-05T01:13:00.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:00.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:13:00.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:13:00.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : miss 2024-09-05T01:13:00.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:00.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:00.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:00.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:00.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:00.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:00.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:00.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:00.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:00.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:00.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:00.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 93967985084112 notifier 6533 bl.length()=939 2024-09-05T01:13:00.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:00.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:00.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:00.950 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70b7eb39c0 time 2024-09-05T01:13:00.956246+0000 2024-09-05T01:13:00.950 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:00.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:00.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:00.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:00.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:00.952 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:00.952 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f70bb78d2eb] 2024-09-05T01:13:00.952 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f70b7eb39c0 thread_name:radosgw-admin 2024-09-05T01:13:00.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70b7eb39c0 time 2024-09-05T01:13:00.956246+0000 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f70bb78d2eb] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:00.954 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:00.955 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:00.955 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f70ba60c520] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f70bb78d345] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:00.968 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f70b7eb39c0 thread_name:radosgw-admin 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f70ba60c520] 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f70bb78d345] 2024-09-05T01:13:00.969 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:13:00.970 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: _finish_hunting 0 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:13:00.641+0000 7f70b51b8640 1 monclient: found mon.noname-a 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: dump: 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: _finish_auth 0 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: _check_auth_tickets 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: dump: 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6879 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 4 set_mon_vals no callback set 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: shutdown 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) unregister_commands rotate-key 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:00.973 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:00.974 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:00.975 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: starting msgr at 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: starting objecter 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests hook 0x5576a04f6c20 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: setting wanted keys 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: calling monclient init 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.976 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key hook 0x5576a04f5888 2024-09-05T01:13:00.977 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a0382db0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a0383190 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a03ade90 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.102602s 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a03ade90 auth_method 0 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.978 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a0382db0 auth_method 0 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-05T01:13:00.979 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:13:00.641+0000 7f70b61ba640 1 monclient: found mon.noname-a 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a0383190 auth_method 0 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: dump: 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.980 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: _finish_auth 0 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: _check_auth_tickets 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: dump: 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 4 set_mon_vals no callback set 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6882 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 1 librados: init done 2024-09-05T01:13:00.982 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:13:00.645+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05293d0 auth_method 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:13:00.645+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f9c070ae0 auth_method 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:13:00.645+0000 7f70b59b9640 10 monclient: get_auth_request con 0x5576a05407f0 auth_method 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:13:00.649+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a0544b50 auth_method 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:00.983 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.984 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576a054d390 EEXIST 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:00.985 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:00.986 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5576a05481c0 EEXIST 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a0571540 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a0570e70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a056f850 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.112423s 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a0571540 auth_method 0 2024-09-05T01:13:00.987 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a056f850 auth_method 0 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.988 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a0570e70 auth_method 0 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6885 payload 824 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:13:00.653+0000 7f70b61ba640 1 monclient: found mon.noname-a 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: dump: 2024-09-05T01:13:00.989 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: _finish_auth 0 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: _check_auth_tickets 2024-09-05T01:13:00.990 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: dump: 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.991 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6885 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:13:00.653+0000 7f70b69bb640 4 set_mon_vals no callback set 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:00.992 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.993 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:00.994 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f90070a20 auth_method 0 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.995 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5466e6d8 EEXIST 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a05c5260 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a05bf480 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:00.996 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a05c06c0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.116467s 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a05bf480 auth_method 0 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a05c06c0 auth_method 0 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:00.997 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_done global_id 6530 payload 274 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient: _finish_hunting 0 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:13:00.657+0000 7f70b51b8640 1 monclient: found mon.noname-c 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:00.998 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: dump: 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: _finish_auth 0 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: _check_auth_tickets 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6530 2024-09-05T01:13:00.999 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 4 set_mon_vals no callback set 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: dump: 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: shutdown 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.001 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.002 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: starting msgr at 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: starting objecter 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576a0594250 EEXIST 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: setting wanted keys 2024-09-05T01:13:01.003 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: calling monclient init 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.004 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5576a05734a8 EEXIST 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a05bf480 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a05c06c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a05c5260 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.005 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.118980s 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a05bf480 auth_method 0 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a05c5260 auth_method 0 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.006 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a05c06c0 auth_method 0 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:13:00.657+0000 7f70b61ba640 1 monclient: found mon.noname-c 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:01.007 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: dump: 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.008 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: dump: 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.009 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6533 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:13:00.657+0000 7f6f997fa640 4 set_mon_vals no callback set 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: init done 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cr dump hook 0x5576a05b85c8 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.010 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:13:00.661+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05de920 auth_method 0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:13:00.661+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f80070ae0 auth_method 0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 realm 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:13:00.665+0000 7f70b59b9640 10 monclient: get_auth_request con 0x5576a05e2b60 auth_method 0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:13:00.665+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05e6430 auth_method 0 2024-09-05T01:13:01.011 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 searching for the correct realm 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:13:00.665+0000 7f70b61ba640 10 monclient: get_auth_request con 0x5576a05eb140 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:13:00.665+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f70b0126c60 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:13:00.669+0000 7f70b51b8640 10 monclient: get_auth_request con 0x7f70a8043930 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:13:00.669+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f70ac033070 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:13:00.669+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:13:00.873+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f70ac033070 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:13:00.877+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f70b0132040 auth_method 0 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:13:00.885+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:13:00.885+0000 7f6f877fe640 1 client.6533.objecter ms_handle_reset 0x7f70ac033070 session 0x7f70ac033900 osd.4 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:13:00.885+0000 7f6f877fe640 10 monclient: _renew_subs 2024-09-05T01:13:01.012 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:13:00.885+0000 7f6f877fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:13:00.885+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f6f80080900 auth_method 0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.013 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zone default found 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Realm: () 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zonegroup default 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.014 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started sync module instance, tier type = 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=0 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=1 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=2 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=3 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=4 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=5 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=6 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:13:00.929+0000 7f70b7eb39c0 20 add_watcher() i=7 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:13:00.929+0000 7f70b7eb39c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.015 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:13:00.933+0000 7f6f677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.016 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache list hook 0x5576a05b5900 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache inspect hook 0x5576a05b5900 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache erase hook 0x5576a05b5900 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache zap hook 0x5576a05b5900 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 note: GC not initialized 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:13:00.933+0000 7f6f667fc640 20 reqs_thread_entry: start 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace show hook 0x7f70ac001590 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace history hook 0x7f70ac001590 2024-09-05T01:13:01.017 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace active hook 0x7f70ac001590 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace active_short hook 0x7f70ac001590 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 Filter name: none 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:13:00.937+0000 7f6ed7fff640 20 reqs_thread_entry: start 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : miss 2024-09-05T01:13:01.018 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 93967985084112 notifier 6533 bl.length()=939 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.019 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70b7eb39c0 time 2024-09-05T01:13:00.956246+0000 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f70bb78d2eb] 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:01.020 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f70b7eb39c0 thread_name:radosgw-admin 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f70ba60c520] 2024-09-05T01:13:01.021 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f70bb78d345] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:01.022 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:13:01.023 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:13:01.024 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:13:01.025 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:13:01.026 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:13:01.027 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:13:01.028 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:13:01.029 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6ed7fff640 / http_manager 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f667fc640 / http_manager 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f677fe640 / rgw_dt_lg_renew 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f877fe640 / ms_dispatch 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f98ff9640 / io_context_pool 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f997fa640 / io_context_pool 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f9b7fe640 / ms_dispatch 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6fa2604640 / ms_dispatch 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6fa3e07640 / io_context_pool 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b51b8640 / msgr-worker-2 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b59b9640 / msgr-worker-1 2024-09-05T01:13:01.030 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b61ba640 / msgr-worker-0 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b69bb640 / io_context_pool 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b7eb39c0 / radosgw-admin 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.98716.log 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:13:00.641+0000 7f70b51b8640 1 monclient: found mon.noname-a 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:01.031 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: dump: 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.032 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 10 monclient: dump: 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6879 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 4 set_mon_vals no callback set 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: shutdown 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) unregister_commands rotate-key 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:01.034 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding auth protocol: cephx 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.035 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: crc 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f8850) adding con mode: secure 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: starting msgr at 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: starting objecter 2024-09-05T01:13:01.036 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests hook 0x5576a04f6c20 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: setting wanted keys 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 1 librados: calling monclient init 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding auth protocol: cephx 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.037 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: crc 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a04f5740) adding con mode: secure 2024-09-05T01:13:01.038 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key hook 0x5576a04f5888 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a0382db0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a0383190 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a03ade90 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.102602s 2024-09-05T01:13:01.039 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a03ade90 auth_method 0 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a0382db0 auth_method 0 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.040 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:13:00.641+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:13:00.641+0000 7f70b61ba640 1 monclient: found mon.noname-a 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:13:00.641+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:13:00.641+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a0383190 auth_method 0 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: dump: 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:13:00.641+0000 7f6fa2604640 10 monclient: dump: 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.042 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:13:00.641+0000 7f6fa3e07640 4 set_mon_vals no callback set 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:13:00.641+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6882 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.043 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:13:00.645+0000 7f70b7eb39c0 1 librados: init done 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:13:00.645+0000 7f6fa2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:13:00.645+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05293d0 auth_method 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:13:00.645+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f9c070ae0 auth_method 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:13:00.645+0000 7f70b59b9640 10 monclient: get_auth_request con 0x5576a05407f0 auth_method 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:13:00.649+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a0544b50 auth_method 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:01.044 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:01.045 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding auth protocol: cephx 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.046 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: crc 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05499a0) adding con mode: secure 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576a054d390 EEXIST 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding auth protocol: cephx 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.047 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: crc 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:13:00.649+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0548078) adding con mode: secure 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5576a05481c0 EEXIST 2024-09-05T01:13:01.048 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a0571540 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a0570e70 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a056f850 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.112423s 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a0571540 auth_method 0 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.049 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a056f850 auth_method 0 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a0570e70 auth_method 0 2024-09-05T01:13:01.050 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:13:00.653+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6885 payload 824 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:13:00.653+0000 7f70b61ba640 1 monclient: found mon.noname-a 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:13:00.653+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: dump: 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.051 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:01.052 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 10 monclient: dump: 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6885 2024-09-05T01:13:01.053 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:13:00.653+0000 7f70b69bb640 4 set_mon_vals no callback set 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:13:00.653+0000 7f6f9b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:01.054 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding auth protocol: cephx 2024-09-05T01:13:01.055 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: crc 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0590d40) adding con mode: secure 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:13:00.653+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f90070a20 auth_method 0 2024-09-05T01:13:01.056 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding auth protocol: cephx 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.057 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: crc 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:13:00.653+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466e590) adding con mode: secure 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5466e6d8 EEXIST 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a05c5260 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a05bf480 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a05c06c0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.058 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.116467s 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a05bf480 auth_method 0 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a05c06c0 auth_method 0 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.059 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): handle_auth_done global_id 6530 payload 274 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:13:00.657+0000 7f70b51b8640 1 monclient: found mon.noname-c 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: dump: 2024-09-05T01:13:01.060 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6530 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.061 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 4 set_mon_vals no callback set 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:13:00.657+0000 7f6f997fa640 10 monclient: dump: 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.062 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: shutdown 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: build_initial_monmap 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: monmap: 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding auth protocol: cephx 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.064 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: crc 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a05c14c0) adding con mode: secure 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: starting msgr at 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: starting objecter 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576a0594250 EEXIST 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: setting wanted keys 2024-09-05T01:13:01.065 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: calling monclient init 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: init 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding auth protocol: cephx 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.066 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: crc 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 AuthRegistry(0x5576a0573360) adding con mode: secure 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5576a05734a8 EEXIST 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-a con 0x5576a05bf480 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-b con 0x5576a05c06c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): picked mon.noname-c con 0x5576a05c5260 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.067 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient(hunting): authenticate will time out at 2432.118980s 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): get_auth_request con 0x5576a05bf480 auth_method 0 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request con 0x5576a05c5260 auth_method 0 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.068 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:13:00.657+0000 7f70b59b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request con 0x5576a05c06c0 auth_method 0 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:13:00.657+0000 7f70b51b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient(hunting): handle_auth_done global_id 6533 payload 824 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient: _finish_hunting 0 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:13:00.657+0000 7f70b61ba640 1 monclient: found mon.noname-c 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:13:00.657+0000 7f70b61ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.069 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: dump: 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.070 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: _finish_auth 0 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: _check_auth_tickets 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:13:00.657+0000 7f6f877fe640 10 monclient: dump: 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 monclient: authenticate success, global_id 6533 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:13:00.657+0000 7f6f997fa640 4 set_mon_vals no callback set 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _renew_subs 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 1 librados: init done 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:13:00.657+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cr dump hook 0x5576a05b85c8 2024-09-05T01:13:01.072 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:13:00.661+0000 7f6f877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:13:00.661+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05de920 auth_method 0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:13:00.661+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f6f80070ae0 auth_method 0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 realm 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.073 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:13:00.661+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:13:00.665+0000 7f70b59b9640 10 monclient: get_auth_request con 0x5576a05e2b60 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:13:00.665+0000 7f70b51b8640 10 monclient: get_auth_request con 0x5576a05e6430 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:13:00.665+0000 7f70b7eb39c0 20 searching for the correct realm 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:13:00.665+0000 7f70b61ba640 10 monclient: get_auth_request con 0x5576a05eb140 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:13:00.665+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f70b0126c60 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:13:00.669+0000 7f70b51b8640 10 monclient: get_auth_request con 0x7f70a8043930 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:13:00.669+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f70ac033070 auth_method 0 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:13:00.669+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.074 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:13:00.873+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f70ac033070 auth_method 0 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:13:00.877+0000 7f70b59b9640 10 monclient: get_auth_request con 0x7f70b0132040 auth_method 0 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:13:00.885+0000 7f70b61ba640 0 -- 172.21.15.99:0/3174486651 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70ac033070 msgr2=0x7f70ac00e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:13:00.885+0000 7f6f877fe640 1 client.6533.objecter ms_handle_reset 0x7f70ac033070 session 0x7f70ac033900 osd.4 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:13:00.885+0000 7f6f877fe640 10 monclient: _renew_subs 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:13:00.885+0000 7f6f877fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:13:00.885+0000 7f70b61ba640 10 monclient: get_auth_request con 0x7f6f80080900 auth_method 0 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:01.075 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:13:00.897+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zone default found 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Realm: () 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 zonegroup default 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.076 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started sync module instance, tier type = 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:13:00.901+0000 7f70b7eb39c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=0 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=1 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=2 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=3 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=4 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=5 2024-09-05T01:13:01.077 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:13:00.925+0000 7f70b7eb39c0 20 add_watcher() i=6 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:13:00.929+0000 7f70b7eb39c0 20 add_watcher() i=7 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:13:00.929+0000 7f70b7eb39c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding auth protocol: cephx 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:13:00.933+0000 7f6f677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.078 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: crc 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 AuthRegistry(0x7ffc5466ea70) adding con mode: secure 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache list hook 0x5576a05b5900 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache inspect hook 0x5576a05b5900 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache erase hook 0x5576a05b5900 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command cache zap hook 0x5576a05b5900 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:13:00.933+0000 7f70b7eb39c0 5 note: GC not initialized 2024-09-05T01:13:01.079 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:13:00.933+0000 7f6f667fc640 20 reqs_thread_entry: start 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace show hook 0x7f70ac001590 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace history hook 0x7f70ac001590 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace active hook 0x7f70ac001590 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 5 asok(0x5576a02ea2b0) register_command sync trace active_short hook 0x7f70ac001590 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 Filter name: none 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:13:00.937+0000 7f6ed7fff640 20 reqs_thread_entry: start 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:13:01.080 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : miss 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:13:00.937+0000 7f70b7eb39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:13:00.949+0000 7f70b7eb39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 93967985084112 notifier 6533 bl.length()=939 2024-09-05T01:13:01.081 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:13:00.949+0000 7f6f98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:13:00.953+0000 7f70b7eb39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70b7eb39c0 time 2024-09-05T01:13:00.956246+0000 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f70bb78d2eb] 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:01.082 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:13:00.957+0000 7f70b7eb39c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f70b7eb39c0 thread_name:radosgw-admin 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:01.083 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f70ba60c520] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f70bb78d345] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f70bb78d49f] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55769ddb7681] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x14227be) [0x55769e8157be] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55769ddccafd] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f70ba5f3d90] 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:01.084 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:13:01.085 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:13:01.086 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:13:01.087 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:13:01.088 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:13:01.089 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:13:01.090 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:13:01.091 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6ed7fff640 / http_manager 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f667fc640 / http_manager 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f677fe640 / rgw_dt_lg_renew 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f877fe640 / ms_dispatch 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f98ff9640 / io_context_pool 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f997fa640 / io_context_pool 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6f9b7fe640 / ms_dispatch 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6fa2604640 / ms_dispatch 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f6fa3e07640 / io_context_pool 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b51b8640 / msgr-worker-2 2024-09-05T01:13:01.092 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b59b9640 / msgr-worker-1 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b61ba640 / msgr-worker-0 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b69bb640 / io_context_pool 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: 7f70b7eb39c0 / radosgw-admin 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:13:00.959504Z_6f0c8dc1-d0ca-4c26-afd4-44c2c07e0f35/log 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:13:01.093 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-05T01:13:01.094 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 realm 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.041+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:01.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.045+0000 7f8d200009c0 20 searching for the correct realm 2024-09-05T01:13:01.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.049+0000 7f8d1e307640 0 -- 172.21.15.99:0/1532418800 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8d08117290 msgr2=0x7f8d080fec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.265+0000 7f8d1e307640 0 -- 172.21.15.99:0/1532418800 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8d08117290 msgr2=0x7f8d080fec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.277+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:01.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 zone default found 2024-09-05T01:13:01.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 4 Realm: () 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 zonegroup default 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 started sync module instance, tier type = 2024-09-05T01:13:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.281+0000 7f8d200009c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:01.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=0 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=1 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=2 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=3 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=4 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=5 2024-09-05T01:13:01.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.305+0000 7f8d200009c0 20 add_watcher() i=6 2024-09-05T01:13:01.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.309+0000 7f8d200009c0 20 add_watcher() i=7 2024-09-05T01:13:01.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.309+0000 7f8d200009c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:01.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8bcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:01.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:01.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 5 note: GC not initialized 2024-09-05T01:13:01.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8bce7fc640 20 reqs_thread_entry: start 2024-09-05T01:13:01.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:01.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 Filter name: none 2024-09-05T01:13:01.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8b3ffff640 20 reqs_thread_entry: start 2024-09-05T01:13:01.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:01.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.313+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:13:01.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:01.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:01.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:13:01.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.317+0000 7f8d200009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:01.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.321+0000 7f8bcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.325+0000 7f8d200009c0 20 remove_watcher() i=0 2024-09-05T01:13:01.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.325+0000 7f8d200009c0 2 removed watcher, disabling cache 2024-09-05T01:13:01.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.329+0000 7f8d200009c0 20 remove_watcher() i=1 2024-09-05T01:13:01.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.333+0000 7f8d200009c0 20 remove_watcher() i=2 2024-09-05T01:13:01.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.333+0000 7f8d200009c0 20 remove_watcher() i=3 2024-09-05T01:13:01.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.337+0000 7f8d200009c0 20 remove_watcher() i=4 2024-09-05T01:13:01.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.337+0000 7f8d200009c0 20 remove_watcher() i=5 2024-09-05T01:13:01.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.337+0000 7f8d200009c0 20 remove_watcher() i=6 2024-09-05T01:13:01.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.341+0000 7f8d200009c0 20 remove_watcher() i=7 2024-09-05T01:13:01.351 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.351 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:01.351 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:01.351 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:01.477 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:13:01.513 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:01.513 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:01.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 realm 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.565+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.569+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.569+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.569+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:01.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.569+0000 7f691ad4d9c0 20 searching for the correct realm 2024-09-05T01:13:01.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.573+0000 7f6919054640 0 -- 172.21.15.99:0/1115716480 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f690c12e040 msgr2=0x7f690c0fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.789+0000 7f6919054640 0 -- 172.21.15.99:0/1115716480 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f690c12e040 msgr2=0x7f690c0fcfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:01.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:01.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:01.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:01.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:01.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.801+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 zone default found 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 4 Realm: () 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 zonegroup default 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:01.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 started sync module instance, tier type = 2024-09-05T01:13:01.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.805+0000 7f691ad4d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=0 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=1 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=2 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=3 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=4 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=5 2024-09-05T01:13:01.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.829+0000 7f691ad4d9c0 20 add_watcher() i=6 2024-09-05T01:13:01.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.837+0000 7f691ad4d9c0 20 add_watcher() i=7 2024-09-05T01:13:01.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.837+0000 7f691ad4d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:01.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f67cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:01.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:01.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 5 note: GC not initialized 2024-09-05T01:13:01.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f67cdfe3640 20 reqs_thread_entry: start 2024-09-05T01:13:01.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:01.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 Filter name: none 2024-09-05T01:13:01.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f673f7fe640 20 reqs_thread_entry: start 2024-09-05T01:13:01.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-05T01:13:01.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:01.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:13:01.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:13:01.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : miss 2024-09-05T01:13:01.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.841+0000 7f691ad4d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:01.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.845+0000 7f691ad4d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to be held by another RGW process; skipping for now 2024-09-05T01:13:01.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.849+0000 7f67cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:01.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.853+0000 7f691ad4d9c0 20 remove_watcher() i=0 2024-09-05T01:13:01.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.853+0000 7f691ad4d9c0 2 removed watcher, disabling cache 2024-09-05T01:13:01.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.857+0000 7f691ad4d9c0 20 remove_watcher() i=1 2024-09-05T01:13:01.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.861+0000 7f691ad4d9c0 20 remove_watcher() i=2 2024-09-05T01:13:01.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.865+0000 7f691ad4d9c0 20 remove_watcher() i=3 2024-09-05T01:13:01.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.865+0000 7f691ad4d9c0 20 remove_watcher() i=4 2024-09-05T01:13:01.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.869+0000 7f691ad4d9c0 20 remove_watcher() i=5 2024-09-05T01:13:01.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.873+0000 7f691ad4d9c0 20 remove_watcher() i=6 2024-09-05T01:13:01.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:01.873+0000 7f691ad4d9c0 20 remove_watcher() i=7 2024-09-05T01:13:01.885 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:13:31.917 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:13:31.954 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:31.954 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:32.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.004+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.004+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.004+0000 7f7b93ed89c0 20 realm 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.004+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:32.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:32.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.008+0000 7f7b93ed89c0 20 searching for the correct realm 2024-09-05T01:13:32.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.016+0000 7f7b921df640 0 -- 172.21.15.99:0/1833131184 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55b161908290 msgr2=0x55b16190a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:32.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.024+0000 7f7b921df640 0 -- 172.21.15.99:0/1833131184 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55b1618fb970 msgr2=0x55b1618fde10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:32.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 zone default found 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 4 Realm: () 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 zonegroup default 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 started sync module instance, tier type = 2024-09-05T01:13:32.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.032+0000 7f7b93ed89c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:32.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=0 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=1 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=2 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=3 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=4 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=5 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.056+0000 7f7b93ed89c0 20 add_watcher() i=6 2024-09-05T01:13:32.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 20 add_watcher() i=7 2024-09-05T01:13:32.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:32.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7a47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:32.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:32.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 5 note: GC not initialized 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7a46fe5640 20 reqs_thread_entry: start 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.060+0000 7f7b93ed89c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 20 Filter name: none 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7a44fe1640 20 reqs_thread_entry: start 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-05T01:13:32.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : miss 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-05T01:13:32.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:32.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.064+0000 7f7b93ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:32.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.068+0000 7f7b93ed89c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:13:32.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7b93ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7b93ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7b93ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7b93ed89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:32.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7a74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94220334435168 notifier 6942 bl.length()=939 2024-09-05T01:13:32.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7a74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7a74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.080+0000 7f7a74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.084+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:32.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.084+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:32.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.084+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:32.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.084+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:32.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.0 2024-09-05T01:13:32.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.0 2024-09-05T01:13:32.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.1 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.1 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.2 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.2 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.3 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.3 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.4 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.4 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.5 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.5 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.6 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.6 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.7 2024-09-05T01:13:32.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.7 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.8 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.8 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.9 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.9 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.10 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.10 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.11 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2.11 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.0 2024-09-05T01:13:32.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.1 2024-09-05T01:13:32.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2 2024-09-05T01:13:32.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.096+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.3 2024-09-05T01:13:32.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.100+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.4 2024-09-05T01:13:32.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.100+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.5 2024-09-05T01:13:32.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.100+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.6 2024-09-05T01:13:32.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.100+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.7 2024-09-05T01:13:32.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.100+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.8 2024-09-05T01:13:32.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.104+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.9 2024-09-05T01:13:32.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.104+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.10 2024-09-05T01:13:32.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.108+0000 7f7b93ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:32.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.108+0000 7f7b93ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:32.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7b93ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7b93ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7b93ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7b93ed89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:32.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7a757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94220334435168 notifier 6942 bl.length()=939 2024-09-05T01:13:32.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7a757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7a757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.112+0000 7f7a757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.116+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:32.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.116+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:32.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.116+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:32.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.116+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:32.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.120+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.0 2024-09-05T01:13:32.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.120+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.1 2024-09-05T01:13:32.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.2 2024-09-05T01:13:32.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.3 2024-09-05T01:13:32.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.4 2024-09-05T01:13:32.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.5 2024-09-05T01:13:32.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.6 2024-09-05T01:13:32.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.124+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.7 2024-09-05T01:13:32.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.128+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.8 2024-09-05T01:13:32.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.128+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.9 2024-09-05T01:13:32.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.128+0000 7f7b93ed89c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27.10 2024-09-05T01:13:32.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.128+0000 7f7b93ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:32.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.128+0000 7f7b93ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 2024-09-05T01:13:32.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7b93ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7b93ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7b93ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7b93ed89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27, ofs0, ns] 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7a74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94220334435168 notifier 6942 bl.length()=907 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7a74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 info.flags=0x17 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7a74ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 to cache LRU end 2024-09-05T01:13:32.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.132+0000 7f7a74ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:32.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.136+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_sources= new_sources= 2024-09-05T01:13:32.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.136+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential sources added=[] removed=[] 2024-09-05T01:13:32.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.136+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): orig_dests= new_dests= 2024-09-05T01:13:32.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.136+0000 7f7b93ed89c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27]): potential dests added=[] removed=[] 2024-09-05T01:13:32.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.140+0000 7f7b93ed89c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-05T01:13:32.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.144+0000 7f7a47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:32.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.148+0000 7f7b93ed89c0 20 remove_watcher() i=0 2024-09-05T01:13:32.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.148+0000 7f7b93ed89c0 2 removed watcher, disabling cache 2024-09-05T01:13:32.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.148+0000 7f7b93ed89c0 20 remove_watcher() i=1 2024-09-05T01:13:32.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.152+0000 7f7b93ed89c0 20 remove_watcher() i=2 2024-09-05T01:13:32.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.156+0000 7f7b93ed89c0 20 remove_watcher() i=3 2024-09-05T01:13:32.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.156+0000 7f7b93ed89c0 20 remove_watcher() i=4 2024-09-05T01:13:32.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.156+0000 7f7b93ed89c0 20 remove_watcher() i=5 2024-09-05T01:13:32.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.160+0000 7f7b93ed89c0 20 remove_watcher() i=6 2024-09-05T01:13:32.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.160+0000 7f7b93ed89c0 20 remove_watcher() i=7 2024-09-05T01:13:32.173 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-05T01:13:32.204 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:32.204 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:32.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 realm 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.252+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.256+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:32.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.256+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.256+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:32.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.256+0000 7f3c8ee409c0 20 searching for the correct realm 2024-09-05T01:13:32.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.260+0000 7f3c8c145640 0 -- 172.21.15.99:0/1432830306 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f3c84063970 msgr2=0x7f3c84045940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:13:32.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.476+0000 7f3c8c946640 0 -- 172.21.15.99:0/1432830306 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f3c7c0b1040 msgr2=0x7f3c7c0b0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:32.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.488+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:32.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:32.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 zone default found 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 4 Realm: () 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 zonegroup default 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 started sync module instance, tier type = 2024-09-05T01:13:32.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.492+0000 7f3c8ee409c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=0 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=1 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=2 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=3 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=4 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=5 2024-09-05T01:13:32.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=6 2024-09-05T01:13:32.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 20 add_watcher() i=7 2024-09-05T01:13:32.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.516+0000 7f3c8ee409c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:32.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:32.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:32.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:32.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 5 note: GC not initialized 2024-09-05T01:13:32.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3b41fe3640 20 reqs_thread_entry: start 2024-09-05T01:13:32.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:32.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 20 Filter name: none 2024-09-05T01:13:32.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3ab37fe640 20 reqs_thread_entry: start 2024-09-05T01:13:32.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.520+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:32.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:32.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:32.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-05T01:13:32.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:32.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-05T01:13:32.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.524+0000 7f3c8ee409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:32.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.528+0000 7f3b42fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:32.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.532+0000 7f3c8ee409c0 20 remove_watcher() i=0 2024-09-05T01:13:32.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.532+0000 7f3c8ee409c0 2 removed watcher, disabling cache 2024-09-05T01:13:32.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.536+0000 7f3c8ee409c0 20 remove_watcher() i=1 2024-09-05T01:13:32.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.536+0000 7f3c8ee409c0 20 remove_watcher() i=2 2024-09-05T01:13:32.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.540+0000 7f3c8ee409c0 20 remove_watcher() i=3 2024-09-05T01:13:32.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.540+0000 7f3c8ee409c0 20 remove_watcher() i=4 2024-09-05T01:13:32.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.544+0000 7f3c8ee409c0 20 remove_watcher() i=5 2024-09-05T01:13:32.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.544+0000 7f3c8ee409c0 20 remove_watcher() i=6 2024-09-05T01:13:32.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:32.544+0000 7f3c8ee409c0 20 remove_watcher() i=7 2024-09-05T01:13:32.557 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:32.557 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:32.557 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-trim-reshard-log-entries id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:13:32.557 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:33.549 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-05T01:13:33.549 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:35.708 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-05T01:13:35.742 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:35.742 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:35.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.788+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 realm 2024-09-05T01:13:35.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:35.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:35.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:35.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.792+0000 7ff0587059c0 20 searching for the correct realm 2024-09-05T01:13:35.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.800+0000 7ff056a0c640 0 -- 172.21.15.99:0/2236685379 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5624ecae19b0 msgr2=0x5624ecae3e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:35.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.808+0000 7ff05620b640 0 -- 172.21.15.99:0/2236685379 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7ff0500c3040 msgr2=0x7ff0500c4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:35.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:35.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:35.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.812+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 zone default found 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 4 Realm: () 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:35.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 zonegroup default 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 started sync module instance, tier type = 2024-09-05T01:13:35.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.816+0000 7ff0587059c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=0 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=1 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=2 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=3 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=4 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=5 2024-09-05T01:13:35.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=6 2024-09-05T01:13:35.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 20 add_watcher() i=7 2024-09-05T01:13:35.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.832+0000 7ff0587059c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:35.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7fef0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:35.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 5 note: GC not initialized 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7fee877fe640 20 reqs_thread_entry: start 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 20 Filter name: none 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7fee857fa640 20 reqs_thread_entry: start 2024-09-05T01:13:35.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.836+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:35.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:35.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:35.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:35.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:35.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.840+0000 7ff0587059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:35.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.844+0000 7fef0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:35.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.848+0000 7ff0587059c0 20 remove_watcher() i=0 2024-09-05T01:13:35.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.848+0000 7ff0587059c0 2 removed watcher, disabling cache 2024-09-05T01:13:35.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.852+0000 7ff0587059c0 20 remove_watcher() i=1 2024-09-05T01:13:35.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.852+0000 7ff0587059c0 20 remove_watcher() i=2 2024-09-05T01:13:35.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.856+0000 7ff0587059c0 20 remove_watcher() i=3 2024-09-05T01:13:35.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.856+0000 7ff0587059c0 20 remove_watcher() i=4 2024-09-05T01:13:35.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.856+0000 7ff0587059c0 20 remove_watcher() i=5 2024-09-05T01:13:35.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.860+0000 7ff0587059c0 20 remove_watcher() i=6 2024-09-05T01:13:35.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.860+0000 7ff0587059c0 20 remove_watcher() i=7 2024-09-05T01:13:35.870 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:35.870 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:35.870 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:35.870 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:35.871 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-05T01:13:35.902 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:35.902 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:35.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.948+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 realm 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:35.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:35.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.952+0000 7f6de82669c0 20 searching for the correct realm 2024-09-05T01:13:35.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.960+0000 7f6de5d6c640 0 -- 172.21.15.99:0/2529101298 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f6de0017020 msgr2=0x7f6de005ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:35.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.964+0000 7f6de5d6c640 0 -- 172.21.15.99:0/2529101298 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f6de005e3f0 msgr2=0x7f6de005ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 zone default found 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 4 Realm: () 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:35.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 zonegroup default 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.972+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.976+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.976+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.976+0000 7f6de82669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:35.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.976+0000 7f6de82669c0 20 started sync module instance, tier type = 2024-09-05T01:13:35.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.976+0000 7f6de82669c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:35.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=0 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=1 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=2 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=3 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=4 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=5 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=6 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 20 add_watcher() i=7 2024-09-05T01:13:35.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.992+0000 7f6de82669c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:35.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6c977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:35.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:35.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:35.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 5 note: GC not initialized 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6c967fc640 20 reqs_thread_entry: start 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 Filter name: none 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6c07fff640 20 reqs_thread_entry: start 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-05T01:13:35.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : miss 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:35.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:35.996+0000 7f6de82669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.004+0000 7f6de82669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.004+0000 7f6de82669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.004+0000 7f6de82669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.004+0000 7f6de82669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6cc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94913676429728 notifier 6996 bl.length()=915 2024-09-05T01:13:36.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6cc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6cc8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6cc8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.008+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.0 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.0 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.1 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.1 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.2 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.2 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.3 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.3 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.4 2024-09-05T01:13:36.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.4 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.5 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.5 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.6 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.6 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.7 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.7 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.8 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.8 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.9 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.9 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.10 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.10 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.11 2024-09-05T01:13:36.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.11 2024-09-05T01:13:36.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.0 2024-09-05T01:13:36.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1 2024-09-05T01:13:36.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.2 2024-09-05T01:13:36.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.020+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.3 2024-09-05T01:13:36.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.024+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.4 2024-09-05T01:13:36.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.024+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.5 2024-09-05T01:13:36.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.024+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.6 2024-09-05T01:13:36.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.024+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.7 2024-09-05T01:13:36.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.024+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.8 2024-09-05T01:13:36.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.028+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.9 2024-09-05T01:13:36.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.028+0000 7f6de82669c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.10 2024-09-05T01:13:36.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.032+0000 7f6de82669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:36.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.032+0000 7f6de82669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6de82669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6de82669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6de82669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6de82669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6cc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94913676429728 notifier 6996 bl.length()=915 2024-09-05T01:13:36.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6cc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6cc8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.036+0000 7f6cc8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 -1 Injecting error=-5 at location=block_writes 2024-09-05T01:13:36.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.040+0000 7f6de82669c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-05T01:13:36.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:36.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.048+0000 7f6de82669c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6cc97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94913676429728 notifier 6996 bl.length()=883 2024-09-05T01:13:36.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6cc97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6cc97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6cc97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.052+0000 7f6de82669c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.056+0000 7f6de82669c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-05T01:13:36.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.060+0000 7f6c977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.064+0000 7f6de82669c0 20 remove_watcher() i=0 2024-09-05T01:13:36.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.064+0000 7f6de82669c0 2 removed watcher, disabling cache 2024-09-05T01:13:36.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.068+0000 7f6de82669c0 20 remove_watcher() i=1 2024-09-05T01:13:36.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.068+0000 7f6de82669c0 20 remove_watcher() i=2 2024-09-05T01:13:36.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.072+0000 7f6de82669c0 20 remove_watcher() i=3 2024-09-05T01:13:36.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.072+0000 7f6de82669c0 20 remove_watcher() i=4 2024-09-05T01:13:36.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.076+0000 7f6de82669c0 20 remove_watcher() i=5 2024-09-05T01:13:36.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.076+0000 7f6de82669c0 20 remove_watcher() i=6 2024-09-05T01:13:36.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.076+0000 7f6de82669c0 20 remove_watcher() i=7 2024-09-05T01:13:36.089 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-05T01:13:36.120 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:36.120 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:36.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 realm 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.164+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.168+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.168+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.168+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:36.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.168+0000 7fdae1fe39c0 20 searching for the correct realm 2024-09-05T01:13:36.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.172+0000 7fdae02ea640 0 -- 172.21.15.99:0/2897502540 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fdad406b920 msgr2=0x7fdad40617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:36.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.388+0000 7fdae02ea640 0 -- 172.21.15.99:0/2897502540 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fdad406b920 msgr2=0x7fdad40617f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:36.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.400+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 zone default found 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 4 Realm: () 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:36.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 zonegroup default 2024-09-05T01:13:36.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 started sync module instance, tier type = 2024-09-05T01:13:36.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.404+0000 7fdae1fe39c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:36.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=0 2024-09-05T01:13:36.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=1 2024-09-05T01:13:36.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=2 2024-09-05T01:13:36.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=3 2024-09-05T01:13:36.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=4 2024-09-05T01:13:36.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=5 2024-09-05T01:13:36.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.428+0000 7fdae1fe39c0 20 add_watcher() i=6 2024-09-05T01:13:36.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.432+0000 7fdae1fe39c0 20 add_watcher() i=7 2024-09-05T01:13:36.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.432+0000 7fdae1fe39c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:36.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fd995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:36.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:36.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 5 note: GC not initialized 2024-09-05T01:13:36.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fd994fe1640 20 reqs_thread_entry: start 2024-09-05T01:13:36.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:36.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 20 Filter name: none 2024-09-05T01:13:36.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fd90e7fc640 20 reqs_thread_entry: start 2024-09-05T01:13:36.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.436+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:36.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:36.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:36.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:36.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:36.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.440+0000 7fdae1fe39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:36.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.444+0000 7fd995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.452+0000 7fdae1fe39c0 20 remove_watcher() i=0 2024-09-05T01:13:36.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.452+0000 7fdae1fe39c0 2 removed watcher, disabling cache 2024-09-05T01:13:36.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.452+0000 7fdae1fe39c0 20 remove_watcher() i=1 2024-09-05T01:13:36.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.456+0000 7fdae1fe39c0 20 remove_watcher() i=2 2024-09-05T01:13:36.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.456+0000 7fdae1fe39c0 20 remove_watcher() i=3 2024-09-05T01:13:36.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.460+0000 7fdae1fe39c0 20 remove_watcher() i=4 2024-09-05T01:13:36.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.460+0000 7fdae1fe39c0 20 remove_watcher() i=5 2024-09-05T01:13:36.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.464+0000 7fdae1fe39c0 20 remove_watcher() i=6 2024-09-05T01:13:36.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.464+0000 7fdae1fe39c0 20 remove_watcher() i=7 2024-09-05T01:13:36.475 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:36.475 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:36.475 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:36.475 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:36.581 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:13:36.617 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:36.617 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:36.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.664+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 realm 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:36.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.668+0000 7f11237909c0 20 searching for the correct realm 2024-09-05T01:13:36.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.676+0000 7f1121a97640 0 -- 172.21.15.99:0/2481196213 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55a6c1cdbc80 msgr2=0x55a6c1cde140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:36.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.684+0000 7f1121296640 0 -- 172.21.15.99:0/2481196213 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f111c0ce070 msgr2=0x7f111c0f95b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:36.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.688+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 zone default found 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 4 Realm: () 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 zonegroup default 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 started sync module instance, tier type = 2024-09-05T01:13:36.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.692+0000 7f11237909c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:36.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=0 2024-09-05T01:13:36.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=1 2024-09-05T01:13:36.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=2 2024-09-05T01:13:36.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=3 2024-09-05T01:13:36.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=4 2024-09-05T01:13:36.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=5 2024-09-05T01:13:36.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=6 2024-09-05T01:13:36.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 20 add_watcher() i=7 2024-09-05T01:13:36.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.708+0000 7f11237909c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:36.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f0fd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:36.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:36.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 5 note: GC not initialized 2024-09-05T01:13:36.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f0fd67e4640 20 reqs_thread_entry: start 2024-09-05T01:13:36.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:36.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 Filter name: none 2024-09-05T01:13:36.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f0f47fff640 20 reqs_thread_entry: start 2024-09-05T01:13:36.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-05T01:13:36.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : miss 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.712+0000 7f11237909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f0ff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94174704426000 notifier 6671 bl.length()=915 2024-09-05T01:13:36.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f0ff3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f0ff3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f0ff3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.724+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.0 2024-09-05T01:13:36.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.0 2024-09-05T01:13:36.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.1 2024-09-05T01:13:36.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.1 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.2 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.2 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.3 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.3 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.4 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.4 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.5 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.5 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.6 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.6 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.7 2024-09-05T01:13:36.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.7 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.8 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.8 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.9 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.9 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.10 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.10 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.11 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1.11 2024-09-05T01:13:36.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.0 2024-09-05T01:13:36.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1 2024-09-05T01:13:36.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.2 2024-09-05T01:13:36.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.736+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.3 2024-09-05T01:13:36.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.740+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.4 2024-09-05T01:13:36.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.740+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.5 2024-09-05T01:13:36.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.740+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.6 2024-09-05T01:13:36.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.740+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.7 2024-09-05T01:13:36.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.740+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.8 2024-09-05T01:13:36.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.744+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.9 2024-09-05T01:13:36.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.744+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.10 2024-09-05T01:13:36.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.748+0000 7f11237909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:36.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.748+0000 7f11237909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f11237909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f11237909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f11237909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f11237909c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f0ff3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94174704426000 notifier 6671 bl.length()=915 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f0ff3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f0ff3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.752+0000 7f0ff3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.756+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.756+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.756+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.756+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.760+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.0 2024-09-05T01:13:36.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.760+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.1 2024-09-05T01:13:36.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.760+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.2 2024-09-05T01:13:36.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.760+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.3 2024-09-05T01:13:36.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.4 2024-09-05T01:13:36.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.5 2024-09-05T01:13:36.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.6 2024-09-05T01:13:36.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.7 2024-09-05T01:13:36.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.8 2024-09-05T01:13:36.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.9 2024-09-05T01:13:36.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.764+0000 7f11237909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28.10 2024-09-05T01:13:36.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:36.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 2024-09-05T01:13:36.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f11237909c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28, ofs0, ns] 2024-09-05T01:13:36.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f1004ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94174704426000 notifier 6671 bl.length()=883 2024-09-05T01:13:36.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f1004ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 info.flags=0x17 2024-09-05T01:13:36.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f1004ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 to cache LRU end 2024-09-05T01:13:36.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.768+0000 7f1004ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:36.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.772+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_sources= new_sources= 2024-09-05T01:13:36.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.772+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential sources added=[] removed=[] 2024-09-05T01:13:36.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.772+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): orig_dests= new_dests= 2024-09-05T01:13:36.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.772+0000 7f11237909c0 20 handle_bi_update(): bucket=:error-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28]): potential dests added=[] removed=[] 2024-09-05T01:13:36.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.776+0000 7f11237909c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-05T01:13:36.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.780+0000 7f0fd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.784+0000 7f11237909c0 20 remove_watcher() i=0 2024-09-05T01:13:36.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.784+0000 7f11237909c0 2 removed watcher, disabling cache 2024-09-05T01:13:36.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.784+0000 7f11237909c0 20 remove_watcher() i=1 2024-09-05T01:13:36.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.788+0000 7f11237909c0 20 remove_watcher() i=2 2024-09-05T01:13:36.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.788+0000 7f11237909c0 20 remove_watcher() i=3 2024-09-05T01:13:36.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.792+0000 7f11237909c0 20 remove_watcher() i=4 2024-09-05T01:13:36.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.792+0000 7f11237909c0 20 remove_watcher() i=5 2024-09-05T01:13:36.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.796+0000 7f11237909c0 20 remove_watcher() i=6 2024-09-05T01:13:36.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.796+0000 7f11237909c0 20 remove_watcher() i=7 2024-09-05T01:13:36.808 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-05T01:13:36.837 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:36.837 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:36.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 realm 2024-09-05T01:13:36.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:36.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.884+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.888+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.888+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.888+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:36.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.888+0000 7fc123ecd9c0 20 searching for the correct realm 2024-09-05T01:13:36.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.892+0000 7fc1221d4640 0 -- 172.21.15.99:0/869451764 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc11802a060 msgr2=0x7fc11804c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:36.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.900+0000 7fc1221d4640 0 -- 172.21.15.99:0/869451764 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fbfec080900 msgr2=0x7fbfec082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:13:36.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:36.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 zone default found 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 4 Realm: () 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:36.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 zonegroup default 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.908+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.912+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.912+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.912+0000 7fc123ecd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:36.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.912+0000 7fc123ecd9c0 20 started sync module instance, tier type = 2024-09-05T01:13:36.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.912+0000 7fc123ecd9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=0 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=1 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=2 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=3 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=4 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=5 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=6 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 20 add_watcher() i=7 2024-09-05T01:13:36.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fc123ecd9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.928+0000 7fbfd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 5 note: GC not initialized 2024-09-05T01:13:36.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fbfd27fc640 20 reqs_thread_entry: start 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 Filter name: none 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fbf43fff640 20 reqs_thread_entry: start 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:36.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:36.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.932+0000 7fc123ecd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:36.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.936+0000 7fbfd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:36.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.940+0000 7fc123ecd9c0 20 remove_watcher() i=0 2024-09-05T01:13:36.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.940+0000 7fc123ecd9c0 2 removed watcher, disabling cache 2024-09-05T01:13:36.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.944+0000 7fc123ecd9c0 20 remove_watcher() i=1 2024-09-05T01:13:36.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.944+0000 7fc123ecd9c0 20 remove_watcher() i=2 2024-09-05T01:13:36.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.948+0000 7fc123ecd9c0 20 remove_watcher() i=3 2024-09-05T01:13:36.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.948+0000 7fc123ecd9c0 20 remove_watcher() i=4 2024-09-05T01:13:36.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.952+0000 7fc123ecd9c0 20 remove_watcher() i=5 2024-09-05T01:13:36.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.952+0000 7fc123ecd9c0 20 remove_watcher() i=6 2024-09-05T01:13:36.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:36.952+0000 7fc123ecd9c0 20 remove_watcher() i=7 2024-09-05T01:13:36.965 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:36.965 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:36.965 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:13:36.965 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:37.907 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at block_writes 2024-09-05T01:13:37.907 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.070 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-05T01:13:40.103 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:40.103 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:40.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.148+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 realm 2024-09-05T01:13:40.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:40.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:40.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.152+0000 7fe5aa1229c0 20 searching for the correct realm 2024-09-05T01:13:40.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.156+0000 7fe5a8429640 0 -- 172.21.15.99:0/187009538 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe590105170 msgr2=0x7fe5900f67e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.376+0000 7fe5a8429640 0 -- 172.21.15.99:0/187009538 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe590105170 msgr2=0x7fe5900f67e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:40.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:40.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:40.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:40.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:40.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:40.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.384+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:40.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 zone default found 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 4 Realm: () 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 zonegroup default 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.388+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.392+0000 7fe5aa1229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.392+0000 7fe5aa1229c0 20 started sync module instance, tier type = 2024-09-05T01:13:40.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.392+0000 7fe5aa1229c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:40.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=0 2024-09-05T01:13:40.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=1 2024-09-05T01:13:40.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=2 2024-09-05T01:13:40.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=3 2024-09-05T01:13:40.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=4 2024-09-05T01:13:40.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=5 2024-09-05T01:13:40.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.412+0000 7fe5aa1229c0 20 add_watcher() i=6 2024-09-05T01:13:40.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.416+0000 7fe5aa1229c0 20 add_watcher() i=7 2024-09-05T01:13:40.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.416+0000 7fe5aa1229c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:40.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe45dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:40.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:40.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 5 note: GC not initialized 2024-09-05T01:13:40.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe45cfe1640 20 reqs_thread_entry: start 2024-09-05T01:13:40.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:40.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 20 Filter name: none 2024-09-05T01:13:40.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe3d67fc640 20 reqs_thread_entry: start 2024-09-05T01:13:40.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.420+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:40.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:40.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:40.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.424+0000 7fe5aa1229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:40.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.428+0000 7fe45dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.432+0000 7fe5aa1229c0 20 remove_watcher() i=0 2024-09-05T01:13:40.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.432+0000 7fe5aa1229c0 2 removed watcher, disabling cache 2024-09-05T01:13:40.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.436+0000 7fe5aa1229c0 20 remove_watcher() i=1 2024-09-05T01:13:40.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.436+0000 7fe5aa1229c0 20 remove_watcher() i=2 2024-09-05T01:13:40.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.440+0000 7fe5aa1229c0 20 remove_watcher() i=3 2024-09-05T01:13:40.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.440+0000 7fe5aa1229c0 20 remove_watcher() i=4 2024-09-05T01:13:40.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.444+0000 7fe5aa1229c0 20 remove_watcher() i=5 2024-09-05T01:13:40.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.444+0000 7fe5aa1229c0 20 remove_watcher() i=6 2024-09-05T01:13:40.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.448+0000 7fe5aa1229c0 20 remove_watcher() i=7 2024-09-05T01:13:40.459 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.459 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:40.459 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:40.459 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.460 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-05T01:13:40.494 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:40.494 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:40.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 realm 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:40.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 searching for the correct realm 2024-09-05T01:13:40.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.552+0000 7f3287d66640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5561f0671070 msgr2=0x5561f0673530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.560+0000 7f3287565640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f327802a060 msgr2=0x7f327808a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:40.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:40.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:40.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:40.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:40.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:40.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zone default found 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Realm: () 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:40.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zonegroup default 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started sync module instance, tier type = 2024-09-05T01:13:40.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=0 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=1 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=2 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=3 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=4 2024-09-05T01:13:40.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=5 2024-09-05T01:13:40.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=6 2024-09-05T01:13:40.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=7 2024-09-05T01:13:40.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.584+0000 7f3289a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:40.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f313dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 note: GC not initialized 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f313cfe1640 20 reqs_thread_entry: start 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 Filter name: none 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f30b67fc640 20 reqs_thread_entry: start 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-05T01:13:40.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : miss 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.0 2024-09-05T01:13:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1 2024-09-05T01:13:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2 2024-09-05T01:13:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.3 2024-09-05T01:13:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.4 2024-09-05T01:13:40.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.5 2024-09-05T01:13:40.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.6 2024-09-05T01:13:40.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.7 2024-09-05T01:13:40.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.8 2024-09-05T01:13:40.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.9 2024-09-05T01:13:40.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.10 2024-09-05T01:13:40.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:40.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3289a5f9c0 time 2024-09-05T01:13:40.633982+0000 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f328d3392eb] 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.629 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3289a5f9c0 time 2024-09-05T01:13:40.633982+0000 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f328d3392eb] 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.630 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:13:40.631 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f3289a5f9c0 thread_name:radosgw-admin 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f328c1b8520] 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f328d339345] 2024-09-05T01:13:40.643 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f3289a5f9c0 thread_name:radosgw-admin 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f328c1b8520] 2024-09-05T01:13:40.644 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f328d339345] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.645 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key hook 0x5561f057b768 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f04370f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f0437ee0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.646 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f04c0e00 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.983276s 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f04c0e00 auth_method 0 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f04370f0 auth_method 0 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.647 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:13:40.520+0000 7f3287d66640 1 monclient: found mon.noname-a 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:13:40.520+0000 7f3173e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: dump: 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.648 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:40.649 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: dump: 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 7083 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:13:40.524+0000 7f317560a640 4 set_mon_vals no callback set 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.650 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 1 librados: init done 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:13:40.524+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f05a3400 auth_method 0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:13:40.524+0000 7f3287565640 10 monclient: get_auth_request con 0x7f316c070b10 auth_method 0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:13:40.524+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f05c6520 auth_method 0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:13:40.528+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f05ca710 auth_method 0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.651 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.652 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5561f05d2df0 EEXIST 2024-09-05T01:13:40.653 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.654 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x5561f05cdbf0 EEXIST 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f05f6fa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f05f68d0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f05f52b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.993090s 2024-09-05T01:13:40.655 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f05f6fa0 auth_method 0 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f05f52b0 auth_method 0 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.656 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f05f68d0 auth_method 0 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:13:40.532+0000 7f3287d66640 1 monclient: found mon.noname-c 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: dump: 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.657 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:40.658 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: dump: 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 6716 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:13:40.532+0000 7f3286563640 4 set_mon_vals no callback set 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.659 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: get_monmap_and_config 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.660 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.661 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3160070a20 auth_method 0 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.662 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff2334458 EEXIST 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f061a3d0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.663 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f061a7b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f0644f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.997071s 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f061a3d0 auth_method 0 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f061a7b0 auth_method 0 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.664 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_done global_id 7089 payload 274 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:13:40.536+0000 7f3287565640 1 monclient: found mon.noname-a 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: dump: 2024-09-05T01:13:40.665 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.666 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: dump: 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 7089 2024-09-05T01:13:40.667 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 4 set_mon_vals no callback set 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: shutdown 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.668 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.669 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: starting msgr at 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: starting objecter 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5561f05bd0d0 EEXIST 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: setting wanted keys 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: calling monclient init 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.670 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.671 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x5561f05f8f08 EEXIST 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f061a3d0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f0644f30 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f063b100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.999641s 2024-09-05T01:13:40.672 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f063b100 auth_method 0 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f0644f30 auth_method 0 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.673 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f061a3d0 auth_method 0 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:13:40.540+0000 7f3287d66640 1 monclient: found mon.noname-c 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: dump: 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.674 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 6722 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:40.675 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: dump: 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:13:40.540+0000 7f316affd640 4 set_mon_vals no callback set 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.676 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 1 librados: init done 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cr dump hook 0x5561f063ee28 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:13:40.540+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f06648a0 auth_method 0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:13:40.540+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3150070ba0 auth_method 0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 realm 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.677 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:13:40.544+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f0668ae0 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:13:40.544+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f066c360 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 searching for the correct realm 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:13:40.544+0000 7f3287d66640 10 monclient: get_auth_request con 0x5561f0671070 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:13:40.548+0000 7f3287565640 10 monclient: get_auth_request con 0x7f327802a060 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:13:40.548+0000 7f3286d64640 10 monclient: get_auth_request con 0x7f328004b960 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:13:40.548+0000 7f3287d66640 10 monclient: get_auth_request con 0x7f32700c8040 auth_method 0 2024-09-05T01:13:40.678 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:13:40.552+0000 7f3287d66640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5561f0671070 msgr2=0x5561f0673530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:13:40.552+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x5561f0671070 session 0x5561f06709f0 osd.3 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:13:40.552+0000 7f31697fa640 10 monclient: _renew_subs 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:13:40.552+0000 7f31697fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:13:40.552+0000 7f3287d66640 10 monclient: get_auth_request con 0x7f3150080940 auth_method 0 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:13:40.552+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3278015070 auth_method 0 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:13:40.560+0000 7f3287565640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f327802a060 msgr2=0x7f327808a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:13:40.560+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x7f327802a060 session 0x7f3278016040 osd.7 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:13:40.560+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f0671070 auth_method 0 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:40.679 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zone default found 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Realm: () 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:40.680 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zonegroup default 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started sync module instance, tier type = 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=0 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=1 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=2 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=3 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=4 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=5 2024-09-05T01:13:40.681 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=6 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=7 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.682 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:13:40.588+0000 7f313dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache list hook 0x5561f063fb20 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache inspect hook 0x5561f063fb20 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache erase hook 0x5561f063fb20 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache zap hook 0x5561f063fb20 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 note: GC not initialized 2024-09-05T01:13:40.683 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:13:40.588+0000 7f313cfe1640 20 reqs_thread_entry: start 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace show hook 0x7f32800074f0 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace history hook 0x7f32800074f0 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace active hook 0x7f32800074f0 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace active_short hook 0x7f32800074f0 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 Filter name: none 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:13:40.588+0000 7f30b67fc640 20 reqs_thread_entry: start 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-05T01:13:40.684 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : miss 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.685 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.686 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.687 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.0 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:13:40.612+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x5561f066c360 session 0x5561f0667e30 osd.0 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:13:40.612+0000 7f3286d64640 10 monclient: get_auth_request con 0x7f327802a060 auth_method 0 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.3 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.4 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.5 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.6 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.7 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.8 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.9 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.10 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:40.688 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.689 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3289a5f9c0 time 2024-09-05T01:13:40.633982+0000 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f328d3392eb] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:40.690 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f3289a5f9c0 thread_name:radosgw-admin 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f328c1b8520] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f328d339345] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.691 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:13:40.692 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:13:40.693 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:13:40.694 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:13:40.695 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:13:40.696 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:13:40.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:13:40.698 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f30b67fc640 / http_manager 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f313cfe1640 / http_manager 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f313dfe3640 / rgw_dt_lg_renew 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f31697fa640 / ms_dispatch 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f316a7fc640 / io_context_pool 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f316affd640 / io_context_pool 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3171602640 / ms_dispatch 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3173e07640 / ms_dispatch 2024-09-05T01:13:40.699 INFO:tasks.workunit.client.0.smithi099.stderr: 7f317560a640 / io_context_pool 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3286563640 / io_context_pool 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3286d64640 / msgr-worker-2 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3287565640 / msgr-worker-1 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3287d66640 / msgr-worker-0 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3289a5f9c0 / radosgw-admin 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.105206.log 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.700 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: crc 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f057b620) adding con mode: secure 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key hook 0x5561f057b768 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f04370f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f0437ee0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f04c0e00 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.701 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:13:40.520+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.983276s 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f04c0e00 auth_method 0 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f04370f0 auth_method 0 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.702 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:13:40.520+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:13:40.520+0000 7f3287d66640 1 monclient: found mon.noname-a 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:13:40.520+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:13:40.520+0000 7f3173e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: dump: 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.703 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:13:40.524+0000 7f3173e07640 10 monclient: dump: 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.704 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 7083 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:13:40.524+0000 7f317560a640 4 set_mon_vals no callback set 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:13:40.524+0000 7f3289a5f9c0 1 librados: init done 2024-09-05T01:13:40.705 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:13:40.524+0000 7f3173e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:13:40.524+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f05a3400 auth_method 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:13:40.524+0000 7f3287565640 10 monclient: get_auth_request con 0x7f316c070b10 auth_method 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:13:40.524+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f05c6520 auth_method 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:13:40.528+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f05ca710 auth_method 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.706 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding auth protocol: cephx 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.707 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: crc 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:13:40.528+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cf420) adding con mode: secure 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5561f05d2df0 EEXIST 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding auth protocol: cephx 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.708 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: crc 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05cdaa8) adding con mode: secure 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x5561f05cdbf0 EEXIST 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:13:40.709 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f05f6fa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f05f68d0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f05f52b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.993090s 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f05f6fa0 auth_method 0 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f05f52b0 auth_method 0 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.710 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:13:40.532+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f05f68d0 auth_method 0 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:13:40.532+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 6716 payload 824 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:13:40.532+0000 7f3287d66640 1 monclient: found mon.noname-c 2024-09-05T01:13:40.711 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:13:40.532+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: dump: 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.712 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:13:40.532+0000 7f3171602640 10 monclient: dump: 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.713 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 6716 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:13:40.532+0000 7f3286563640 4 set_mon_vals no callback set 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:13:40.532+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:13:40.532+0000 7f3171602640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: get_monmap_and_config 2024-09-05T01:13:40.714 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.715 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding auth protocol: cephx 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: crc 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f06164b0) adding con mode: secure 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3160070a20 auth_method 0 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.716 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding auth protocol: cephx 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.717 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: crc 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff2334310) adding con mode: secure 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff2334458 EEXIST 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f061a3d0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f061a7b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f0644f30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.718 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.997071s 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f061a3d0 auth_method 0 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f061a7b0 auth_method 0 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.719 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): handle_auth_done global_id 7089 payload 274 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:13:40.536+0000 7f3287565640 1 monclient: found mon.noname-a 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: dump: 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.720 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:13:40.536+0000 7f316affd640 10 monclient: dump: 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.721 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 7089 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 4 set_mon_vals no callback set 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: shutdown 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: build_initial_monmap 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 build_initial for_mkfs: 0 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: monmap: 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:13:40.722 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding auth protocol: cephx 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.723 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: crc 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f064a0b0) adding con mode: secure 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: starting msgr at 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: starting objecter 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5561f05bd0d0 EEXIST 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: setting wanted keys 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 1 librados: calling monclient init 2024-09-05T01:13:40.724 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: init 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding auth protocol: cephx 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.725 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: crc 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 AuthRegistry(0x5561f05f8dc0) adding con mode: secure 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command rotate-key cmddesc rotate-key hook 0x5561f05f8f08 EEXIST 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5561f061a3d0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5561f0644f30 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5561f063b100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:13:40.726 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:13:40.536+0000 7f3289a5f9c0 10 monclient(hunting): authenticate will time out at 2471.999641s 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): get_auth_request con 0x5561f063b100 auth_method 0 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request con 0x5561f0644f30 auth_method 0 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:13:40.536+0000 7f3287d66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:13:40.727 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:13:40.536+0000 7f3286d64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request con 0x5561f061a3d0 auth_method 0 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:13:40.536+0000 7f3287565640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient: _finish_hunting 0 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:13:40.540+0000 7f3287d66640 1 monclient: found mon.noname-c 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:13:40.540+0000 7f3287d66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: dump: 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.728 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: _finish_auth 0 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: _check_auth_tickets 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 5 monclient: authenticate success, global_id 6722 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:13:40.729 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:13:40.540+0000 7f31697fa640 10 monclient: dump: 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:13:40.540+0000 7f316affd640 4 set_mon_vals no callback set 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.730 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _renew_subs 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 1 librados: init done 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cr dump hook 0x5561f063ee28 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:13:40.540+0000 7f31697fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:13:40.540+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f06648a0 auth_method 0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:13:40.540+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3150070ba0 auth_method 0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 realm 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:13:40.540+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.731 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:13:40.544+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f0668ae0 auth_method 0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:13:40.544+0000 7f3286d64640 10 monclient: get_auth_request con 0x5561f066c360 auth_method 0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:13:40.544+0000 7f3289a5f9c0 20 searching for the correct realm 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:13:40.544+0000 7f3287d66640 10 monclient: get_auth_request con 0x5561f0671070 auth_method 0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:13:40.548+0000 7f3287565640 10 monclient: get_auth_request con 0x7f327802a060 auth_method 0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:13:40.548+0000 7f3286d64640 10 monclient: get_auth_request con 0x7f328004b960 auth_method 0 2024-09-05T01:13:40.732 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:13:40.548+0000 7f3287d66640 10 monclient: get_auth_request con 0x7f32700c8040 auth_method 0 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:13:40.552+0000 7f3287d66640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5561f0671070 msgr2=0x5561f0673530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:13:40.552+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x5561f0671070 session 0x5561f06709f0 osd.3 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:13:40.552+0000 7f31697fa640 10 monclient: _renew_subs 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:13:40.552+0000 7f31697fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:13:40.552+0000 7f3287d66640 10 monclient: get_auth_request con 0x7f3150080940 auth_method 0 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:13:40.552+0000 7f3287565640 10 monclient: get_auth_request con 0x7f3278015070 auth_method 0 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:13:40.560+0000 7f3287565640 0 -- 172.21.15.99:0/3925493269 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f327802a060 msgr2=0x7f327808a3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:13:40.560+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x7f327802a060 session 0x7f3278016040 osd.7 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:13:40.560+0000 7f3287565640 10 monclient: get_auth_request con 0x5561f0671070 auth_method 0 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:40.733 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:13:40.564+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zone default found 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Realm: () 2024-09-05T01:13:40.734 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 zonegroup default 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started sync module instance, tier type = 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:13:40.568+0000 7f3289a5f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=0 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=1 2024-09-05T01:13:40.735 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=2 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=3 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=4 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=5 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=6 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 20 add_watcher() i=7 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:13:40.584+0000 7f3289a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding auth protocol: cephx 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.736 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:13:40.588+0000 7f313dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: crc 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 AuthRegistry(0x7ffff23347f0) adding con mode: secure 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache list hook 0x5561f063fb20 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache inspect hook 0x5561f063fb20 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache erase hook 0x5561f063fb20 2024-09-05T01:13:40.737 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command cache zap hook 0x5561f063fb20 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 note: GC not initialized 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:13:40.588+0000 7f313cfe1640 20 reqs_thread_entry: start 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace show hook 0x7f32800074f0 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace history hook 0x7f32800074f0 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace active hook 0x7f32800074f0 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 5 asok(0x5561f036e2b0) register_command sync trace active_short hook 0x7f32800074f0 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 Filter name: none 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:13:40.588+0000 7f30b67fc640 20 reqs_thread_entry: start 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-05T01:13:40.738 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : miss 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:13:40.588+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:13:40.596+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.739 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:13:40.600+0000 7f316a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:13:40.600+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.0 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.1 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.2 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.3 2024-09-05T01:13:40.740 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.4 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.5 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.6 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.7 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.8 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.9 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.10 2024-09-05T01:13:40.741 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1.11 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.0 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:13:40.612+0000 7f31697fa640 1 client.6722.objecter ms_handle_reset 0x5561f066c360 session 0x5561f0667e30 osd.0 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:13:40.612+0000 7f3286d64640 10 monclient: get_auth_request con 0x7f327802a060 auth_method 0 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.3 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.4 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:13:40.612+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.5 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.6 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.7 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:13:40.616+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.8 2024-09-05T01:13:40.742 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.9 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:13:40.620+0000 7f3289a5f9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.10 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : hit (requested=0x17, cached=0x17) 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:13:40.628+0000 7f3289a5f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 93879133487088 notifier 6722 bl.length()=915 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:13:40.628+0000 7f316affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:13:40.743 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3289a5f9c0 time 2024-09-05T01:13:40.633982+0000 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f328d3392eb] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.744 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:13:40.632+0000 7f3289a5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f3289a5f9c0 thread_name:radosgw-admin 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f328c1b8520] 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f328d339345] 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f328d33949f] 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5561eef05681] 2024-09-05T01:13:40.745 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1632) [0x5561eef19ed2] 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5561eef1b4b4] 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f328c19fd90] 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:13:40.746 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:13:40.747 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:13:40.748 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:13:40.749 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:13:40.750 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:13:40.751 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:13:40.752 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f30b67fc640 / http_manager 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f313cfe1640 / http_manager 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f313dfe3640 / rgw_dt_lg_renew 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f31697fa640 / ms_dispatch 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f316a7fc640 / io_context_pool 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f316affd640 / io_context_pool 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3171602640 / ms_dispatch 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3173e07640 / ms_dispatch 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f317560a640 / io_context_pool 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3286563640 / io_context_pool 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3286d64640 / msgr-worker-2 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3287565640 / msgr-worker-1 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3287d66640 / msgr-worker-0 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3289a5f9c0 / radosgw-admin 2024-09-05T01:13:40.753 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:13:40.754 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:13:40.754 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:13:40.636375Z_c9d4419e-7830-47cb-a9b6-f9cbf15448dd/log 2024-09-05T01:13:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:13:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:13:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-05T01:13:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 realm 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.712+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.716+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.716+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.716+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.716+0000 7f53efc729c0 20 searching for the correct realm 2024-09-05T01:13:40.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.720+0000 7f53edf79640 0 -- 172.21.15.99:0/1196996905 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f53e40ddbd0 msgr2=0x7f53e40b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.936+0000 7f53edf79640 0 -- 172.21.15.99:0/1196996905 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f53e40ddbd0 msgr2=0x7f53e40b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:40.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.948+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:40.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 zone default found 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 4 Realm: () 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:40.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 zonegroup default 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:40.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 started sync module instance, tier type = 2024-09-05T01:13:40.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.952+0000 7f53efc729c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:40.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=0 2024-09-05T01:13:40.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=1 2024-09-05T01:13:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=2 2024-09-05T01:13:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=3 2024-09-05T01:13:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=4 2024-09-05T01:13:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.976+0000 7f53efc729c0 20 add_watcher() i=5 2024-09-05T01:13:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.980+0000 7f53efc729c0 20 add_watcher() i=6 2024-09-05T01:13:40.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.980+0000 7f53efc729c0 20 add_watcher() i=7 2024-09-05T01:13:40.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.980+0000 7f53efc729c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:40.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.984+0000 7f52a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.984+0000 7f53efc729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:40.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.984+0000 7f53efc729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:40.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.984+0000 7f53efc729c0 5 note: GC not initialized 2024-09-05T01:13:40.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f52a27e4640 20 reqs_thread_entry: start 2024-09-05T01:13:40.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:40.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 Filter name: none 2024-09-05T01:13:40.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f5213fff640 20 reqs_thread_entry: start 2024-09-05T01:13:40.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-05T01:13:40.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:40.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:40.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.988+0000 7f53efc729c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:40.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.992+0000 7f53efc729c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-05T01:13:40.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.992+0000 7f53efc729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:13:40.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:40.996+0000 7f52a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.000+0000 7f53efc729c0 20 remove_watcher() i=0 2024-09-05T01:13:40.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.000+0000 7f53efc729c0 2 removed watcher, disabling cache 2024-09-05T01:13:40.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.000+0000 7f53efc729c0 20 remove_watcher() i=1 2024-09-05T01:13:41.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.004+0000 7f53efc729c0 20 remove_watcher() i=2 2024-09-05T01:13:41.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.004+0000 7f53efc729c0 20 remove_watcher() i=3 2024-09-05T01:13:41.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.008+0000 7f53efc729c0 20 remove_watcher() i=4 2024-09-05T01:13:41.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.008+0000 7f53efc729c0 20 remove_watcher() i=5 2024-09-05T01:13:41.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.012+0000 7f53efc729c0 20 remove_watcher() i=6 2024-09-05T01:13:41.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.012+0000 7f53efc729c0 20 remove_watcher() i=7 2024-09-05T01:13:41.024 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:41.024 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:13:41.025 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:13:41.025 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:13:41.133 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:13:41.168 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:13:41.169 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:13:41.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 realm 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.216+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.220+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:41.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.220+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.220+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:13:41.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.220+0000 7f45b48c69c0 20 searching for the correct realm 2024-09-05T01:13:41.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.224+0000 7f45b2bcd640 0 -- 172.21.15.99:0/3175619970 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f45a80ce040 msgr2=0x7f45a80eba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:41.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.440+0000 7f45b2bcd640 0 -- 172.21.15.99:0/3175619970 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f45a80ce040 msgr2=0x7f45a80eba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:13:41.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:13:41.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.452+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:13:41.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 zone default found 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 4 Realm: () 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 zonegroup default 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:13:41.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 started sync module instance, tier type = 2024-09-05T01:13:41.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.456+0000 7f45b48c69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:13:41.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=0 2024-09-05T01:13:41.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=1 2024-09-05T01:13:41.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=2 2024-09-05T01:13:41.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=3 2024-09-05T01:13:41.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=4 2024-09-05T01:13:41.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=5 2024-09-05T01:13:41.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.480+0000 7f45b48c69c0 20 add_watcher() i=6 2024-09-05T01:13:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.484+0000 7f45b48c69c0 20 add_watcher() i=7 2024-09-05T01:13:41.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.484+0000 7f45b48c69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:13:41.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.488+0000 7f4468fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:13:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:13:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 5 note: GC not initialized 2024-09-05T01:13:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f43e37fe640 20 reqs_thread_entry: start 2024-09-05T01:13:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:13:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 Filter name: none 2024-09-05T01:13:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f43e17fa640 20 reqs_thread_entry: start 2024-09-05T01:13:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-05T01:13:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:13:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-05T01:13:41.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-05T01:13:41.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : miss 2024-09-05T01:13:41.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:13:41.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-05T01:13:41.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:13:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:13:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:13:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:13:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.492+0000 7f45b48c69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:13:41.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.496+0000 7f45b48c69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to be held by another RGW process; skipping for now 2024-09-05T01:13:41.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.496+0000 7f4468fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:13:41.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.504+0000 7f45b48c69c0 20 remove_watcher() i=0 2024-09-05T01:13:41.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.504+0000 7f45b48c69c0 2 removed watcher, disabling cache 2024-09-05T01:13:41.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.504+0000 7f45b48c69c0 20 remove_watcher() i=1 2024-09-05T01:13:41.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.508+0000 7f45b48c69c0 20 remove_watcher() i=2 2024-09-05T01:13:41.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.508+0000 7f45b48c69c0 20 remove_watcher() i=3 2024-09-05T01:13:41.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.512+0000 7f45b48c69c0 20 remove_watcher() i=4 2024-09-05T01:13:41.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.512+0000 7f45b48c69c0 20 remove_watcher() i=5 2024-09-05T01:13:41.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.516+0000 7f45b48c69c0 20 remove_watcher() i=6 2024-09-05T01:13:41.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:13:41.516+0000 7f45b48c69c0 20 remove_watcher() i=7 2024-09-05T01:13:41.529 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:14:11.561 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:14:11.597 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:11.597 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:11.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 realm 2024-09-05T01:14:11.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:11.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.647+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.651+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:11.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.651+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.651+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:11.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.651+0000 7fa14ae6c9c0 20 searching for the correct realm 2024-09-05T01:14:11.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.655+0000 7fa149173640 0 -- 172.21.15.99:0/1363049479 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa13c0d1070 msgr2=0x7fa13c0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:11.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.871+0000 7fa149173640 0 -- 172.21.15.99:0/1363049479 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa13c0d1070 msgr2=0x7fa13c0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:11.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:11.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:11.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:11.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 zone default found 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 4 Realm: () 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 zonegroup default 2024-09-05T01:14:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.883+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:11.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 started sync module instance, tier type = 2024-09-05T01:14:11.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.887+0000 7fa14ae6c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:11.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=0 2024-09-05T01:14:11.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=1 2024-09-05T01:14:11.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=2 2024-09-05T01:14:11.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=3 2024-09-05T01:14:11.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=4 2024-09-05T01:14:11.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=5 2024-09-05T01:14:11.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.911+0000 7fa14ae6c9c0 20 add_watcher() i=6 2024-09-05T01:14:11.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.915+0000 7fa14ae6c9c0 20 add_watcher() i=7 2024-09-05T01:14:11.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.915+0000 7fa14ae6c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:11.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7f9fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:11.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:11.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:11.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 5 note: GC not initialized 2024-09-05T01:14:11.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7f9ffe7e4640 20 reqs_thread_entry: start 2024-09-05T01:14:11.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:11.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 20 Filter name: none 2024-09-05T01:14:11.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7f9ff77fe640 20 reqs_thread_entry: start 2024-09-05T01:14:11.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-05T01:14:11.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.919+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:14:11.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-05T01:14:11.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-05T01:14:11.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : miss 2024-09-05T01:14:11.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.923+0000 7fa14ae6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:14:11.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.927+0000 7fa14ae6c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:14:11.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa14ae6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa14ae6c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa14ae6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa14ae6c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:14:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa01f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94015515110464 notifier 6773 bl.length()=915 2024-09-05T01:14:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa01f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa01f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.939+0000 7fa01f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.943+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:14:11.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.943+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:14:11.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.943+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:14:11.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.943+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.0 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.0 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.1 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.1 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.2 2024-09-05T01:14:11.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.2 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.3 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.3 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.4 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.4 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.5 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.5 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.6 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.6 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.7 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.7 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.8 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.8 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.9 2024-09-05T01:14:11.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.9 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.10 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.10 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.11 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2.11 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.951+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.0 2024-09-05T01:14:11.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1 2024-09-05T01:14:11.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2 2024-09-05T01:14:11.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.3 2024-09-05T01:14:11.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.4 2024-09-05T01:14:11.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.5 2024-09-05T01:14:11.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.955+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.6 2024-09-05T01:14:11.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.959+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.7 2024-09-05T01:14:11.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.959+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.8 2024-09-05T01:14:11.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.959+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.9 2024-09-05T01:14:11.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.963+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.10 2024-09-05T01:14:11.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.967+0000 7fa14ae6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:11.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.967+0000 7fa14ae6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa01f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94015515110464 notifier 6773 bl.length()=915 2024-09-05T01:14:11.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa01f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa01f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa01f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:14:11.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:14:11.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:14:11.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.971+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:14:11.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.979+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.0 2024-09-05T01:14:11.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.979+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.1 2024-09-05T01:14:11.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.979+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.2 2024-09-05T01:14:11.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.979+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.3 2024-09-05T01:14:11.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.979+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.4 2024-09-05T01:14:11.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.983+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.5 2024-09-05T01:14:11.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.983+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.6 2024-09-05T01:14:11.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.983+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.7 2024-09-05T01:14:11.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.983+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.8 2024-09-05T01:14:11.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.983+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.9 2024-09-05T01:14:11.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29.10 2024-09-05T01:14:11.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:11.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 2024-09-05T01:14:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa14ae6c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29, ofs0, ns] 2024-09-05T01:14:11.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa01f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94015515110464 notifier 6773 bl.length()=883 2024-09-05T01:14:11.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa01f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 info.flags=0x17 2024-09-05T01:14:11.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa01f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 to cache LRU end 2024-09-05T01:14:11.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.987+0000 7fa01f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:11.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.991+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_sources= new_sources= 2024-09-05T01:14:11.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.991+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential sources added=[] removed=[] 2024-09-05T01:14:11.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.991+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): orig_dests= new_dests= 2024-09-05T01:14:11.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.991+0000 7fa14ae6c9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29]): potential dests added=[] removed=[] 2024-09-05T01:14:11.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.995+0000 7fa14ae6c9c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-05T01:14:11.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:11.999+0000 7f9fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:12.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.003+0000 7fa14ae6c9c0 20 remove_watcher() i=0 2024-09-05T01:14:12.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.003+0000 7fa14ae6c9c0 2 removed watcher, disabling cache 2024-09-05T01:14:12.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.007+0000 7fa14ae6c9c0 20 remove_watcher() i=1 2024-09-05T01:14:12.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.007+0000 7fa14ae6c9c0 20 remove_watcher() i=2 2024-09-05T01:14:12.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.011+0000 7fa14ae6c9c0 20 remove_watcher() i=3 2024-09-05T01:14:12.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.011+0000 7fa14ae6c9c0 20 remove_watcher() i=4 2024-09-05T01:14:12.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.015+0000 7fa14ae6c9c0 20 remove_watcher() i=5 2024-09-05T01:14:12.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.015+0000 7fa14ae6c9c0 20 remove_watcher() i=6 2024-09-05T01:14:12.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.015+0000 7fa14ae6c9c0 20 remove_watcher() i=7 2024-09-05T01:14:12.032 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-05T01:14:12.062 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:12.062 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:12.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.107+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 realm 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:12.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:12.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.111+0000 7efe76eb29c0 20 searching for the correct realm 2024-09-05T01:14:12.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.115+0000 7efe751b9640 0 -- 172.21.15.99:0/1568072261 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7efe5c108c00 msgr2=0x7efe5c133a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:12.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.331+0000 7efe751b9640 0 -- 172.21.15.99:0/1568072261 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7efe5c108c00 msgr2=0x7efe5c133a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:12.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:12.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:12.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:12.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:12.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:12.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 zone default found 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 4 Realm: () 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 zonegroup default 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.343+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.347+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.347+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.347+0000 7efe76eb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:12.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.347+0000 7efe76eb29c0 20 started sync module instance, tier type = 2024-09-05T01:14:12.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.347+0000 7efe76eb29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=0 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=1 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=2 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=3 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=4 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=5 2024-09-05T01:14:12.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=6 2024-09-05T01:14:12.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 20 add_watcher() i=7 2024-09-05T01:14:12.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.371+0000 7efe76eb29c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:12.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.375+0000 7efd2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:12.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:12.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:12.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 5 note: GC not initialized 2024-09-05T01:14:12.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efd29fe3640 20 reqs_thread_entry: start 2024-09-05T01:14:12.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:12.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 Filter name: none 2024-09-05T01:14:12.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efc9b7fe640 20 reqs_thread_entry: start 2024-09-05T01:14:12.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:14:12.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:14:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:14:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.379+0000 7efe76eb29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.383+0000 7efe76eb29c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-05T01:14:12.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.383+0000 7efe76eb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:12.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.383+0000 7efd2afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:12.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.391+0000 7efe76eb29c0 20 remove_watcher() i=0 2024-09-05T01:14:12.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.391+0000 7efe76eb29c0 2 removed watcher, disabling cache 2024-09-05T01:14:12.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.391+0000 7efe76eb29c0 20 remove_watcher() i=1 2024-09-05T01:14:12.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.395+0000 7efe76eb29c0 20 remove_watcher() i=2 2024-09-05T01:14:12.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.395+0000 7efe76eb29c0 20 remove_watcher() i=3 2024-09-05T01:14:12.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.399+0000 7efe76eb29c0 20 remove_watcher() i=4 2024-09-05T01:14:12.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.399+0000 7efe76eb29c0 20 remove_watcher() i=5 2024-09-05T01:14:12.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.399+0000 7efe76eb29c0 20 remove_watcher() i=6 2024-09-05T01:14:12.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:12.403+0000 7efe76eb29c0 20 remove_watcher() i=7 2024-09-05T01:14:12.414 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:14:12.414 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:13.297 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-05T01:14:13.297 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:15.458 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-05T01:14:15.490 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:15.490 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:15.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.535+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 realm 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:15.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.539+0000 7f48cb9099c0 20 searching for the correct realm 2024-09-05T01:14:15.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.547+0000 7f48c940f640 0 -- 172.21.15.99:0/3811941201 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f48c40d1020 msgr2=0x7f48c40fa360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:14:15.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.555+0000 7f48c940f640 0 -- 172.21.15.99:0/3811941201 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f48c40c2050 msgr2=0x7f48c40fa360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.559+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 zone default found 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 4 Realm: () 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:15.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:15.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:15.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 zonegroup default 2024-09-05T01:14:15.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 started sync module instance, tier type = 2024-09-05T01:14:15.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.563+0000 7f48cb9099c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=0 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=1 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=2 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=3 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=4 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=5 2024-09-05T01:14:15.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=6 2024-09-05T01:14:15.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 20 add_watcher() i=7 2024-09-05T01:14:15.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.579+0000 7f48cb9099c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:15.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f477f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 5 note: GC not initialized 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f477e7e4640 20 reqs_thread_entry: start 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 Filter name: none 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f46effff640 20 reqs_thread_entry: start 2024-09-05T01:14:15.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.583+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:15.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:15.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:15.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f48cb9099c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:15.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.587+0000 7f477f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.595+0000 7f48cb9099c0 20 remove_watcher() i=0 2024-09-05T01:14:15.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.595+0000 7f48cb9099c0 2 removed watcher, disabling cache 2024-09-05T01:14:15.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.595+0000 7f48cb9099c0 20 remove_watcher() i=1 2024-09-05T01:14:15.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.599+0000 7f48cb9099c0 20 remove_watcher() i=2 2024-09-05T01:14:15.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.599+0000 7f48cb9099c0 20 remove_watcher() i=3 2024-09-05T01:14:15.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.603+0000 7f48cb9099c0 20 remove_watcher() i=4 2024-09-05T01:14:15.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.603+0000 7f48cb9099c0 20 remove_watcher() i=5 2024-09-05T01:14:15.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.603+0000 7f48cb9099c0 20 remove_watcher() i=6 2024-09-05T01:14:15.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.607+0000 7f48cb9099c0 20 remove_watcher() i=7 2024-09-05T01:14:15.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:15.617 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:15.617 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:15.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:15.617 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-05T01:14:15.649 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:15.649 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:15.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.691+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 realm 2024-09-05T01:14:15.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:15.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.695+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.699+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:15.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.699+0000 7f2b7d7559c0 20 searching for the correct realm 2024-09-05T01:14:15.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.703+0000 7f2b7ba5c640 0 -- 172.21.15.99:0/1301121372 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f2b70065b90 msgr2=0x7f2b7005cdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:15.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.711+0000 7f2b7b25b640 0 -- 172.21.15.99:0/1301121372 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f2b740680c0 msgr2=0x7f2b7408c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.715+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 zone default found 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 4 Realm: () 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 zonegroup default 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 started sync module instance, tier type = 2024-09-05T01:14:15.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.719+0000 7f2b7d7559c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=0 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=1 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=2 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=3 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=4 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=5 2024-09-05T01:14:15.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=6 2024-09-05T01:14:15.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 20 add_watcher() i=7 2024-09-05T01:14:15.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.735+0000 7f2b7d7559c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 5 note: GC not initialized 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2a30fe1640 20 reqs_thread_entry: start 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:15.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 Filter name: none 2024-09-05T01:14:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f29aa7fc640 20 reqs_thread_entry: start 2024-09-05T01:14:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-05T01:14:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 : miss 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.739+0000 7f2b7d7559c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:15.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:15.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:15.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.743+0000 7f2b7d7559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 2024-09-05T01:14:15.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.751+0000 7f2b7d7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:15.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.751+0000 7f2b7d7559c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:15.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.751+0000 7f2b7d7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.751+0000 7f2b7d7559c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30, ofs0, ns] 2024-09-05T01:14:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2a5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94484125798176 notifier 6827 bl.length()=931 2024-09-05T01:14:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2a5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2a5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:15.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2a5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:15.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_sources= new_sources= 2024-09-05T01:14:15.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential sources added=[] removed=[] 2024-09-05T01:14:15.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_dests= new_dests= 2024-09-05T01:14:15.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.755+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential dests added=[] removed=[] 2024-09-05T01:14:15.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.0 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.0 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.1 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.1 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.2 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.2 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.3 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.3 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.4 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.4 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.5 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.5 2024-09-05T01:14:15.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.6 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.6 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.7 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.7 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.8 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.8 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.9 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.9 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.10 2024-09-05T01:14:15.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.10 2024-09-05T01:14:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.11 2024-09-05T01:14:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1.11 2024-09-05T01:14:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.0 2024-09-05T01:14:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1 2024-09-05T01:14:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.763+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2 2024-09-05T01:14:15.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.3 2024-09-05T01:14:15.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.4 2024-09-05T01:14:15.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.5 2024-09-05T01:14:15.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.6 2024-09-05T01:14:15.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.7 2024-09-05T01:14:15.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.767+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.8 2024-09-05T01:14:15.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.771+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.9 2024-09-05T01:14:15.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.771+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.10 2024-09-05T01:14:15.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.775+0000 7f2b7d7559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:15.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.775+0000 7f2b7d7559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 2024-09-05T01:14:15.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:15.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:15.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:15.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30, ofs0, ns] 2024-09-05T01:14:15.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2a5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94484125798176 notifier 6827 bl.length()=931 2024-09-05T01:14:15.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2a5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:15.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2a5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:15.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2a5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:15.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_sources= new_sources= 2024-09-05T01:14:15.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential sources added=[] removed=[] 2024-09-05T01:14:15.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_dests= new_dests= 2024-09-05T01:14:15.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.779+0000 7f2b7d7559c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential dests added=[] removed=[] 2024-09-05T01:14:15.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.783+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.0 2024-09-05T01:14:15.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1 2024-09-05T01:14:15.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2 2024-09-05T01:14:15.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.3 2024-09-05T01:14:15.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.4 2024-09-05T01:14:15.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.5 2024-09-05T01:14:15.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.6 2024-09-05T01:14:15.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.7 2024-09-05T01:14:15.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.787+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.8 2024-09-05T01:14:15.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.791+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.9 2024-09-05T01:14:15.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.791+0000 7f2b7d7559c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.10 2024-09-05T01:14:15.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.791+0000 7f2b7d7559c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-05T01:14:15.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.791+0000 7f2b7d7559c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-05T01:14:15.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.799+0000 7f2a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.803+0000 7f2b7d7559c0 20 remove_watcher() i=0 2024-09-05T01:14:15.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.803+0000 7f2b7d7559c0 2 removed watcher, disabling cache 2024-09-05T01:14:15.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.807+0000 7f2b7d7559c0 20 remove_watcher() i=1 2024-09-05T01:14:15.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.807+0000 7f2b7d7559c0 20 remove_watcher() i=2 2024-09-05T01:14:15.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.811+0000 7f2b7d7559c0 20 remove_watcher() i=3 2024-09-05T01:14:15.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.811+0000 7f2b7d7559c0 20 remove_watcher() i=4 2024-09-05T01:14:15.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.811+0000 7f2b7d7559c0 20 remove_watcher() i=5 2024-09-05T01:14:15.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.815+0000 7f2b7d7559c0 20 remove_watcher() i=6 2024-09-05T01:14:15.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.815+0000 7f2b7d7559c0 20 remove_watcher() i=7 2024-09-05T01:14:15.826 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-05T01:14:15.852 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:15.852 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:15.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.895+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 realm 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.899+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.903+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:15.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.903+0000 7f5a2e5c99c0 20 searching for the correct realm 2024-09-05T01:14:15.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.907+0000 7f5a2c8d0640 0 -- 172.21.15.99:0/3708508909 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x561d885360e0 msgr2=0x561d885385a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:15.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.915+0000 7f5a2c0cf640 0 -- 172.21.15.99:0/3708508909 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f5a24086c70 msgr2=0x7f5a24085740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:15.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:15.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.919+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 zone default found 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 4 Realm: () 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 zonegroup default 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 started sync module instance, tier type = 2024-09-05T01:14:15.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.923+0000 7f5a2e5c99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:15.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=0 2024-09-05T01:14:15.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=1 2024-09-05T01:14:15.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=2 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=3 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=4 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=5 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=6 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 20 add_watcher() i=7 2024-09-05T01:14:15.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.939+0000 7f5a2e5c99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:15.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f58e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 5 note: GC not initialized 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f58e1fdb640 20 reqs_thread_entry: start 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 20 Filter name: none 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f58537fe640 20 reqs_thread_entry: start 2024-09-05T01:14:15.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.943+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:15.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:14:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:15.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:14:15.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.947+0000 7f5a2e5c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:15.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.951+0000 7f58e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:15.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.955+0000 7f5a2e5c99c0 20 remove_watcher() i=0 2024-09-05T01:14:15.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.955+0000 7f5a2e5c99c0 2 removed watcher, disabling cache 2024-09-05T01:14:15.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.959+0000 7f5a2e5c99c0 20 remove_watcher() i=1 2024-09-05T01:14:15.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.959+0000 7f5a2e5c99c0 20 remove_watcher() i=2 2024-09-05T01:14:15.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.963+0000 7f5a2e5c99c0 20 remove_watcher() i=3 2024-09-05T01:14:15.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.963+0000 7f5a2e5c99c0 20 remove_watcher() i=4 2024-09-05T01:14:15.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.967+0000 7f5a2e5c99c0 20 remove_watcher() i=5 2024-09-05T01:14:15.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.967+0000 7f5a2e5c99c0 20 remove_watcher() i=6 2024-09-05T01:14:15.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:15.967+0000 7f5a2e5c99c0 20 remove_watcher() i=7 2024-09-05T01:14:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:15.979 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:15.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:16.073 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:14:16.107 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:16.107 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:16.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.151+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.151+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.151+0000 7f29a53009c0 20 realm 2024-09-05T01:14:16.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.151+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:16.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:16.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.155+0000 7f29a53009c0 20 searching for the correct realm 2024-09-05T01:14:16.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.159+0000 7f29a3607640 0 -- 172.21.15.99:0/2457486267 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f2998030060 msgr2=0x7f2998062bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.167+0000 7f29a3607640 0 -- 172.21.15.99:0/2457486267 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f286c080900 msgr2=0x7f286c082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.175+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 zone default found 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 4 Realm: () 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 zonegroup default 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 started sync module instance, tier type = 2024-09-05T01:14:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.179+0000 7f29a53009c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=0 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=1 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=2 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=3 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=4 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=5 2024-09-05T01:14:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=6 2024-09-05T01:14:16.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 20 add_watcher() i=7 2024-09-05T01:14:16.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.195+0000 7f29a53009c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:16.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f28597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:16.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:16.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:16.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 5 note: GC not initialized 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f27d3fff640 20 reqs_thread_entry: start 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 Filter name: none 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f27d1ffb640 20 reqs_thread_entry: start 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-05T01:14:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 : miss 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:16.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.199+0000 7f29a53009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 2024-09-05T01:14:16.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.203+0000 7f29a53009c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f29a53009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f29a53009c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f29a53009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f29a53009c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30, ofs0, ns] 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f28867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94867516340768 notifier 6863 bl.length()=931 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f28867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f28867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.215+0000 7f28867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.219+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_sources= new_sources= 2024-09-05T01:14:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.219+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential sources added=[] removed=[] 2024-09-05T01:14:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.219+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_dests= new_dests= 2024-09-05T01:14:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.219+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential dests added=[] removed=[] 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.0 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.0 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.1 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.1 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.2 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.2 2024-09-05T01:14:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.3 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.3 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.4 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.4 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.5 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.5 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.6 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.6 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.7 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.7 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.8 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.8 2024-09-05T01:14:16.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.9 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.9 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.10 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.10 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.11 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2.11 2024-09-05T01:14:16.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.0 2024-09-05T01:14:16.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1 2024-09-05T01:14:16.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2 2024-09-05T01:14:16.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.3 2024-09-05T01:14:16.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.227+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.4 2024-09-05T01:14:16.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.5 2024-09-05T01:14:16.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.6 2024-09-05T01:14:16.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.7 2024-09-05T01:14:16.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.8 2024-09-05T01:14:16.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.9 2024-09-05T01:14:16.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.231+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.10 2024-09-05T01:14:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:16.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 2024-09-05T01:14:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f29a53009c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30, ofs0, ns] 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f2885ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94867516340768 notifier 6863 bl.length()=931 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f2885ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f2885ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.239+0000 7f2885ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.243+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_sources= new_sources= 2024-09-05T01:14:16.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.243+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential sources added=[] removed=[] 2024-09-05T01:14:16.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.243+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_dests= new_dests= 2024-09-05T01:14:16.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.243+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential dests added=[] removed=[] 2024-09-05T01:14:16.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.0 2024-09-05T01:14:16.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.1 2024-09-05T01:14:16.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.2 2024-09-05T01:14:16.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.3 2024-09-05T01:14:16.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.4 2024-09-05T01:14:16.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.5 2024-09-05T01:14:16.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.6 2024-09-05T01:14:16.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.7 2024-09-05T01:14:16.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.247+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.8 2024-09-05T01:14:16.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.9 2024-09-05T01:14:16.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30.10 2024-09-05T01:14:16.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:16.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f29a53009c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30, ofs0, ns] 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f2885ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94867516340768 notifier 6863 bl.length()=899 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f2885ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 info.flags=0x17 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f2885ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 to cache LRU end 2024-09-05T01:14:16.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.251+0000 7f2885ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.255+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_sources= new_sources= 2024-09-05T01:14:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.255+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential sources added=[] removed=[] 2024-09-05T01:14:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.255+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): orig_dests= new_dests= 2024-09-05T01:14:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.255+0000 7f29a53009c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30]): potential dests added=[] removed=[] 2024-09-05T01:14:16.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.259+0000 7f29a53009c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:14:16.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.263+0000 7f28597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:16.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.267+0000 7f29a53009c0 20 remove_watcher() i=0 2024-09-05T01:14:16.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.267+0000 7f29a53009c0 2 removed watcher, disabling cache 2024-09-05T01:14:16.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.267+0000 7f29a53009c0 20 remove_watcher() i=1 2024-09-05T01:14:16.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.271+0000 7f29a53009c0 20 remove_watcher() i=2 2024-09-05T01:14:16.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.271+0000 7f29a53009c0 20 remove_watcher() i=3 2024-09-05T01:14:16.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.275+0000 7f29a53009c0 20 remove_watcher() i=4 2024-09-05T01:14:16.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.275+0000 7f29a53009c0 20 remove_watcher() i=5 2024-09-05T01:14:16.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.275+0000 7f29a53009c0 20 remove_watcher() i=6 2024-09-05T01:14:16.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.279+0000 7f29a53009c0 20 remove_watcher() i=7 2024-09-05T01:14:16.289 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-05T01:14:16.317 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:16.317 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:16.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.359+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 realm 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:16.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:16.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.363+0000 7f72098a59c0 20 searching for the correct realm 2024-09-05T01:14:16.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.371+0000 7f7207bac640 0 -- 172.21.15.99:0/1740990401 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f71fc028030 msgr2=0x7f71fc02aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:16.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.375+0000 7f7207bac640 0 -- 172.21.15.99:0/1740990401 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f70d0080900 msgr2=0x7f70d0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:16.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.383+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 zone default found 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 4 Realm: () 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 zonegroup default 2024-09-05T01:14:16.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 started sync module instance, tier type = 2024-09-05T01:14:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.387+0000 7f72098a59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:16.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=0 2024-09-05T01:14:16.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=1 2024-09-05T01:14:16.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=2 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=3 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=4 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=5 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=6 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 20 add_watcher() i=7 2024-09-05T01:14:16.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.403+0000 7f72098a59c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:16.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f70bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:16.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 5 note: GC not initialized 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f70bcfe1640 20 reqs_thread_entry: start 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 Filter name: none 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f70367fc640 20 reqs_thread_entry: start 2024-09-05T01:14:16.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.407+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:16.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:16.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:16.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f72098a59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:16.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.411+0000 7f70bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.419+0000 7f72098a59c0 20 remove_watcher() i=0 2024-09-05T01:14:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.419+0000 7f72098a59c0 2 removed watcher, disabling cache 2024-09-05T01:14:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.419+0000 7f72098a59c0 20 remove_watcher() i=1 2024-09-05T01:14:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.423+0000 7f72098a59c0 20 remove_watcher() i=2 2024-09-05T01:14:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.423+0000 7f72098a59c0 20 remove_watcher() i=3 2024-09-05T01:14:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.427+0000 7f72098a59c0 20 remove_watcher() i=4 2024-09-05T01:14:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.427+0000 7f72098a59c0 20 remove_watcher() i=5 2024-09-05T01:14:16.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.427+0000 7f72098a59c0 20 remove_watcher() i=6 2024-09-05T01:14:16.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:16.427+0000 7f72098a59c0 20 remove_watcher() i=7 2024-09-05T01:14:16.440 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:14:16.440 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:17.354 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-05T01:14:17.354 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:19.478 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-05T01:14:19.511 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:19.511 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:19.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 realm 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.559+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.563+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.563+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.563+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:19.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.563+0000 7f6008cf49c0 20 searching for the correct realm 2024-09-05T01:14:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.567+0000 7f6006ffb640 0 -- 172.21.15.99:0/1894825012 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5ffc033040 msgr2=0x7f5ffc034430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.575+0000 7f60067fa640 0 -- 172.21.15.99:0/1894825012 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f60000767a0 msgr2=0x7f6000065050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:19.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 zone default found 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 4 Realm: () 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 zonegroup default 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.583+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 started sync module instance, tier type = 2024-09-05T01:14:19.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.587+0000 7f6008cf49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:19.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=0 2024-09-05T01:14:19.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=1 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=2 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=3 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=4 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=5 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=6 2024-09-05T01:14:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 20 add_watcher() i=7 2024-09-05T01:14:19.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.603+0000 7f6008cf49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:19.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f5ebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 5 note: GC not initialized 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f5e377fe640 20 reqs_thread_entry: start 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 Filter name: none 2024-09-05T01:14:19.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f5e357fa640 20 reqs_thread_entry: start 2024-09-05T01:14:19.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:19.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:19.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.607+0000 7f6008cf49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:19.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.611+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.611+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:19.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.611+0000 7f6008cf49c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.611+0000 7f6008cf49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:19.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.611+0000 7f6008cf49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:19.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.615+0000 7f5ebcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.619+0000 7f6008cf49c0 20 remove_watcher() i=0 2024-09-05T01:14:19.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.619+0000 7f6008cf49c0 2 removed watcher, disabling cache 2024-09-05T01:14:19.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.619+0000 7f6008cf49c0 20 remove_watcher() i=1 2024-09-05T01:14:19.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.623+0000 7f6008cf49c0 20 remove_watcher() i=2 2024-09-05T01:14:19.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.627+0000 7f6008cf49c0 20 remove_watcher() i=3 2024-09-05T01:14:19.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.627+0000 7f6008cf49c0 20 remove_watcher() i=4 2024-09-05T01:14:19.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.627+0000 7f6008cf49c0 20 remove_watcher() i=5 2024-09-05T01:14:19.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.631+0000 7f6008cf49c0 20 remove_watcher() i=6 2024-09-05T01:14:19.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.631+0000 7f6008cf49c0 20 remove_watcher() i=7 2024-09-05T01:14:19.642 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:19.642 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:19.643 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:19.643 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:19.643 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-05T01:14:19.678 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:19.678 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:19.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 realm 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.723+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.727+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.727+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.727+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:19.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.727+0000 7f6afa36a9c0 20 searching for the correct realm 2024-09-05T01:14:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.731+0000 7f6af8671640 0 -- 172.21.15.99:0/3306793829 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6aec065f30 msgr2=0x7f6aec05be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.739+0000 7f6af7e70640 0 -- 172.21.15.99:0/3306793829 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f6af006b490 msgr2=0x7f6af00870d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 zone default found 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 4 Realm: () 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 zonegroup default 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 started sync module instance, tier type = 2024-09-05T01:14:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.747+0000 7f6afa36a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=0 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=1 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=2 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=3 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=4 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=5 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.763+0000 7f6afa36a9c0 20 add_watcher() i=6 2024-09-05T01:14:19.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 add_watcher() i=7 2024-09-05T01:14:19.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f69adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 5 note: GC not initialized 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f69acfe1640 20 reqs_thread_entry: start 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 Filter name: none 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f69267fc640 20 reqs_thread_entry: start 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-05T01:14:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.767+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-05T01:14:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 : miss 2024-09-05T01:14:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.771+0000 7f6afa36a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 2024-09-05T01:14:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31, ofs0, ns] 2024-09-05T01:14:19.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f69d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94572730785184 notifier 6911 bl.length()=931 2024-09-05T01:14:19.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f69d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f69d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f69d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_sources= new_sources= 2024-09-05T01:14:19.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential sources added=[] removed=[] 2024-09-05T01:14:19.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_dests= new_dests= 2024-09-05T01:14:19.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.779+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential dests added=[] removed=[] 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.0 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.0 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.1 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.1 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.2 2024-09-05T01:14:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.2 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.3 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.3 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.4 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.4 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.5 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.5 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.6 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.6 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.7 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.7 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.8 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.8 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.9 2024-09-05T01:14:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.9 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.10 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.10 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.11 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1.11 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.0 2024-09-05T01:14:19.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.791+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1 2024-09-05T01:14:19.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.2 2024-09-05T01:14:19.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.3 2024-09-05T01:14:19.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.4 2024-09-05T01:14:19.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.5 2024-09-05T01:14:19.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.6 2024-09-05T01:14:19.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.795+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.7 2024-09-05T01:14:19.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.799+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.8 2024-09-05T01:14:19.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.799+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.9 2024-09-05T01:14:19.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.799+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.10 2024-09-05T01:14:19.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:19.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 2024-09-05T01:14:19.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f6afa36a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31, ofs0, ns] 2024-09-05T01:14:19.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f69d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94572730785184 notifier 6911 bl.length()=931 2024-09-05T01:14:19.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f69d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f69d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.807+0000 7f69d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.811+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_sources= new_sources= 2024-09-05T01:14:19.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.811+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential sources added=[] removed=[] 2024-09-05T01:14:19.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.811+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_dests= new_dests= 2024-09-05T01:14:19.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.811+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential dests added=[] removed=[] 2024-09-05T01:14:19.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.815+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.0 2024-09-05T01:14:19.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.815+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.1 2024-09-05T01:14:19.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.815+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.2 2024-09-05T01:14:19.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.3 2024-09-05T01:14:19.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.4 2024-09-05T01:14:19.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.5 2024-09-05T01:14:19.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.6 2024-09-05T01:14:19.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.7 2024-09-05T01:14:19.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.8 2024-09-05T01:14:19.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.819+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.9 2024-09-05T01:14:19.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31.10 2024-09-05T01:14:19.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-05T01:14:19.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:19.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 2024-09-05T01:14:19.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f6afa36a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31, ofs0, ns] 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f69d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 94572730785184 notifier 6911 bl.length()=899 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f69d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 info.flags=0x17 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f69d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 to cache LRU end 2024-09-05T01:14:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.823+0000 7f69d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:19.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.827+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_sources= new_sources= 2024-09-05T01:14:19.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.827+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential sources added=[] removed=[] 2024-09-05T01:14:19.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.827+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): orig_dests= new_dests= 2024-09-05T01:14:19.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.827+0000 7f6afa36a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31]): potential dests added=[] removed=[] 2024-09-05T01:14:19.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.831+0000 7f6afa36a9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:14:19.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.835+0000 7f69adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.839+0000 7f6afa36a9c0 20 remove_watcher() i=0 2024-09-05T01:14:19.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.839+0000 7f6afa36a9c0 2 removed watcher, disabling cache 2024-09-05T01:14:19.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.839+0000 7f6afa36a9c0 20 remove_watcher() i=1 2024-09-05T01:14:19.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.843+0000 7f6afa36a9c0 20 remove_watcher() i=2 2024-09-05T01:14:19.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.843+0000 7f6afa36a9c0 20 remove_watcher() i=3 2024-09-05T01:14:19.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.847+0000 7f6afa36a9c0 20 remove_watcher() i=4 2024-09-05T01:14:19.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.847+0000 7f6afa36a9c0 20 remove_watcher() i=5 2024-09-05T01:14:19.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.851+0000 7f6afa36a9c0 20 remove_watcher() i=6 2024-09-05T01:14:19.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.851+0000 7f6afa36a9c0 20 remove_watcher() i=7 2024-09-05T01:14:19.865 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-05T01:14:19.892 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:19.893 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:19.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.939+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 realm 2024-09-05T01:14:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:19.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:19.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.943+0000 7f4479e6c9c0 20 searching for the correct realm 2024-09-05T01:14:19.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.947+0000 7f4478173640 0 -- 172.21.15.99:0/2663472 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f446c064650 msgr2=0x7f446c0630c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.955+0000 7f4478173640 0 -- 172.21.15.99:0/2663472 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4340080900 msgr2=0x7f4340082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:19.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:19.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 zone default found 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 4 Realm: () 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 zonegroup default 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.963+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.967+0000 7f4479e6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:19.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.967+0000 7f4479e6c9c0 20 started sync module instance, tier type = 2024-09-05T01:14:19.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.967+0000 7f4479e6c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:19.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=0 2024-09-05T01:14:19.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=1 2024-09-05T01:14:19.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=2 2024-09-05T01:14:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=3 2024-09-05T01:14:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=4 2024-09-05T01:14:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=5 2024-09-05T01:14:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.979+0000 7f4479e6c9c0 20 add_watcher() i=6 2024-09-05T01:14:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 add_watcher() i=7 2024-09-05T01:14:19.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:19.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f432dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 5 note: GC not initialized 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f432cfe1640 20 reqs_thread_entry: start 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 Filter name: none 2024-09-05T01:14:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f42a67fc640 20 reqs_thread_entry: start 2024-09-05T01:14:19.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.983+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:19.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:19.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:19.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:19.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:19.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:19.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.987+0000 7f4479e6c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:19.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.991+0000 7f432dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:19.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.995+0000 7f4479e6c9c0 20 remove_watcher() i=0 2024-09-05T01:14:19.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.995+0000 7f4479e6c9c0 2 removed watcher, disabling cache 2024-09-05T01:14:19.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.999+0000 7f4479e6c9c0 20 remove_watcher() i=1 2024-09-05T01:14:19.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:19.999+0000 7f4479e6c9c0 20 remove_watcher() i=2 2024-09-05T01:14:19.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:20.003+0000 7f4479e6c9c0 20 remove_watcher() i=3 2024-09-05T01:14:20.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:20.003+0000 7f4479e6c9c0 20 remove_watcher() i=4 2024-09-05T01:14:20.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:20.003+0000 7f4479e6c9c0 20 remove_watcher() i=5 2024-09-05T01:14:20.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:20.007+0000 7f4479e6c9c0 20 remove_watcher() i=6 2024-09-05T01:14:20.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:20.007+0000 7f4479e6c9c0 20 remove_watcher() i=7 2024-09-05T01:14:20.018 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:20.018 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:20.018 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-05T01:14:20.018 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:20.949 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-05T01:14:20.949 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.085 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-05T01:14:23.118 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:23.118 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:23.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.163+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 realm 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.167+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.171+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:23.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.171+0000 7fee7eb839c0 20 searching for the correct realm 2024-09-05T01:14:23.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.175+0000 7fee7ce8a640 0 -- 172.21.15.99:0/814270411 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fee70020060 msgr2=0x7fee700728d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.183+0000 7fee7ce8a640 0 -- 172.21.15.99:0/814270411 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fed44080930 msgr2=0x7fed44082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:23.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:23.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:23.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 zone default found 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 4 Realm: () 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 zonegroup default 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.191+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 started sync module instance, tier type = 2024-09-05T01:14:23.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.195+0000 7fee7eb839c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=0 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=1 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=2 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=3 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=4 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=5 2024-09-05T01:14:23.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=6 2024-09-05T01:14:23.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 20 add_watcher() i=7 2024-09-05T01:14:23.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.223+0000 7fee7eb839c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:23.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fed32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:23.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:23.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 5 note: GC not initialized 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fed31fdb640 20 reqs_thread_entry: start 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 Filter name: none 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7feca37fe640 20 reqs_thread_entry: start 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:23.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.227+0000 7fee7eb839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:23.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.231+0000 7fed32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.235+0000 7fee7eb839c0 20 remove_watcher() i=0 2024-09-05T01:14:23.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.235+0000 7fee7eb839c0 2 removed watcher, disabling cache 2024-09-05T01:14:23.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.235+0000 7fee7eb839c0 20 remove_watcher() i=1 2024-09-05T01:14:23.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.239+0000 7fee7eb839c0 20 remove_watcher() i=2 2024-09-05T01:14:23.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.239+0000 7fee7eb839c0 20 remove_watcher() i=3 2024-09-05T01:14:23.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.243+0000 7fee7eb839c0 20 remove_watcher() i=4 2024-09-05T01:14:23.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.243+0000 7fee7eb839c0 20 remove_watcher() i=5 2024-09-05T01:14:23.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.243+0000 7fee7eb839c0 20 remove_watcher() i=6 2024-09-05T01:14:23.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.247+0000 7fee7eb839c0 20 remove_watcher() i=7 2024-09-05T01:14:23.256 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.256 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:23.257 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:23.257 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.257 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-05T01:14:23.289 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:23.289 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:23.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 realm 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:23.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 searching for the correct realm 2024-09-05T01:14:23.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.343+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x561941d83560 msgr2=0x561941d859d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.351+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f4e18080930 msgr2=0x7f4e18082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zone default found 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Realm: () 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:23.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:23.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zonegroup default 2024-09-05T01:14:23.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started sync module instance, tier type = 2024-09-05T01:14:23.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:23.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=0 2024-09-05T01:14:23.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=1 2024-09-05T01:14:23.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=2 2024-09-05T01:14:23.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=3 2024-09-05T01:14:23.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=4 2024-09-05T01:14:23.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=5 2024-09-05T01:14:23.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=6 2024-09-05T01:14:23.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 add_watcher() i=7 2024-09-05T01:14:23.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:23.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4e067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:23.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:23.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 note: GC not initialized 2024-09-05T01:14:23.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4e057e2640 20 reqs_thread_entry: start 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 Filter name: none 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4dfe7fc640 20 reqs_thread_entry: start 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : miss 2024-09-05T01:14:23.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.411+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:23.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.429 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4f521cd9c0 time 2024-09-05T01:14:23.435333+0000 2024-09-05T01:14:23.429 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:14:23.430 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.430 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4f55aa72eb] 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.431+0000 7f4f521cd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4f521cd9c0 time 2024-09-05T01:14:23.435333+0000 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.431 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4f55aa72eb] 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:14:23.432 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f4f521cd9c0 thread_name:radosgw-admin 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4f54926520] 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4f55aa7345] 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.451 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.435+0000 7f4f521cd9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f4f521cd9c0 thread_name:radosgw-admin 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4f54926520] 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4f55aa7345] 2024-09-05T01:14:23.452 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.453 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key hook 0x561941c9a858 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941b27db0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941be6850 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941cc8ed0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.776789s 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941b27db0 auth_method 0 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.454 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941cc8ed0 auth_method 0 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_done global_id 7338 payload 824 2024-09-05T01:14:23.455 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:14:23.315+0000 7f4f504d4640 1 monclient: found mon.noname-a 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: dump: 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.456 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: dump: 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.457 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 7338 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:14:23.315+0000 7f4e3de0b640 4 set_mon_vals no callback set 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 1 librados: init done 2024-09-05T01:14:23.458 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:14:23.315+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941cd8960 auth_method 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4e38070ae0 auth_method 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:14:23.319+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x561941ce4d60 auth_method 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:14:23.323+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941ce9400 auth_method 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.459 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.460 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561941cf1b20 EEXIST 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.461 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.462 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x561941cec8e0 EEXIST 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d15cd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d15600 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d13fe0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.463 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.787827s 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d15cd0 auth_method 0 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941d13fe0 auth_method 0 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.464 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request con 0x561941d15600 auth_method 0 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_done global_id 6959 payload 824 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:14:23.327+0000 7f4f504d4640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.465 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: dump: 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: dump: 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6959 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:14:23.327+0000 7f4f50cd5640 4 set_mon_vals no callback set 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.468 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: get_monmap_and_config 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.469 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.470 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4e28070a20 auth_method 0 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.471 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe44d9e8d8 EEXIST 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d38ed0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d63480 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.472 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d64690 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.791694s 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request con 0x561941d63480 auth_method 0 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d38ed0 auth_method 0 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.473 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_done global_id 6962 payload 274 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d64690 auth_method 0 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.474 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: dump: 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.475 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: dump: 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.476 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6962 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 4 set_mon_vals no callback set 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: shutdown 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.477 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.478 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: starting msgr at 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: starting objecter 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561941d5c050 EEXIST 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: setting wanted keys 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: calling monclient init 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.479 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.480 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x561941d17c38 EEXIST 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d38ed0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d63480 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d64690 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.794189s 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d38ed0 auth_method 0 2024-09-05T01:14:23.481 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941d64690 auth_method 0 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.482 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: dump: 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.483 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: dump: 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.484 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6965 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:14:23.331+0000 7f4e2effd640 4 set_mon_vals no callback set 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.485 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: init done 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cr dump hook 0x561941d57528 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:14:23.335+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d83560 auth_method 0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:14:23.335+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x7f4e18070b10 auth_method 0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 realm 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:23.486 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:14:23.335+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x561941d87750 auth_method 0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:14:23.339+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941d8af90 auth_method 0 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 searching for the correct realm 2024-09-05T01:14:23.487 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:14:23.339+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d8fd50 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:14:23.339+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4f4811ec20 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:14:23.339+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x7f4f40046060 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:14:23.343+0000 7f4f504d4640 10 monclient: get_auth_request con 0x7f4f44037040 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:14:23.343+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x561941d83560 msgr2=0x561941d859d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 1 client.6965.objecter ms_handle_reset 0x561941d83560 session 0x561941d82e90 osd.1 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 10 monclient: _renew_subs 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:14:23.343+0000 7f4f504d4640 10 monclient: get_auth_request con 0x7f4e18080930 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:14:23.347+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4f480c7030 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:14:23.351+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f4e18080930 msgr2=0x7f4e18082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:14:23.351+0000 7f4e2d7fa640 1 client.6965.objecter ms_handle_reset 0x7f4e18080930 session 0x561941d82e90 osd.1 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:14:23.351+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d83560 auth_method 0 2024-09-05T01:14:23.488 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zone default found 2024-09-05T01:14:23.489 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Realm: () 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zonegroup default 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started sync module instance, tier type = 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=0 2024-09-05T01:14:23.490 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=1 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=2 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=3 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=4 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=5 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=6 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 add_watcher() i=7 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.491 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:14:23.379+0000 7f4e067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:23.492 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache list hook 0x561941d61e00 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache inspect hook 0x561941d61e00 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache erase hook 0x561941d61e00 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache zap hook 0x561941d61e00 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 note: GC not initialized 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:14:23.379+0000 7f4e057e2640 20 reqs_thread_entry: start 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace show hook 0x7f4f44003a20 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace history hook 0x7f4f44003a20 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace active hook 0x7f4f44003a20 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace active_short hook 0x7f4f44003a20 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 Filter name: none 2024-09-05T01:14:23.493 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:14:23.379+0000 7f4dfe7fc640 20 reqs_thread_entry: start 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : miss 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.494 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.495 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.496 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.497 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:14:23.411+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.498 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.499 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4f521cd9c0 time 2024-09-05T01:14:23.435333+0000 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4f55aa72eb] 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.500 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:14:23.435+0000 7f4f521cd9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f4f521cd9c0 thread_name:radosgw-admin 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4f54926520] 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:14:23.501 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4f55aa7345] 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:14:23.502 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:14:23.503 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:14:23.504 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:14:23.505 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:14:23.506 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:14:23.507 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:14:23.508 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4dfe7fc640 / http_manager 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e057e2640 / http_manager 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e067e4640 / rgw_dt_lg_renew 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2d7fa640 / ms_dispatch 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2e7fc640 / io_context_pool 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2effd640 / io_context_pool 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e357fa640 / ms_dispatch 2024-09-05T01:14:23.509 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e37fff640 / ms_dispatch 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e3de0b640 / io_context_pool 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f4f4d2640 / msgr-worker-2 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f4fcd3640 / msgr-worker-1 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f504d4640 / msgr-worker-0 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f50cd5640 / io_context_pool 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f521cd9c0 / radosgw-admin 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.113466.log 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.510 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key hook 0x561941c9a858 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941b27db0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941be6850 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941cc8ed0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.776789s 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941b27db0 auth_method 0 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.511 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941cc8ed0 auth_method 0 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient(hunting): handle_auth_done global_id 7338 payload 824 2024-09-05T01:14:23.512 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:14:23.315+0000 7f4f504d4640 1 monclient: found mon.noname-a 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:14:23.315+0000 7f4f504d4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: dump: 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.513 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:14:23.315+0000 7f4e37fff640 10 monclient: dump: 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.514 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 7338 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:14:23.315+0000 7f4e3de0b640 4 set_mon_vals no callback set 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:14:23.315+0000 7f4f521cd9c0 1 librados: init done 2024-09-05T01:14:23.515 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:14:23.315+0000 7f4e37fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:14:23.315+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941cd8960 auth_method 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:14:23.315+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4e38070ae0 auth_method 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:14:23.319+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x561941ce4d60 auth_method 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:14:23.323+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941ce9400 auth_method 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.516 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding auth protocol: cephx 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.517 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: crc 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cee110) adding con mode: secure 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561941cf1b20 EEXIST 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding auth protocol: cephx 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.518 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: crc 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 AuthRegistry(0x561941cec798) adding con mode: secure 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x561941cec8e0 EEXIST 2024-09-05T01:14:23.519 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d15cd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d15600 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d13fe0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:14:23.323+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.787827s 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d15cd0 auth_method 0 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.520 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:14:23.323+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941d13fe0 auth_method 0 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:14:23.323+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request con 0x561941d15600 auth_method 0 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.521 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient(hunting): handle_auth_done global_id 6959 payload 824 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:14:23.327+0000 7f4f504d4640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:14:23.327+0000 7f4f504d4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: dump: 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.522 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:14:23.327+0000 7f4e357fa640 10 monclient: dump: 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.523 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6959 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:14:23.327+0000 7f4f50cd5640 4 set_mon_vals no callback set 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.524 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:14:23.327+0000 7f4e357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: get_monmap_and_config 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.525 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.526 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.526 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.526 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.526 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding auth protocol: cephx 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.528 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: crc 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d34f50) adding con mode: secure 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4e28070a20 auth_method 0 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding auth protocol: cephx 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.529 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: crc 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9e790) adding con mode: secure 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe44d9e8d8 EEXIST 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:14:23.530 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d38ed0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d63480 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d64690 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:14:23.327+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.791694s 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request con 0x561941d63480 auth_method 0 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d38ed0 auth_method 0 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.531 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:14:23.327+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:14:23.327+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient(hunting): handle_auth_done global_id 6962 payload 274 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:14:23.331+0000 7f4f4f4d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.532 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d64690 auth_method 0 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: dump: 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.533 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:14:23.331+0000 7f4e2effd640 10 monclient: dump: 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.534 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6962 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 4 set_mon_vals no callback set 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: shutdown 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: build_initial_monmap 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 build_initial for_mkfs: 0 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: monmap: 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:14:23.535 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding auth protocol: cephx 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.536 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: crc 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d64bd0) adding con mode: secure 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: starting msgr at 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: starting objecter 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561941d5c050 EEXIST 2024-09-05T01:14:23.537 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: setting wanted keys 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: calling monclient init 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: init 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding auth protocol: cephx 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.538 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: crc 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 AuthRegistry(0x561941d17af0) adding con mode: secure 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command rotate-key cmddesc rotate-key hook 0x561941d17c38 EEXIST 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-c con 0x561941d38ed0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-b con 0x561941d63480 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:14:23.539 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): picked mon.noname-a con 0x561941d64690 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient(hunting): authenticate will time out at 2514.794189s 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request con 0x561941d38ed0 auth_method 0 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): get_auth_request con 0x561941d64690 auth_method 0 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:14:23.540 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:14:23.331+0000 7f4f504d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient(hunting): handle_auth_done global_id 6965 payload 824 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient: _finish_hunting 0 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 1 monclient: found mon.noname-c 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:14:23.331+0000 7f4f4fcd3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: dump: 2024-09-05T01:14:23.541 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: _finish_auth 0 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: _check_auth_tickets 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:14:23.542 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:14:23.331+0000 7f4e2d7fa640 10 monclient: dump: 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:14:23.543 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 monclient: authenticate success, global_id 6965 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:14:23.331+0000 7f4e2effd640 4 set_mon_vals no callback set 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _renew_subs 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 1 librados: init done 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:14:23.331+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cr dump hook 0x561941d57528 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:14:23.335+0000 7f4e2d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:14:23.544 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:14:23.335+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d83560 auth_method 0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:14:23.335+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x7f4e18070b10 auth_method 0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 realm 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:14:23.335+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:14:23.335+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x561941d87750 auth_method 0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.545 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:14:23.339+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x561941d8af90 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:14:23.339+0000 7f4f521cd9c0 20 searching for the correct realm 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:14:23.339+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d8fd50 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:14:23.339+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4f4811ec20 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:14:23.339+0000 7f4f4f4d2640 10 monclient: get_auth_request con 0x7f4f40046060 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:14:23.343+0000 7f4f504d4640 10 monclient: get_auth_request con 0x7f4f44037040 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:14:23.343+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x561941d83560 msgr2=0x561941d859d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 1 client.6965.objecter ms_handle_reset 0x561941d83560 session 0x561941d82e90 osd.1 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 10 monclient: _renew_subs 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:14:23.343+0000 7f4e2d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:14:23.343+0000 7f4f504d4640 10 monclient: get_auth_request con 0x7f4e18080930 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:14:23.347+0000 7f4f4fcd3640 10 monclient: get_auth_request con 0x7f4f480c7030 auth_method 0 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:14:23.351+0000 7f4f504d4640 0 -- 172.21.15.99:0/2668500329 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f4e18080930 msgr2=0x7f4e18082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.546 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:14:23.351+0000 7f4e2d7fa640 1 client.6965.objecter ms_handle_reset 0x7f4e18080930 session 0x561941d82e90 osd.1 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:14:23.351+0000 7f4f504d4640 10 monclient: get_auth_request con 0x561941d83560 auth_method 0 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:23.547 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zone default found 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Realm: () 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 zonegroup default 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started sync module instance, tier type = 2024-09-05T01:14:23.548 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:14:23.359+0000 7f4f521cd9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=0 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=1 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=2 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=3 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=4 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=5 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:14:23.375+0000 7f4f521cd9c0 20 add_watcher() i=6 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 add_watcher() i=7 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding auth protocol: cephx 2024-09-05T01:14:23.549 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:14:23.379+0000 7f4e067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: crc 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 AuthRegistry(0x7ffe44d9ec70) adding con mode: secure 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:14:23.550 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache list hook 0x561941d61e00 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache inspect hook 0x561941d61e00 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache erase hook 0x561941d61e00 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command cache zap hook 0x561941d61e00 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 note: GC not initialized 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:14:23.379+0000 7f4e057e2640 20 reqs_thread_entry: start 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace show hook 0x7f4f44003a20 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace history hook 0x7f4f44003a20 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace active hook 0x7f4f44003a20 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 5 asok(0x561941a8f2b0) register_command sync trace active_short hook 0x7f4f44003a20 2024-09-05T01:14:23.551 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 Filter name: none 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:14:23.379+0000 7f4dfe7fc640 20 reqs_thread_entry: start 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:14:23.379+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : miss 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.552 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:14:23.383+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:14:23.391+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:14:23.391+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.553 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:14:23.395+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.554 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:23.555 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:14:23.403+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:14:23.407+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:14:23.411+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:14:23.415+0000 7f4f521cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:23.556 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:14:23.419+0000 7f4f521cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94666478933680 notifier 6965 bl.length()=931 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:14:23.419+0000 7f4e2e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:14:23.423+0000 7f4f521cd9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:23.557 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:14:23.427+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:14:23.431+0000 7f4f521cd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4f521cd9c0 time 2024-09-05T01:14:23.435333+0000 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:14:23.558 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4f55aa72eb] 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:14:23.435+0000 7f4f521cd9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:14:23.559 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f4f521cd9c0 thread_name:radosgw-admin 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4f54926520] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4f55aa7345] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4f55aa749f] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561940196681] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5619401abdd7] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4f5490dd90] 2024-09-05T01:14:23.560 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:14:23.561 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:14:23.562 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:14:23.563 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:14:23.564 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:14:23.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:14:23.566 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:14:23.567 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4dfe7fc640 / http_manager 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e057e2640 / http_manager 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e067e4640 / rgw_dt_lg_renew 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2d7fa640 / ms_dispatch 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2e7fc640 / io_context_pool 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e2effd640 / io_context_pool 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e357fa640 / ms_dispatch 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e37fff640 / ms_dispatch 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4e3de0b640 / io_context_pool 2024-09-05T01:14:23.568 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f4f4d2640 / msgr-worker-2 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f4fcd3640 / msgr-worker-1 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f504d4640 / msgr-worker-0 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f50cd5640 / io_context_pool 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7f4f521cd9c0 / radosgw-admin 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:14:23.437404Z_4fad1602-56d2-46c6-857b-927b674bad84/log 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:14:23.569 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.511+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 realm 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.515+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.519+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.519+0000 7f991fd7b9c0 20 searching for the correct realm 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.523+0000 7f991d881640 0 -- 172.21.15.99:0/2691045501 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f99180b63d0 msgr2=0x7f99180b6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.531+0000 7f991d881640 0 -- 172.21.15.99:0/2691045501 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f97e8080970 msgr2=0x7f97e8082da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:23.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 zone default found 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 4 Realm: () 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:23.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 zonegroup default 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.535+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 started sync module instance, tier type = 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.539+0000 7f991fd7b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=0 2024-09-05T01:14:23.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=1 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=2 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=3 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=4 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=5 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=6 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 add_watcher() i=7 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f97cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.555+0000 7f991fd7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 5 note: GC not initialized 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f97ce7fc640 20 reqs_thread_entry: start 2024-09-05T01:14:23.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 Filter name: none 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f973ffff640 20 reqs_thread_entry: start 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.559+0000 7f991fd7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:23.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.563+0000 7f97cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.567+0000 7f991fd7b9c0 20 remove_watcher() i=0 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.567+0000 7f991fd7b9c0 2 removed watcher, disabling cache 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.567+0000 7f991fd7b9c0 20 remove_watcher() i=1 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.571+0000 7f991fd7b9c0 20 remove_watcher() i=2 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.575+0000 7f991fd7b9c0 20 remove_watcher() i=3 2024-09-05T01:14:23.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.575+0000 7f991fd7b9c0 20 remove_watcher() i=4 2024-09-05T01:14:23.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.575+0000 7f991fd7b9c0 20 remove_watcher() i=5 2024-09-05T01:14:23.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.579+0000 7f991fd7b9c0 20 remove_watcher() i=6 2024-09-05T01:14:23.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:23.579+0000 7f991fd7b9c0 20 remove_watcher() i=7 2024-09-05T01:14:23.591 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:23.591 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:23.591 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:23.591 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:54.002 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:14:54.038 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:54.038 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:54.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 realm 2024-09-05T01:14:54.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:54.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:54.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.086+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.090+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:54.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.090+0000 7f0d6274c9c0 20 searching for the correct realm 2024-09-05T01:14:54.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.094+0000 7f0d60a53640 0 -- 172.21.15.99:0/1692303060 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0d54025070 msgr2=0x7f0d5406ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:54.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.106+0000 7f0d5fa51640 0 -- 172.21.15.99:0/1692303060 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x56477486b910 msgr2=0x56477486dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:54.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:54.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:54.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 zone default found 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 4 Realm: () 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 zonegroup default 2024-09-05T01:14:54.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.318+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 started sync module instance, tier type = 2024-09-05T01:14:54.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.322+0000 7f0d6274c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:54.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=0 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=1 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=2 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=3 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=4 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.346+0000 7f0d6274c9c0 20 add_watcher() i=5 2024-09-05T01:14:54.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.350+0000 7f0d6274c9c0 20 add_watcher() i=6 2024-09-05T01:14:54.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.350+0000 7f0d6274c9c0 20 add_watcher() i=7 2024-09-05T01:14:54.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.350+0000 7f0d6274c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:54.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0c177de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:54.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0d6274c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:54.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0d6274c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:54.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0d6274c9c0 5 note: GC not initialized 2024-09-05T01:14:54.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0c167dc640 20 reqs_thread_entry: start 2024-09-05T01:14:54.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0d6274c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:54.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0d6274c9c0 20 Filter name: none 2024-09-05T01:14:54.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.354+0000 7f0c0f7fe640 20 reqs_thread_entry: start 2024-09-05T01:14:54.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-05T01:14:54.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:54.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-05T01:14:54.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-05T01:14:54.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : miss 2024-09-05T01:14:54.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:54.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:54.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.358+0000 7f0d6274c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:54.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0d6274c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0d6274c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0d6274c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0d6274c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:54.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0c36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94864897688096 notifier 6998 bl.length()=931 2024-09-05T01:14:54.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0c36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0c36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.370+0000 7f0c36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.374+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:54.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.374+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:54.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.374+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:54.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.374+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.0 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.1 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.2 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.3 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.4 2024-09-05T01:14:54.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.5 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.6 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.7 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.8 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.9 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.10 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:54.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1.11 2024-09-05T01:14:54.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:54.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.382+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:54.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.386+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:54.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.386+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:54.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.386+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:54.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:54.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:54.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:54.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:54.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:54.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.390+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:54.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.398+0000 7f0d6274c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:54.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.398+0000 7f0d6274c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:54.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0d6274c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0d6274c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0d6274c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0d6274c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:54.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0c36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94864897688096 notifier 6998 bl.length()=931 2024-09-05T01:14:54.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0c36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0c36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.402+0000 7f0c36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.406+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:54.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.406+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:54.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.406+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:54.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.406+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:54.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.410+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.0 2024-09-05T01:14:54.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.410+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.1 2024-09-05T01:14:54.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.410+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.2 2024-09-05T01:14:54.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.3 2024-09-05T01:14:54.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.4 2024-09-05T01:14:54.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.5 2024-09-05T01:14:54.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.6 2024-09-05T01:14:54.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.7 2024-09-05T01:14:54.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.8 2024-09-05T01:14:54.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.414+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.9 2024-09-05T01:14:54.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32.10 2024-09-05T01:14:54.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:54.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 2024-09-05T01:14:54.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0d6274c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32, ofs0, ns] 2024-09-05T01:14:54.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0c36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464324 cookie 94864897688096 notifier 6998 bl.length()=899 2024-09-05T01:14:54.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0c36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 info.flags=0x17 2024-09-05T01:14:54.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0c36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 to cache LRU end 2024-09-05T01:14:54.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.418+0000 7f0c36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:54.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.422+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_sources= new_sources= 2024-09-05T01:14:54.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.422+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential sources added=[] removed=[] 2024-09-05T01:14:54.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.422+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): orig_dests= new_dests= 2024-09-05T01:14:54.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.422+0000 7f0d6274c9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32]): potential dests added=[] removed=[] 2024-09-05T01:14:54.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.430+0000 7f0d6274c9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-05T01:14:54.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.434+0000 7f0c177de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:54.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.438+0000 7f0d6274c9c0 20 remove_watcher() i=0 2024-09-05T01:14:54.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.438+0000 7f0d6274c9c0 2 removed watcher, disabling cache 2024-09-05T01:14:54.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.438+0000 7f0d6274c9c0 20 remove_watcher() i=1 2024-09-05T01:14:54.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.442+0000 7f0d6274c9c0 20 remove_watcher() i=2 2024-09-05T01:14:54.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.442+0000 7f0d6274c9c0 20 remove_watcher() i=3 2024-09-05T01:14:54.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.446+0000 7f0d6274c9c0 20 remove_watcher() i=4 2024-09-05T01:14:54.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.450+0000 7f0d6274c9c0 20 remove_watcher() i=5 2024-09-05T01:14:54.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.450+0000 7f0d6274c9c0 20 remove_watcher() i=6 2024-09-05T01:14:54.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.454+0000 7f0d6274c9c0 20 remove_watcher() i=7 2024-09-05T01:14:54.470 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-05T01:14:54.503 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:54.504 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:54.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 realm 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.550+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.554+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:54.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.554+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.554+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:54.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.554+0000 7f051abb59c0 20 searching for the correct realm 2024-09-05T01:14:54.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.558+0000 7f0518ebc640 0 -- 172.21.15.99:0/598088663 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f050c01bc20 msgr2=0x7f050c05d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:54.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.774+0000 7f0518ebc640 0 -- 172.21.15.99:0/598088663 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f050c01bc20 msgr2=0x7f050c05d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.786+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:54.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 zone default found 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 4 Realm: () 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:54.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 zonegroup default 2024-09-05T01:14:54.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:54.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 started sync module instance, tier type = 2024-09-05T01:14:54.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.790+0000 7f051abb59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=0 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=1 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=2 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=3 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=4 2024-09-05T01:14:54.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=5 2024-09-05T01:14:54.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.814+0000 7f051abb59c0 20 add_watcher() i=6 2024-09-05T01:14:54.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.818+0000 7f051abb59c0 20 add_watcher() i=7 2024-09-05T01:14:54.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.818+0000 7f051abb59c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:54.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f03cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:54.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:54.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:54.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 5 note: GC not initialized 2024-09-05T01:14:54.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f03cdfdb640 20 reqs_thread_entry: start 2024-09-05T01:14:54.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:54.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 20 Filter name: none 2024-09-05T01:14:54.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f033f7fe640 20 reqs_thread_entry: start 2024-09-05T01:14:54.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.822+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:54.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:54.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:54.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:14:54.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:54.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:14:54.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.826+0000 7f051abb59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:54.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.830+0000 7f03cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:54.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.834+0000 7f051abb59c0 20 remove_watcher() i=0 2024-09-05T01:14:54.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.834+0000 7f051abb59c0 2 removed watcher, disabling cache 2024-09-05T01:14:54.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.838+0000 7f051abb59c0 20 remove_watcher() i=1 2024-09-05T01:14:54.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.842+0000 7f051abb59c0 20 remove_watcher() i=2 2024-09-05T01:14:54.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.842+0000 7f051abb59c0 20 remove_watcher() i=3 2024-09-05T01:14:54.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.846+0000 7f051abb59c0 20 remove_watcher() i=4 2024-09-05T01:14:54.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.846+0000 7f051abb59c0 20 remove_watcher() i=5 2024-09-05T01:14:54.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.846+0000 7f051abb59c0 20 remove_watcher() i=6 2024-09-05T01:14:54.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:54.850+0000 7f051abb59c0 20 remove_watcher() i=7 2024-09-05T01:14:54.862 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:54.862 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:54.862 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:14:54.862 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-05T01:14:55.743 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:57.998 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-05T01:14:58.030 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:58.030 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:58.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 realm 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.078+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.082+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.082+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.082+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:58.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.082+0000 7f13178189c0 20 searching for the correct realm 2024-09-05T01:14:58.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.086+0000 7f1315b1f640 0 -- 172.21.15.99:0/2395251696 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55cc02b15aa0 msgr2=0x55cc02b17f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.098+0000 7f1314b1d640 0 -- 172.21.15.99:0/2395251696 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x55cc02b1d580 msgr2=0x55cc02b1f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.102+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 zone default found 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 4 Realm: () 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 zonegroup default 2024-09-05T01:14:58.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 started sync module instance, tier type = 2024-09-05T01:14:58.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.106+0000 7f13178189c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:58.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=0 2024-09-05T01:14:58.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=1 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=2 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=3 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=4 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=5 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.122+0000 7f13178189c0 20 add_watcher() i=6 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 add_watcher() i=7 2024-09-05T01:14:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:58.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f11cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 5 note: GC not initialized 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f11ca7e4640 20 reqs_thread_entry: start 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 Filter name: none 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f113bfff640 20 reqs_thread_entry: start 2024-09-05T01:14:58.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.126+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.130+0000 7f13178189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.134+0000 7f11cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.138+0000 7f13178189c0 20 remove_watcher() i=0 2024-09-05T01:14:58.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.138+0000 7f13178189c0 2 removed watcher, disabling cache 2024-09-05T01:14:58.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.142+0000 7f13178189c0 20 remove_watcher() i=1 2024-09-05T01:14:58.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.142+0000 7f13178189c0 20 remove_watcher() i=2 2024-09-05T01:14:58.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.146+0000 7f13178189c0 20 remove_watcher() i=3 2024-09-05T01:14:58.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.146+0000 7f13178189c0 20 remove_watcher() i=4 2024-09-05T01:14:58.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.146+0000 7f13178189c0 20 remove_watcher() i=5 2024-09-05T01:14:58.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.150+0000 7f13178189c0 20 remove_watcher() i=6 2024-09-05T01:14:58.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.150+0000 7f13178189c0 20 remove_watcher() i=7 2024-09-05T01:14:58.162 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:58.163 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:58.163 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:58.163 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:58.163 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-05T01:14:58.195 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:58.196 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:58.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.238+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 realm 2024-09-05T01:14:58.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:58.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:58.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.242+0000 7fb2eafc29c0 20 searching for the correct realm 2024-09-05T01:14:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.250+0000 7fb2e92c9640 0 -- 172.21.15.99:0/4060049283 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb2d4019070 msgr2=0x7fb2d400e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.258+0000 7fb2e92c9640 0 -- 172.21.15.99:0/4060049283 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb1b4080900 msgr2=0x7fb1b4082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 zone default found 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 4 Realm: () 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 zonegroup default 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 started sync module instance, tier type = 2024-09-05T01:14:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.266+0000 7fb2eafc29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=0 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=1 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=2 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=3 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=4 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=5 2024-09-05T01:14:58.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=6 2024-09-05T01:14:58.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 20 add_watcher() i=7 2024-09-05T01:14:58.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.282+0000 7fb2eafc29c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:58.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb19efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:58.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 5 note: GC not initialized 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb19dfe3640 20 reqs_thread_entry: start 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 Filter name: none 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb10f7fe640 20 reqs_thread_entry: start 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-05T01:14:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 : miss 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.286+0000 7fb2eafc29c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:58.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.290+0000 7fb2eafc29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 2024-09-05T01:14:58.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.298+0000 7fb2eafc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.298+0000 7fb2eafc29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.298+0000 7fb2eafc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.298+0000 7fb2eafc29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33, ofs0, ns] 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb1bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464351 cookie 94825700990464 notifier 7052 bl.length()=911 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb1bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb1bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb1bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_sources= new_sources= 2024-09-05T01:14:58.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential sources added=[] removed=[] 2024-09-05T01:14:58.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_dests= new_dests= 2024-09-05T01:14:58.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.302+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential dests added=[] removed=[] 2024-09-05T01:14:58.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.310+0000 7fb2eafc29c0 -1 Injecting error=-5 at location=do_reshard 2024-09-05T01:14:58.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:58.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 2024-09-05T01:14:58.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.330+0000 7fb2eafc29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33, ofs0, ns] 2024-09-05T01:14:58.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb1bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94825700990464 notifier 7052 bl.length()=879 2024-09-05T01:14:58.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb1bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb1bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb1bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_sources= new_sources= 2024-09-05T01:14:58.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential sources added=[] removed=[] 2024-09-05T01:14:58.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_dests= new_dests= 2024-09-05T01:14:58.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb2eafc29c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential dests added=[] removed=[] 2024-09-05T01:14:58.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.334+0000 7fb2eafc29c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-05T01:14:58.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.338+0000 7fb19efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.342+0000 7fb2eafc29c0 20 remove_watcher() i=0 2024-09-05T01:14:58.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.342+0000 7fb2eafc29c0 2 removed watcher, disabling cache 2024-09-05T01:14:58.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.346+0000 7fb2eafc29c0 20 remove_watcher() i=1 2024-09-05T01:14:58.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.350+0000 7fb2eafc29c0 20 remove_watcher() i=2 2024-09-05T01:14:58.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.354+0000 7fb2eafc29c0 20 remove_watcher() i=3 2024-09-05T01:14:58.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.354+0000 7fb2eafc29c0 20 remove_watcher() i=4 2024-09-05T01:14:58.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.354+0000 7fb2eafc29c0 20 remove_watcher() i=5 2024-09-05T01:14:58.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.358+0000 7fb2eafc29c0 20 remove_watcher() i=6 2024-09-05T01:14:58.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.358+0000 7fb2eafc29c0 20 remove_watcher() i=7 2024-09-05T01:14:58.370 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-05T01:14:58.396 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:58.397 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:58.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 realm 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.442+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.446+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.446+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.446+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:58.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.446+0000 7fa66937c9c0 20 searching for the correct realm 2024-09-05T01:14:58.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.450+0000 7fa666681640 0 -- 172.21.15.99:0/3654750201 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fa6580e6040 msgr2=0x7fa6580fb940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.458+0000 7fa666e82640 0 -- 172.21.15.99:0/3654750201 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fa660078140 msgr2=0x7fa66005bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:58.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:58.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:58.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.466+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:58.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 zone default found 2024-09-05T01:14:58.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 4 Realm: () 2024-09-05T01:14:58.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:58.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 zonegroup default 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 started sync module instance, tier type = 2024-09-05T01:14:58.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.470+0000 7fa66937c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:58.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=0 2024-09-05T01:14:58.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=1 2024-09-05T01:14:58.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=2 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=3 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=4 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=5 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=6 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 20 add_watcher() i=7 2024-09-05T01:14:58.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.486+0000 7fa66937c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:58.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa51d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 5 note: GC not initialized 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa497fff640 20 reqs_thread_entry: start 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 Filter name: none 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa495ffb640 20 reqs_thread_entry: start 2024-09-05T01:14:58.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.490+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.494+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.494+0000 7fa66937c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.494+0000 7fa66937c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.494+0000 7fa66937c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.494+0000 7fa51d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.498+0000 7fa66937c9c0 20 remove_watcher() i=0 2024-09-05T01:14:58.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.498+0000 7fa66937c9c0 2 removed watcher, disabling cache 2024-09-05T01:14:58.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.502+0000 7fa66937c9c0 20 remove_watcher() i=1 2024-09-05T01:14:58.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.506+0000 7fa66937c9c0 20 remove_watcher() i=2 2024-09-05T01:14:58.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.506+0000 7fa66937c9c0 20 remove_watcher() i=3 2024-09-05T01:14:58.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.510+0000 7fa66937c9c0 20 remove_watcher() i=4 2024-09-05T01:14:58.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.510+0000 7fa66937c9c0 20 remove_watcher() i=5 2024-09-05T01:14:58.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.514+0000 7fa66937c9c0 20 remove_watcher() i=6 2024-09-05T01:14:58.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.514+0000 7fa66937c9c0 20 remove_watcher() i=7 2024-09-05T01:14:58.527 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:58.527 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:58.527 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:14:58.527 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:14:58.660 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:58.660 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:58.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 realm 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.706+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.710+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.710+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.710+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.710+0000 7f03b75469c0 20 searching for the correct realm 2024-09-05T01:14:58.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.714+0000 7f03b584d640 0 -- 172.21.15.99:0/3509976012 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x559fbb0e0e50 msgr2=0x559fbb0e32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.722+0000 7f03b584d640 0 -- 172.21.15.99:0/3509976012 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f0280080900 msgr2=0x7f0280082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 zone default found 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 4 Realm: () 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 zonegroup default 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 started sync module instance, tier type = 2024-09-05T01:14:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.730+0000 7f03b75469c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:58.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=0 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=1 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=2 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=3 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=4 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=5 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.746+0000 7f03b75469c0 20 add_watcher() i=6 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 add_watcher() i=7 2024-09-05T01:14:58.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:58.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f026b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:58.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:58.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 5 note: GC not initialized 2024-09-05T01:14:58.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f026a7e4640 20 reqs_thread_entry: start 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 Filter name: none 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f01dbfff640 20 reqs_thread_entry: start 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.750+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 : miss 2024-09-05T01:14:58.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.754+0000 7f03b75469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 2024-09-05T01:14:58.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f03b75469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f03b75469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f03b75469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f03b75469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33, ofs0, ns] 2024-09-05T01:14:58.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f0298ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 94144526485760 notifier 7476 bl.length()=911 2024-09-05T01:14:58.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f0298ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f0298ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.762+0000 7f0298ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.766+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_sources= new_sources= 2024-09-05T01:14:58.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.766+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential sources added=[] removed=[] 2024-09-05T01:14:58.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.766+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_dests= new_dests= 2024-09-05T01:14:58.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.766+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential dests added=[] removed=[] 2024-09-05T01:14:58.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.0 2024-09-05T01:14:58.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.0 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.1 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.1 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.2 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.2 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.3 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.3 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.4 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.4 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.5 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.5 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.6 2024-09-05T01:14:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.6 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.7 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.7 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.8 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.8 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.9 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.9 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.10 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.10 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.11 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1.11 2024-09-05T01:14:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.0 2024-09-05T01:14:58.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.774+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1 2024-09-05T01:14:58.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.2 2024-09-05T01:14:58.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.3 2024-09-05T01:14:58.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.4 2024-09-05T01:14:58.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.5 2024-09-05T01:14:58.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.6 2024-09-05T01:14:58.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.778+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.7 2024-09-05T01:14:58.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.782+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.8 2024-09-05T01:14:58.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.782+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.9 2024-09-05T01:14:58.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.782+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.10 2024-09-05T01:14:58.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:58.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 2024-09-05T01:14:58.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f03b75469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33, ofs0, ns] 2024-09-05T01:14:58.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f0298ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94144526485760 notifier 7476 bl.length()=911 2024-09-05T01:14:58.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f0298ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f0298ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.790+0000 7f0298ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.794+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_sources= new_sources= 2024-09-05T01:14:58.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.794+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential sources added=[] removed=[] 2024-09-05T01:14:58.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.794+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_dests= new_dests= 2024-09-05T01:14:58.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.794+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential dests added=[] removed=[] 2024-09-05T01:14:58.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.0 2024-09-05T01:14:58.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.1 2024-09-05T01:14:58.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.2 2024-09-05T01:14:58.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.3 2024-09-05T01:14:58.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.4 2024-09-05T01:14:58.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.798+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.5 2024-09-05T01:14:58.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.6 2024-09-05T01:14:58.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.7 2024-09-05T01:14:58.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.8 2024-09-05T01:14:58.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.9 2024-09-05T01:14:58.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33.10 2024-09-05T01:14:58.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 : hit (requested=0x17, cached=0x17) 2024-09-05T01:14:58.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.802+0000 7f03b75469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f03b75469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f03b75469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f03b75469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f03b75469c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33, ofs0, ns] 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f0298ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94144526485760 notifier 7476 bl.length()=879 2024-09-05T01:14:58.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f0298ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 info.flags=0x17 2024-09-05T01:14:58.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f0298ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 to cache LRU end 2024-09-05T01:14:58.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.806+0000 7f0298ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:14:58.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.810+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_sources= new_sources= 2024-09-05T01:14:58.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.810+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential sources added=[] removed=[] 2024-09-05T01:14:58.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.810+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): orig_dests= new_dests= 2024-09-05T01:14:58.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.810+0000 7f03b75469c0 20 handle_bi_update(): bucket=:error-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33]): potential dests added=[] removed=[] 2024-09-05T01:14:58.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.814+0000 7f03b75469c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-05T01:14:58.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.818+0000 7f026b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.822+0000 7f03b75469c0 20 remove_watcher() i=0 2024-09-05T01:14:58.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.822+0000 7f03b75469c0 2 removed watcher, disabling cache 2024-09-05T01:14:58.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.826+0000 7f03b75469c0 20 remove_watcher() i=1 2024-09-05T01:14:58.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.826+0000 7f03b75469c0 20 remove_watcher() i=2 2024-09-05T01:14:58.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.830+0000 7f03b75469c0 20 remove_watcher() i=3 2024-09-05T01:14:58.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.830+0000 7f03b75469c0 20 remove_watcher() i=4 2024-09-05T01:14:58.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.834+0000 7f03b75469c0 20 remove_watcher() i=5 2024-09-05T01:14:58.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.834+0000 7f03b75469c0 20 remove_watcher() i=6 2024-09-05T01:14:58.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.834+0000 7f03b75469c0 20 remove_watcher() i=7 2024-09-05T01:14:58.849 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-05T01:14:58.876 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:14:58.876 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:14:58.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.918+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 realm 2024-09-05T01:14:58.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:14:58.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.922+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.926+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.926+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.926+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:14:58.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.926+0000 7f4eb0b349c0 20 searching for the correct realm 2024-09-05T01:14:58.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.930+0000 7f4eae63a640 0 -- 172.21.15.99:0/2716644663 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f4ea80777d0 msgr2=0x7f4ea8007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:14:58.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.938+0000 7f4eae63a640 0 -- 172.21.15.99:0/2716644663 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f4d78080900 msgr2=0x7f4d78082d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:14:58.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:14:58.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:14:58.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 zone default found 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 4 Realm: () 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 zonegroup default 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.946+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.950+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.950+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.950+0000 7f4eb0b349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:14:58.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.950+0000 7f4eb0b349c0 20 started sync module instance, tier type = 2024-09-05T01:14:58.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.950+0000 7f4eb0b349c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:14:58.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=0 2024-09-05T01:14:58.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=1 2024-09-05T01:14:58.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=2 2024-09-05T01:14:58.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=3 2024-09-05T01:14:58.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=4 2024-09-05T01:14:58.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=5 2024-09-05T01:14:58.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=6 2024-09-05T01:14:58.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 20 add_watcher() i=7 2024-09-05T01:14:58.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.966+0000 7f4eb0b349c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:14:58.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 5 note: GC not initialized 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4cdf7fe640 20 reqs_thread_entry: start 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 init_complete bucket index max shards: 11 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 Filter name: none 2024-09-05T01:14:58.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4cdd7fa640 20 reqs_thread_entry: start 2024-09-05T01:14:58.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados->read ofs=0 len=0 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:14:58.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.970+0000 7f4eb0b349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:14:58.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.974+0000 7f4d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:14:58.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.978+0000 7f4eb0b349c0 20 remove_watcher() i=0 2024-09-05T01:14:58.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.978+0000 7f4eb0b349c0 2 removed watcher, disabling cache 2024-09-05T01:14:58.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.982+0000 7f4eb0b349c0 20 remove_watcher() i=1 2024-09-05T01:14:58.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.982+0000 7f4eb0b349c0 20 remove_watcher() i=2 2024-09-05T01:14:58.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.986+0000 7f4eb0b349c0 20 remove_watcher() i=3 2024-09-05T01:14:58.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.986+0000 7f4eb0b349c0 20 remove_watcher() i=4 2024-09-05T01:14:58.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.990+0000 7f4eb0b349c0 20 remove_watcher() i=5 2024-09-05T01:14:58.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.990+0000 7f4eb0b349c0 20 remove_watcher() i=6 2024-09-05T01:14:58.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:14:58.990+0000 7f4eb0b349c0 20 remove_watcher() i=7 2024-09-05T01:14:59.003 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:59.003 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:14:59.003 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:14:59.003 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:14:59.957 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-05T01:14:59.957 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.145 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-05T01:15:02.178 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:02.178 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:02.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.222+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 realm 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.226+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.234+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.234+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.234+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:02.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.234+0000 7eff19fab9c0 20 searching for the correct realm 2024-09-05T01:15:02.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.234+0000 7eff172b0640 0 -- 172.21.15.99:0/192732354 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7eff000023a0 msgr2=0x7eff08008980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.450+0000 7eff17ab1640 0 -- 172.21.15.99:0/192732354 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7eff00003cc0 msgr2=0x7eff10060890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:02.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:02.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:02.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.466+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 zone default found 2024-09-05T01:15:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 4 Realm: () 2024-09-05T01:15:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:02.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:02.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:02.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 zonegroup default 2024-09-05T01:15:02.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 started sync module instance, tier type = 2024-09-05T01:15:02.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.470+0000 7eff19fab9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=0 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=1 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=2 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=3 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=4 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=5 2024-09-05T01:15:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.498+0000 7eff19fab9c0 20 add_watcher() i=6 2024-09-05T01:15:02.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.502+0000 7eff19fab9c0 20 add_watcher() i=7 2024-09-05T01:15:02.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.502+0000 7eff19fab9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:02.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7efdcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:02.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:02.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 5 note: GC not initialized 2024-09-05T01:15:02.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7efdccfe1640 20 reqs_thread_entry: start 2024-09-05T01:15:02.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:02.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 Filter name: none 2024-09-05T01:15:02.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7efd467fc640 20 reqs_thread_entry: start 2024-09-05T01:15:02.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.506+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:02.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:02.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:02.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.510+0000 7eff19fab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:02.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.514+0000 7efdcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.518+0000 7eff19fab9c0 20 remove_watcher() i=0 2024-09-05T01:15:02.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.518+0000 7eff19fab9c0 2 removed watcher, disabling cache 2024-09-05T01:15:02.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.522+0000 7eff19fab9c0 20 remove_watcher() i=1 2024-09-05T01:15:02.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.522+0000 7eff19fab9c0 20 remove_watcher() i=2 2024-09-05T01:15:02.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.526+0000 7eff19fab9c0 20 remove_watcher() i=3 2024-09-05T01:15:02.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.526+0000 7eff19fab9c0 20 remove_watcher() i=4 2024-09-05T01:15:02.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.530+0000 7eff19fab9c0 20 remove_watcher() i=5 2024-09-05T01:15:02.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.530+0000 7eff19fab9c0 20 remove_watcher() i=6 2024-09-05T01:15:02.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.530+0000 7eff19fab9c0 20 remove_watcher() i=7 2024-09-05T01:15:02.545 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.545 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:02.545 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:02.545 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.546 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-05T01:15:02.581 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:02.581 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:02.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.626+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 realm 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:02.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 searching for the correct realm 2024-09-05T01:15:02.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.638+0000 7fb5e0851640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55aa34063210 msgr2=0x55aa340656d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:15:02.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.646+0000 7fb5e0050640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb5d80ce040 msgr2=0x7fb5d80bf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zone default found 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Realm: () 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zonegroup default 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started sync module instance, tier type = 2024-09-05T01:15:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=0 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=1 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=2 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=3 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=4 2024-09-05T01:15:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=5 2024-09-05T01:15:02.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=6 2024-09-05T01:15:02.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=7 2024-09-05T01:15:02.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.674+0000 7fb5e254a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:02.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb496fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 note: GC not initialized 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb495fdb640 20 reqs_thread_entry: start 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 Filter name: none 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb4077fe640 20 reqs_thread_entry: start 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-05T01:15:02.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : miss 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94189505630672 notifier 7530 bl.length()=911 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:02.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:02.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:02.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:02.703 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5e254a9c0 time 2024-09-05T01:15:02.708969+0000 2024-09-05T01:15:02.703 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:02.704 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.704 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb5e5e242eb] 2024-09-05T01:15:02.704 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.704 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.705 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.705 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:15:02.705 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.705 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fb5e254a9c0 thread_name:radosgw-admin 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5e254a9c0 time 2024-09-05T01:15:02.708969+0000 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb5e5e242eb] 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.706 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.707 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:15:02.707 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.707 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:15:02.707 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:15:02.707 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb5e4ca3520] 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb5e5e24345] 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.721 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fb5e254a9c0 thread_name:radosgw-admin 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb5e4ca3520] 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:02.722 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb5e5e24345] 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:02.723 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: dump: 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7518 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 4 set_mon_vals no callback set 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.725 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: dump: 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.726 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: shutdown 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) unregister_commands rotate-key 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.727 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.728 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.729 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: starting msgr at 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: starting objecter 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests hook 0x55aa33ce3060 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: setting wanted keys 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: calling monclient init 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.730 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.731 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key hook 0x55aa33f6d5a8 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa33e2afa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa33eb6590 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa33eb69a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.732 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.069379s 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa33e2afa0 auth_method 0 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa33eb6590 auth_method 0 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.733 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:15:02.606+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.734 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: dump: 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7521 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.736 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: dump: 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.737 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:15:02.606+0000 7fb4ce60c640 4 set_mon_vals no callback set 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: init done 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:15:02.610+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa33fa1c40 auth_method 0 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:15:02.610+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb4c8070ae0 auth_method 0 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:15:02.610+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa33fb7ed0 auth_method 0 2024-09-05T01:15:02.738 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:15:02.614+0000 7fb5df84f640 10 monclient: get_auth_request con 0x55aa33fbc0c0 auth_method 0 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.739 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.740 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.741 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa33fc4940 EEXIST 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.742 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.743 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x55aa33fbf760 EEXIST 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa33fe8af0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa33fe8420 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa33fe6e00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.744 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.081204s 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa33fe8af0 auth_method 0 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa33fe6e00 auth_method 0 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.745 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa33fe8420 auth_method 0 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-05T01:15:02.746 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:15:02.618+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: dump: 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.747 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: dump: 2024-09-05T01:15:02.748 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.749 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7524 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:15:02.618+0000 7fb5e1052640 4 set_mon_vals no callback set 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.750 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.751 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.752 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb4b8070a20 auth_method 0 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.753 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.754 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc318e3478 EEXIST 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa3403c980 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa34037dc0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa3402e490 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.755 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.085232s 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa3403c980 auth_method 0 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa34037dc0 auth_method 0 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.756 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa3402e490 auth_method 0 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7527 payload 274 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.757 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:15:02.622+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: dump: 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.758 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7527 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 4 set_mon_vals no callback set 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.759 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: dump: 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.760 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: shutdown 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.762 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.763 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: starting msgr at 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: starting objecter 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa3400b920 EEXIST 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: setting wanted keys 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: calling monclient init 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.764 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.765 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x55aa33feaa58 EEXIST 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.766 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:15:02.767 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa3402e490 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.767 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa34037dc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.767 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa3403c980 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.767 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.087827s 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa34037dc0 auth_method 0 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.768 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa3403c980 auth_method 0 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.769 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:15:02.626+0000 7fb5df84f640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:15:02.626+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa3402e490 auth_method 0 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: dump: 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.770 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.771 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: dump: 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:15:02.626+0000 7fb4b77fe640 4 set_mon_vals no callback set 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7530 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 1 librados: init done 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cr dump hook 0x55aa3402b788 2024-09-05T01:15:02.773 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa34056a30 auth_method 0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:15:02.626+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb4a8070b10 auth_method 0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 realm 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.774 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:15:02.630+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa3405ad30 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:15:02.630+0000 7fb5df84f640 10 monclient: get_auth_request con 0x55aa3405e450 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 searching for the correct realm 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:15:02.630+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa34063210 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:15:02.634+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb5d80ce040 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:15:02.634+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb5d000e040 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:15:02.634+0000 7fb5e0851640 10 monclient: get_auth_request con 0x7fb5d401c040 auth_method 0 2024-09-05T01:15:02.775 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:15:02.638+0000 7fb5e0851640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55aa34063210 msgr2=0x55aa340656d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x55aa34063210 session 0x55aa34062b90 osd.3 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 10 monclient: _renew_subs 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:15:02.638+0000 7fb5e0851640 10 monclient: get_auth_request con 0x7fb4a8080930 auth_method 0 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:15:02.642+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb5d80bf040 auth_method 0 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:15:02.646+0000 7fb5e0050640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb5d80ce040 msgr2=0x7fb5d80bf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:15:02.646+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x7fb5d80ce040 session 0x7fb5d80c5040 osd.7 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:15:02.650+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa34063210 auth_method 0 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:02.776 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.777 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zone default found 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Realm: () 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zonegroup default 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.778 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started sync module instance, tier type = 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=0 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=1 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=2 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=3 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=4 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=5 2024-09-05T01:15:02.779 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=6 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=7 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.780 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.781 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.781 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:15:02.678+0000 7fb496fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.781 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.784 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache list hook 0x55aa340320d0 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache inspect hook 0x55aa340320d0 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache erase hook 0x55aa340320d0 2024-09-05T01:15:02.785 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache zap hook 0x55aa340320d0 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 note: GC not initialized 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:15:02.678+0000 7fb495fdb640 20 reqs_thread_entry: start 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace show hook 0x7fb5d008c020 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace history hook 0x7fb5d008c020 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace active hook 0x7fb5d008c020 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace active_short hook 0x7fb5d008c020 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 Filter name: none 2024-09-05T01:15:02.786 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:15:02.678+0000 7fb4077fe640 20 reqs_thread_entry: start 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : miss 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.787 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94189505630672 notifier 7530 bl.length()=911 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.788 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:15:02.698+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x55aa3405e450 session 0x55aa3405a5d0 osd.0 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:15:02.698+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb5d80ce040 auth_method 0 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5e254a9c0 time 2024-09-05T01:15:02.708969+0000 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:02.789 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb5e5e242eb] 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.790 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fb5e254a9c0 thread_name:radosgw-admin 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb5e4ca3520] 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb5e5e24345] 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.791 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:15:02.792 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:15:02.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:15:02.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:15:02.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:15:02.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:15:02.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:15:02.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:15:02.799 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:15:02.800 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4077fe640 / http_manager 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb495fdb640 / http_manager 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb496fdd640 / rgw_dt_lg_renew 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4b5ffb640 / ms_dispatch 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4b77fe640 / io_context_pool 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4c5ffb640 / ms_dispatch 2024-09-05T01:15:02.801 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4cce09640 / ms_dispatch 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4ce60c640 / io_context_pool 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5df84f640 / msgr-worker-2 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e0050640 / msgr-worker-1 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e0851640 / msgr-worker-0 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e1052640 / io_context_pool 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e254a9c0 / radosgw-admin 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.119370.log 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:15:02.802 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: dump: 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.803 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7518 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:15:02.602+0000 7fb5e254a9c0 4 set_mon_vals no callback set 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.804 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:15:02.602+0000 7fb4ce60c640 10 monclient: dump: 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.805 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: shutdown 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) unregister_commands rotate-key 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.806 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding auth protocol: cephx 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.807 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: crc 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f9a280) adding con mode: secure 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.808 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: starting msgr at 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: starting objecter 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests hook 0x55aa33ce3060 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: setting wanted keys 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: calling monclient init 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding auth protocol: cephx 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.809 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: crc 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33f6d460) adding con mode: secure 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.810 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key hook 0x55aa33f6d5a8 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa33e2afa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa33eb6590 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa33eb69a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.069379s 2024-09-05T01:15:02.811 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa33e2afa0 auth_method 0 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa33eb6590 auth_method 0 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.812 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:15:02.606+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7521 payload 824 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:15:02.606+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:15:02.606+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: dump: 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.813 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7521 2024-09-05T01:15:02.814 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:15:02.606+0000 7fb4cce09640 10 monclient: dump: 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.815 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:15:02.606+0000 7fb4ce60c640 4 set_mon_vals no callback set 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:15:02.606+0000 7fb5e254a9c0 1 librados: init done 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:15:02.610+0000 7fb4cce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.816 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:15:02.610+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa33fa1c40 auth_method 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:15:02.610+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb4c8070ae0 auth_method 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:15:02.610+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa33fb7ed0 auth_method 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:15:02.614+0000 7fb5df84f640 10 monclient: get_auth_request con 0x55aa33fbc0c0 auth_method 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.817 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding auth protocol: cephx 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.818 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: crc 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fc0ef0) adding con mode: secure 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa33fc4940 EEXIST 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.819 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding auth protocol: cephx 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.820 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: crc 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fbf618) adding con mode: secure 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x55aa33fbf760 EEXIST 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa33fe8af0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa33fe8420 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.821 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa33fe6e00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.081204s 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa33fe8af0 auth_method 0 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa33fe6e00 auth_method 0 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.822 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:15:02.618+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa33fe8420 auth_method 0 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:15:02.618+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7524 payload 824 2024-09-05T01:15:02.823 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:15:02.618+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:15:02.618+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: dump: 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.824 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 10 monclient: dump: 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.825 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7524 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:15:02.618+0000 7fb5e1052640 4 set_mon_vals no callback set 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.826 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:15:02.618+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:15:02.618+0000 7fb4c5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.827 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.828 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding auth protocol: cephx 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.829 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: crc 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa34008420) adding con mode: secure 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb4b8070a20 auth_method 0 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding auth protocol: cephx 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.830 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: crc 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3330) adding con mode: secure 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc318e3478 EEXIST 2024-09-05T01:15:02.831 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa3403c980 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa34037dc0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa3402e490 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.085232s 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): get_auth_request con 0x55aa3403c980 auth_method 0 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.832 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa34037dc0 auth_method 0 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.833 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa3402e490 auth_method 0 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:15:02.622+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient(hunting): handle_auth_done global_id 7527 payload 274 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:15:02.622+0000 7fb5e0050640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:15:02.622+0000 7fb5e0050640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.834 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: dump: 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.835 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7527 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 4 set_mon_vals no callback set 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:15:02.622+0000 7fb4b77fe640 10 monclient: dump: 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.836 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: shutdown 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: build_initial_monmap 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:02.837 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: monmap: 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.838 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding auth protocol: cephx 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.839 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: crc 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa3402ef50) adding con mode: secure 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: starting msgr at 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: starting objecter 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command objecter_requests cmddesc objecter_requests hook 0x55aa3400b920 EEXIST 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: setting wanted keys 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 1 librados: calling monclient init 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: init 2024-09-05T01:15:02.840 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding auth protocol: cephx 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.841 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: crc 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 AuthRegistry(0x55aa33fea910) adding con mode: secure 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command rotate-key cmddesc rotate-key hook 0x55aa33feaa58 EEXIST 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-b con 0x55aa3402e490 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-a con 0x55aa34037dc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): picked mon.noname-c con 0x55aa3403c980 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.842 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:15:02.622+0000 7fb5e254a9c0 10 monclient(hunting): authenticate will time out at 2554.087827s 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request con 0x55aa34037dc0 auth_method 0 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:15:02.622+0000 7fb5df84f640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): get_auth_request con 0x55aa3403c980 auth_method 0 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:02.843 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient: _finish_hunting 0 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:15:02.626+0000 7fb5df84f640 1 monclient: found mon.noname-a 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:15:02.626+0000 7fb5df84f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.844 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:15:02.626+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa3402e490 auth_method 0 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: dump: 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.845 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: _finish_auth 0 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: _check_auth_tickets 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 10 monclient: dump: 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:02.846 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:15:02.626+0000 7fb4b77fe640 4 set_mon_vals no callback set 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 5 monclient: authenticate success, global_id 7530 2024-09-05T01:15:02.847 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _renew_subs 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 1 librados: init done 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cr dump hook 0x55aa3402b788 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:15:02.626+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:15:02.626+0000 7fb4b5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:02.848 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:15:02.626+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa34056a30 auth_method 0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:15:02.626+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb4a8070b10 auth_method 0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 realm 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.849 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:15:02.630+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa3405ad30 auth_method 0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:15:02.630+0000 7fb5df84f640 10 monclient: get_auth_request con 0x55aa3405e450 auth_method 0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:15:02.630+0000 7fb5e254a9c0 20 searching for the correct realm 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:15:02.630+0000 7fb5e0851640 10 monclient: get_auth_request con 0x55aa34063210 auth_method 0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:15:02.634+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb5d80ce040 auth_method 0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:15:02.634+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb5d000e040 auth_method 0 2024-09-05T01:15:02.850 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:15:02.634+0000 7fb5e0851640 10 monclient: get_auth_request con 0x7fb5d401c040 auth_method 0 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:15:02.638+0000 7fb5e0851640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55aa34063210 msgr2=0x55aa340656d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x55aa34063210 session 0x55aa34062b90 osd.3 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 10 monclient: _renew_subs 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:15:02.638+0000 7fb4b5ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:15:02.638+0000 7fb5e0851640 10 monclient: get_auth_request con 0x7fb4a8080930 auth_method 0 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:15:02.642+0000 7fb5e0050640 10 monclient: get_auth_request con 0x7fb5d80bf040 auth_method 0 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:15:02.646+0000 7fb5e0050640 0 -- 172.21.15.99:0/2798036960 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb5d80ce040 msgr2=0x7fb5d80bf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:15:02.646+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x7fb5d80ce040 session 0x7fb5d80c5040 osd.7 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:15:02.650+0000 7fb5e0050640 10 monclient: get_auth_request con 0x55aa34063210 auth_method 0 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:02.851 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zone default found 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Realm: () 2024-09-05T01:15:02.852 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 zonegroup default 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:15:02.654+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.853 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started sync module instance, tier type = 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:15:02.658+0000 7fb5e254a9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=0 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=1 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=2 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=3 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=4 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=5 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=6 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 20 add_watcher() i=7 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:15:02.674+0000 7fb5e254a9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.854 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding auth protocol: cephx 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:15:02.678+0000 7fb496fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.855 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: crc 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 AuthRegistry(0x7ffc318e3810) adding con mode: secure 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache list hook 0x55aa340320d0 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache inspect hook 0x55aa340320d0 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache erase hook 0x55aa340320d0 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command cache zap hook 0x55aa340320d0 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 note: GC not initialized 2024-09-05T01:15:02.856 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:15:02.678+0000 7fb495fdb640 20 reqs_thread_entry: start 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace show hook 0x7fb5d008c020 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace history hook 0x7fb5d008c020 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace active hook 0x7fb5d008c020 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 5 asok(0x55aa33d602b0) register_command sync trace active_short hook 0x7fb5d008c020 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 Filter name: none 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:15:02.678+0000 7fb4077fe640 20 reqs_thread_entry: start 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.857 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : miss 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:15:02.678+0000 7fb5e254a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.858 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:15:02.690+0000 7fb5e254a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94189505630672 notifier 7530 bl.length()=911 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:15:02.690+0000 7fb4b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:15:02.694+0000 7fb5e254a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:15:02.698+0000 7fb4b5ffb640 1 client.7530.objecter ms_handle_reset 0x55aa3405e450 session 0x55aa3405a5d0 osd.0 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:15:02.698+0000 7fb5df84f640 10 monclient: get_auth_request con 0x7fb5d80ce040 auth_method 0 2024-09-05T01:15:02.859 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb5e254a9c0 time 2024-09-05T01:15:02.708969+0000 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fb5e5e242eb] 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:15:02.860 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:15:02.706+0000 7fb5e254a9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fb5e254a9c0 thread_name:radosgw-admin 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fb5e4ca3520] 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fb5e5e24345] 2024-09-05T01:15:02.861 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fb5e5e2449f] 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aa3215f681] 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55aa32174b6a] 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fb5e4c8ad90] 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:15:02.862 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:15:02.863 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:15:02.864 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:15:02.865 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:15:02.866 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:15:02.867 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:15:02.868 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:15:02.869 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4077fe640 / http_manager 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb495fdb640 / http_manager 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb496fdd640 / rgw_dt_lg_renew 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4b5ffb640 / ms_dispatch 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4b77fe640 / io_context_pool 2024-09-05T01:15:02.870 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4c5ffb640 / ms_dispatch 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4cce09640 / ms_dispatch 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb4ce60c640 / io_context_pool 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5df84f640 / msgr-worker-2 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e0050640 / msgr-worker-1 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e0851640 / msgr-worker-0 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e1052640 / io_context_pool 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: 7fb5e254a9c0 / radosgw-admin 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:15:02.710987Z_e5e6c625-e694-460c-9670-583dfb98f4e9/log 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:15:02.871 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.782+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 realm 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.786+0000 7ffa40edd9c0 20 searching for the correct realm 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.794+0000 7ffa3e9e3640 0 -- 172.21.15.99:0/497155277 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7ffa3805d380 msgr2=0x7ffa3808aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.802+0000 7ffa3e9e3640 0 -- 172.21.15.99:0/497155277 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7ff908080930 msgr2=0x7ff908082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.806+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 zone default found 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 4 Realm: () 2024-09-05T01:15:02.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 zonegroup default 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 started sync module instance, tier type = 2024-09-05T01:15:02.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.810+0000 7ffa40edd9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=0 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=1 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=2 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=3 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=4 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=5 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=6 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 20 add_watcher() i=7 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.834+0000 7ffa40edd9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ff8f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 5 note: GC not initialized 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ff86ffff640 20 reqs_thread_entry: start 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 Filter name: none 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ff86dffb640 20 reqs_thread_entry: start 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-05T01:15:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.838+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.842+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.842+0000 7ffa40edd9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.842+0000 7ffa40edd9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.842+0000 7ffa40edd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.846+0000 7ff8f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.854+0000 7ffa40edd9c0 20 remove_watcher() i=0 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.854+0000 7ffa40edd9c0 2 removed watcher, disabling cache 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.854+0000 7ffa40edd9c0 20 remove_watcher() i=1 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.858+0000 7ffa40edd9c0 20 remove_watcher() i=2 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.858+0000 7ffa40edd9c0 20 remove_watcher() i=3 2024-09-05T01:15:02.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.862+0000 7ffa40edd9c0 20 remove_watcher() i=4 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.862+0000 7ffa40edd9c0 20 remove_watcher() i=5 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.866+0000 7ffa40edd9c0 20 remove_watcher() i=6 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:02.866+0000 7ffa40edd9c0 20 remove_watcher() i=7 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:02.884 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:02.977 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:15:03.013 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:03.013 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:03.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 realm 2024-09-05T01:15:03.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:03.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.058+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.062+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:03.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.062+0000 7f8a54c0e9c0 20 searching for the correct realm 2024-09-05T01:15:03.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.066+0000 7f8a52f15640 0 -- 172.21.15.99:0/3118130581 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8a48037040 msgr2=0x7f8a48015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:03.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.282+0000 7f8a52f15640 0 -- 172.21.15.99:0/3118130581 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8a48037040 msgr2=0x7f8a48015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:03.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.294+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:03.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:03.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 zone default found 2024-09-05T01:15:03.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 4 Realm: () 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 zonegroup default 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:03.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 started sync module instance, tier type = 2024-09-05T01:15:03.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.298+0000 7f8a54c0e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=0 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=1 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=2 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=3 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=4 2024-09-05T01:15:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=5 2024-09-05T01:15:03.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=6 2024-09-05T01:15:03.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 20 add_watcher() i=7 2024-09-05T01:15:03.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.322+0000 7f8a54c0e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.326+0000 7f8908fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.326+0000 7f8a54c0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.326+0000 7f8a54c0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 5 note: GC not initialized 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f88837fe640 20 reqs_thread_entry: start 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 Filter name: none 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f88817fa640 20 reqs_thread_entry: start 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-05T01:15:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:03.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-05T01:15:03.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-05T01:15:03.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : miss 2024-09-05T01:15:03.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:03.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-05T01:15:03.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:03.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:03.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:03.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:03.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.330+0000 7f8a54c0e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:03.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.334+0000 7f8a54c0e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to be held by another RGW process; skipping for now 2024-09-05T01:15:03.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.334+0000 7f8908fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:03.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.338+0000 7f8a54c0e9c0 20 remove_watcher() i=0 2024-09-05T01:15:03.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.338+0000 7f8a54c0e9c0 2 removed watcher, disabling cache 2024-09-05T01:15:03.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.342+0000 7f8a54c0e9c0 20 remove_watcher() i=1 2024-09-05T01:15:03.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.346+0000 7f8a54c0e9c0 20 remove_watcher() i=2 2024-09-05T01:15:03.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.346+0000 7f8a54c0e9c0 20 remove_watcher() i=3 2024-09-05T01:15:03.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.350+0000 7f8a54c0e9c0 20 remove_watcher() i=4 2024-09-05T01:15:03.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.350+0000 7f8a54c0e9c0 20 remove_watcher() i=5 2024-09-05T01:15:03.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.354+0000 7f8a54c0e9c0 20 remove_watcher() i=6 2024-09-05T01:15:03.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:03.354+0000 7f8a54c0e9c0 20 remove_watcher() i=7 2024-09-05T01:15:03.368 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:15:33.400 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:15:33.436 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:33.437 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 realm 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.485+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.489+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:33.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.489+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.489+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:33.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.489+0000 7f5f0e5d49c0 20 searching for the correct realm 2024-09-05T01:15:33.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.493+0000 7f5f0b8d9640 0 -- 172.21.15.99:0/2696660635 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f5efc0ee060 msgr2=0x7f5efc0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:33.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.709+0000 7f5f0c0da640 0 -- 172.21.15.99:0/2696660635 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f5ef4003be0 msgr2=0x7f5f040606f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:33.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:33.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:33.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.725+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 zone default found 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 4 Realm: () 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 zonegroup default 2024-09-05T01:15:33.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 started sync module instance, tier type = 2024-09-05T01:15:33.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.729+0000 7f5f0e5d49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=0 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=1 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=2 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=3 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=4 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=5 2024-09-05T01:15:33.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.753+0000 7f5f0e5d49c0 20 add_watcher() i=6 2024-09-05T01:15:33.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.757+0000 7f5f0e5d49c0 20 add_watcher() i=7 2024-09-05T01:15:33.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.757+0000 7f5f0e5d49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:33.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5dc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5f0e5d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5f0e5d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5f0e5d49c0 5 note: GC not initialized 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5dc1fdb640 20 reqs_thread_entry: start 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5f0e5d49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:33.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5f0e5d49c0 20 Filter name: none 2024-09-05T01:15:33.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.761+0000 7f5d337fe640 20 reqs_thread_entry: start 2024-09-05T01:15:33.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-05T01:15:33.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:33.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-05T01:15:33.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-05T01:15:33.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : miss 2024-09-05T01:15:33.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.765+0000 7f5f0e5d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:33.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.769+0000 7f5f0e5d49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:15:33.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5f0e5d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5f0e5d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5f0e5d49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5f0e5d49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:33.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5de37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94610175679056 notifier 7190 bl.length()=911 2024-09-05T01:15:33.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5de37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5de37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.785+0000 7f5de37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.789+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:33.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.789+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:33.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.789+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:33.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.789+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.0 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.0 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.1 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.1 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.2 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.2 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.3 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.3 2024-09-05T01:15:33.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.4 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.4 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.5 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.5 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.6 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.6 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.7 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.7 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.8 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.8 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.9 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.9 2024-09-05T01:15:33.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.10 2024-09-05T01:15:33.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.10 2024-09-05T01:15:33.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.11 2024-09-05T01:15:33.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2.11 2024-09-05T01:15:33.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.0 2024-09-05T01:15:33.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.801+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.1 2024-09-05T01:15:33.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.805+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2 2024-09-05T01:15:33.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.805+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.3 2024-09-05T01:15:33.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.805+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.4 2024-09-05T01:15:33.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.805+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.5 2024-09-05T01:15:33.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.805+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.6 2024-09-05T01:15:33.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.809+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.7 2024-09-05T01:15:33.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.809+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.8 2024-09-05T01:15:33.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.809+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.9 2024-09-05T01:15:33.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.809+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.10 2024-09-05T01:15:33.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.817+0000 7f5f0e5d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : hit (requested=0x17, cached=0x17) 2024-09-05T01:15:33.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.817+0000 7f5f0e5d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:33.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5f0e5d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5f0e5d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5f0e5d49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5f0e5d49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:33.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5de2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94610175679056 notifier 7190 bl.length()=911 2024-09-05T01:15:33.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5de2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5de2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.821+0000 7f5de2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.825+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:33.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.825+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:33.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.825+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:33.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.825+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:33.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.829+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.0 2024-09-05T01:15:33.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.829+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.1 2024-09-05T01:15:33.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.829+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.2 2024-09-05T01:15:33.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.3 2024-09-05T01:15:33.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.4 2024-09-05T01:15:33.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.5 2024-09-05T01:15:33.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.6 2024-09-05T01:15:33.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.7 2024-09-05T01:15:33.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.833+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.8 2024-09-05T01:15:33.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.837+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.9 2024-09-05T01:15:33.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.837+0000 7f5f0e5d49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34.10 2024-09-05T01:15:33.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.837+0000 7f5f0e5d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 : hit (requested=0x17, cached=0x17) 2024-09-05T01:15:33.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.837+0000 7f5f0e5d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 2024-09-05T01:15:33.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5f0e5d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5f0e5d49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5f0e5d49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5f0e5d49c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34, ofs0, ns] 2024-09-05T01:15:33.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5de37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94610175679056 notifier 7190 bl.length()=879 2024-09-05T01:15:33.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5de37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 info.flags=0x17 2024-09-05T01:15:33.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5de37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 to cache LRU end 2024-09-05T01:15:33.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.841+0000 7f5de37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:33.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.845+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_sources= new_sources= 2024-09-05T01:15:33.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.845+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential sources added=[] removed=[] 2024-09-05T01:15:33.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.845+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): orig_dests= new_dests= 2024-09-05T01:15:33.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.845+0000 7f5f0e5d49c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34]): potential dests added=[] removed=[] 2024-09-05T01:15:33.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.849+0000 7f5f0e5d49c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-05T01:15:33.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.853+0000 7f5dc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:33.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.857+0000 7f5f0e5d49c0 20 remove_watcher() i=0 2024-09-05T01:15:33.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.857+0000 7f5f0e5d49c0 2 removed watcher, disabling cache 2024-09-05T01:15:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.861+0000 7f5f0e5d49c0 20 remove_watcher() i=1 2024-09-05T01:15:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.861+0000 7f5f0e5d49c0 20 remove_watcher() i=2 2024-09-05T01:15:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.865+0000 7f5f0e5d49c0 20 remove_watcher() i=3 2024-09-05T01:15:33.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.865+0000 7f5f0e5d49c0 20 remove_watcher() i=4 2024-09-05T01:15:33.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.869+0000 7f5f0e5d49c0 20 remove_watcher() i=5 2024-09-05T01:15:33.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.869+0000 7f5f0e5d49c0 20 remove_watcher() i=6 2024-09-05T01:15:33.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.873+0000 7f5f0e5d49c0 20 remove_watcher() i=7 2024-09-05T01:15:33.889 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-05T01:15:33.918 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:33.919 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:33.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.961+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 realm 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:33.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:33.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.965+0000 7f27893759c0 20 searching for the correct realm 2024-09-05T01:15:33.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.973+0000 7f2786e7b640 0 -- 172.21.15.99:0/3358806886 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f27800b9ac0 msgr2=0x7f27800c6400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:15:33.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.981+0000 7f2786e7b640 0 -- 172.21.15.99:0/3358806886 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f27800d23f0 msgr2=0x7f27800d2830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:33.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:33.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 zone default found 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 4 Realm: () 2024-09-05T01:15:33.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 zonegroup default 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:33.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:33.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 started sync module instance, tier type = 2024-09-05T01:15:33.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:33.989+0000 7f27893759c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=0 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=1 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=2 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=3 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=4 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=5 2024-09-05T01:15:34.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=6 2024-09-05T01:15:34.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 20 add_watcher() i=7 2024-09-05T01:15:34.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.005+0000 7f27893759c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:34.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f263d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:34.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:34.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 5 note: GC not initialized 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f25b7fff640 20 reqs_thread_entry: start 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 20 Filter name: none 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f25b5ffb640 20 reqs_thread_entry: start 2024-09-05T01:15:34.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.009+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:34.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:34.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:34.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:34.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:34.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:34.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-05T01:15:34.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.013+0000 7f27893759c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:34.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.017+0000 7f27893759c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-05T01:15:34.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.017+0000 7f27893759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:34.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.021+0000 7f263d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:34.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.025+0000 7f27893759c0 20 remove_watcher() i=0 2024-09-05T01:15:34.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.025+0000 7f27893759c0 2 removed watcher, disabling cache 2024-09-05T01:15:34.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.025+0000 7f27893759c0 20 remove_watcher() i=1 2024-09-05T01:15:34.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.029+0000 7f27893759c0 20 remove_watcher() i=2 2024-09-05T01:15:34.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.033+0000 7f27893759c0 20 remove_watcher() i=3 2024-09-05T01:15:34.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.033+0000 7f27893759c0 20 remove_watcher() i=4 2024-09-05T01:15:34.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.037+0000 7f27893759c0 20 remove_watcher() i=5 2024-09-05T01:15:34.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.037+0000 7f27893759c0 20 remove_watcher() i=6 2024-09-05T01:15:34.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:34.037+0000 7f27893759c0 20 remove_watcher() i=7 2024-09-05T01:15:34.051 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:34.051 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:34.051 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:15:34.051 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:34.931 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-05T01:15:34.931 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:37.100 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-05T01:15:37.133 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:37.133 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:37.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.177+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 realm 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:37.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.181+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.185+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:37.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.185+0000 7f66bac839c0 20 searching for the correct realm 2024-09-05T01:15:37.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.185+0000 7f66b7f88640 0 -- 172.21.15.99:0/1494702245 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f66b0018040 msgr2=0x7f66b0063430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:37.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.397+0000 7f66b8789640 0 -- 172.21.15.99:0/1494702245 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f66a80ae040 msgr2=0x7f66a80f9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:37.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 zone default found 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 4 Realm: () 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 zonegroup default 2024-09-05T01:15:37.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.413+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 started sync module instance, tier type = 2024-09-05T01:15:37.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.417+0000 7f66bac839c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=0 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=1 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=2 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=3 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=4 2024-09-05T01:15:37.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=5 2024-09-05T01:15:37.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=6 2024-09-05T01:15:37.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 20 add_watcher() i=7 2024-09-05T01:15:37.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.441+0000 7f66bac839c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:37.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.445+0000 7f656efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:37.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.445+0000 7f66bac839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:37.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.445+0000 7f66bac839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:37.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.445+0000 7f66bac839c0 5 note: GC not initialized 2024-09-05T01:15:37.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f656dfdb640 20 reqs_thread_entry: start 2024-09-05T01:15:37.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:37.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 Filter name: none 2024-09-05T01:15:37.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f64df7fe640 20 reqs_thread_entry: start 2024-09-05T01:15:37.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:37.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:37.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:37.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.449+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.453+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:37.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.453+0000 7f66bac839c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.453+0000 7f66bac839c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:37.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.453+0000 7f66bac839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:37.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.457+0000 7f656efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:37.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.461+0000 7f66bac839c0 20 remove_watcher() i=0 2024-09-05T01:15:37.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.461+0000 7f66bac839c0 2 removed watcher, disabling cache 2024-09-05T01:15:37.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.465+0000 7f66bac839c0 20 remove_watcher() i=1 2024-09-05T01:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.465+0000 7f66bac839c0 20 remove_watcher() i=2 2024-09-05T01:15:37.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.469+0000 7f66bac839c0 20 remove_watcher() i=3 2024-09-05T01:15:37.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.469+0000 7f66bac839c0 20 remove_watcher() i=4 2024-09-05T01:15:37.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.473+0000 7f66bac839c0 20 remove_watcher() i=5 2024-09-05T01:15:37.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.473+0000 7f66bac839c0 20 remove_watcher() i=6 2024-09-05T01:15:37.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.473+0000 7f66bac839c0 20 remove_watcher() i=7 2024-09-05T01:15:37.491 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:37.491 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:37.491 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:37.491 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:37.491 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-05T01:15:37.528 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:37.528 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:37.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.569+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 realm 2024-09-05T01:15:37.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:37.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.573+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.777+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:37.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.777+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.781+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:37.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.781+0000 7f9cc4fd79c0 20 searching for the correct realm 2024-09-05T01:15:37.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.789+0000 7f9cc32de640 0 -- 172.21.15.99:0/487954130 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x560c1848b000 msgr2=0x560c1848d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:37.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.801+0000 7f9cc22dc640 0 -- 172.21.15.99:0/487954130 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x560c18492b00 msgr2=0x560c18494ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.809+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:37.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 zone default found 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 4 Realm: () 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:37.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:37.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 zonegroup default 2024-09-05T01:15:37.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.813+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.817+0000 7f9cc4fd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:37.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.817+0000 7f9cc4fd79c0 20 started sync module instance, tier type = 2024-09-05T01:15:37.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.817+0000 7f9cc4fd79c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:37.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=0 2024-09-05T01:15:37.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=1 2024-09-05T01:15:37.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=2 2024-09-05T01:15:37.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=3 2024-09-05T01:15:37.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=4 2024-09-05T01:15:37.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=5 2024-09-05T01:15:37.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.837+0000 7f9cc4fd79c0 20 add_watcher() i=6 2024-09-05T01:15:37.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.841+0000 7f9cc4fd79c0 20 add_watcher() i=7 2024-09-05T01:15:37.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.841+0000 7f9cc4fd79c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:37.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.845+0000 7f9b797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:37.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.845+0000 7f9cc4fd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:37.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.845+0000 7f9cc4fd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:37.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.845+0000 7f9cc4fd79c0 5 note: GC not initialized 2024-09-05T01:15:37.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.845+0000 7f9af3fff640 20 reqs_thread_entry: start 2024-09-05T01:15:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 Filter name: none 2024-09-05T01:15:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9af1ffb640 20 reqs_thread_entry: start 2024-09-05T01:15:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-05T01:15:37.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:37.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:37.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-05T01:15:37.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 : miss 2024-09-05T01:15:37.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:37.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.849+0000 7f9cc4fd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 2024-09-05T01:15:37.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9cc4fd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:37.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9cc4fd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:37.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9cc4fd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:37.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9cc4fd79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35, ofs0, ns] 2024-09-05T01:15:37.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9ba67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94609947022272 notifier 7644 bl.length()=923 2024-09-05T01:15:37.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9ba67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:37.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9ba67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:37.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.861+0000 7f9ba67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:37.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.865+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_sources= new_sources= 2024-09-05T01:15:37.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.865+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential sources added=[] removed=[] 2024-09-05T01:15:37.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.865+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_dests= new_dests= 2024-09-05T01:15:37.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.865+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential dests added=[] removed=[] 2024-09-05T01:15:37.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.869+0000 7f9cc4fd79c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-05T01:15:37.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.869+0000 7f9cc4fd79c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-05T01:15:37.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.881+0000 7f9cc4fd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 : hit (requested=0x17, cached=0x17) 2024-09-05T01:15:37.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.881+0000 7f9cc4fd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 2024-09-05T01:15:37.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:37.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:37.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:37.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35, ofs0, ns] 2024-09-05T01:15:37.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9ba5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94609947022272 notifier 7644 bl.length()=891 2024-09-05T01:15:37.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9ba5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:37.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9ba5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:37.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9ba5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:37.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_sources= new_sources= 2024-09-05T01:15:37.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential sources added=[] removed=[] 2024-09-05T01:15:37.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_dests= new_dests= 2024-09-05T01:15:37.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.885+0000 7f9cc4fd79c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential dests added=[] removed=[] 2024-09-05T01:15:37.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.893+0000 7f9b797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:37.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.897+0000 7f9cc4fd79c0 20 remove_watcher() i=0 2024-09-05T01:15:37.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.897+0000 7f9cc4fd79c0 2 removed watcher, disabling cache 2024-09-05T01:15:37.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.897+0000 7f9cc4fd79c0 20 remove_watcher() i=1 2024-09-05T01:15:37.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.901+0000 7f9cc4fd79c0 20 remove_watcher() i=2 2024-09-05T01:15:37.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.901+0000 7f9cc4fd79c0 20 remove_watcher() i=3 2024-09-05T01:15:37.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.905+0000 7f9cc4fd79c0 20 remove_watcher() i=4 2024-09-05T01:15:37.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.905+0000 7f9cc4fd79c0 20 remove_watcher() i=5 2024-09-05T01:15:37.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.909+0000 7f9cc4fd79c0 20 remove_watcher() i=6 2024-09-05T01:15:37.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.909+0000 7f9cc4fd79c0 20 remove_watcher() i=7 2024-09-05T01:15:37.925 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-05T01:15:37.956 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:37.956 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:37.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:37.997+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 realm 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.001+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.005+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:38.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.005+0000 7fbeb07559c0 20 searching for the correct realm 2024-09-05T01:15:38.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.009+0000 7fbeae25b640 0 -- 172.21.15.99:0/2390978074 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fbea8026020 msgr2=0x7fbea8002600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.017+0000 7fbeae25b640 0 -- 172.21.15.99:0/2390978074 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fbea8063910 msgr2=0x7fbea805f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.021+0000 7fbeb07559c0 20 zone default found 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 4 Realm: () 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 zonegroup default 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 started sync module instance, tier type = 2024-09-05T01:15:38.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.025+0000 7fbeb07559c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=0 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=1 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=2 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=3 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=4 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=5 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=6 2024-09-05T01:15:38.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 20 add_watcher() i=7 2024-09-05T01:15:38.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbeb07559c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:38.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.041+0000 7fbd64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 5 note: GC not initialized 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbcdf7fe640 20 reqs_thread_entry: start 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 Filter name: none 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbcdd7fa640 20 reqs_thread_entry: start 2024-09-05T01:15:38.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:38.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:38.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:38.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:38.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:38.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.045+0000 7fbeb07559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:38.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.049+0000 7fbd64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.053+0000 7fbeb07559c0 20 remove_watcher() i=0 2024-09-05T01:15:38.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.053+0000 7fbeb07559c0 2 removed watcher, disabling cache 2024-09-05T01:15:38.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.057+0000 7fbeb07559c0 20 remove_watcher() i=1 2024-09-05T01:15:38.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.057+0000 7fbeb07559c0 20 remove_watcher() i=2 2024-09-05T01:15:38.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.061+0000 7fbeb07559c0 20 remove_watcher() i=3 2024-09-05T01:15:38.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.061+0000 7fbeb07559c0 20 remove_watcher() i=4 2024-09-05T01:15:38.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.065+0000 7fbeb07559c0 20 remove_watcher() i=5 2024-09-05T01:15:38.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.065+0000 7fbeb07559c0 20 remove_watcher() i=6 2024-09-05T01:15:38.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.065+0000 7fbeb07559c0 20 remove_watcher() i=7 2024-09-05T01:15:38.079 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:38.079 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:38.079 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:38.079 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:38.177 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:15:38.211 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:38.211 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:38.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.253+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 realm 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.257+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:38.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.261+0000 7f44cd9ac9c0 20 searching for the correct realm 2024-09-05T01:15:38.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.265+0000 7f44cb4b2640 0 -- 172.21.15.99:0/910057101 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f44c40fa5c0 msgr2=0x7f44c40f9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.273+0000 7f44cb4b2640 0 -- 172.21.15.99:0/910057101 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f44c4126270 msgr2=0x7f44c40c29d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:38.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:38.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.277+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 zone default found 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 4 Realm: () 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 zonegroup default 2024-09-05T01:15:38.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 started sync module instance, tier type = 2024-09-05T01:15:38.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.281+0000 7f44cd9ac9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:38.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=0 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=1 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=2 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=3 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=4 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=5 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.297+0000 7f44cd9ac9c0 20 add_watcher() i=6 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f44cd9ac9c0 20 add_watcher() i=7 2024-09-05T01:15:38.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f44cd9ac9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:38.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f4381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f44cd9ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f44cd9ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.301+0000 7f44cd9ac9c0 5 note: GC not initialized 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f4380fe1640 20 reqs_thread_entry: start 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 Filter name: none 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f42fa7fc640 20 reqs_thread_entry: start 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-05T01:15:38.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 : miss 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:38.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:38.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.305+0000 7f44cd9ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f44cd9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f44cd9ac9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f44cd9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f44cd9ac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35, ofs0, ns] 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f43ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464337 cookie 94658194542336 notifier 7683 bl.length()=923 2024-09-05T01:15:38.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f43ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f43ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.317+0000 7f43ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.321+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_sources= new_sources= 2024-09-05T01:15:38.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.321+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential sources added=[] removed=[] 2024-09-05T01:15:38.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.321+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_dests= new_dests= 2024-09-05T01:15:38.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.321+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential dests added=[] removed=[] 2024-09-05T01:15:38.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.0 2024-09-05T01:15:38.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.0 2024-09-05T01:15:38.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.1 2024-09-05T01:15:38.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.1 2024-09-05T01:15:38.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.2 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.2 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.3 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.3 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.4 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.4 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.5 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.5 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.6 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.6 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.7 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.7 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.8 2024-09-05T01:15:38.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.8 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.9 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.9 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.10 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.10 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.11 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1.11 2024-09-05T01:15:38.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.329+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.0 2024-09-05T01:15:38.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.333+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1 2024-09-05T01:15:38.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.333+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.2 2024-09-05T01:15:38.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.333+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.3 2024-09-05T01:15:38.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.333+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.4 2024-09-05T01:15:38.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.333+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.5 2024-09-05T01:15:38.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.337+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.6 2024-09-05T01:15:38.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.337+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.7 2024-09-05T01:15:38.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.337+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.8 2024-09-05T01:15:38.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.337+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.9 2024-09-05T01:15:38.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.337+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.10 2024-09-05T01:15:38.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.349+0000 7f44cd9ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 : hit (requested=0x17, cached=0x17) 2024-09-05T01:15:38.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.349+0000 7f44cd9ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 2024-09-05T01:15:38.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f44cd9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f44cd9ac9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f44cd9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f44cd9ac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35, ofs0, ns] 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f43ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464338 cookie 94658194542336 notifier 7683 bl.length()=923 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f43ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f43ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.353+0000 7f43ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.357+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_sources= new_sources= 2024-09-05T01:15:38.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.357+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential sources added=[] removed=[] 2024-09-05T01:15:38.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.357+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_dests= new_dests= 2024-09-05T01:15:38.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.357+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential dests added=[] removed=[] 2024-09-05T01:15:38.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.361+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.0 2024-09-05T01:15:38.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.1 2024-09-05T01:15:38.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.2 2024-09-05T01:15:38.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.3 2024-09-05T01:15:38.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.4 2024-09-05T01:15:38.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.5 2024-09-05T01:15:38.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.365+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.6 2024-09-05T01:15:38.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.7 2024-09-05T01:15:38.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.8 2024-09-05T01:15:38.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.9 2024-09-05T01:15:38.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35.10 2024-09-05T01:15:38.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 : hit (requested=0x17, cached=0x17) 2024-09-05T01:15:38.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.369+0000 7f44cd9ac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f44cd9ac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f44cd9ac9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f44cd9ac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f44cd9ac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35, ofs0, ns] 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f43ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464339 cookie 94658194542336 notifier 7683 bl.length()=891 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f43ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 info.flags=0x17 2024-09-05T01:15:38.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f43ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 to cache LRU end 2024-09-05T01:15:38.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.373+0000 7f43ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:38.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.377+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_sources= new_sources= 2024-09-05T01:15:38.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.377+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential sources added=[] removed=[] 2024-09-05T01:15:38.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.377+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): orig_dests= new_dests= 2024-09-05T01:15:38.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.377+0000 7f44cd9ac9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35]): potential dests added=[] removed=[] 2024-09-05T01:15:38.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.381+0000 7f44cd9ac9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-05T01:15:38.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.385+0000 7f4381fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.389+0000 7f44cd9ac9c0 20 remove_watcher() i=0 2024-09-05T01:15:38.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.389+0000 7f44cd9ac9c0 2 removed watcher, disabling cache 2024-09-05T01:15:38.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.393+0000 7f44cd9ac9c0 20 remove_watcher() i=1 2024-09-05T01:15:38.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.397+0000 7f44cd9ac9c0 20 remove_watcher() i=2 2024-09-05T01:15:38.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.397+0000 7f44cd9ac9c0 20 remove_watcher() i=3 2024-09-05T01:15:38.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.401+0000 7f44cd9ac9c0 20 remove_watcher() i=4 2024-09-05T01:15:38.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.401+0000 7f44cd9ac9c0 20 remove_watcher() i=5 2024-09-05T01:15:38.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.401+0000 7f44cd9ac9c0 20 remove_watcher() i=6 2024-09-05T01:15:38.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.405+0000 7f44cd9ac9c0 20 remove_watcher() i=7 2024-09-05T01:15:38.419 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-05T01:15:38.445 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:38.445 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:38.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 realm 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.489+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.493+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.493+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.493+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:38.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.493+0000 7f48402329c0 20 searching for the correct realm 2024-09-05T01:15:38.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.497+0000 7f483dd38640 0 -- 172.21.15.99:0/3635799951 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f48380b7430 msgr2=0x7f48380b78b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.505+0000 7f483dd38640 0 -- 172.21.15.99:0/3635799951 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f48380d9910 msgr2=0x7f48380c8430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:38.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:38.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:38.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 zone default found 2024-09-05T01:15:38.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 4 Realm: () 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 zonegroup default 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:38.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 started sync module instance, tier type = 2024-09-05T01:15:38.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.513+0000 7f48402329c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:38.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=0 2024-09-05T01:15:38.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=1 2024-09-05T01:15:38.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=2 2024-09-05T01:15:38.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=3 2024-09-05T01:15:38.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=4 2024-09-05T01:15:38.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=5 2024-09-05T01:15:38.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=6 2024-09-05T01:15:38.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 20 add_watcher() i=7 2024-09-05T01:15:38.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.529+0000 7f48402329c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:38.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f46ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 5 note: GC not initialized 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f46ee7fc640 20 reqs_thread_entry: start 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 Filter name: none 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f465ffff640 20 reqs_thread_entry: start 2024-09-05T01:15:38.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:38.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.533+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:38.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:38.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:38.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.537+0000 7f48402329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:38.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.541+0000 7f46ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:38.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.545+0000 7f48402329c0 20 remove_watcher() i=0 2024-09-05T01:15:38.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.545+0000 7f48402329c0 2 removed watcher, disabling cache 2024-09-05T01:15:38.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.549+0000 7f48402329c0 20 remove_watcher() i=1 2024-09-05T01:15:38.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.549+0000 7f48402329c0 20 remove_watcher() i=2 2024-09-05T01:15:38.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.553+0000 7f48402329c0 20 remove_watcher() i=3 2024-09-05T01:15:38.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.553+0000 7f48402329c0 20 remove_watcher() i=4 2024-09-05T01:15:38.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.557+0000 7f48402329c0 20 remove_watcher() i=5 2024-09-05T01:15:38.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.557+0000 7f48402329c0 20 remove_watcher() i=6 2024-09-05T01:15:38.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:38.557+0000 7f48402329c0 20 remove_watcher() i=7 2024-09-05T01:15:38.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:38.572 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:38.572 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:15:38.572 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:39.442 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-05T01:15:39.442 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-05T01:15:41.673 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:41.673 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.717+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 realm 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.721+0000 7f7b618319c0 20 searching for the correct realm 2024-09-05T01:15:41.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.729+0000 7f7b5f337640 0 -- 172.21.15.99:0/1063895647 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f7b5812d040 msgr2=0x7f7b580029f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:41.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.737+0000 7f7b5f337640 0 -- 172.21.15.99:0/1063895647 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f7b580f6960 msgr2=0x7f7b5811ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:41.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 zone default found 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 4 Realm: () 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 zonegroup default 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.741+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 started sync module instance, tier type = 2024-09-05T01:15:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.745+0000 7f7b618319c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:41.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=0 2024-09-05T01:15:41.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=1 2024-09-05T01:15:41.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=2 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=3 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=4 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=5 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=6 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 20 add_watcher() i=7 2024-09-05T01:15:41.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.761+0000 7f7b618319c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:41.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 5 note: GC not initialized 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7a14fe1640 20 reqs_thread_entry: start 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 Filter name: none 2024-09-05T01:15:41.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f798e7fc640 20 reqs_thread_entry: start 2024-09-05T01:15:41.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:41.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.765+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:41.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:41.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:41.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:41.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.769+0000 7f7b618319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:41.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.773+0000 7f7a15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.777+0000 7f7b618319c0 20 remove_watcher() i=0 2024-09-05T01:15:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.777+0000 7f7b618319c0 2 removed watcher, disabling cache 2024-09-05T01:15:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.777+0000 7f7b618319c0 20 remove_watcher() i=1 2024-09-05T01:15:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.781+0000 7f7b618319c0 20 remove_watcher() i=2 2024-09-05T01:15:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.785+0000 7f7b618319c0 20 remove_watcher() i=3 2024-09-05T01:15:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.785+0000 7f7b618319c0 20 remove_watcher() i=4 2024-09-05T01:15:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.785+0000 7f7b618319c0 20 remove_watcher() i=5 2024-09-05T01:15:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.789+0000 7f7b618319c0 20 remove_watcher() i=6 2024-09-05T01:15:41.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.789+0000 7f7b618319c0 20 remove_watcher() i=7 2024-09-05T01:15:41.803 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:41.803 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:41.803 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:41.803 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:41.803 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-05T01:15:41.836 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:41.836 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:41.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 realm 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:41.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:41.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:41.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:41.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 searching for the correct realm 2024-09-05T01:15:41.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:41.885+0000 7f03f8abb640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f03ec03b030 msgr2=0x7f03ec02f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.105+0000 7f03f92bc640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f03e4003be0 msgr2=0x7f03f4063a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:42.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:42.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zone default found 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Realm: () 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zonegroup default 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started sync module instance, tier type = 2024-09-05T01:15:42.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=0 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=1 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=2 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=3 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=4 2024-09-05T01:15:42.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=5 2024-09-05T01:15:42.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=6 2024-09-05T01:15:42.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.149+0000 7f03fb7b69c0 20 add_watcher() i=7 2024-09-05T01:15:42.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.149+0000 7f03fb7b69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f02affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 note: GC not initialized 2024-09-05T01:15:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f02aefe5640 20 reqs_thread_entry: start 2024-09-05T01:15:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 Filter name: none 2024-09-05T01:15:42.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f02acfe1640 20 reqs_thread_entry: start 2024-09-05T01:15:42.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-05T01:15:42.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:42.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-05T01:15:42.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : miss 2024-09-05T01:15:42.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:42.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:42.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:15:42.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:15:42.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 93968491758320 notifier 7322 bl.length()=923 2024-09-05T01:15:42.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:15:42.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:15:42.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:15:42.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:15:42.175 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03fb7b69c0 time 2024-09-05T01:15:42.181601+0000 2024-09-05T01:15:42.176 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:42.177 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.177 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f03ff0902eb] 2024-09-05T01:15:42.177 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f03fb7b69c0 thread_name:radosgw-admin 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03fb7b69c0 time 2024-09-05T01:15:42.181601+0000 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.178 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f03ff0902eb] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:15:42.179 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f03fdf0f520] 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:42.187 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f03ff090345] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f03fb7b69c0 thread_name:radosgw-admin 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.188 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f03fdf0f520] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f03ff090345] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:15:42.189 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient(hunting): handle_auth_done global_id 7719 payload 274 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:15:41.857+0000 7f03f8abb640 1 monclient: found mon.noname-a 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: dump: 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.190 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7719 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 4 set_mon_vals no callback set 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:42.191 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: dump: 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: shutdown 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) unregister_commands rotate-key 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.192 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.193 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.194 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: starting msgr at 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: starting objecter 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests hook 0x5576be6027f0 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: setting wanted keys 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: calling monclient init 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.195 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key hook 0x5576be827cf8 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be82d5a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.196 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be82daf0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x7f03e4003100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.325489s 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be82daf0 auth_method 0 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x7f03e4003100 auth_method 0 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.197 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:15:41.861+0000 7f03f9abd640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: dump: 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.198 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: dump: 2024-09-05T01:15:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7313 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:15:41.861+0000 7f02e7606640 4 set_mon_vals no callback set 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.200 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: init done 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:15:41.865+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02e0070b10 auth_method 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:15:41.865+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be852fd0 auth_method 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:15:41.865+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be872b80 auth_method 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:15:41.865+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be876ff0 auth_method 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.201 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.202 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576be87f910 EEXIST 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.203 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x5576be87a6d0 EEXIST 2024-09-05T01:15:42.204 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8a3ac0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8a33f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8a1dd0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.335303s 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8a3ac0 auth_method 0 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.205 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8a1dd0 auth_method 0 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:15:41.869+0000 7f03f9abd640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.206 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:15:41.869+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be8a33f0 auth_method 0 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: dump: 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.207 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: dump: 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.208 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7316 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:15:41.873+0000 7f03fa2be640 4 set_mon_vals no callback set 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.209 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.210 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02d4070a20 auth_method 0 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.211 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.212 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1ab749c8 EEXIST 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8f7910 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8c7330 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8f30e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.213 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.339167s 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8f7910 auth_method 0 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8f30e0 auth_method 0 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.214 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be8c7330 auth_method 0 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_done global_id 7728 payload 274 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:15:41.873+0000 7f03f92bc640 1 monclient: found mon.noname-a 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:42.215 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: dump: 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.216 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: dump: 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.217 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7728 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 4 set_mon_vals no callback set 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: shutdown 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.218 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.219 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: starting msgr at 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: starting objecter 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576be8a1a40 EEXIST 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: setting wanted keys 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: calling monclient init 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.220 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.221 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x5576be8a5a28 EEXIST 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8c7330 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8f30e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8f7910 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.222 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.341759s 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be8f30e0 auth_method 0 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8f7910 auth_method 0 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.223 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8c7330 auth_method 0 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:15:41.877+0000 7f03f8abb640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: dump: 2024-09-05T01:15:42.224 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.225 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: dump: 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.226 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:15:41.877+0000 7f02dcff9640 4 set_mon_vals no callback set 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7322 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: init done 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cr dump hook 0x7f03ec011968 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:15:41.881+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02c4070ae0 auth_method 0 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:15:41.881+0000 7f03f9abd640 10 monclient: get_auth_request con 0x5576be911760 auth_method 0 2024-09-05T01:15:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 realm 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:15:41.881+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be915950 auth_method 0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:15:41.885+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be9191b0 auth_method 0 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:42.228 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 searching for the correct realm 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:15:41.885+0000 7f03f9abd640 10 monclient: get_auth_request con 0x5576be91df70 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:15:41.885+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f03e4003be0 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:15:41.885+0000 7f03f8abb640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f03ec03b030 msgr2=0x7f03ec02f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:15:42.093+0000 7f03f8abb640 10 monclient: get_auth_request con 0x7f03ec03b030 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:15:42.093+0000 7f03f9abd640 10 monclient: get_auth_request con 0x7f03f00dd060 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:15:42.101+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be6a2370 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:15:42.105+0000 7f03f92bc640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f03e4003be0 msgr2=0x7f03f4063a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:15:42.105+0000 7f02caffd640 1 client.7322.objecter ms_handle_reset 0x7f03e4003be0 session 0x7f03f4090b00 osd.7 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:15:42.105+0000 7f02caffd640 10 monclient: _renew_subs 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:15:42.105+0000 7f02caffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:15:42.105+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02c4080900 auth_method 0 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:42.229 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zone default found 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Realm: () 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zonegroup default 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started sync module instance, tier type = 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=0 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=1 2024-09-05T01:15:42.231 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=2 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=3 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=4 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=5 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=6 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:15:42.149+0000 7f03fb7b69c0 20 add_watcher() i=7 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:15:42.149+0000 7f03fb7b69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.232 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:15:42.153+0000 7f02affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache list hook 0x5576be8eea80 2024-09-05T01:15:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache inspect hook 0x5576be8eea80 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache erase hook 0x5576be8eea80 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache zap hook 0x5576be8eea80 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 note: GC not initialized 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:15:42.153+0000 7f02aefe5640 20 reqs_thread_entry: start 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace show hook 0x7f03e4001d40 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace history hook 0x7f03e4001d40 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace active hook 0x7f03e4001d40 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace active_short hook 0x7f03e4001d40 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 Filter name: none 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:15:42.153+0000 7f02acfe1640 20 reqs_thread_entry: start 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-05T01:15:42.234 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : miss 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.235 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 93968491758320 notifier 7322 bl.length()=923 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03fb7b69c0 time 2024-09-05T01:15:42.181601+0000 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:42.236 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f03ff0902eb] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.237 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f03fb7b69c0 thread_name:radosgw-admin 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f03fdf0f520] 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:42.238 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f03ff090345] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:15:42.239 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:15:42.240 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:15:42.241 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:15:42.242 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:15:42.243 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:15:42.244 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:15:42.245 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:15:42.246 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02acfe1640 / http_manager 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02aefe5640 / http_manager 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02affe7640 / rgw_dt_lg_renew 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02caffd640 / ms_dispatch 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02dcff9640 / io_context_pool 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02deffd640 / ms_dispatch 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02e5e03640 / ms_dispatch 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02e7606640 / io_context_pool 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f8abb640 / msgr-worker-2 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f92bc640 / msgr-worker-1 2024-09-05T01:15:42.247 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f9abd640 / msgr-worker-0 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03fa2be640 / io_context_pool 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03fb7b69c0 / radosgw-admin 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.125860.log 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient(hunting): handle_auth_done global_id 7719 payload 274 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:15:41.857+0000 7f03f8abb640 1 monclient: found mon.noname-a 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:15:41.857+0000 7f03f8abb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.248 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: dump: 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.249 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7719 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:15:41.857+0000 7f03fb7b69c0 4 set_mon_vals no callback set 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:15:41.857+0000 7f02e7606640 10 monclient: dump: 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.250 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: shutdown 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) unregister_commands rotate-key 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.251 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding auth protocol: cephx 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.252 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: crc 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be82e060) adding con mode: secure 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: starting msgr at 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: starting objecter 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests hook 0x5576be6027f0 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: setting wanted keys 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: calling monclient init 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding auth protocol: cephx 2024-09-05T01:15:42.253 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: crc 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be827bb0) adding con mode: secure 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key hook 0x5576be827cf8 2024-09-05T01:15:42.254 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be82d5a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be82daf0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x7f03e4003100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.325489s 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be82daf0 auth_method 0 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.255 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x7f03e4003100 auth_method 0 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:15:41.861+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient(hunting): handle_auth_done global_id 7313 payload 824 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:15:41.861+0000 7f03f9abd640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:15:41.861+0000 7f03f9abd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.256 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: dump: 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.257 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:15:41.861+0000 7f02e5e03640 10 monclient: dump: 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.258 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7313 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:15:41.861+0000 7f02e7606640 4 set_mon_vals no callback set 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:15:41.861+0000 7f03fb7b69c0 1 librados: init done 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:15:41.865+0000 7f02e5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:15:41.865+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02e0070b10 auth_method 0 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:15:41.865+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be852fd0 auth_method 0 2024-09-05T01:15:42.259 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:15:41.865+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be872b80 auth_method 0 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:15:41.865+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be876ff0 auth_method 0 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.260 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding auth protocol: cephx 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.261 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: crc 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87bf00) adding con mode: secure 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576be87f910 EEXIST 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.262 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding auth protocol: cephx 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: crc 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be87a588) adding con mode: secure 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.263 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x5576be87a6d0 EEXIST 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8a3ac0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8a33f0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8a1dd0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:15:41.869+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.335303s 2024-09-05T01:15:42.264 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8a3ac0 auth_method 0 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8a1dd0 auth_method 0 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:15:41.869+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.265 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:15:41.869+0000 7f03f9abd640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:15:41.869+0000 7f03f9abd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:15:41.869+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be8a33f0 auth_method 0 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: dump: 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.266 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:15:41.873+0000 7f02deffd640 10 monclient: dump: 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.267 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7316 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:15:41.873+0000 7f03fa2be640 4 set_mon_vals no callback set 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.268 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:15:41.873+0000 7f02deffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.269 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding auth protocol: cephx 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.270 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: crc 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8c3410) adding con mode: secure 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02d4070a20 auth_method 0 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.271 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding auth protocol: cephx 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: crc 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74880) adding con mode: secure 2024-09-05T01:15:42.272 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1ab749c8 EEXIST 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8f7910 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8c7330 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8f30e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.339167s 2024-09-05T01:15:42.273 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8f7910 auth_method 0 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8f30e0 auth_method 0 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.274 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:15:41.873+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be8c7330 auth_method 0 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:15:41.873+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient(hunting): handle_auth_done global_id 7728 payload 274 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:15:41.873+0000 7f03f92bc640 1 monclient: found mon.noname-a 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:15:41.873+0000 7f03f92bc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:15:42.275 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: dump: 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.276 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:15:41.873+0000 7f02dcff9640 10 monclient: dump: 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.277 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7728 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:15:41.873+0000 7f03fb7b69c0 4 set_mon_vals no callback set 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: shutdown 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: build_initial_monmap 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 build_initial for_mkfs: 0 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: monmap: 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:15:42.278 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding auth protocol: cephx 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.279 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: crc 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8e8330) adding con mode: secure 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: starting msgr at 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: starting objecter 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5576be8a1a40 EEXIST 2024-09-05T01:15:42.280 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: setting wanted keys 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: calling monclient init 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: init 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding auth protocol: cephx 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.281 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: crc 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 AuthRegistry(0x5576be8a58e0) adding con mode: secure 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command rotate-key cmddesc rotate-key hook 0x5576be8a5a28 EEXIST 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-b con 0x5576be8c7330 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-c con 0x5576be8f30e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): picked mon.noname-a con 0x5576be8f7910 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:15:42.282 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient(hunting): authenticate will time out at 2593.341759s 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): get_auth_request con 0x5576be8f30e0 auth_method 0 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): get_auth_request con 0x5576be8f7910 auth_method 0 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:15:42.283 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:15:41.877+0000 7f03f9abd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): get_auth_request con 0x5576be8c7330 auth_method 0 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:15:41.877+0000 7f03f92bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient(hunting): handle_auth_done global_id 7322 payload 824 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient: _finish_hunting 0 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:15:41.877+0000 7f03f8abb640 1 monclient: found mon.noname-c 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:15:41.877+0000 7f03f8abb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: dump: 2024-09-05T01:15:42.284 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: _finish_auth 0 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: _check_auth_tickets 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_config config(0 keys) 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:15:42.285 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:15:41.877+0000 7f02caffd640 10 monclient: dump: 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:15:41.877+0000 7f02dcff9640 4 set_mon_vals no callback set 2024-09-05T01:15:42.286 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 monclient: authenticate success, global_id 7322 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _renew_subs 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 1 librados: init done 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:15:41.877+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cr dump hook 0x7f03ec011968 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:15:41.881+0000 7f02caffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:15:41.881+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02c4070ae0 auth_method 0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:15:41.881+0000 7f03f9abd640 10 monclient: get_auth_request con 0x5576be911760 auth_method 0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.287 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 realm 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:15:41.881+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:15:41.881+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be915950 auth_method 0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:15:41.885+0000 7f03f8abb640 10 monclient: get_auth_request con 0x5576be9191b0 auth_method 0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:15:41.885+0000 7f03fb7b69c0 20 searching for the correct realm 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:15:41.885+0000 7f03f9abd640 10 monclient: get_auth_request con 0x5576be91df70 auth_method 0 2024-09-05T01:15:42.288 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:15:41.885+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f03e4003be0 auth_method 0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:15:41.885+0000 7f03f8abb640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f03ec03b030 msgr2=0x7f03ec02f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:15:42.093+0000 7f03f8abb640 10 monclient: get_auth_request con 0x7f03ec03b030 auth_method 0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:15:42.093+0000 7f03f9abd640 10 monclient: get_auth_request con 0x7f03f00dd060 auth_method 0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:15:42.101+0000 7f03f92bc640 10 monclient: get_auth_request con 0x5576be6a2370 auth_method 0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:15:42.105+0000 7f03f92bc640 0 -- 172.21.15.99:0/1050894512 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f03e4003be0 msgr2=0x7f03f4063a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:15:42.105+0000 7f02caffd640 1 client.7322.objecter ms_handle_reset 0x7f03e4003be0 session 0x7f03f4090b00 osd.7 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:15:42.105+0000 7f02caffd640 10 monclient: _renew_subs 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:15:42.105+0000 7f02caffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:15:42.105+0000 7f03f92bc640 10 monclient: get_auth_request con 0x7f02c4080900 auth_method 0 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:42.289 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zone default found 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Realm: () 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 zonegroup default 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.290 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:15:42.121+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started sync module instance, tier type = 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:15:42.125+0000 7f03fb7b69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=0 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=1 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=2 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=3 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=4 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=5 2024-09-05T01:15:42.291 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:15:42.145+0000 7f03fb7b69c0 20 add_watcher() i=6 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:15:42.149+0000 7f03fb7b69c0 20 add_watcher() i=7 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:15:42.149+0000 7f03fb7b69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding auth protocol: cephx 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.292 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: crc 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:15:42.153+0000 7f02affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 AuthRegistry(0x7fff1ab74d60) adding con mode: secure 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache list hook 0x5576be8eea80 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache inspect hook 0x5576be8eea80 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache erase hook 0x5576be8eea80 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command cache zap hook 0x5576be8eea80 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 note: GC not initialized 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:15:42.153+0000 7f02aefe5640 20 reqs_thread_entry: start 2024-09-05T01:15:42.293 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace show hook 0x7f03e4001d40 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace history hook 0x7f03e4001d40 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace active hook 0x7f03e4001d40 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 5 asok(0x5576be61a2b0) register_command sync trace active_short hook 0x7f03e4001d40 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 Filter name: none 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:15:42.153+0000 7f02acfe1640 20 reqs_thread_entry: start 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:15:42.153+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : miss 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.294 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:15:42.157+0000 7f03fb7b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:15:42.165+0000 7f03fb7b69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 93968491758320 notifier 7322 bl.length()=923 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:15:42.169+0000 7f02dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.295 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:15:42.169+0000 7f03fb7b69c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f03fb7b69c0 time 2024-09-05T01:15:42.181601+0000 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f03ff0902eb] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:15:42.296 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:15:42.177+0000 7f03fb7b69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f03fb7b69c0 thread_name:radosgw-admin 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f03fdf0f520] 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f03ff090345] 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f03ff09049f] 2024-09-05T01:15:42.297 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5576bcf3b681] 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x5576bd99982c] 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5576bcf50afd] 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f03fdef6d90] 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:15:42.298 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:15:42.299 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:15:42.300 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:15:42.301 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:15:42.302 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:15:42.303 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:15:42.304 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02acfe1640 / http_manager 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02aefe5640 / http_manager 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02affe7640 / rgw_dt_lg_renew 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02caffd640 / ms_dispatch 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02dcff9640 / io_context_pool 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02deffd640 / ms_dispatch 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02e5e03640 / ms_dispatch 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f02e7606640 / io_context_pool 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f8abb640 / msgr-worker-2 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f92bc640 / msgr-worker-1 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03f9abd640 / msgr-worker-0 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03fa2be640 / io_context_pool 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03fb7b69c0 / radosgw-admin 2024-09-05T01:15:42.305 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:15:42.306 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:15:42.306 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:15:42.185059Z_a43eb94e-22ff-4680-ad74-37f2d335bf87/log 2024-09-05T01:15:42.306 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.261+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 realm 2024-09-05T01:15:42.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.265+0000 7f99d85b89c0 20 searching for the correct realm 2024-09-05T01:15:42.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.269+0000 7f99d68bf640 0 -- 172.21.15.99:0/1096944761 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f99cc1198e0 msgr2=0x7f99cc0b78f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.485+0000 7f99d68bf640 0 -- 172.21.15.99:0/1096944761 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f99cc1198e0 msgr2=0x7f99cc0b78f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:42.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.497+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:42.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 zone default found 2024-09-05T01:15:42.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 4 Realm: () 2024-09-05T01:15:42.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 zonegroup default 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 started sync module instance, tier type = 2024-09-05T01:15:42.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.501+0000 7f99d85b89c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:42.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=0 2024-09-05T01:15:42.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=1 2024-09-05T01:15:42.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=2 2024-09-05T01:15:42.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=3 2024-09-05T01:15:42.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=4 2024-09-05T01:15:42.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=5 2024-09-05T01:15:42.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=6 2024-09-05T01:15:42.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 20 add_watcher() i=7 2024-09-05T01:15:42.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.525+0000 7f99d85b89c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:42.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.529+0000 7f988cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.529+0000 7f99d85b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:42.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.529+0000 7f99d85b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:42.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 5 note: GC not initialized 2024-09-05T01:15:42.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f98077fe640 20 reqs_thread_entry: start 2024-09-05T01:15:42.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:42.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 20 Filter name: none 2024-09-05T01:15:42.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f98057fa640 20 reqs_thread_entry: start 2024-09-05T01:15:42.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.533+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-05T01:15:42.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:42.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-05T01:15:42.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.537+0000 7f99d85b89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:15:42.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.541+0000 7f988cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.549+0000 7f99d85b89c0 20 remove_watcher() i=0 2024-09-05T01:15:42.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.549+0000 7f99d85b89c0 2 removed watcher, disabling cache 2024-09-05T01:15:42.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.549+0000 7f99d85b89c0 20 remove_watcher() i=1 2024-09-05T01:15:42.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.553+0000 7f99d85b89c0 20 remove_watcher() i=2 2024-09-05T01:15:42.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.553+0000 7f99d85b89c0 20 remove_watcher() i=3 2024-09-05T01:15:42.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.557+0000 7f99d85b89c0 20 remove_watcher() i=4 2024-09-05T01:15:42.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.557+0000 7f99d85b89c0 20 remove_watcher() i=5 2024-09-05T01:15:42.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.561+0000 7f99d85b89c0 20 remove_watcher() i=6 2024-09-05T01:15:42.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.561+0000 7f99d85b89c0 20 remove_watcher() i=7 2024-09-05T01:15:42.578 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.578 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:15:42.578 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:15:42.578 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:15:42.685 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:15:42.722 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:15:42.722 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:15:42.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.765+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 realm 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.769+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.773+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:15:42.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.773+0000 7fb5ef9569c0 20 searching for the correct realm 2024-09-05T01:15:42.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.777+0000 7fb5edc5d640 0 -- 172.21.15.99:0/3994865595 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb5d8019070 msgr2=0x7fb5d8066040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:15:42.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.793+0000 7fb5edc5d640 0 -- 172.21.15.99:0/3994865595 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb4b8080900 msgr2=0x7fb4b8082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:15:42.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 zone default found 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 4 Realm: () 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 zonegroup default 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.801+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.805+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.805+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.805+0000 7fb5ef9569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:15:42.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.805+0000 7fb5ef9569c0 20 started sync module instance, tier type = 2024-09-05T01:15:42.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.805+0000 7fb5ef9569c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=0 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=1 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=2 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=3 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=4 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=5 2024-09-05T01:15:42.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=6 2024-09-05T01:15:42.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 20 add_watcher() i=7 2024-09-05T01:15:42.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.821+0000 7fb5ef9569c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:15:42.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb4a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 5 note: GC not initialized 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb4a2fe5640 20 reqs_thread_entry: start 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 init_complete bucket index max shards: 11 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 Filter name: none 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb4a0fe1640 20 reqs_thread_entry: start 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-05T01:15:42.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:15:42.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-05T01:15:42.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-05T01:15:42.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : miss 2024-09-05T01:15:42.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.825+0000 7fb5ef9569c0 20 rados->read ofs=0 len=0 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:15:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:15:42.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb5ef9569c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to be held by another RGW process; skipping for now 2024-09-05T01:15:42.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.829+0000 7fb4a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:15:42.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.837+0000 7fb5ef9569c0 20 remove_watcher() i=0 2024-09-05T01:15:42.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.837+0000 7fb5ef9569c0 2 removed watcher, disabling cache 2024-09-05T01:15:42.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.837+0000 7fb5ef9569c0 20 remove_watcher() i=1 2024-09-05T01:15:42.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.841+0000 7fb5ef9569c0 20 remove_watcher() i=2 2024-09-05T01:15:42.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.841+0000 7fb5ef9569c0 20 remove_watcher() i=3 2024-09-05T01:15:42.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.845+0000 7fb5ef9569c0 20 remove_watcher() i=4 2024-09-05T01:15:42.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.845+0000 7fb5ef9569c0 20 remove_watcher() i=5 2024-09-05T01:15:42.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.849+0000 7fb5ef9569c0 20 remove_watcher() i=6 2024-09-05T01:15:42.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:15:42.849+0000 7fb5ef9569c0 20 remove_watcher() i=7 2024-09-05T01:15:42.863 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:16:12.881 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:16:12.918 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:12.918 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:12.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.964+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 realm 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:12.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:12.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.968+0000 7fe9d6d929c0 20 searching for the correct realm 2024-09-05T01:16:12.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.976+0000 7fe9d5099640 0 -- 172.21.15.99:0/3013679450 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe9cc0c1040 msgr2=0x7fe9cc0fcad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:12.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.984+0000 7fe9d5099640 0 -- 172.21.15.99:0/3013679450 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe8a0080900 msgr2=0x7fe8a0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:12.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 zone default found 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 4 Realm: () 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:12.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 zonegroup default 2024-09-05T01:16:12.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.992+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.996+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.996+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:12.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.996+0000 7fe9d6d929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:12.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.996+0000 7fe9d6d929c0 20 started sync module instance, tier type = 2024-09-05T01:16:12.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:12.996+0000 7fe9d6d929c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=0 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=1 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=2 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=3 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=4 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=5 2024-09-05T01:16:13.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=6 2024-09-05T01:16:13.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 20 add_watcher() i=7 2024-09-05T01:16:13.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.012+0000 7fe9d6d929c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:13.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe88afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 5 note: GC not initialized 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe889fe3640 20 reqs_thread_entry: start 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 Filter name: none 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe7fb7fe640 20 reqs_thread_entry: start 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-05T01:16:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:16:13.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-05T01:16:13.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-05T01:16:13.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : miss 2024-09-05T01:16:13.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.016+0000 7fe9d6d929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:16:13.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.020+0000 7fe9d6d929c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:16:13.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.032+0000 7fe9d6d929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.032+0000 7fe9d6d929c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.032+0000 7fe9d6d929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.032+0000 7fe9d6d929c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe8ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94251469415424 notifier 7788 bl.length()=923 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe8ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe8ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe8ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:16:13.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:16:13.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:16:13.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.036+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:16:13.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.0 2024-09-05T01:16:13.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.0 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.1 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.1 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.2 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.2 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.3 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.3 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.4 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.4 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.5 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.5 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.6 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.6 2024-09-05T01:16:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.7 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.7 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.8 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.8 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.9 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.9 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.10 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.10 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.11 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2.11 2024-09-05T01:16:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.0 2024-09-05T01:16:13.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.1 2024-09-05T01:16:13.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2 2024-09-05T01:16:13.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.3 2024-09-05T01:16:13.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.048+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.4 2024-09-05T01:16:13.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.052+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.5 2024-09-05T01:16:13.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.052+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.6 2024-09-05T01:16:13.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.052+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.7 2024-09-05T01:16:13.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.052+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.8 2024-09-05T01:16:13.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.056+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.9 2024-09-05T01:16:13.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.056+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.10 2024-09-05T01:16:13.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.064+0000 7fe9d6d929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:13.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.064+0000 7fe9d6d929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:16:13.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe9d6d929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe9d6d929c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe9d6d929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe9d6d929c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:16:13.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe8ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94251469415424 notifier 7788 bl.length()=923 2024-09-05T01:16:13.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe8ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe8ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.068+0000 7fe8ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.072+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:16:13.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.072+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:16:13.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.072+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:16:13.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.072+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:16:13.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.076+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.0 2024-09-05T01:16:13.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.076+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.1 2024-09-05T01:16:13.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.076+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.2 2024-09-05T01:16:13.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.076+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.3 2024-09-05T01:16:13.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.080+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.4 2024-09-05T01:16:13.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.080+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.5 2024-09-05T01:16:13.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.080+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.6 2024-09-05T01:16:13.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.080+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.7 2024-09-05T01:16:13.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.080+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.8 2024-09-05T01:16:13.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.084+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.9 2024-09-05T01:16:13.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.084+0000 7fe9d6d929c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36.10 2024-09-05T01:16:13.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.084+0000 7fe9d6d929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:13.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.084+0000 7fe9d6d929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe9d6d929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe9d6d929c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe9d6d929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe9d6d929c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36, ofs0, ns] 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe8ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464283 cookie 94251469415424 notifier 7788 bl.length()=891 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe8ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 info.flags=0x17 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe8ab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 to cache LRU end 2024-09-05T01:16:13.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.088+0000 7fe8ab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:13.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.092+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_sources= new_sources= 2024-09-05T01:16:13.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.092+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential sources added=[] removed=[] 2024-09-05T01:16:13.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.092+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): orig_dests= new_dests= 2024-09-05T01:16:13.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.092+0000 7fe9d6d929c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36]): potential dests added=[] removed=[] 2024-09-05T01:16:13.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.096+0000 7fe9d6d929c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-05T01:16:13.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.100+0000 7fe88afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:13.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.108+0000 7fe9d6d929c0 20 remove_watcher() i=0 2024-09-05T01:16:13.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.108+0000 7fe9d6d929c0 2 removed watcher, disabling cache 2024-09-05T01:16:13.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.108+0000 7fe9d6d929c0 20 remove_watcher() i=1 2024-09-05T01:16:13.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.112+0000 7fe9d6d929c0 20 remove_watcher() i=2 2024-09-05T01:16:13.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.112+0000 7fe9d6d929c0 20 remove_watcher() i=3 2024-09-05T01:16:13.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.116+0000 7fe9d6d929c0 20 remove_watcher() i=4 2024-09-05T01:16:13.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.116+0000 7fe9d6d929c0 20 remove_watcher() i=5 2024-09-05T01:16:13.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.120+0000 7fe9d6d929c0 20 remove_watcher() i=6 2024-09-05T01:16:13.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.120+0000 7fe9d6d929c0 20 remove_watcher() i=7 2024-09-05T01:16:13.133 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-05T01:16:13.163 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:13.163 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:13.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.208+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 realm 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:13.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.212+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.216+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:13.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.216+0000 7f581ec749c0 20 searching for the correct realm 2024-09-05T01:16:13.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.220+0000 7f581cf7b640 0 -- 172.21.15.99:0/1095969566 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5810008050 msgr2=0x7f581006dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:13.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.436+0000 7f581cf7b640 0 -- 172.21.15.99:0/1095969566 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5810008050 msgr2=0x7f581006dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:13.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.448+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 zone default found 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 4 Realm: () 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 zonegroup default 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:13.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 started sync module instance, tier type = 2024-09-05T01:16:13.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.452+0000 7f581ec749c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=0 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=1 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=2 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=3 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=4 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=5 2024-09-05T01:16:13.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=6 2024-09-05T01:16:13.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 20 add_watcher() i=7 2024-09-05T01:16:13.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.476+0000 7f581ec749c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:13.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f56d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:13.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:13.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:13.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 5 note: GC not initialized 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f56d1fdb640 20 reqs_thread_entry: start 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 Filter name: none 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f56437fe640 20 reqs_thread_entry: start 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:16:13.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.480+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:16:13.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:13.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-05T01:16:13.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:13.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-05T01:16:13.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.484+0000 7f581ec749c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:13.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.488+0000 7f56d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:13.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.492+0000 7f581ec749c0 20 remove_watcher() i=0 2024-09-05T01:16:13.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.492+0000 7f581ec749c0 2 removed watcher, disabling cache 2024-09-05T01:16:13.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.496+0000 7f581ec749c0 20 remove_watcher() i=1 2024-09-05T01:16:13.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.496+0000 7f581ec749c0 20 remove_watcher() i=2 2024-09-05T01:16:13.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.500+0000 7f581ec749c0 20 remove_watcher() i=3 2024-09-05T01:16:13.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.500+0000 7f581ec749c0 20 remove_watcher() i=4 2024-09-05T01:16:13.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.504+0000 7f581ec749c0 20 remove_watcher() i=5 2024-09-05T01:16:13.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.504+0000 7f581ec749c0 20 remove_watcher() i=6 2024-09-05T01:16:13.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:13.504+0000 7f581ec749c0 20 remove_watcher() i=7 2024-09-05T01:16:13.519 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:13.520 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:13.520 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-logrecord-writes id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:16:13.520 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:14.433 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-05T01:16:14.433 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:16.651 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-05T01:16:16.684 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:16.684 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 realm 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.732+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.736+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:16.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.736+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.736+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:16.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.736+0000 7fedb97979c0 20 searching for the correct realm 2024-09-05T01:16:16.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.740+0000 7fedb7a9e640 0 -- 172.21.15.99:0/1598164196 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7feda800e070 msgr2=0x7feda80994a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:16.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.956+0000 7fedb7a9e640 0 -- 172.21.15.99:0/1598164196 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7feda800e070 msgr2=0x7feda80994a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.968+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:16.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 zone default found 2024-09-05T01:16:16.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 4 Realm: () 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 zonegroup default 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:16.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:16.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 started sync module instance, tier type = 2024-09-05T01:16:16.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.972+0000 7fedb97979c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=0 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=1 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=2 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=3 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=4 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=5 2024-09-05T01:16:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:16.996+0000 7fedb97979c0 20 add_watcher() i=6 2024-09-05T01:16:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.000+0000 7fedb97979c0 20 add_watcher() i=7 2024-09-05T01:16:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.000+0000 7fedb97979c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:17.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fec6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:17.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:17.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 5 note: GC not initialized 2024-09-05T01:16:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fec6cfe1640 20 reqs_thread_entry: start 2024-09-05T01:16:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 20 Filter name: none 2024-09-05T01:16:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7febe67fc640 20 reqs_thread_entry: start 2024-09-05T01:16:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.004+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:17.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:17.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:17.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:17.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:17.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.008+0000 7fedb97979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:17.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.012+0000 7fec6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.016+0000 7fedb97979c0 20 remove_watcher() i=0 2024-09-05T01:16:17.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.016+0000 7fedb97979c0 2 removed watcher, disabling cache 2024-09-05T01:16:17.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.020+0000 7fedb97979c0 20 remove_watcher() i=1 2024-09-05T01:16:17.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.020+0000 7fedb97979c0 20 remove_watcher() i=2 2024-09-05T01:16:17.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.024+0000 7fedb97979c0 20 remove_watcher() i=3 2024-09-05T01:16:17.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.028+0000 7fedb97979c0 20 remove_watcher() i=4 2024-09-05T01:16:17.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.028+0000 7fedb97979c0 20 remove_watcher() i=5 2024-09-05T01:16:17.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.028+0000 7fedb97979c0 20 remove_watcher() i=6 2024-09-05T01:16:17.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.032+0000 7fedb97979c0 20 remove_watcher() i=7 2024-09-05T01:16:17.045 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:17.045 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:17.045 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:16:17.045 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:17.046 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-05T01:16:17.078 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:17.079 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:17.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.124+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.124+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.124+0000 7f38eaad29c0 20 realm 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.124+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:17.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:17.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.128+0000 7f38eaad29c0 20 searching for the correct realm 2024-09-05T01:16:17.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.132+0000 7f38e8dd9640 0 -- 172.21.15.99:0/3372060748 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f38d0008050 msgr2=0x7f38d00641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:17.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.348+0000 7f38e8dd9640 0 -- 172.21.15.99:0/3372060748 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f38d0008050 msgr2=0x7f38d00641b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:17.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:17.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.360+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 zone default found 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 4 Realm: () 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 zonegroup default 2024-09-05T01:16:17.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 started sync module instance, tier type = 2024-09-05T01:16:17.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.364+0000 7f38eaad29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:17.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=0 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=1 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=2 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=3 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=4 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=5 2024-09-05T01:16:17.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=6 2024-09-05T01:16:17.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 20 add_watcher() i=7 2024-09-05T01:16:17.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.388+0000 7f38eaad29c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:17.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.392+0000 7f379f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:17.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:17.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 5 note: GC not initialized 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f379e7dc640 20 reqs_thread_entry: start 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 Filter name: none 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f37977fe640 20 reqs_thread_entry: start 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-05T01:16:17.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-05T01:16:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 : miss 2024-09-05T01:16:17.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:17.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:17.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.396+0000 7f38eaad29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.400+0000 7f38eaad29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 2024-09-05T01:16:17.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f38eaad29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f38eaad29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f38eaad29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f38eaad29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37, ofs0, ns] 2024-09-05T01:16:17.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f37bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94762070461776 notifier 7851 bl.length()=931 2024-09-05T01:16:17.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f37bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f37bf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.408+0000 7f37bf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.412+0000 7f37beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94762070461776 notifier 7851 bl.length()=931 2024-09-05T01:16:17.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.412+0000 7f37beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.412+0000 7f37beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.412+0000 7f37beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.416+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_sources= new_sources= 2024-09-05T01:16:17.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.416+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential sources added=[] removed=[] 2024-09-05T01:16:17.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.416+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_dests= new_dests= 2024-09-05T01:16:17.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.416+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential dests added=[] removed=[] 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.0 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.0 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.1 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.1 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.2 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.2 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.3 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.3 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.4 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.4 2024-09-05T01:16:17.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.5 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.5 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.6 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.6 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.7 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.7 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.8 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.8 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.9 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.9 2024-09-05T01:16:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.10 2024-09-05T01:16:17.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.10 2024-09-05T01:16:17.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.11 2024-09-05T01:16:17.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.11 2024-09-05T01:16:17.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.424+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.0 2024-09-05T01:16:17.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.428+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1 2024-09-05T01:16:17.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.428+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.2 2024-09-05T01:16:17.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.428+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.3 2024-09-05T01:16:17.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.428+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.4 2024-09-05T01:16:17.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.432+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.5 2024-09-05T01:16:17.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.432+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.6 2024-09-05T01:16:17.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.432+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.7 2024-09-05T01:16:17.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.432+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.8 2024-09-05T01:16:17.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.436+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.9 2024-09-05T01:16:17.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.436+0000 7f38eaad29c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.10 2024-09-05T01:16:17.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.440+0000 7f38eaad29c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-05T01:16:17.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.440+0000 7f38eaad29c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-05T01:16:17.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:17.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 2024-09-05T01:16:17.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f38eaad29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37, ofs0, ns] 2024-09-05T01:16:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f37beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94762070461776 notifier 7851 bl.length()=899 2024-09-05T01:16:17.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f37beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:17.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f37beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:17.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.464+0000 7f37beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:17.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.468+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_sources= new_sources= 2024-09-05T01:16:17.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.468+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential sources added=[] removed=[] 2024-09-05T01:16:17.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.468+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_dests= new_dests= 2024-09-05T01:16:17.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.468+0000 7f38eaad29c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential dests added=[] removed=[] 2024-09-05T01:16:17.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.468+0000 7f38eaad29c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-05T01:16:17.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.472+0000 7f379f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.476+0000 7f38eaad29c0 20 remove_watcher() i=0 2024-09-05T01:16:17.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.476+0000 7f38eaad29c0 2 removed watcher, disabling cache 2024-09-05T01:16:17.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.480+0000 7f38eaad29c0 20 remove_watcher() i=1 2024-09-05T01:16:17.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.480+0000 7f38eaad29c0 20 remove_watcher() i=2 2024-09-05T01:16:17.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.484+0000 7f38eaad29c0 20 remove_watcher() i=3 2024-09-05T01:16:17.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.484+0000 7f38eaad29c0 20 remove_watcher() i=4 2024-09-05T01:16:17.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.488+0000 7f38eaad29c0 20 remove_watcher() i=5 2024-09-05T01:16:17.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.488+0000 7f38eaad29c0 20 remove_watcher() i=6 2024-09-05T01:16:17.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.488+0000 7f38eaad29c0 20 remove_watcher() i=7 2024-09-05T01:16:17.503 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-05T01:16:17.532 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:17.533 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:17.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.576+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 realm 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:17.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:17.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.580+0000 7fca7f89b9c0 20 searching for the correct realm 2024-09-05T01:16:17.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.588+0000 7fca7dba2640 0 -- 172.21.15.99:0/969146226 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fca7401e040 msgr2=0x7fca740621d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:17.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.592+0000 7fca7dba2640 0 -- 172.21.15.99:0/969146226 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc948080900 msgr2=0x7fc948082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 zone default found 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 4 Realm: () 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 zonegroup default 2024-09-05T01:16:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.600+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.604+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.604+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.604+0000 7fca7f89b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.604+0000 7fca7f89b9c0 20 started sync module instance, tier type = 2024-09-05T01:16:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.604+0000 7fca7f89b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:17.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=0 2024-09-05T01:16:17.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=1 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=2 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=3 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=4 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=5 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=6 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 20 add_watcher() i=7 2024-09-05T01:16:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.620+0000 7fca7f89b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fc9337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:17.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 5 note: GC not initialized 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fc9327e4640 20 reqs_thread_entry: start 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 Filter name: none 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fc8a3fff640 20 reqs_thread_entry: start 2024-09-05T01:16:17.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.624+0000 7fca7f89b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.628+0000 7fca7f89b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.628+0000 7fca7f89b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:17.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.628+0000 7fc9337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:17.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.632+0000 7fca7f89b9c0 20 remove_watcher() i=0 2024-09-05T01:16:17.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.632+0000 7fca7f89b9c0 2 removed watcher, disabling cache 2024-09-05T01:16:17.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.636+0000 7fca7f89b9c0 20 remove_watcher() i=1 2024-09-05T01:16:17.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.640+0000 7fca7f89b9c0 20 remove_watcher() i=2 2024-09-05T01:16:17.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.640+0000 7fca7f89b9c0 20 remove_watcher() i=3 2024-09-05T01:16:17.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.644+0000 7fca7f89b9c0 20 remove_watcher() i=4 2024-09-05T01:16:17.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.644+0000 7fca7f89b9c0 20 remove_watcher() i=5 2024-09-05T01:16:17.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.644+0000 7fca7f89b9c0 20 remove_watcher() i=6 2024-09-05T01:16:17.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.644+0000 7fca7f89b9c0 20 remove_watcher() i=7 2024-09-05T01:16:17.656 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:17.656 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:17.656 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:16:17.657 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:16:17.788 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:17.788 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:17.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.832+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 realm 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:17.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:17.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.836+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.840+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.840+0000 7f3d48abb9c0 20 searching for the correct realm 2024-09-05T01:16:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:17.840+0000 7f3d46dc2640 0 -- 172.21.15.99:0/415998401 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3d300e9b70 msgr2=0x7f3d300e1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:18.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.056+0000 7f3d46dc2640 0 -- 172.21.15.99:0/415998401 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3d300e9b70 msgr2=0x7f3d300e1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:18.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:18.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:18.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.068+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:18.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 zone default found 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 4 Realm: () 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 zonegroup default 2024-09-05T01:16:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 started sync module instance, tier type = 2024-09-05T01:16:18.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.072+0000 7f3d48abb9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=0 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=1 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=2 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=3 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=4 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=5 2024-09-05T01:16:18.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.092+0000 7f3d48abb9c0 20 add_watcher() i=6 2024-09-05T01:16:18.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.096+0000 7f3d48abb9c0 20 add_watcher() i=7 2024-09-05T01:16:18.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.096+0000 7f3d48abb9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:18.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3bfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:18.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:18.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:18.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 5 note: GC not initialized 2024-09-05T01:16:18.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3b777fe640 20 reqs_thread_entry: start 2024-09-05T01:16:18.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 20 Filter name: none 2024-09-05T01:16:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3b757fa640 20 reqs_thread_entry: start 2024-09-05T01:16:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-05T01:16:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.100+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 : miss 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:18.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.104+0000 7f3d48abb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 2024-09-05T01:16:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3d48abb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3d48abb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3d48abb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3d48abb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37, ofs0, ns] 2024-09-05T01:16:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3c29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94024534708704 notifier 7887 bl.length()=931 2024-09-05T01:16:18.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3c29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3c29ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.112+0000 7f3c29ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.116+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_sources= new_sources= 2024-09-05T01:16:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.116+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential sources added=[] removed=[] 2024-09-05T01:16:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.116+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_dests= new_dests= 2024-09-05T01:16:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.116+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential dests added=[] removed=[] 2024-09-05T01:16:18.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.0 2024-09-05T01:16:18.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.0 2024-09-05T01:16:18.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.1 2024-09-05T01:16:18.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.1 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.2 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.2 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.3 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.3 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.4 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.4 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.5 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.5 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.6 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.6 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.7 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.7 2024-09-05T01:16:18.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.8 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.8 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.9 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.9 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.10 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.10 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.11 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1.11 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.0 2024-09-05T01:16:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1 2024-09-05T01:16:18.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.2 2024-09-05T01:16:18.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.128+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.3 2024-09-05T01:16:18.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.132+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.4 2024-09-05T01:16:18.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.132+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.5 2024-09-05T01:16:18.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.132+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.6 2024-09-05T01:16:18.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.132+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.7 2024-09-05T01:16:18.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.132+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.8 2024-09-05T01:16:18.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.136+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.9 2024-09-05T01:16:18.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.136+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.10 2024-09-05T01:16:18.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.140+0000 7f3d48abb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:18.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.140+0000 7f3d48abb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37, ofs0, ns] 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3c29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 94024534708704 notifier 7887 bl.length()=931 2024-09-05T01:16:18.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3c29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3c29ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3c29ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_sources= new_sources= 2024-09-05T01:16:18.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential sources added=[] removed=[] 2024-09-05T01:16:18.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_dests= new_dests= 2024-09-05T01:16:18.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.144+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential dests added=[] removed=[] 2024-09-05T01:16:18.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.152+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.0 2024-09-05T01:16:18.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.152+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.1 2024-09-05T01:16:18.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.152+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.2 2024-09-05T01:16:18.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.152+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.3 2024-09-05T01:16:18.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.152+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.4 2024-09-05T01:16:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.5 2024-09-05T01:16:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.6 2024-09-05T01:16:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.7 2024-09-05T01:16:18.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.8 2024-09-05T01:16:18.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.9 2024-09-05T01:16:18.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.156+0000 7f3d48abb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37.10 2024-09-05T01:16:18.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:18.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 2024-09-05T01:16:18.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.160+0000 7f3d48abb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37, ofs0, ns] 2024-09-05T01:16:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3c29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94024534708704 notifier 7887 bl.length()=899 2024-09-05T01:16:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3c29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 info.flags=0x17 2024-09-05T01:16:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3c29ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 to cache LRU end 2024-09-05T01:16:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3c29ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_sources= new_sources= 2024-09-05T01:16:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential sources added=[] removed=[] 2024-09-05T01:16:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): orig_dests= new_dests= 2024-09-05T01:16:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.164+0000 7f3d48abb9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37]): potential dests added=[] removed=[] 2024-09-05T01:16:18.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.172+0000 7f3d48abb9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-05T01:16:18.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.172+0000 7f3bfcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.180+0000 7f3d48abb9c0 20 remove_watcher() i=0 2024-09-05T01:16:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.180+0000 7f3d48abb9c0 2 removed watcher, disabling cache 2024-09-05T01:16:18.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.180+0000 7f3d48abb9c0 20 remove_watcher() i=1 2024-09-05T01:16:18.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.184+0000 7f3d48abb9c0 20 remove_watcher() i=2 2024-09-05T01:16:18.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.188+0000 7f3d48abb9c0 20 remove_watcher() i=3 2024-09-05T01:16:18.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.188+0000 7f3d48abb9c0 20 remove_watcher() i=4 2024-09-05T01:16:18.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.188+0000 7f3d48abb9c0 20 remove_watcher() i=5 2024-09-05T01:16:18.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.192+0000 7f3d48abb9c0 20 remove_watcher() i=6 2024-09-05T01:16:18.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.192+0000 7f3d48abb9c0 20 remove_watcher() i=7 2024-09-05T01:16:18.208 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-05T01:16:18.237 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:18.238 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:18.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.280+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 realm 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:18.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.284+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.288+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:18.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.288+0000 7fb333a509c0 20 searching for the correct realm 2024-09-05T01:16:18.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.292+0000 7fb331d57640 0 -- 172.21.15.99:0/4232068811 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb3280cf040 msgr2=0x7fb3280019a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:18.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.508+0000 7fb331d57640 0 -- 172.21.15.99:0/4232068811 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb3280cf040 msgr2=0x7fb3280019a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:18.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:18.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.520+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 zone default found 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 4 Realm: () 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 zonegroup default 2024-09-05T01:16:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:18.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 started sync module instance, tier type = 2024-09-05T01:16:18.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.524+0000 7fb333a509c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=0 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=1 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=2 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=3 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=4 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=5 2024-09-05T01:16:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=6 2024-09-05T01:16:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 20 add_watcher() i=7 2024-09-05T01:16:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.548+0000 7fb333a509c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.552+0000 7fb1e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:18.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:18.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:18.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 5 note: GC not initialized 2024-09-05T01:16:18.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb1e67e4640 20 reqs_thread_entry: start 2024-09-05T01:16:18.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:18.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 Filter name: none 2024-09-05T01:16:18.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb157fff640 20 reqs_thread_entry: start 2024-09-05T01:16:18.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.556+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.560+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:18.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.560+0000 7fb333a509c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:18.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.560+0000 7fb333a509c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:18.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.560+0000 7fb333a509c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:18.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.564+0000 7fb1e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:18.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.568+0000 7fb333a509c0 20 remove_watcher() i=0 2024-09-05T01:16:18.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.568+0000 7fb333a509c0 2 removed watcher, disabling cache 2024-09-05T01:16:18.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.568+0000 7fb333a509c0 20 remove_watcher() i=1 2024-09-05T01:16:18.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.572+0000 7fb333a509c0 20 remove_watcher() i=2 2024-09-05T01:16:18.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.572+0000 7fb333a509c0 20 remove_watcher() i=3 2024-09-05T01:16:18.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.576+0000 7fb333a509c0 20 remove_watcher() i=4 2024-09-05T01:16:18.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.580+0000 7fb333a509c0 20 remove_watcher() i=5 2024-09-05T01:16:18.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.580+0000 7fb333a509c0 20 remove_watcher() i=6 2024-09-05T01:16:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:18.580+0000 7fb333a509c0 20 remove_watcher() i=7 2024-09-05T01:16:18.596 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:18.596 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:18.596 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:16:18.596 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:19.481 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-05T01:16:19.481 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:21.650 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-05T01:16:21.682 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:21.683 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:21.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.727+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 realm 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:21.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:21.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.731+0000 7fb812fa49c0 20 searching for the correct realm 2024-09-05T01:16:21.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.739+0000 7fb8112ab640 0 -- 172.21.15.99:0/2331762795 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fb804028070 msgr2=0x7fb804038920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:21.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.743+0000 7fb810aaa640 0 -- 172.21.15.99:0/2331762795 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fb80804b920 msgr2=0x7fb808023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:21.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.751+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 zone default found 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 4 Realm: () 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 zonegroup default 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 started sync module instance, tier type = 2024-09-05T01:16:21.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.755+0000 7fb812fa49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:21.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=0 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=1 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=2 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=3 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=4 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=5 2024-09-05T01:16:21.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=6 2024-09-05T01:16:21.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 20 add_watcher() i=7 2024-09-05T01:16:21.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.771+0000 7fb812fa49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:21.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb6c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 5 note: GC not initialized 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb6c5fe3640 20 reqs_thread_entry: start 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:21.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 20 Filter name: none 2024-09-05T01:16:21.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb6377fe640 20 reqs_thread_entry: start 2024-09-05T01:16:21.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.775+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:21.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:21.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:21.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:21.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.779+0000 7fb812fa49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.783+0000 7fb812fa49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:21.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.783+0000 7fb812fa49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:21.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.787+0000 7fb6c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:21.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.791+0000 7fb812fa49c0 20 remove_watcher() i=0 2024-09-05T01:16:21.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.791+0000 7fb812fa49c0 2 removed watcher, disabling cache 2024-09-05T01:16:21.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.791+0000 7fb812fa49c0 20 remove_watcher() i=1 2024-09-05T01:16:21.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.795+0000 7fb812fa49c0 20 remove_watcher() i=2 2024-09-05T01:16:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.795+0000 7fb812fa49c0 20 remove_watcher() i=3 2024-09-05T01:16:21.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.799+0000 7fb812fa49c0 20 remove_watcher() i=4 2024-09-05T01:16:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.799+0000 7fb812fa49c0 20 remove_watcher() i=5 2024-09-05T01:16:21.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.803+0000 7fb812fa49c0 20 remove_watcher() i=6 2024-09-05T01:16:21.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.803+0000 7fb812fa49c0 20 remove_watcher() i=7 2024-09-05T01:16:21.815 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:21.816 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:21.816 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:16:21.816 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:21.816 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-05T01:16:21.850 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:21.851 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:21.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 realm 2024-09-05T01:16:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:21.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:21.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.895+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.899+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:21.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.899+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:21.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.899+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:21.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.899+0000 7fd9d38a49c0 20 searching for the correct realm 2024-09-05T01:16:21.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.903+0000 7fd9d1bab640 0 -- 172.21.15.99:0/536223434 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fd9bc0e4b60 msgr2=0x7fd9bc0b9450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:21.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:21.911+0000 7fd9d0ba9640 0 -- 172.21.15.99:0/536223434 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x7fd9bc0e4b60 msgr2=0x7fd89c085630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:22.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:22.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.127+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:22.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 zone default found 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 4 Realm: () 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 zonegroup default 2024-09-05T01:16:22.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.131+0000 7fd9d38a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.135+0000 7fd9d38a49c0 20 started sync module instance, tier type = 2024-09-05T01:16:22.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.135+0000 7fd9d38a49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:22.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=0 2024-09-05T01:16:22.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=1 2024-09-05T01:16:22.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=2 2024-09-05T01:16:22.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=3 2024-09-05T01:16:22.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=4 2024-09-05T01:16:22.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=5 2024-09-05T01:16:22.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=6 2024-09-05T01:16:22.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 20 add_watcher() i=7 2024-09-05T01:16:22.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.159+0000 7fd9d38a49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.163+0000 7fd887fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:22.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:22.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:22.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 5 note: GC not initialized 2024-09-05T01:16:22.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd886fe5640 20 reqs_thread_entry: start 2024-09-05T01:16:22.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:22.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 Filter name: none 2024-09-05T01:16:22.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd884fe1640 20 reqs_thread_entry: start 2024-09-05T01:16:22.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-05T01:16:22.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:22.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:22.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-05T01:16:22.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 : miss 2024-09-05T01:16:22.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.167+0000 7fd9d38a49c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.171+0000 7fd9d38a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 2024-09-05T01:16:22.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd9d38a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd9d38a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd9d38a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd9d38a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38, ofs0, ns] 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd8b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464350 cookie 94448076435552 notifier 7520 bl.length()=931 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd8b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd8b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.183+0000 7fd8b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.187+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_sources= new_sources= 2024-09-05T01:16:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.187+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential sources added=[] removed=[] 2024-09-05T01:16:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.187+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_dests= new_dests= 2024-09-05T01:16:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.187+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential dests added=[] removed=[] 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.0 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.0 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.1 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.1 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.2 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.2 2024-09-05T01:16:22.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.3 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.3 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.4 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.4 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.5 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.5 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.6 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.6 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.7 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.7 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.8 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.8 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.9 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.9 2024-09-05T01:16:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.10 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.10 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.11 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1.11 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.0 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1 2024-09-05T01:16:22.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.203+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.2 2024-09-05T01:16:22.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.207+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.3 2024-09-05T01:16:22.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.207+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.4 2024-09-05T01:16:22.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.207+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.5 2024-09-05T01:16:22.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.207+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.6 2024-09-05T01:16:22.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.211+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.7 2024-09-05T01:16:22.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.211+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.8 2024-09-05T01:16:22.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.211+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.9 2024-09-05T01:16:22.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.215+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.10 2024-09-05T01:16:22.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.223+0000 7fd9d38a49c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-05T01:16:22.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.223+0000 7fd9d38a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:22.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.223+0000 7fd9d38a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 2024-09-05T01:16:22.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd9d38a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd9d38a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd9d38a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd9d38a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38, ofs0, ns] 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd8b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464351 cookie 94448076435552 notifier 7520 bl.length()=931 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd8b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd8b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.227+0000 7fd8b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.231+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_sources= new_sources= 2024-09-05T01:16:22.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.231+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential sources added=[] removed=[] 2024-09-05T01:16:22.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.231+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_dests= new_dests= 2024-09-05T01:16:22.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.231+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential dests added=[] removed=[] 2024-09-05T01:16:22.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.235+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.0 2024-09-05T01:16:22.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.239+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.1 2024-09-05T01:16:22.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.239+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.2 2024-09-05T01:16:22.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.239+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.3 2024-09-05T01:16:22.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.239+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.4 2024-09-05T01:16:22.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.239+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.5 2024-09-05T01:16:22.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.243+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.6 2024-09-05T01:16:22.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.243+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.7 2024-09-05T01:16:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.243+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.8 2024-09-05T01:16:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.243+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.9 2024-09-05T01:16:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.243+0000 7fd9d38a49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38.10 2024-09-05T01:16:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.247+0000 7fd9d38a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.247+0000 7fd9d38a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 2024-09-05T01:16:22.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.247+0000 7fd9d38a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd9d38a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd9d38a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd9d38a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38, ofs0, ns] 2024-09-05T01:16:22.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd8b4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94448076435552 notifier 7520 bl.length()=899 2024-09-05T01:16:22.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd8b4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 info.flags=0x17 2024-09-05T01:16:22.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd8b4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 to cache LRU end 2024-09-05T01:16:22.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.251+0000 7fd8b4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:22.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.255+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_sources= new_sources= 2024-09-05T01:16:22.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.255+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential sources added=[] removed=[] 2024-09-05T01:16:22.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.255+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): orig_dests= new_dests= 2024-09-05T01:16:22.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.255+0000 7fd9d38a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38]): potential dests added=[] removed=[] 2024-09-05T01:16:22.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.259+0000 7fd9d38a49c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-05T01:16:22.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.263+0000 7fd887fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:22.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.267+0000 7fd9d38a49c0 20 remove_watcher() i=0 2024-09-05T01:16:22.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.267+0000 7fd9d38a49c0 2 removed watcher, disabling cache 2024-09-05T01:16:22.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.271+0000 7fd9d38a49c0 20 remove_watcher() i=1 2024-09-05T01:16:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.275+0000 7fd9d38a49c0 20 remove_watcher() i=2 2024-09-05T01:16:22.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.275+0000 7fd9d38a49c0 20 remove_watcher() i=3 2024-09-05T01:16:22.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.279+0000 7fd9d38a49c0 20 remove_watcher() i=4 2024-09-05T01:16:22.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.279+0000 7fd9d38a49c0 20 remove_watcher() i=5 2024-09-05T01:16:22.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.279+0000 7fd9d38a49c0 20 remove_watcher() i=6 2024-09-05T01:16:22.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.283+0000 7fd9d38a49c0 20 remove_watcher() i=7 2024-09-05T01:16:22.298 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-05T01:16:22.329 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:22.329 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:22.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.375+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 realm 2024-09-05T01:16:22.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:22.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:22.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:22.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.379+0000 7f8cabe229c0 20 searching for the correct realm 2024-09-05T01:16:22.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.387+0000 7f8ca9928640 0 -- 172.21.15.99:0/3280689912 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f8ca406afc0 msgr2=0x7f8ca4060e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:22.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.395+0000 7f8ca9928640 0 -- 172.21.15.99:0/3280689912 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f8ca4038730 msgr2=0x7f8ca4068bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.399+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 zone default found 2024-09-05T01:16:22.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 4 Realm: () 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 zonegroup default 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:22.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 started sync module instance, tier type = 2024-09-05T01:16:22.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.403+0000 7f8cabe229c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:22.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=0 2024-09-05T01:16:22.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=1 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=2 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=3 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=4 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=5 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=6 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 20 add_watcher() i=7 2024-09-05T01:16:22.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.419+0000 7f8cabe229c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 5 note: GC not initialized 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8b5a7fc640 20 reqs_thread_entry: start 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 Filter name: none 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8acbfff640 20 reqs_thread_entry: start 2024-09-05T01:16:22.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:22.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.423+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:22.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:22.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:22.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:22.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:22.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.427+0000 7f8cabe229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:22.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.431+0000 7f8b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.435+0000 7f8cabe229c0 20 remove_watcher() i=0 2024-09-05T01:16:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.435+0000 7f8cabe229c0 2 removed watcher, disabling cache 2024-09-05T01:16:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.435+0000 7f8cabe229c0 20 remove_watcher() i=1 2024-09-05T01:16:22.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.439+0000 7f8cabe229c0 20 remove_watcher() i=2 2024-09-05T01:16:22.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.439+0000 7f8cabe229c0 20 remove_watcher() i=3 2024-09-05T01:16:22.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.443+0000 7f8cabe229c0 20 remove_watcher() i=4 2024-09-05T01:16:22.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.443+0000 7f8cabe229c0 20 remove_watcher() i=5 2024-09-05T01:16:22.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.447+0000 7f8cabe229c0 20 remove_watcher() i=6 2024-09-05T01:16:22.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:22.447+0000 7f8cabe229c0 20 remove_watcher() i=7 2024-09-05T01:16:22.459 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:22.459 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:22.460 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-05T01:16:22.460 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:23.385 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-05T01:16:23.385 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:25.540 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-05T01:16:25.573 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:25.573 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:25.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.619+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 realm 2024-09-05T01:16:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:25.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:25.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:25.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:25.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.827+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:25.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.831+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:25.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.831+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:25.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.831+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:25.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.831+0000 7f3891b329c0 20 searching for the correct realm 2024-09-05T01:16:25.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.835+0000 7f388f638640 0 -- 172.21.15.99:0/307553599 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f3888008050 msgr2=0x7f3888061290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:25.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:25.843+0000 7f388f638640 0 -- 172.21.15.99:0/307553599 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x556b4e994c70 msgr2=0x7f38880830b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 zone default found 2024-09-05T01:16:26.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 4 Realm: () 2024-09-05T01:16:26.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 zonegroup default 2024-09-05T01:16:26.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.067+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.071+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.071+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.071+0000 7f3891b329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.071+0000 7f3891b329c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.071+0000 7f3891b329c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=0 2024-09-05T01:16:26.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=1 2024-09-05T01:16:26.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=2 2024-09-05T01:16:26.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=3 2024-09-05T01:16:26.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=4 2024-09-05T01:16:26.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=5 2024-09-05T01:16:26.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.095+0000 7f3891b329c0 20 add_watcher() i=6 2024-09-05T01:16:26.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.099+0000 7f3891b329c0 20 add_watcher() i=7 2024-09-05T01:16:26.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.099+0000 7f3891b329c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.099+0000 7f37467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 5 note: GC not initialized 2024-09-05T01:16:26.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f37457e2640 20 reqs_thread_entry: start 2024-09-05T01:16:26.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 Filter name: none 2024-09-05T01:16:26.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f373e7fc640 20 reqs_thread_entry: start 2024-09-05T01:16:26.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.103+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:26.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:26.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:26.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.107+0000 7f3891b329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:26.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.111+0000 7f37467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.123+0000 7f3891b329c0 20 remove_watcher() i=0 2024-09-05T01:16:26.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.123+0000 7f3891b329c0 2 removed watcher, disabling cache 2024-09-05T01:16:26.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.123+0000 7f3891b329c0 20 remove_watcher() i=1 2024-09-05T01:16:26.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.127+0000 7f3891b329c0 20 remove_watcher() i=2 2024-09-05T01:16:26.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.127+0000 7f3891b329c0 20 remove_watcher() i=3 2024-09-05T01:16:26.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.131+0000 7f3891b329c0 20 remove_watcher() i=4 2024-09-05T01:16:26.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.131+0000 7f3891b329c0 20 remove_watcher() i=5 2024-09-05T01:16:26.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.131+0000 7f3891b329c0 20 remove_watcher() i=6 2024-09-05T01:16:26.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.135+0000 7f3891b329c0 20 remove_watcher() i=7 2024-09-05T01:16:26.149 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.149 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:26.149 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:16:26.149 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.149 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-05T01:16:26.188 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:26.188 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:26.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 realm 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:26.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 searching for the correct realm 2024-09-05T01:16:26.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.243+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.459+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zone default found 2024-09-05T01:16:26.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Realm: () 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zonegroup default 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=0 2024-09-05T01:16:26.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=1 2024-09-05T01:16:26.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=2 2024-09-05T01:16:26.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=3 2024-09-05T01:16:26.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=4 2024-09-05T01:16:26.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=5 2024-09-05T01:16:26.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=6 2024-09-05T01:16:26.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.503+0000 7f08b7fe99c0 20 add_watcher() i=7 2024-09-05T01:16:26.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.503+0000 7f08b7fe99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f07677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 note: GC not initialized 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f07667fc640 20 reqs_thread_entry: start 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 Filter name: none 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f06d7fff640 20 reqs_thread_entry: start 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-05T01:16:26.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:26.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : miss 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:26.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:26.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94766173294032 notifier 7995 bl.length()=931 2024-09-05T01:16:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:26.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.0 2024-09-05T01:16:26.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1 2024-09-05T01:16:26.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2 2024-09-05T01:16:26.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.3 2024-09-05T01:16:26.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.4 2024-09-05T01:16:26.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.5 2024-09-05T01:16:26.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.6 2024-09-05T01:16:26.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.7 2024-09-05T01:16:26.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.8 2024-09-05T01:16:26.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.9 2024-09-05T01:16:26.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.547+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.10 2024-09-05T01:16:26.552 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f08b7fe99c0 time 2024-09-05T01:16:26.557299+0000 2024-09-05T01:16:26.552 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:26.553 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.553 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f08bb8c32eb] 2024-09-05T01:16:26.553 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.553 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f08b7fe99c0 thread_name:radosgw-admin 2024-09-05T01:16:26.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f08b7fe99c0 time 2024-09-05T01:16:26.557299+0000 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f08bb8c32eb] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.555 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:26.556 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:26.556 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f08ba742520] 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:26.565 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f08bb8c3345] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f08b7fe99c0 thread_name:radosgw-admin 2024-09-05T01:16:26.566 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f08ba742520] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f08bb8c3345] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:26.567 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: crc 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: secure 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: crc 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: secure 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: starting msgr at 2024-09-05T01:16:26.568 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: starting objecter 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests hook 0x563078088bc0 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: setting wanted keys 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: calling monclient init 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.569 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key hook 0x56307808b068 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:16:26.570 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563077f09370 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563077fd4260 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x563077fd7670 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.677114s 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x563077fd4260 auth_method 0 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.571 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563077f09370 auth_method 0 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-05T01:16:26.572 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:16:26.215+0000 7f08b52ee640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: dump: 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.573 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: dump: 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.574 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:16:26.215+0000 7f07a3e07640 4 set_mon_vals no callback set 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7986 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.575 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: init done 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:16:26.219+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f079c070ae0 auth_method 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:16:26.219+0000 7f08b62f0640 10 monclient: get_auth_request con 0x5630780c9030 auth_method 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:16:26.219+0000 7f08b5aef640 10 monclient: get_auth_request con 0x5630780d5bc0 auth_method 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:16:26.219+0000 7f08b52ee640 10 monclient: get_auth_request con 0x5630780d9f20 auth_method 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.576 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.577 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.578 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630780e2760 EEXIST 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.579 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x5630780dd4e0 EEXIST 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x563078106910 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563078106240 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563078104c20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.580 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.686738s 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): get_auth_request con 0x563078104c20 auth_method 0 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x563078106240 auth_method 0 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.581 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563078106910 auth_method 0 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_done global_id 7565 payload 824 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:16:26.223+0000 7f08b52ee640 1 monclient: found mon.noname-c 2024-09-05T01:16:26.582 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: dump: 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.583 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: dump: 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.584 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7565 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:16:26.223+0000 7f08b6af1640 4 set_mon_vals no callback set 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.585 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: get_monmap_and_config 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.586 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.587 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f0790070a20 auth_method 0 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.588 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.589 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc36f04a28 EEXIST 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x56307815a710 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x56307812a410 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563078127a20 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.590 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.690774s 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x56307815a710 auth_method 0 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): get_auth_request con 0x563078127a20 auth_method 0 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.591 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_done global_id 7992 payload 274 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:16:26.227+0000 7f08b5aef640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: dump: 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.592 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7992 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: dump: 2024-09-05T01:16:26.593 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: get_monmap_and_config success 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 4 set_mon_vals no callback set 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: shutdown 2024-09-05T01:16:26.594 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.595 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.596 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: starting msgr at 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: starting objecter 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630781058c0 EEXIST 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: setting wanted keys 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: calling monclient init 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.597 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.598 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x563078108878 EEXIST 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563078127a20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x56307812a410 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x56307815a710 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.693430s 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x56307812a410 auth_method 0 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.599 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563078127a20 auth_method 0 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.600 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:16:26.231+0000 7f08b5aef640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:16:26.231+0000 7f08b62f0640 10 monclient: get_auth_request con 0x56307815a710 auth_method 0 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: dump: 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.601 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: dump: 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.602 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7995 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:16:26.231+0000 7f07997fa640 4 set_mon_vals no callback set 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.603 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: init done 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cr dump hook 0x563077f44a58 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:16:26.235+0000 7f08b62f0640 10 monclient: get_auth_request con 0x563078175460 auth_method 0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:16:26.235+0000 7f08b52ee640 10 monclient: get_auth_request con 0x7f0780070b10 auth_method 0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 realm 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.604 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:16:26.235+0000 7f08b5aef640 10 monclient: get_auth_request con 0x563078179780 auth_method 0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:16:26.239+0000 7f08b52ee640 10 monclient: get_auth_request con 0x56307817cea0 auth_method 0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 searching for the correct realm 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:16:26.239+0000 7f08b62f0640 10 monclient: get_auth_request con 0x563078181c60 auth_method 0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:16:26.239+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f08b00c0040 auth_method 0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:16:26.239+0000 7f08b52ee640 10 monclient: get_auth_request con 0x7f08a8040070 auth_method 0 2024-09-05T01:16:26.605 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:16:26.243+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f08ac086040 auth_method 0 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:16:26.243+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:16:26.447+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f08ac086040 auth_method 0 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:16:26.451+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f08b00d1930 auth_method 0 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:16:26.459+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:16:26.459+0000 7f07877fe640 1 client.7995.objecter ms_handle_reset 0x7f08ac086040 session 0x7f08ac07b910 osd.4 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:16:26.459+0000 7f07877fe640 10 monclient: _renew_subs 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:16:26.459+0000 7f07877fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:16:26.459+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f0780080930 auth_method 0 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.606 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zone default found 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Realm: () 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zonegroup default 2024-09-05T01:16:26.607 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=0 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=1 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=2 2024-09-05T01:16:26.608 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=3 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=4 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=5 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=6 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:16:26.503+0000 7f08b7fe99c0 20 add_watcher() i=7 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:16:26.503+0000 7f08b7fe99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:16:26.507+0000 7f07677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.609 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache list hook 0x56307815e090 2024-09-05T01:16:26.610 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache inspect hook 0x56307815e090 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache erase hook 0x56307815e090 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache zap hook 0x56307815e090 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 note: GC not initialized 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:16:26.507+0000 7f07667fc640 20 reqs_thread_entry: start 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace show hook 0x7f08a8012070 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace history hook 0x7f08a8012070 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace active hook 0x7f08a8012070 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace active_short hook 0x7f08a8012070 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 Filter name: none 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:16:26.507+0000 7f06d7fff640 20 reqs_thread_entry: start 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.611 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : miss 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.612 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94766173294032 notifier 7995 bl.length()=931 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.613 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.614 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.0 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.3 2024-09-05T01:16:26.615 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.4 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.5 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.6 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.7 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.8 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.9 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:16:26.547+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.10 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f08b7fe99c0 time 2024-09-05T01:16:26.557299+0000 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f08bb8c32eb] 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.616 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f08b7fe99c0 thread_name:radosgw-admin 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f08ba742520] 2024-09-05T01:16:26.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f08bb8c3345] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:26.618 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:16:26.619 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:16:26.620 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:16:26.621 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:16:26.622 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:16:26.623 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:16:26.624 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:16:26.625 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f06d7fff640 / http_manager 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07667fc640 / http_manager 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07677fe640 / rgw_dt_lg_renew 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07877fe640 / ms_dispatch 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07997fa640 / io_context_pool 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f079b7fe640 / ms_dispatch 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07a2604640 / ms_dispatch 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07a3e07640 / io_context_pool 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b52ee640 / msgr-worker-2 2024-09-05T01:16:26.626 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b5aef640 / msgr-worker-1 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b62f0640 / msgr-worker-0 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b6af1640 / io_context_pool 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b7fe99c0 / radosgw-admin 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.134121.log 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: crc 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: secure 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: crc 2024-09-05T01:16:26.627 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780901d0) adding con mode: secure 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: starting msgr at 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: starting objecter 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests hook 0x563078088bc0 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: setting wanted keys 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: calling monclient init 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding auth protocol: cephx 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.628 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: crc 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 AuthRegistry(0x56307808af20) adding con mode: secure 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.629 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key hook 0x56307808b068 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563077f09370 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563077fd4260 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x563077fd7670 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.677114s 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x563077fd4260 auth_method 0 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.630 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563077f09370 auth_method 0 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:16:26.215+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.631 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient(hunting): handle_auth_done global_id 7986 payload 824 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:16:26.215+0000 7f08b52ee640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:16:26.215+0000 7f08b52ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: dump: 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.632 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:16:26.215+0000 7f07a2604640 10 monclient: dump: 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.633 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:16:26.215+0000 7f07a3e07640 4 set_mon_vals no callback set 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7986 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.634 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:16:26.215+0000 7f08b7fe99c0 1 librados: init done 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:16:26.219+0000 7f07a2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:16:26.219+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f079c070ae0 auth_method 0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:16:26.219+0000 7f08b62f0640 10 monclient: get_auth_request con 0x5630780c9030 auth_method 0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:16:26.219+0000 7f08b5aef640 10 monclient: get_auth_request con 0x5630780d5bc0 auth_method 0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:16:26.219+0000 7f08b52ee640 10 monclient: get_auth_request con 0x5630780d9f20 auth_method 0 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.635 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.636 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding auth protocol: cephx 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.637 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: crc 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dedd0) adding con mode: secure 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630780e2760 EEXIST 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding auth protocol: cephx 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.638 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: crc 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 AuthRegistry(0x5630780dd398) adding con mode: secure 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x5630780dd4e0 EEXIST 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.639 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x563078106910 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563078106240 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563078104c20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.686738s 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): get_auth_request con 0x563078104c20 auth_method 0 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.640 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x563078106240 auth_method 0 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:16:26.223+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563078106910 auth_method 0 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.641 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:16:26.223+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient(hunting): handle_auth_done global_id 7565 payload 824 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:16:26.223+0000 7f08b52ee640 1 monclient: found mon.noname-c 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:16:26.223+0000 7f08b52ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: dump: 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.642 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.643 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:16:26.223+0000 7f079b7fe640 10 monclient: dump: 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.644 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7565 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:16:26.223+0000 7f08b6af1640 4 set_mon_vals no callback set 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:16:26.223+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:16:26.227+0000 7f079b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: get_monmap_and_config 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.645 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.646 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding auth protocol: cephx 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: crc 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x563078126270) adding con mode: secure 2024-09-05T01:16:26.647 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f0790070a20 auth_method 0 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding auth protocol: cephx 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.648 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: crc 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f048e0) adding con mode: secure 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc36f04a28 EEXIST 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.649 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x56307815a710 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x56307812a410 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x563078127a20 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.653 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.690774s 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x56307815a710 auth_method 0 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): get_auth_request con 0x563078127a20 auth_method 0 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.654 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:16:26.227+0000 7f08b62f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient(hunting): handle_auth_done global_id 7992 payload 274 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:16:26.227+0000 7f08b5aef640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:16:26.227+0000 7f08b5aef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: dump: 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.655 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7992 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.656 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:16:26.227+0000 7f07997fa640 10 monclient: dump: 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.657 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 10 monclient: get_monmap_and_config success 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:16:26.227+0000 7f08b7fe99c0 4 set_mon_vals no callback set 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: shutdown 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: build_initial_monmap 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: monmap: 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.658 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding auth protocol: cephx 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.659 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: crc 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078156900) adding con mode: secure 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: starting msgr at 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: starting objecter 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command objecter_requests cmddesc objecter_requests hook 0x5630781058c0 EEXIST 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: setting wanted keys 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: calling monclient init 2024-09-05T01:16:26.660 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: init 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding auth protocol: cephx 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.661 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: crc 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 AuthRegistry(0x563078108730) adding con mode: secure 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command rotate-key cmddesc rotate-key hook 0x563078108878 EEXIST 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-a con 0x563078127a20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-c con 0x56307812a410 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): picked mon.noname-b con 0x56307815a710 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.662 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient(hunting): authenticate will time out at 2637.693430s 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): get_auth_request con 0x56307812a410 auth_method 0 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): get_auth_request con 0x563078127a20 auth_method 0 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.663 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:16:26.231+0000 7f08b52ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient: _finish_hunting 0 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:16:26.231+0000 7f08b5aef640 1 monclient: found mon.noname-a 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:16:26.231+0000 7f08b5aef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:16:26.231+0000 7f08b62f0640 10 monclient: get_auth_request con 0x56307815a710 auth_method 0 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:26.664 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: dump: 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: _finish_auth 0 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: _check_auth_tickets 2024-09-05T01:16:26.665 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:16:26.231+0000 7f07877fe640 10 monclient: dump: 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:26.666 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 monclient: authenticate success, global_id 7995 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:16:26.231+0000 7f07997fa640 4 set_mon_vals no callback set 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _renew_subs 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 1 librados: init done 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:16:26.231+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cr dump hook 0x563077f44a58 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.667 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:16:26.235+0000 7f07877fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:16:26.235+0000 7f08b62f0640 10 monclient: get_auth_request con 0x563078175460 auth_method 0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:16:26.235+0000 7f08b52ee640 10 monclient: get_auth_request con 0x7f0780070b10 auth_method 0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 realm 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:16:26.235+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.668 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:16:26.235+0000 7f08b5aef640 10 monclient: get_auth_request con 0x563078179780 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:16:26.239+0000 7f08b52ee640 10 monclient: get_auth_request con 0x56307817cea0 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:16:26.239+0000 7f08b7fe99c0 20 searching for the correct realm 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:16:26.239+0000 7f08b62f0640 10 monclient: get_auth_request con 0x563078181c60 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:16:26.239+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f08b00c0040 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:16:26.239+0000 7f08b52ee640 10 monclient: get_auth_request con 0x7f08a8040070 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:16:26.243+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f08ac086040 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:16:26.243+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:16:26.447+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f08ac086040 auth_method 0 2024-09-05T01:16:26.669 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:16:26.451+0000 7f08b5aef640 10 monclient: get_auth_request con 0x7f08b00d1930 auth_method 0 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:16:26.459+0000 7f08b62f0640 0 -- 172.21.15.99:0/497877512 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f08ac086040 msgr2=0x7f08ac04aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:16:26.459+0000 7f07877fe640 1 client.7995.objecter ms_handle_reset 0x7f08ac086040 session 0x7f08ac07b910 osd.4 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:16:26.459+0000 7f07877fe640 10 monclient: _renew_subs 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:16:26.459+0000 7f07877fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:16:26.459+0000 7f08b62f0640 10 monclient: get_auth_request con 0x7f0780080930 auth_method 0 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.670 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:16:26.471+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zone default found 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Realm: () 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 zonegroup default 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.671 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:16:26.475+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:16:26.479+0000 7f08b7fe99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=0 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=1 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=2 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=3 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=4 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=5 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:16:26.499+0000 7f08b7fe99c0 20 add_watcher() i=6 2024-09-05T01:16:26.672 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:16:26.503+0000 7f08b7fe99c0 20 add_watcher() i=7 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:16:26.503+0000 7f08b7fe99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding auth protocol: cephx 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:16:26.507+0000 7f07677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.673 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: crc 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 AuthRegistry(0x7ffc36f04dc0) adding con mode: secure 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache list hook 0x56307815e090 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache inspect hook 0x56307815e090 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache erase hook 0x56307815e090 2024-09-05T01:16:26.674 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command cache zap hook 0x56307815e090 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 note: GC not initialized 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:16:26.507+0000 7f07667fc640 20 reqs_thread_entry: start 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace show hook 0x7f08a8012070 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace history hook 0x7f08a8012070 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace active hook 0x7f08a8012070 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 5 asok(0x563077e812b0) register_command sync trace active_short hook 0x7f08a8012070 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 Filter name: none 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:16:26.507+0000 7f06d7fff640 20 reqs_thread_entry: start 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.675 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : miss 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:16:26.507+0000 7f08b7fe99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.676 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:16:26.519+0000 7f08b7fe99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94766173294032 notifier 7995 bl.length()=931 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:16:26.519+0000 7f07997fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:16:26.523+0000 7f08b7fe99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.0 2024-09-05T01:16:26.677 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.1 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.2 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.3 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.4 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.5 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.6 2024-09-05T01:16:26.678 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.7 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.8 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.9 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.10 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1.11 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.0 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:16:26.535+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2 2024-09-05T01:16:26.679 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.3 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.4 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.5 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:16:26.539+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.6 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.7 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.8 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:16:26.543+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.9 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:16:26.547+0000 7f08b7fe99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.10 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f08b7fe99c0 time 2024-09-05T01:16:26.557299+0000 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.680 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f08bb8c32eb] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:16:26.555+0000 7f08b7fe99c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f08b7fe99c0 thread_name:radosgw-admin 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.681 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f08ba742520] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f08bb8c3345] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f08bb8c349f] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563075da5681] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x563075db9e68] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563075dbb4b4] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f08ba729d90] 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:26.682 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:16:26.683 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:16:26.684 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:16:26.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:16:26.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:16:26.687 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:16:26.688 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:16:26.689 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f06d7fff640 / http_manager 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07667fc640 / http_manager 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07677fe640 / rgw_dt_lg_renew 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07877fe640 / ms_dispatch 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07997fa640 / io_context_pool 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f079b7fe640 / ms_dispatch 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07a2604640 / ms_dispatch 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f07a3e07640 / io_context_pool 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b52ee640 / msgr-worker-2 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b5aef640 / msgr-worker-1 2024-09-05T01:16:26.690 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b62f0640 / msgr-worker-0 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b6af1640 / io_context_pool 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr: 7f08b7fe99c0 / radosgw-admin 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:16:26.559674Z_b211b861-5feb-4374-a402-29c4e8e94719/log 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:16:26.691 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 realm 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.639+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.643+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.643+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.643+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.643+0000 7f8f58ce99c0 20 searching for the correct realm 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.647+0000 7f8f56ff0640 0 -- 172.21.15.99:0/321450661 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8f4c04d060 msgr2=0x7f8f4c09d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.655+0000 7f8f56ff0640 0 -- 172.21.15.99:0/321450661 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8e20080900 msgr2=0x7f8e20082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.663+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 zone default found 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 4 Realm: () 2024-09-05T01:16:26.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 zonegroup default 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.667+0000 7f8f58ce99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=0 2024-09-05T01:16:26.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=1 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=2 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=3 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=4 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=5 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=6 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 20 add_watcher() i=7 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.683+0000 7f8f58ce99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 5 note: GC not initialized 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8d877fe640 20 reqs_thread_entry: start 2024-09-05T01:16:26.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 Filter name: none 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8d857fa640 20 reqs_thread_entry: start 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.687+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.691+0000 7f8f58ce99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:26.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.695+0000 7f8e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.699+0000 7f8f58ce99c0 20 remove_watcher() i=0 2024-09-05T01:16:26.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.699+0000 7f8f58ce99c0 2 removed watcher, disabling cache 2024-09-05T01:16:26.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.699+0000 7f8f58ce99c0 20 remove_watcher() i=1 2024-09-05T01:16:26.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.703+0000 7f8f58ce99c0 20 remove_watcher() i=2 2024-09-05T01:16:26.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.707+0000 7f8f58ce99c0 20 remove_watcher() i=3 2024-09-05T01:16:26.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.707+0000 7f8f58ce99c0 20 remove_watcher() i=4 2024-09-05T01:16:26.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.707+0000 7f8f58ce99c0 20 remove_watcher() i=5 2024-09-05T01:16:26.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.711+0000 7f8f58ce99c0 20 remove_watcher() i=6 2024-09-05T01:16:26.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.711+0000 7f8f58ce99c0 20 remove_watcher() i=7 2024-09-05T01:16:26.723 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.723 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:26.724 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-05T01:16:26.724 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:26.854 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:16:26.891 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:26.891 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:26.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.935+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 realm 2024-09-05T01:16:26.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:26.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.939+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.943+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:26.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.943+0000 7fcd948599c0 20 searching for the correct realm 2024-09-05T01:16:26.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.947+0000 7fcd92b60640 0 -- 172.21.15.99:0/3686836474 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5590bf3c4bf0 msgr2=0x5590bf3c70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.955+0000 7fcd9235f640 0 -- 172.21.15.99:0/3686836474 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fcd8c01f040 msgr2=0x7fcd8c01f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:26.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:26.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:26.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:26.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:26.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:26.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:26.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.959+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:26.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:26.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 zone default found 2024-09-05T01:16:26.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 4 Realm: () 2024-09-05T01:16:26.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:26.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:26.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:26.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 zonegroup default 2024-09-05T01:16:26.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:26.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 started sync module instance, tier type = 2024-09-05T01:16:26.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.963+0000 7fcd948599c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:26.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=0 2024-09-05T01:16:26.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=1 2024-09-05T01:16:26.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=2 2024-09-05T01:16:26.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=3 2024-09-05T01:16:26.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=4 2024-09-05T01:16:26.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=5 2024-09-05T01:16:26.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=6 2024-09-05T01:16:26.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 20 add_watcher() i=7 2024-09-05T01:16:26.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.979+0000 7fcd948599c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:26.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcc48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 5 note: GC not initialized 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcbc37fe640 20 reqs_thread_entry: start 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 Filter name: none 2024-09-05T01:16:26.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcbc17fa640 20 reqs_thread_entry: start 2024-09-05T01:16:26.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-05T01:16:26.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:26.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:26.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : miss 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.983+0000 7fcd948599c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:26.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:26.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:26.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:26.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.987+0000 7fcd948599c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to be held by another RGW process; skipping for now 2024-09-05T01:16:26.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.991+0000 7fcc48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:26.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.995+0000 7fcd948599c0 20 remove_watcher() i=0 2024-09-05T01:16:26.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.995+0000 7fcd948599c0 2 removed watcher, disabling cache 2024-09-05T01:16:26.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.995+0000 7fcd948599c0 20 remove_watcher() i=1 2024-09-05T01:16:26.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.999+0000 7fcd948599c0 20 remove_watcher() i=2 2024-09-05T01:16:26.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:26.999+0000 7fcd948599c0 20 remove_watcher() i=3 2024-09-05T01:16:27.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:27.003+0000 7fcd948599c0 20 remove_watcher() i=4 2024-09-05T01:16:27.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:27.003+0000 7fcd948599c0 20 remove_watcher() i=5 2024-09-05T01:16:27.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:27.007+0000 7fcd948599c0 20 remove_watcher() i=6 2024-09-05T01:16:27.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:27.007+0000 7fcd948599c0 20 remove_watcher() i=7 2024-09-05T01:16:27.018 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-05T01:16:57.021 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-05T01:16:57.058 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:57.059 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:57.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.102+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 realm 2024-09-05T01:16:57.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:57.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:57.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:57.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.106+0000 7f6f36b759c0 20 searching for the correct realm 2024-09-05T01:16:57.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.110+0000 7f6f34e7c640 0 -- 172.21.15.99:0/3805730489 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6f28019040 msgr2=0x7f6f2802a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:57.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.122+0000 7f6f34e7c640 0 -- 172.21.15.99:0/3805730489 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6dfc080830 msgr2=0x7f6dfc082c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:57.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:57.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:57.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.126+0000 7f6f36b759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:57.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 zone default found 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 4 Realm: () 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:57.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 zonegroup default 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 started sync module instance, tier type = 2024-09-05T01:16:57.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.130+0000 7f6f36b759c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=0 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=1 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=2 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=3 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=4 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=5 2024-09-05T01:16:57.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=6 2024-09-05T01:16:57.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 20 add_watcher() i=7 2024-09-05T01:16:57.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.150+0000 7f6f36b759c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:57.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6deb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:57.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:57.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:57.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 5 note: GC not initialized 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6dea7dc640 20 reqs_thread_entry: start 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 Filter name: none 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6de37fe640 20 reqs_thread_entry: start 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-05T01:16:57.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:57.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-05T01:16:57.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-05T01:16:57.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : miss 2024-09-05T01:16:57.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.154+0000 7f6f36b759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:57.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.158+0000 7f6f36b759c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:16:57.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6f36b759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6f36b759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6f36b759c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6f36b759c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:57.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6e0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94459103447120 notifier 8052 bl.length()=931 2024-09-05T01:16:57.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6e0b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6e0b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.174+0000 7f6e0b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.178+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:57.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.178+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:57.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.178+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:57.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.178+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.0 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.0 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.1 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.1 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.2 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.2 2024-09-05T01:16:57.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.3 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.3 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.4 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.4 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.5 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.5 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.6 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.6 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.7 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.7 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.8 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.8 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.9 2024-09-05T01:16:57.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.9 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.10 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.10 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.11 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2.11 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.0 2024-09-05T01:16:57.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1 2024-09-05T01:16:57.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2 2024-09-05T01:16:57.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.190+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.3 2024-09-05T01:16:57.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.194+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.4 2024-09-05T01:16:57.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.194+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.5 2024-09-05T01:16:57.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.194+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.6 2024-09-05T01:16:57.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.194+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.7 2024-09-05T01:16:57.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.194+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.8 2024-09-05T01:16:57.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.198+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.9 2024-09-05T01:16:57.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.198+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.10 2024-09-05T01:16:57.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:57.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:57.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6f36b759c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:57.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6e0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94459103447120 notifier 8052 bl.length()=931 2024-09-05T01:16:57.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6e0b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6e0b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.206+0000 7f6e0b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.210+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:57.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.210+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:57.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.210+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:57.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.210+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:57.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.214+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.0 2024-09-05T01:16:57.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.1 2024-09-05T01:16:57.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.2 2024-09-05T01:16:57.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.3 2024-09-05T01:16:57.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.4 2024-09-05T01:16:57.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.5 2024-09-05T01:16:57.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.6 2024-09-05T01:16:57.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.7 2024-09-05T01:16:57.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.218+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.8 2024-09-05T01:16:57.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.222+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.9 2024-09-05T01:16:57.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.222+0000 7f6f36b759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39.10 2024-09-05T01:16:57.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.222+0000 7f6f36b759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 : hit (requested=0x17, cached=0x17) 2024-09-05T01:16:57.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.222+0000 7f6f36b759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39, ofs0, ns] 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6e0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94459103447120 notifier 8052 bl.length()=899 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6e0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 info.flags=0x17 2024-09-05T01:16:57.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6e0affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 to cache LRU end 2024-09-05T01:16:57.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6e0affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-05T01:16:57.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_sources= new_sources= 2024-09-05T01:16:57.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential sources added=[] removed=[] 2024-09-05T01:16:57.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): orig_dests= new_dests= 2024-09-05T01:16:57.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.226+0000 7f6f36b759c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39]): potential dests added=[] removed=[] 2024-09-05T01:16:57.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.234+0000 7f6f36b759c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-05T01:16:57.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.238+0000 7f6deb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:57.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.242+0000 7f6f36b759c0 20 remove_watcher() i=0 2024-09-05T01:16:57.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.242+0000 7f6f36b759c0 2 removed watcher, disabling cache 2024-09-05T01:16:57.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.246+0000 7f6f36b759c0 20 remove_watcher() i=1 2024-09-05T01:16:57.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.246+0000 7f6f36b759c0 20 remove_watcher() i=2 2024-09-05T01:16:57.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.250+0000 7f6f36b759c0 20 remove_watcher() i=3 2024-09-05T01:16:57.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.250+0000 7f6f36b759c0 20 remove_watcher() i=4 2024-09-05T01:16:57.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.254+0000 7f6f36b759c0 20 remove_watcher() i=5 2024-09-05T01:16:57.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.254+0000 7f6f36b759c0 20 remove_watcher() i=6 2024-09-05T01:16:57.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.254+0000 7f6f36b759c0 20 remove_watcher() i=7 2024-09-05T01:16:57.271 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-05T01:16:57.301 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:57.301 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:57.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.342+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 realm 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:57.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.346+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.350+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:57.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.350+0000 7f64f17b59c0 20 searching for the correct realm 2024-09-05T01:16:57.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.354+0000 7f64efabc640 0 -- 172.21.15.99:0/2456596728 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x557700099670 msgr2=0x55770009ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:57.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.362+0000 7f64efabc640 0 -- 172.21.15.99:0/2456596728 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f63b8080930 msgr2=0x7f63b8082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:57.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.366+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 zone default found 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 4 Realm: () 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 zonegroup default 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:57.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 started sync module instance, tier type = 2024-09-05T01:16:57.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.370+0000 7f64f17b59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=0 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=1 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=2 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=3 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=4 2024-09-05T01:16:57.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=5 2024-09-05T01:16:57.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=6 2024-09-05T01:16:57.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 20 add_watcher() i=7 2024-09-05T01:16:57.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.386+0000 7f64f17b59c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:57.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f63a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:57.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:57.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 5 note: GC not initialized 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f63a4fe1640 20 reqs_thread_entry: start 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 Filter name: none 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f631e7fc640 20 reqs_thread_entry: start 2024-09-05T01:16:57.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:57.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.390+0000 7f64f17b59c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.394+0000 7f64f17b59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-05T01:16:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.394+0000 7f64f17b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.394+0000 7f63a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:57.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.398+0000 7f64f17b59c0 20 remove_watcher() i=0 2024-09-05T01:16:57.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.398+0000 7f64f17b59c0 2 removed watcher, disabling cache 2024-09-05T01:16:57.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.402+0000 7f64f17b59c0 20 remove_watcher() i=1 2024-09-05T01:16:57.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.402+0000 7f64f17b59c0 20 remove_watcher() i=2 2024-09-05T01:16:57.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.406+0000 7f64f17b59c0 20 remove_watcher() i=3 2024-09-05T01:16:57.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.406+0000 7f64f17b59c0 20 remove_watcher() i=4 2024-09-05T01:16:57.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.410+0000 7f64f17b59c0 20 remove_watcher() i=5 2024-09-05T01:16:57.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.410+0000 7f64f17b59c0 20 remove_watcher() i=6 2024-09-05T01:16:57.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:57.410+0000 7f64f17b59c0 20 remove_watcher() i=7 2024-09-05T01:16:57.425 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:57.425 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:57.425 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-change-reshard-state id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-05T01:16:57.425 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:58.309 INFO:tasks.workunit.client.0.smithi099.stderr: test: logrecord could be stopped after reshard failed 2024-09-05T01:16:58.309 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:16:58.342 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:58.342 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:58.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.386+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 realm 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:58.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:58.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.390+0000 7f6193c359c0 20 searching for the correct realm 2024-09-05T01:16:58.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.394+0000 7f6191f3c640 0 -- 172.21.15.99:0/3914770467 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f61880c0020 msgr2=0x7f61880b8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:58.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.610+0000 7f6191f3c640 0 -- 172.21.15.99:0/3914770467 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f61880c0020 msgr2=0x7f61880b8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:58.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:58.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 zone default found 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 4 Realm: () 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:58.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 zonegroup default 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.622+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 started sync module instance, tier type = 2024-09-05T01:16:58.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.626+0000 7f6193c359c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=0 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=1 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=2 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=3 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=4 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=5 2024-09-05T01:16:58.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=6 2024-09-05T01:16:58.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 20 add_watcher() i=7 2024-09-05T01:16:58.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.650+0000 7f6193c359c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:58.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f60477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:58.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:58.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:58.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 5 note: GC not initialized 2024-09-05T01:16:58.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f60467e4640 20 reqs_thread_entry: start 2024-09-05T01:16:58.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:58.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 20 Filter name: none 2024-09-05T01:16:58.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f5fb7fff640 20 reqs_thread_entry: start 2024-09-05T01:16:58.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.654+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:58.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:58.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:58.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:58.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.658+0000 7f6193c359c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.662+0000 7f6193c359c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:58.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.662+0000 7f6193c359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:58.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.662+0000 7f60477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:58.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.670+0000 7f6193c359c0 20 remove_watcher() i=0 2024-09-05T01:16:58.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.670+0000 7f6193c359c0 2 removed watcher, disabling cache 2024-09-05T01:16:58.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.670+0000 7f6193c359c0 20 remove_watcher() i=1 2024-09-05T01:16:58.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.674+0000 7f6193c359c0 20 remove_watcher() i=2 2024-09-05T01:16:58.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.674+0000 7f6193c359c0 20 remove_watcher() i=3 2024-09-05T01:16:58.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.678+0000 7f6193c359c0 20 remove_watcher() i=4 2024-09-05T01:16:58.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.678+0000 7f6193c359c0 20 remove_watcher() i=5 2024-09-05T01:16:58.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.682+0000 7f6193c359c0 20 remove_watcher() i=6 2024-09-05T01:16:58.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.682+0000 7f6193c359c0 20 remove_watcher() i=7 2024-09-05T01:16:58.699 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:16:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-05T01:16:58.699 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:58.700 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:16:58.726 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:58.727 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:58.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 realm 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:58.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.770+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:58.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:58.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.774+0000 7f275f53d9c0 20 searching for the correct realm 2024-09-05T01:16:58.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.778+0000 7f275d844640 0 -- 172.21.15.99:0/405991552 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f27540e0030 msgr2=0x7f27540e2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:58.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:58.994+0000 7f275d844640 0 -- 172.21.15.99:0/405991552 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f27540e0030 msgr2=0x7f27540e2460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 zone default found 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 4 Realm: () 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 zonegroup default 2024-09-05T01:16:59.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.006+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.010+0000 7f275f53d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=0 2024-09-05T01:16:59.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=1 2024-09-05T01:16:59.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=2 2024-09-05T01:16:59.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=3 2024-09-05T01:16:59.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=4 2024-09-05T01:16:59.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=5 2024-09-05T01:16:59.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=6 2024-09-05T01:16:59.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 20 add_watcher() i=7 2024-09-05T01:16:59.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.034+0000 7f275f53d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.038+0000 7f26137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 5 note: GC not initialized 2024-09-05T01:16:59.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f26127e4640 20 reqs_thread_entry: start 2024-09-05T01:16:59.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 Filter name: none 2024-09-05T01:16:59.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f2583fff640 20 reqs_thread_entry: start 2024-09-05T01:16:59.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:59.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:59.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.042+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.046+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.046+0000 7f275f53d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.046+0000 7f275f53d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:59.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.046+0000 7f275f53d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:59.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.050+0000 7f26137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.054+0000 7f275f53d9c0 20 remove_watcher() i=0 2024-09-05T01:16:59.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.054+0000 7f275f53d9c0 2 removed watcher, disabling cache 2024-09-05T01:16:59.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.058+0000 7f275f53d9c0 20 remove_watcher() i=1 2024-09-05T01:16:59.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.058+0000 7f275f53d9c0 20 remove_watcher() i=2 2024-09-05T01:16:59.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.062+0000 7f275f53d9c0 20 remove_watcher() i=3 2024-09-05T01:16:59.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.062+0000 7f275f53d9c0 20 remove_watcher() i=4 2024-09-05T01:16:59.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.066+0000 7f275f53d9c0 20 remove_watcher() i=5 2024-09-05T01:16:59.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.066+0000 7f275f53d9c0 20 remove_watcher() i=6 2024-09-05T01:16:59.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.066+0000 7f275f53d9c0 20 remove_watcher() i=7 2024-09-05T01:16:59.084 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-05T01:16:59.120 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:59.121 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:59.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.162+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 realm 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:59.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:59.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 searching for the correct realm 2024-09-05T01:16:59.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.174+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7a180ad610 msgr2=0x7f7a180ad030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.178+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f78f0080880 msgr2=0x7f78f0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zone default found 2024-09-05T01:16:59.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Realm: () 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zonegroup default 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=0 2024-09-05T01:16:59.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=1 2024-09-05T01:16:59.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=2 2024-09-05T01:16:59.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=3 2024-09-05T01:16:59.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=4 2024-09-05T01:16:59.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=5 2024-09-05T01:16:59.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=6 2024-09-05T01:16:59.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=7 2024-09-05T01:16:59.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.206+0000 7f7a26eac9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f78db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 note: GC not initialized 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f78da7e4640 20 reqs_thread_entry: start 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 Filter name: none 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f78d37fe640 20 reqs_thread_entry: start 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:16:59.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:16:59.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:16:59.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:16:59.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:16:59.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:16:59.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94740598469936 notifier 7685 bl.length()=827 2024-09-05T01:16:59.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:16:59.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:16:59.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:16:59.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:16:59.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.253 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a26eac9c0 time 2024-09-05T01:16:59.258526+0000 2024-09-05T01:16:59.253 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:59.254 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a2a7862eb] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a26eac9c0 time 2024-09-05T01:16:59.258526+0000 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:59.255 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a2a7862eb] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:16:59.256 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a26eac9c0 thread_name:radosgw-admin 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a29605520] 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a2a786345] 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.272 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a26eac9c0 thread_name:radosgw-admin 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a29605520] 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:59.273 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a2a786345] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:16:59.274 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key hook 0x562a83a7eab8 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a8390bdb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a839ca850 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.275 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83a81c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.608627s 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a839ca850 auth_method 0 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a8390bdb0 auth_method 0 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.276 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 8121 payload 824 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:16:59.146+0000 7f7a241b1640 1 monclient: found mon.noname-a 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:16:59.146+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83a81c80 auth_method 0 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:59.277 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: dump: 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.278 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: dump: 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 8121 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:16:59.146+0000 7f7912e0d640 4 set_mon_vals no callback set 2024-09-05T01:16:59.279 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 1 librados: init done 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f790c070ae0 auth_method 0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:16:59.150+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83aa7170 auth_method 0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:16:59.150+0000 7f7a249b2640 10 monclient: get_auth_request con 0x562a83ac99f0 auth_method 0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:16:59.150+0000 7f7a241b1640 10 monclient: get_auth_request con 0x562a83acdd50 auth_method 0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.280 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.281 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a83ad6470 EEXIST 2024-09-05T01:16:59.282 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.283 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x562a83ad1150 EEXIST 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83afa620 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83af9f50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83af8930 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.284 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.617988s 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a83afa620 auth_method 0 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): get_auth_request con 0x562a83af8930 auth_method 0 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.285 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83af9f50 auth_method 0 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_done global_id 8124 payload 824 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:16:59.154+0000 7f7a249b2640 1 monclient: found mon.noname-a 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: dump: 2024-09-05T01:16:59.286 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.287 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: dump: 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:16:59.154+0000 7f7a259b4640 4 set_mon_vals no callback set 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 8124 2024-09-05T01:16:59.288 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: get_monmap_and_config 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.289 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.290 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: get_auth_request con 0x7f78fc070a20 auth_method 0 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.291 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.292 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x7ffea89af2d8 EEXIST 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83b1dfe0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83b49840 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83b40000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.622390s 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83b49840 auth_method 0 2024-09-05T01:16:59.293 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): get_auth_request con 0x562a83b40000 auth_method 0 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.294 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 7682 payload 274 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:16:59.158+0000 7f7a241b1640 1 monclient: found mon.noname-c 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: dump: 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.295 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 7682 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 4 set_mon_vals no callback set 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: dump: 2024-09-05T01:16:59.296 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: shutdown 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.297 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.298 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.299 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: starting msgr at 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: starting objecter 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a83b1c3d0 EEXIST 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: setting wanted keys 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: calling monclient init 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.300 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.301 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x562a83afc588 EEXIST 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83b1dfe0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83b40000 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83b49840 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.624951s 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83b40000 auth_method 0 2024-09-05T01:16:59.302 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a83b1dfe0 auth_method 0 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 7685 payload 824 2024-09-05T01:16:59.303 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:16:59.162+0000 7f7a241b1640 1 monclient: found mon.noname-c 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: dump: 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.304 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: dump: 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.305 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:16:59.162+0000 7f78fbfff640 4 set_mon_vals no callback set 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 7685 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: init done 2024-09-05T01:16:59.306 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cr dump hook 0x562a83b47b38 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:16:59.166+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f78f0070ae0 auth_method 0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:16:59.166+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83b67680 auth_method 0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 realm 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:59.307 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:16:59.166+0000 7f7a249b2640 10 monclient: get_auth_request con 0x562a83b6b940 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:16:59.166+0000 7f7a241b1640 10 monclient: get_auth_request con 0x562a83b6f080 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 searching for the correct realm 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:16:59.166+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83b73e20 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:16:59.170+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f7a1c00fb50 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:16:59.170+0000 7f7a241b1640 10 monclient: get_auth_request con 0x7f7a14034060 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:16:59.170+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f7a180ad610 auth_method 0 2024-09-05T01:16:59.308 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:16:59.174+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7a180ad610 msgr2=0x7f7a180ad030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 1 client.7685.objecter ms_handle_reset 0x7f7a180ad610 session 0x7f7a180a6070 osd.4 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 10 monclient: _renew_subs 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:16:59.174+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f78f0080880 auth_method 0 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:16:59.174+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f7a1c025410 auth_method 0 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:16:59.178+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f78f0080880 msgr2=0x7f78f0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:16:59.178+0000 7f78fa7fc640 1 client.7685.objecter ms_handle_reset 0x7f78f0080880 session 0x7f7a180a6070 osd.4 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:16:59.178+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f7a180ad610 auth_method 0 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.309 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zone default found 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Realm: () 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.310 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zonegroup default 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=0 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=1 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=2 2024-09-05T01:16:59.311 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=3 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=4 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=5 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=6 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=7 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.312 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:16:59.210+0000 7f78db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.313 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache list hook 0x562a83b3dd50 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache inspect hook 0x562a83b3dd50 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache erase hook 0x562a83b3dd50 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache zap hook 0x562a83b3dd50 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 note: GC not initialized 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:16:59.210+0000 7f78da7e4640 20 reqs_thread_entry: start 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace show hook 0x7f7a140045d0 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace history hook 0x7f7a140045d0 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace active hook 0x7f7a140045d0 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace active_short hook 0x7f7a140045d0 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 Filter name: none 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:16:59.210+0000 7f78d37fe640 20 reqs_thread_entry: start 2024-09-05T01:16:59.314 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:16:59.315 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94740598469936 notifier 7685 bl.length()=827 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.316 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.317 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.318 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.319 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.320 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a26eac9c0 time 2024-09-05T01:16:59.258526+0000 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a2a7862eb] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:59.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a26eac9c0 thread_name:radosgw-admin 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a29605520] 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a2a786345] 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.322 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:16:59.323 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:16:59.324 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:16:59.325 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:16:59.326 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:16:59.327 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:16:59.328 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:16:59.329 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78d37fe640 / http_manager 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78da7e4640 / http_manager 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78db7e6640 / rgw_dt_lg_renew 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fa7fc640 / ms_dispatch 2024-09-05T01:16:59.330 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fb7fe640 / io_context_pool 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fbfff640 / io_context_pool 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f790a7fc640 / ms_dispatch 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791160a640 / ms_dispatch 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7912e0d640 / io_context_pool 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a241b1640 / msgr-worker-2 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a249b2640 / msgr-worker-1 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a251b3640 / msgr-worker-0 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a259b4640 / io_context_pool 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a26eac9c0 / radosgw-admin 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.138251.log 2024-09-05T01:16:59.331 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: crc 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83a7e970) adding con mode: secure 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key hook 0x562a83a7eab8 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:16:59.332 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a8390bdb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a839ca850 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83a81c80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.608627s 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a839ca850 auth_method 0 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a8390bdb0 auth_method 0 2024-09-05T01:16:59.333 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 8121 payload 824 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:16:59.146+0000 7f7a241b1640 1 monclient: found mon.noname-a 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:16:59.146+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:16:59.146+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83a81c80 auth_method 0 2024-09-05T01:16:59.334 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: dump: 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.335 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:16:59.146+0000 7f791160a640 10 monclient: dump: 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.336 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 8121 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:16:59.146+0000 7f7912e0d640 4 set_mon_vals no callback set 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:16:59.146+0000 7f7a26eac9c0 1 librados: init done 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:16:59.146+0000 7f791160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:16:59.146+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f790c070ae0 auth_method 0 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:16:59.150+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83aa7170 auth_method 0 2024-09-05T01:16:59.337 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:16:59.150+0000 7f7a249b2640 10 monclient: get_auth_request con 0x562a83ac99f0 auth_method 0 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:16:59.150+0000 7f7a241b1640 10 monclient: get_auth_request con 0x562a83acdd50 auth_method 0 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.338 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding auth protocol: cephx 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.339 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: crc 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad2aa0) adding con mode: secure 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a83ad6470 EEXIST 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding auth protocol: cephx 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.340 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: crc 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83ad1008) adding con mode: secure 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x562a83ad1150 EEXIST 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83afa620 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.341 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83af9f50 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83af8930 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.617988s 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a83afa620 auth_method 0 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): get_auth_request con 0x562a83af8930 auth_method 0 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.342 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:16:59.154+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83af9f50 auth_method 0 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:16:59.154+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.343 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient(hunting): handle_auth_done global_id 8124 payload 824 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:16:59.154+0000 7f7a249b2640 1 monclient: found mon.noname-a 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:16:59.154+0000 7f7a249b2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: dump: 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.344 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:16:59.154+0000 7f790a7fc640 10 monclient: dump: 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.345 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:16:59.154+0000 7f7a259b4640 4 set_mon_vals no callback set 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 8124 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:16:59.154+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:16:59.158+0000 7f790a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.346 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: get_monmap_and_config 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.347 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding auth protocol: cephx 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.348 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: crc 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b19f20) adding con mode: secure 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: get_auth_request con 0x7f78fc070a20 auth_method 0 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding auth protocol: cephx 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: crc 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af190) adding con mode: secure 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x7ffea89af2d8 EEXIST 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.350 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83b1dfe0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83b49840 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83b40000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.622390s 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83b49840 auth_method 0 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.351 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): get_auth_request con 0x562a83b40000 auth_method 0 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:16:59.158+0000 7f7a251b3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 7682 payload 274 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:16:59.158+0000 7f7a241b1640 1 monclient: found mon.noname-c 2024-09-05T01:16:59.352 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:16:59.158+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: dump: 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.353 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 7682 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 4 set_mon_vals no callback set 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:16:59.158+0000 7f78fbfff640 10 monclient: dump: 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.354 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: shutdown 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: build_initial_monmap 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 1 build_initial for_mkfs: 0 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 10 monclient: monmap: 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:16:59.355 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding auth protocol: cephx 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.356 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: crc 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:16:59.158+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83b40550) adding con mode: secure 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: starting msgr at 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: starting objecter 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command objecter_requests cmddesc objecter_requests hook 0x562a83b1c3d0 EEXIST 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: setting wanted keys 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: calling monclient init 2024-09-05T01:16:59.357 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: init 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding auth protocol: cephx 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: crc 2024-09-05T01:16:59.358 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 AuthRegistry(0x562a83afc440) adding con mode: secure 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command rotate-key cmddesc rotate-key hook 0x562a83afc588 EEXIST 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-a con 0x562a83b1dfe0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-c con 0x562a83b40000 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): picked mon.noname-b con 0x562a83b49840 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:16:59.359 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient(hunting): authenticate will time out at 2670.624951s 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): get_auth_request con 0x562a83b40000 auth_method 0 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): get_auth_request con 0x562a83b1dfe0 auth_method 0 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:16:59.360 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:16:59.162+0000 7f7a249b2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient(hunting): handle_auth_done global_id 7685 payload 824 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient: _finish_hunting 0 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:16:59.162+0000 7f7a241b1640 1 monclient: found mon.noname-c 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:16:59.162+0000 7f7a241b1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: dump: 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.361 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: _finish_auth 0 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 10 monclient: dump: 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:16:59.362 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:16:59.162+0000 7f78fbfff640 4 set_mon_vals no callback set 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 monclient: authenticate success, global_id 7685 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _renew_subs 2024-09-05T01:16:59.363 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 1 librados: init done 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cr dump hook 0x562a83b47b38 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:16:59.162+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:16:59.162+0000 7f78fa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:16:59.166+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f78f0070ae0 auth_method 0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:16:59.166+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83b67680 auth_method 0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 realm 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.364 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:16:59.166+0000 7f7a249b2640 10 monclient: get_auth_request con 0x562a83b6b940 auth_method 0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:16:59.166+0000 7f7a241b1640 10 monclient: get_auth_request con 0x562a83b6f080 auth_method 0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:16:59.166+0000 7f7a26eac9c0 20 searching for the correct realm 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:16:59.166+0000 7f7a251b3640 10 monclient: get_auth_request con 0x562a83b73e20 auth_method 0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:16:59.170+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f7a1c00fb50 auth_method 0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:16:59.170+0000 7f7a241b1640 10 monclient: get_auth_request con 0x7f7a14034060 auth_method 0 2024-09-05T01:16:59.365 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:16:59.170+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f7a180ad610 auth_method 0 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:16:59.174+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7a180ad610 msgr2=0x7f7a180ad030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 1 client.7685.objecter ms_handle_reset 0x7f7a180ad610 session 0x7f7a180a6070 osd.4 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 10 monclient: _renew_subs 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:16:59.174+0000 7f78fa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:16:59.174+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f78f0080880 auth_method 0 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:16:59.174+0000 7f7a249b2640 10 monclient: get_auth_request con 0x7f7a1c025410 auth_method 0 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:16:59.178+0000 7f7a251b3640 0 -- 172.21.15.99:0/1238056227 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f78f0080880 msgr2=0x7f78f0082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:16:59.178+0000 7f78fa7fc640 1 client.7685.objecter ms_handle_reset 0x7f78f0080880 session 0x7f7a180a6070 osd.4 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:16:59.178+0000 7f7a251b3640 10 monclient: get_auth_request con 0x7f7a180ad610 auth_method 0 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.366 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.367 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zone default found 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Realm: () 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 zonegroup default 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:16:59.186+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.368 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:16:59.190+0000 7f7a26eac9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=0 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=1 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=2 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=3 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=4 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=5 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=6 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 20 add_watcher() i=7 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:16:59.206+0000 7f7a26eac9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.369 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding auth protocol: cephx 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: crc 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 AuthRegistry(0x7ffea89af670) adding con mode: secure 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:16:59.210+0000 7f78db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.370 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache list hook 0x562a83b3dd50 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache inspect hook 0x562a83b3dd50 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache erase hook 0x562a83b3dd50 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command cache zap hook 0x562a83b3dd50 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 note: GC not initialized 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:16:59.210+0000 7f78da7e4640 20 reqs_thread_entry: start 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace show hook 0x7f7a140045d0 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace history hook 0x7f7a140045d0 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace active hook 0x7f7a140045d0 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 5 asok(0x562a838732b0) register_command sync trace active_short hook 0x7f7a140045d0 2024-09-05T01:16:59.371 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 Filter name: none 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:16:59.210+0000 7f78d37fe640 20 reqs_thread_entry: start 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.372 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:16:59.210+0000 7f7a26eac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:16:59.222+0000 7f7a26eac9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 94740598469936 notifier 7685 bl.length()=827 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:16:59.222+0000 7f78fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:16:59.373 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:16:59.226+0000 7f7a26eac9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.1 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.2 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.3 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.4 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.374 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.5 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.6 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.7 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.8 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.9 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.10 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.11 2024-09-05T01:16:59.375 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.12 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.13 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:16:59.238+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.376 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:16:59.242+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:16:59.246+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.377 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:16:59.250+0000 7f7a26eac9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a26eac9c0 time 2024-09-05T01:16:59.258526+0000 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a2a7862eb] 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.378 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:16:59.254+0000 7f7a26eac9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a26eac9c0 thread_name:radosgw-admin 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a29605520] 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:16:59.379 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a2a786345] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a2a78649f] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562a80fe8681] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x15c8) [0x562a80ffce68] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562a80ffe4b4] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a295ecd90] 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:16:59.380 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:16:59.381 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:16:59.382 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:16:59.383 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:16:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:16:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:16:59.386 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78d37fe640 / http_manager 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78da7e4640 / http_manager 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78db7e6640 / rgw_dt_lg_renew 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fa7fc640 / ms_dispatch 2024-09-05T01:16:59.387 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fb7fe640 / io_context_pool 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f78fbfff640 / io_context_pool 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f790a7fc640 / ms_dispatch 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791160a640 / ms_dispatch 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7912e0d640 / io_context_pool 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a241b1640 / msgr-worker-2 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a249b2640 / msgr-worker-1 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a251b3640 / msgr-worker-0 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a259b4640 / io_context_pool 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a26eac9c0 / radosgw-admin 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:16:59.260919Z_468671e9-7b56-420a-b9dc-25d18bb43b6c/log 2024-09-05T01:16:59.388 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:16:59.389 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:16:59.389 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 realm 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.338+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.342+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.342+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.342+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.342+0000 7fd5451519c0 20 searching for the correct realm 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.346+0000 7fd542c57640 0 -- 172.21.15.99:0/1466780830 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd53c02c060 msgr2=0x7fd53c0971b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.354+0000 7fd542c57640 0 -- 172.21.15.99:0/1466780830 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fd53c017020 msgr2=0x7fd53c064a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 zone default found 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 4 Realm: () 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 zonegroup default 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.362+0000 7fd5451519c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=0 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=1 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=2 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=3 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=4 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=5 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.378+0000 7fd5451519c0 20 add_watcher() i=6 2024-09-05T01:16:59.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.382+0000 7fd5451519c0 20 add_watcher() i=7 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.382+0000 7fd5451519c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd3f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 5 note: GC not initialized 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd373fff640 20 reqs_thread_entry: start 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 Filter name: none 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd371ffb640 20 reqs_thread_entry: start 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:16:59.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.386+0000 7fd5451519c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.390+0000 7fd5451519c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.390+0000 7fd5451519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.390+0000 7fd3f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.398+0000 7fd5451519c0 20 remove_watcher() i=0 2024-09-05T01:16:59.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.398+0000 7fd5451519c0 2 removed watcher, disabling cache 2024-09-05T01:16:59.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.398+0000 7fd5451519c0 20 remove_watcher() i=1 2024-09-05T01:16:59.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.402+0000 7fd5451519c0 20 remove_watcher() i=2 2024-09-05T01:16:59.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.402+0000 7fd5451519c0 20 remove_watcher() i=3 2024-09-05T01:16:59.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.406+0000 7fd5451519c0 20 remove_watcher() i=4 2024-09-05T01:16:59.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.410+0000 7fd5451519c0 20 remove_watcher() i=5 2024-09-05T01:16:59.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.410+0000 7fd5451519c0 20 remove_watcher() i=6 2024-09-05T01:16:59.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.410+0000 7fd5451519c0 20 remove_watcher() i=7 2024-09-05T01:16:59.471 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:16:59.497 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:16:59.497 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:16:59.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.538+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 realm 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:16:59.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.542+0000 7fd7acf779c0 20 searching for the correct realm 2024-09-05T01:16:59.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.550+0000 7fd7aaa7d640 0 -- 172.21.15.99:0/3054617079 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd7a40784f0 msgr2=0x7fd7a4076f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:16:59.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.554+0000 7fd7aaa7d640 0 -- 172.21.15.99:0/3054617079 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd674080900 msgr2=0x7fd674082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:16:59.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:16:59.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.562+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 zone default found 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 4 Realm: () 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 zonegroup default 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:16:59.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 started sync module instance, tier type = 2024-09-05T01:16:59.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.566+0000 7fd7acf779c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=0 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=1 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=2 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=3 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=4 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=5 2024-09-05T01:16:59.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=6 2024-09-05T01:16:59.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 20 add_watcher() i=7 2024-09-05T01:16:59.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.586+0000 7fd7acf779c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:16:59.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd6617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 5 note: GC not initialized 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd5dbfff640 20 reqs_thread_entry: start 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 20 init_complete bucket index max shards: 11 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 20 Filter name: none 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd5d9ffb640 20 reqs_thread_entry: start 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:16:59.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.590+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:16:59.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:16:59.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:16:59.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:16:59.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 rados->read ofs=0 len=0 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:16:59.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:16:59.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.594+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:16:59.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:16:59.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:16:59.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:16:59.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.598+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:16:59.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:16:59.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:16:59.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:16:59.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:16:59.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.602+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:16:59.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.606+0000 7fd7acf779c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.606+0000 7fd7acf779c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:16:59.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.606+0000 7fd6617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:16:59.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.610+0000 7fd7acf779c0 20 remove_watcher() i=0 2024-09-05T01:16:59.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.610+0000 7fd7acf779c0 2 removed watcher, disabling cache 2024-09-05T01:16:59.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.614+0000 7fd7acf779c0 20 remove_watcher() i=1 2024-09-05T01:16:59.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.614+0000 7fd7acf779c0 20 remove_watcher() i=2 2024-09-05T01:16:59.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.618+0000 7fd7acf779c0 20 remove_watcher() i=3 2024-09-05T01:16:59.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.622+0000 7fd7acf779c0 20 remove_watcher() i=4 2024-09-05T01:16:59.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.622+0000 7fd7acf779c0 20 remove_watcher() i=5 2024-09-05T01:16:59.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.622+0000 7fd7acf779c0 20 remove_watcher() i=6 2024-09-05T01:16:59.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:16:59.626+0000 7fd7acf779c0 20 remove_watcher() i=7 2024-09-05T01:17:29.670 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:17:29.704 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:29.704 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:29.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.745+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 realm 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:29.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.749+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.753+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:29.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.753+0000 7ffa6903f9c0 20 searching for the correct realm 2024-09-05T01:17:29.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.757+0000 7ffa67346640 0 -- 172.21.15.99:0/1621452510 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ffa5c035020 msgr2=0x7ffa5c02a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:29.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.765+0000 7ffa67346640 0 -- 172.21.15.99:0/1621452510 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff930080900 msgr2=0x7ff930082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:29.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:29.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:29.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:29.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:29.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:29.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:29.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.769+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 zone default found 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 4 Realm: () 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:29.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 zonegroup default 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:29.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 started sync module instance, tier type = 2024-09-05T01:17:29.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.773+0000 7ffa6903f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:29.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=0 2024-09-05T01:17:29.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=1 2024-09-05T01:17:29.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=2 2024-09-05T01:17:29.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=3 2024-09-05T01:17:29.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=4 2024-09-05T01:17:29.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=5 2024-09-05T01:17:29.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=6 2024-09-05T01:17:29.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 20 add_watcher() i=7 2024-09-05T01:17:29.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.789+0000 7ffa6903f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:29.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ff91d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:29.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:29.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:29.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 5 note: GC not initialized 2024-09-05T01:17:29.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ff897fff640 20 reqs_thread_entry: start 2024-09-05T01:17:29.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:29.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 20 Filter name: none 2024-09-05T01:17:29.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ff895ffb640 20 reqs_thread_entry: start 2024-09-05T01:17:29.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.793+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:29.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:17:29.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:29.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:29.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:29.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:17:29.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.797+0000 7ffa6903f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:29.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.801+0000 7ff91d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:29.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.805+0000 7ffa6903f9c0 20 remove_watcher() i=0 2024-09-05T01:17:29.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.805+0000 7ffa6903f9c0 2 removed watcher, disabling cache 2024-09-05T01:17:29.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.809+0000 7ffa6903f9c0 20 remove_watcher() i=1 2024-09-05T01:17:29.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.809+0000 7ffa6903f9c0 20 remove_watcher() i=2 2024-09-05T01:17:29.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.813+0000 7ffa6903f9c0 20 remove_watcher() i=3 2024-09-05T01:17:29.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.813+0000 7ffa6903f9c0 20 remove_watcher() i=4 2024-09-05T01:17:29.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.817+0000 7ffa6903f9c0 20 remove_watcher() i=5 2024-09-05T01:17:29.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.817+0000 7ffa6903f9c0 20 remove_watcher() i=6 2024-09-05T01:17:29.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:29.817+0000 7ffa6903f9c0 20 remove_watcher() i=7 2024-09-05T01:17:29.953 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:17:29.983 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:29.983 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:30.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.025+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 realm 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.029+0000 7fca879b39c0 20 searching for the correct realm 2024-09-05T01:17:30.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.033+0000 7fca85cba640 0 -- 172.21.15.99:0/3507789537 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fca7c135040 msgr2=0x7fca7c0c8820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.041+0000 7fca85cba640 0 -- 172.21.15.99:0/3507789537 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc950080930 msgr2=0x7fc950082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 zone default found 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 4 Realm: () 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 zonegroup default 2024-09-05T01:17:30.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.049+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.053+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.053+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.053+0000 7fca879b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.053+0000 7fca879b39c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.053+0000 7fca879b39c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=0 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=1 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=2 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=3 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=4 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=5 2024-09-05T01:17:30.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.065+0000 7fca879b39c0 20 add_watcher() i=6 2024-09-05T01:17:30.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fca879b39c0 20 add_watcher() i=7 2024-09-05T01:17:30.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fca879b39c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fc93bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fca879b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fca879b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fca879b39c0 5 note: GC not initialized 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.069+0000 7fc93afe5640 20 reqs_thread_entry: start 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 Filter name: none 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fc938fe1640 20 reqs_thread_entry: start 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:17:30.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:17:30.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:17:30.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:17:30.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.073+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:17:30.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:17:30.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:17:30.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:17:30.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:17:30.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:17:30.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:17:30.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:17:30.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:17:30.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:17:30.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:17:30.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:17:30.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.077+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:17:30.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:17:30.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:17:30.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:17:30.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:17:30.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:17:30.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:17:30.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:17:30.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:17:30.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:17:30.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.081+0000 7fca879b39c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:17:30.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.085+0000 7fc93bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.089+0000 7fca879b39c0 20 remove_watcher() i=0 2024-09-05T01:17:30.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.089+0000 7fca879b39c0 2 removed watcher, disabling cache 2024-09-05T01:17:30.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.089+0000 7fca879b39c0 20 remove_watcher() i=1 2024-09-05T01:17:30.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.093+0000 7fca879b39c0 20 remove_watcher() i=2 2024-09-05T01:17:30.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.093+0000 7fca879b39c0 20 remove_watcher() i=3 2024-09-05T01:17:30.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.097+0000 7fca879b39c0 20 remove_watcher() i=4 2024-09-05T01:17:30.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.097+0000 7fca879b39c0 20 remove_watcher() i=5 2024-09-05T01:17:30.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.101+0000 7fca879b39c0 20 remove_watcher() i=6 2024-09-05T01:17:30.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.101+0000 7fca879b39c0 20 remove_watcher() i=7 2024-09-05T01:17:30.116 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:17:30.141 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:30.142 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:30.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.181+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 realm 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.185+0000 7f0b826049c0 20 searching for the correct realm 2024-09-05T01:17:30.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.189+0000 7f0b8090b640 0 -- 172.21.15.99:0/663189148 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0b740d0c40 msgr2=0x7f0b740fb2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.197+0000 7f0b8090b640 0 -- 172.21.15.99:0/663189148 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f0a48080960 msgr2=0x7f0a48082d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.205+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 zone default found 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 4 Realm: () 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 zonegroup default 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.209+0000 7f0b826049c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=0 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=1 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=2 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=3 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=4 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=5 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=6 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 20 add_watcher() i=7 2024-09-05T01:17:30.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.225+0000 7f0b826049c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0a36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 5 note: GC not initialized 2024-09-05T01:17:30.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0a35fdb640 20 reqs_thread_entry: start 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 Filter name: none 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f09a77fe640 20 reqs_thread_entry: start 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.229+0000 7f0b826049c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.233+0000 7f0b826049c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.233+0000 7f0b826049c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.233+0000 7f0a36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.241+0000 7f0b826049c0 20 remove_watcher() i=0 2024-09-05T01:17:30.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.241+0000 7f0b826049c0 2 removed watcher, disabling cache 2024-09-05T01:17:30.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.241+0000 7f0b826049c0 20 remove_watcher() i=1 2024-09-05T01:17:30.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.241+0000 7f0b826049c0 20 remove_watcher() i=2 2024-09-05T01:17:30.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.245+0000 7f0b826049c0 20 remove_watcher() i=3 2024-09-05T01:17:30.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.245+0000 7f0b826049c0 20 remove_watcher() i=4 2024-09-05T01:17:30.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.249+0000 7f0b826049c0 20 remove_watcher() i=5 2024-09-05T01:17:30.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.249+0000 7f0b826049c0 20 remove_watcher() i=6 2024-09-05T01:17:30.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.249+0000 7f0b826049c0 20 remove_watcher() i=7 2024-09-05T01:17:30.261 INFO:tasks.workunit.client.0.smithi099.stderr: test: duplicated entries should be purged before reshard 2024-09-05T01:17:30.262 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:17:30.285 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:30.285 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:30.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 realm 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.321+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.325+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.325+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.325+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.325+0000 7fb7ea4689c0 20 searching for the correct realm 2024-09-05T01:17:30.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.333+0000 7fb7e7f6e640 0 -- 172.21.15.99:0/1181783703 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fb7e0062c40 msgr2=0x7fb7e0060db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.549+0000 7fb7e876f640 0 -- 172.21.15.99:0/1181783703 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x565449cabcb0 msgr2=0x565449cae140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 zone default found 2024-09-05T01:17:30.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 4 Realm: () 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 zonegroup default 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.557+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.561+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.561+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.561+0000 7fb7ea4689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.561+0000 7fb7ea4689c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.561+0000 7fb7ea4689c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=0 2024-09-05T01:17:30.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=1 2024-09-05T01:17:30.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=2 2024-09-05T01:17:30.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=3 2024-09-05T01:17:30.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=4 2024-09-05T01:17:30.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=5 2024-09-05T01:17:30.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=6 2024-09-05T01:17:30.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 20 add_watcher() i=7 2024-09-05T01:17:30.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.585+0000 7fb7ea4689c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.589+0000 7fb69dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 5 note: GC not initialized 2024-09-05T01:17:30.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb69cfe1640 20 reqs_thread_entry: start 2024-09-05T01:17:30.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 Filter name: none 2024-09-05T01:17:30.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb6167fc640 20 reqs_thread_entry: start 2024-09-05T01:17:30.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.593+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.597+0000 7fb7ea4689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.601+0000 7fb69dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.605+0000 7fb7ea4689c0 20 remove_watcher() i=0 2024-09-05T01:17:30.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.605+0000 7fb7ea4689c0 2 removed watcher, disabling cache 2024-09-05T01:17:30.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.609+0000 7fb7ea4689c0 20 remove_watcher() i=1 2024-09-05T01:17:30.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.609+0000 7fb7ea4689c0 20 remove_watcher() i=2 2024-09-05T01:17:30.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.613+0000 7fb7ea4689c0 20 remove_watcher() i=3 2024-09-05T01:17:30.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.617+0000 7fb7ea4689c0 20 remove_watcher() i=4 2024-09-05T01:17:30.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.617+0000 7fb7ea4689c0 20 remove_watcher() i=5 2024-09-05T01:17:30.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.617+0000 7fb7ea4689c0 20 remove_watcher() i=6 2024-09-05T01:17:30.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.621+0000 7fb7ea4689c0 20 remove_watcher() i=7 2024-09-05T01:17:30.638 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.638 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:17:30.638 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-05T01:17:30.638 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.638 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-05T01:17:30.675 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:30.675 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:30.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 realm 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 searching for the correct realm 2024-09-05T01:17:30.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.725+0000 7fc7dd195640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc7c40d2050 msgr2=0x7fc7c40d3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.733+0000 7fc7dc994640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fc7cc031430 msgr2=0x7fc7cc031870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zone default found 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Realm: () 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zonegroup default 2024-09-05T01:17:30.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=0 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=1 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=2 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=3 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=4 2024-09-05T01:17:30.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=5 2024-09-05T01:17:30.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=6 2024-09-05T01:17:30.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=7 2024-09-05T01:17:30.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc6937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 note: GC not initialized 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc6927e4640 20 reqs_thread_entry: start 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 Filter name: none 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc68b7fe640 20 reqs_thread_entry: start 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:17:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:17:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:17:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:17:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:17:30.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:17:30.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94382382549376 notifier 7796 bl.length()=827 2024-09-05T01:17:30.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:17:30.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:17:30.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:17:30.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:17:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7dee8e9c0 time 2024-09-05T01:17:30.798414+0000 2024-09-05T01:17:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:17:30.794 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.794 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7e27682eb] 2024-09-05T01:17:30.794 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7dee8e9c0 time 2024-09-05T01:17:30.798414+0000 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7e27682eb] 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:17:30.796 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fc7dee8e9c0 thread_name:radosgw-admin 2024-09-05T01:17:30.813 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.813 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7e15e7520] 2024-09-05T01:17:30.813 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:17:30.813 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:17:30.813 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7e2768345] 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fc7dee8e9c0 thread_name:radosgw-admin 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.814 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7e15e7520] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7e2768345] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:17:30.815 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-05T01:17:30.816 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:17:30.697+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: dump: 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.817 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: dump: 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.818 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7784 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 4 set_mon_vals no callback set 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: shutdown 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) unregister_commands rotate-key 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.819 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.820 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.821 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: starting msgr at 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: starting objecter 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests hook 0x55d71c52f590 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: setting wanted keys 2024-09-05T01:17:30.822 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: calling monclient init 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.823 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key hook 0x55d71c52dba8 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c3badb0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c473820 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c533cb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.824 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.162790s 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c473820 auth_method 0 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c3badb0 auth_method 0 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.825 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:17:30.697+0000 7fc7dc994640 1 monclient: found mon.noname-a 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:17:30.826 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: dump: 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.827 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: dump: 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.828 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 4 set_mon_vals no callback set 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 8250 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 1 librados: init done 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:17:30.701+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6c4070b10 auth_method 0 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:17:30.701+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c555f80 auth_method 0 2024-09-05T01:17:30.829 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:17:30.701+0000 7fc7dc994640 10 monclient: get_auth_request con 0x55d71c578a30 auth_method 0 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:17:30.705+0000 7fc7dc193640 10 monclient: get_auth_request con 0x55d71c57cc20 auth_method 0 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.831 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d71c584ee0 EEXIST 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.832 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.833 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x55d71c57fff0 EEXIST 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5a9090 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5a89c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5a73a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.171904s 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5a9090 auth_method 0 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.834 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): get_auth_request con 0x55d71c5a73a0 auth_method 0 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-05T01:17:30.835 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:17:30.709+0000 7fc7dc994640 1 monclient: found mon.noname-a 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: dump: 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.836 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: dump: 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 8253 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:17:30.709+0000 7fc7dd996640 4 set_mon_vals no callback set 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.838 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.839 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.840 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.840 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.840 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.840 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.841 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6b4070bc0 auth_method 0 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.842 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.843 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffed7cfb288 EEXIST 2024-09-05T01:17:30.844 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.844 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:17:30.844 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5fc9b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5ee4a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.845 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.175793s 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5fc9b0 auth_method 0 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.846 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c5f7dd0 auth_method 0 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-05T01:17:30.847 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:17:30.713+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: dump: 2024-09-05T01:17:30.848 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.849 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.849 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.849 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.849 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.849 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7793 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:17:30.850 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 4 set_mon_vals no callback set 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: dump: 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.851 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: shutdown 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.852 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.853 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.854 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: starting msgr at 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: starting objecter 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d71c5aac40 EEXIST 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: setting wanted keys 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: calling monclient init 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.855 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x55d71c5aaff8 EEXIST 2024-09-05T01:17:30.856 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5ee4a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5fc9b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.178449s 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5ee4a0 auth_method 0 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.857 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c5f7dd0 auth_method 0 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.858 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:17:30.713+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: dump: 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.859 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7796 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: dump: 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.860 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 4 set_mon_vals no callback set 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.861 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: init done 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cr dump hook 0x55d71c5f05f8 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:17:30.717+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6a8070ae0 auth_method 0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:17:30.717+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c615550 auth_method 0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 realm 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.862 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:17:30.717+0000 7fc7dc994640 10 monclient: get_auth_request con 0x55d71c6198d0 auth_method 0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:17:30.721+0000 7fc7dc193640 10 monclient: get_auth_request con 0x55d71c61d030 auth_method 0 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 searching for the correct realm 2024-09-05T01:17:30.863 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:17:30.721+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c621df0 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:17:30.721+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7cc00e040 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:17:30.721+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc7d4077070 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:17:30.725+0000 7fc7dd195640 10 monclient: get_auth_request con 0x7fc7c40d2050 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:17:30.725+0000 7fc7dd195640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc7c40d2050 msgr2=0x7fc7c40d3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 1 client.7796.objecter ms_handle_reset 0x7fc7c40d2050 session 0x7fc7c40db040 osd.4 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 10 monclient: _renew_subs 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:17:30.725+0000 7fc7dd195640 10 monclient: get_auth_request con 0x7fc6a8080880 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:17:30.729+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7cc031430 auth_method 0 2024-09-05T01:17:30.864 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:17:30.733+0000 7fc7dc994640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fc7cc031430 msgr2=0x7fc7cc031870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:17:30.733+0000 7fc6b27fc640 1 client.7796.objecter ms_handle_reset 0x7fc7cc031430 session 0x7fc7cc038040 osd.6 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:17:30.733+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7c40d2050 auth_method 0 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.865 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zone default found 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Realm: () 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zonegroup default 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.866 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=0 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=1 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=2 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=3 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=4 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=5 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=6 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=7 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.867 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:17:30.765+0000 7fc6937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.868 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache list hook 0x55d71c5f4410 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache inspect hook 0x55d71c5f4410 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache erase hook 0x55d71c5f4410 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache zap hook 0x55d71c5f4410 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 note: GC not initialized 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:17:30.765+0000 7fc6927e4640 20 reqs_thread_entry: start 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace show hook 0x7fc7cc004ad0 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace history hook 0x7fc7cc004ad0 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace active hook 0x7fc7cc004ad0 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace active_short hook 0x7fc7cc004ad0 2024-09-05T01:17:30.869 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 Filter name: none 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:17:30.765+0000 7fc68b7fe640 20 reqs_thread_entry: start 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.870 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94382382549376 notifier 7796 bl.length()=827 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.871 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7dee8e9c0 time 2024-09-05T01:17:30.798414+0000 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7e27682eb] 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.872 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fc7dee8e9c0 thread_name:radosgw-admin 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7e15e7520] 2024-09-05T01:17:30.873 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7e2768345] 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.874 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:17:30.875 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:17:30.876 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:17:30.877 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:17:30.878 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:17:30.879 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:17:30.880 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:17:30.881 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:17:30.882 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc68b7fe640 / http_manager 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6927e4640 / http_manager 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6937e6640 / rgw_dt_lg_renew 2024-09-05T01:17:30.883 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6b27fc640 / ms_dispatch 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6b3fff640 / io_context_pool 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6c27fc640 / ms_dispatch 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6c960a640 / ms_dispatch 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6cae0d640 / io_context_pool 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dc193640 / msgr-worker-2 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dc994640 / msgr-worker-1 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dd195640 / msgr-worker-0 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dd996640 / io_context_pool 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dee8e9c0 / radosgw-admin 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.142385.log 2024-09-05T01:17:30.884 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7784 payload 274 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:17:30.697+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.885 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: dump: 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.886 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 10 monclient: dump: 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.887 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7784 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 4 set_mon_vals no callback set 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: shutdown 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) unregister_commands rotate-key 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.888 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.889 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.889 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.889 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.889 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.889 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding auth protocol: cephx 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.890 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: crc 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c532cd0) adding con mode: secure 2024-09-05T01:17:30.891 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.892 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: starting msgr at 2024-09-05T01:17:30.892 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: starting objecter 2024-09-05T01:17:30.892 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests hook 0x55d71c52f590 2024-09-05T01:17:30.892 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: setting wanted keys 2024-09-05T01:17:30.892 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 1 librados: calling monclient init 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding auth protocol: cephx 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.893 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.894 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.894 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.894 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.894 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.894 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: crc 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c52da60) adding con mode: secure 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key hook 0x55d71c52dba8 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c3badb0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c473820 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c533cb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.895 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:17:30.697+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.162790s 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c473820 auth_method 0 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.896 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c3badb0 auth_method 0 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.897 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.898 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.898 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.898 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.898 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:17:30.697+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.898 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 8250 payload 824 2024-09-05T01:17:30.899 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.899 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:17:30.697+0000 7fc7dc994640 1 monclient: found mon.noname-a 2024-09-05T01:17:30.899 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:17:30.697+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.899 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.899 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: dump: 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.900 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.901 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.902 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.902 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.902 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.902 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:17:30.697+0000 7fc6c960a640 10 monclient: dump: 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.903 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:17:30.697+0000 7fc6cae0d640 4 set_mon_vals no callback set 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 8250 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.904 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:17:30.701+0000 7fc7dee8e9c0 1 librados: init done 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:17:30.701+0000 7fc6c960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:17:30.701+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6c4070b10 auth_method 0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:17:30.701+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c555f80 auth_method 0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:17:30.701+0000 7fc7dc994640 10 monclient: get_auth_request con 0x55d71c578a30 auth_method 0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:17:30.705+0000 7fc7dc193640 10 monclient: get_auth_request con 0x55d71c57cc20 auth_method 0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.905 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.906 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding auth protocol: cephx 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.907 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: crc 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c581510) adding con mode: secure 2024-09-05T01:17:30.908 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d71c584ee0 EEXIST 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding auth protocol: cephx 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.909 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.910 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: crc 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c57fea8) adding con mode: secure 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x55d71c57fff0 EEXIST 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5a9090 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.911 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5a89c0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5a73a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:17:30.705+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.171904s 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5a9090 auth_method 0 2024-09-05T01:17:30.912 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): get_auth_request con 0x55d71c5a73a0 auth_method 0 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.913 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.914 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.914 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.914 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.914 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:17:30.709+0000 7fc7dd195640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.914 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:17:30.709+0000 7fc7dc994640 1 monclient: found mon.noname-a 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: dump: 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.915 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.916 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 10 monclient: dump: 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.917 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.918 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 8253 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:17:30.709+0000 7fc7dd996640 4 set_mon_vals no callback set 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.919 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:17:30.709+0000 7fc6c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.920 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.921 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding auth protocol: cephx 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.922 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.923 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: crc 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5c85a0) adding con mode: secure 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6b4070bc0 auth_method 0 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.924 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding auth protocol: cephx 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.925 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: crc 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb140) adding con mode: secure 2024-09-05T01:17:30.926 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffed7cfb288 EEXIST 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5fc9b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.927 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5ee4a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:17:30.709+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.175793s 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5fc9b0 auth_method 0 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:17:30.709+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.928 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c5f7dd0 auth_method 0 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:17:30.709+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.929 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:17:30.713+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: dump: 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.930 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7793 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:17:30.931 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 4 set_mon_vals no callback set 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 10 monclient: dump: 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.932 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: shutdown 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: build_initial_monmap 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 build_initial for_mkfs: 0 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: monmap: 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:17:30.933 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding auth protocol: cephx 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.934 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: crc 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5eea20) adding con mode: secure 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: starting msgr at 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: starting objecter 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d71c5aac40 EEXIST 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: setting wanted keys 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: calling monclient init 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: init 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding auth protocol: cephx 2024-09-05T01:17:30.935 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: crc 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 AuthRegistry(0x55d71c5aaeb0) adding con mode: secure 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.936 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command rotate-key cmddesc rotate-key hook 0x55d71c5aaff8 EEXIST 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-c con 0x55d71c5ee4a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-a con 0x55d71c5f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): picked mon.noname-b con 0x55d71c5fc9b0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient(hunting): authenticate will time out at 2702.178449s 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): get_auth_request con 0x55d71c5ee4a0 auth_method 0 2024-09-05T01:17:30.937 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): get_auth_request con 0x55d71c5f7dd0 auth_method 0 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:17:30.938 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:17:30.713+0000 7fc7dc193640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _finish_hunting 0 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:17:30.713+0000 7fc7dc994640 1 monclient: found mon.noname-c 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:17:30.713+0000 7fc7dc994640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.939 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: dump: 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: _finish_auth 0 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: _check_auth_tickets 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 monclient: authenticate success, global_id 7796 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:17:30.941 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:17:30.713+0000 7fc6b27fc640 10 monclient: dump: 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:17:30.713+0000 7fc6b3fff640 4 set_mon_vals no callback set 2024-09-05T01:17:30.942 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _renew_subs 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 1 librados: init done 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:17:30.713+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cr dump hook 0x55d71c5f05f8 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:17:30.717+0000 7fc6b27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:17:30.717+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc6a8070ae0 auth_method 0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:17:30.717+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c615550 auth_method 0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 realm 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.943 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:17:30.717+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:17:30.717+0000 7fc7dc994640 10 monclient: get_auth_request con 0x55d71c6198d0 auth_method 0 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.944 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:17:30.721+0000 7fc7dc193640 10 monclient: get_auth_request con 0x55d71c61d030 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:17:30.721+0000 7fc7dee8e9c0 20 searching for the correct realm 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:17:30.721+0000 7fc7dd195640 10 monclient: get_auth_request con 0x55d71c621df0 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:17:30.721+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7cc00e040 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:17:30.721+0000 7fc7dc193640 10 monclient: get_auth_request con 0x7fc7d4077070 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:17:30.725+0000 7fc7dd195640 10 monclient: get_auth_request con 0x7fc7c40d2050 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:17:30.725+0000 7fc7dd195640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc7c40d2050 msgr2=0x7fc7c40d3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 1 client.7796.objecter ms_handle_reset 0x7fc7c40d2050 session 0x7fc7c40db040 osd.4 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 10 monclient: _renew_subs 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:17:30.725+0000 7fc6b27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:17:30.725+0000 7fc7dd195640 10 monclient: get_auth_request con 0x7fc6a8080880 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:17:30.729+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7cc031430 auth_method 0 2024-09-05T01:17:30.945 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:17:30.733+0000 7fc7dc994640 0 -- 172.21.15.99:0/1287616331 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fc7cc031430 msgr2=0x7fc7cc031870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:17:30.733+0000 7fc6b27fc640 1 client.7796.objecter ms_handle_reset 0x7fc7cc031430 session 0x7fc7cc038040 osd.6 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:17:30.733+0000 7fc7dc994640 10 monclient: get_auth_request con 0x7fc7c40d2050 auth_method 0 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.946 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zone default found 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Realm: () 2024-09-05T01:17:30.947 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.948 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.948 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.948 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 zonegroup default 2024-09-05T01:17:30.948 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.948 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:17:30.741+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:17:30.745+0000 7fc7dee8e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.949 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=0 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=1 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=2 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=3 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=4 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=5 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=6 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 20 add_watcher() i=7 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:17:30.761+0000 7fc7dee8e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.950 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding auth protocol: cephx 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:17:30.765+0000 7fc6937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.951 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: crc 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 AuthRegistry(0x7ffed7cfb620) adding con mode: secure 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:17:30.952 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache list hook 0x55d71c5f4410 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache inspect hook 0x55d71c5f4410 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache erase hook 0x55d71c5f4410 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command cache zap hook 0x55d71c5f4410 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 note: GC not initialized 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:17:30.765+0000 7fc6927e4640 20 reqs_thread_entry: start 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace show hook 0x7fc7cc004ad0 2024-09-05T01:17:30.953 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace history hook 0x7fc7cc004ad0 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace active hook 0x7fc7cc004ad0 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 5 asok(0x55d71c3222b0) register_command sync trace active_short hook 0x7fc7cc004ad0 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 Filter name: none 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:17:30.765+0000 7fc68b7fe640 20 reqs_thread_entry: start 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.954 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.955 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:17:30.765+0000 7fc7dee8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:17:30.777+0000 7fc7dee8e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94382382549376 notifier 7796 bl.length()=827 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:30.956 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:17:30.777+0000 7fc6b3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:17:30.781+0000 7fc7dee8e9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7dee8e9c0 time 2024-09-05T01:17:30.798414+0000 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc7e27682eb] 2024-09-05T01:17:30.957 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:17:30.793+0000 7fc7dee8e9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:17:30.958 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fc7dee8e9c0 thread_name:radosgw-admin 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc7e15e7520] 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc7e2768345] 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc7e276849f] 2024-09-05T01:17:30.959 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d71ad86681] 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d71ad9bb6a] 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc7e15ced90] 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:17:30.960 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:17:30.961 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:17:30.962 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:17:30.963 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:17:30.964 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:17:30.965 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:17:30.966 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:17:30.967 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:17:30.968 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:17:30.969 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc68b7fe640 / http_manager 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6927e4640 / http_manager 2024-09-05T01:17:30.970 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6937e6640 / rgw_dt_lg_renew 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6b27fc640 / ms_dispatch 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6b3fff640 / io_context_pool 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6c27fc640 / ms_dispatch 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6c960a640 / ms_dispatch 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc6cae0d640 / io_context_pool 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dc193640 / msgr-worker-2 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dc994640 / msgr-worker-1 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dd195640 / msgr-worker-0 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dd996640 / io_context_pool 2024-09-05T01:17:30.971 INFO:tasks.workunit.client.0.smithi099.stderr: 7fc7dee8e9c0 / radosgw-admin 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:17:30.800442Z_b7362294-d66d-4f35-90f3-6b7bb1b8704d/log 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:17:30.972 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.873+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 realm 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.877+0000 7f04cd1579c0 20 searching for the correct realm 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.881+0000 7f04ca45c640 0 -- 172.21.15.99:0/3797971471 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f04bc029040 msgr2=0x7f04bc04f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.889+0000 7f04cac5d640 0 -- 172.21.15.99:0/3797971471 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x563d408308f0 msgr2=0x7f04c40ffa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:30.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 zone default found 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 4 Realm: () 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 zonegroup default 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.897+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.901+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.901+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.901+0000 7f04cd1579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.901+0000 7f04cd1579c0 20 started sync module instance, tier type = 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.901+0000 7f04cd1579c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=0 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=1 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=2 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=3 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=4 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=5 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.913+0000 7f04cd1579c0 20 add_watcher() i=6 2024-09-05T01:17:30.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 add_watcher() i=7 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f03817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 5 note: GC not initialized 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f02fbfff640 20 reqs_thread_entry: start 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 Filter name: none 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f02f9ffb640 20 reqs_thread_entry: start 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.917+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:17:30.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.921+0000 7f04cd1579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.925+0000 7f03817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.929+0000 7f04cd1579c0 20 remove_watcher() i=0 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.929+0000 7f04cd1579c0 2 removed watcher, disabling cache 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.933+0000 7f04cd1579c0 20 remove_watcher() i=1 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.933+0000 7f04cd1579c0 20 remove_watcher() i=2 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.937+0000 7f04cd1579c0 20 remove_watcher() i=3 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.937+0000 7f04cd1579c0 20 remove_watcher() i=4 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.941+0000 7f04cd1579c0 20 remove_watcher() i=5 2024-09-05T01:17:30.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.941+0000 7f04cd1579c0 20 remove_watcher() i=6 2024-09-05T01:17:30.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:30.941+0000 7f04cd1579c0 20 remove_watcher() i=7 2024-09-05T01:17:30.999 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:17:31.024 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:17:31.025 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:17:31.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 realm 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.065+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.069+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:31.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.069+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.069+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:17:31.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.069+0000 7f4af87d09c0 20 searching for the correct realm 2024-09-05T01:17:31.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.073+0000 7f4af6ad7640 0 -- 172.21.15.99:0/1736771151 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4aec070040 msgr2=0x7f4aec033740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:17:31.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.081+0000 7f4af62d6640 0 -- 172.21.15.99:0/1736771151 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f4af0100f70 msgr2=0x7f4af010d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:17:31.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:17:31.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:17:31.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:17:31.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:17:31.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:17:31.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:17:31.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:17:31.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:17:31.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 zone default found 2024-09-05T01:17:31.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 4 Realm: () 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 zonegroup default 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.089+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.093+0000 7f4af87d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:17:31.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.093+0000 7f4af87d09c0 20 started sync module instance, tier type = 2024-09-05T01:17:31.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.093+0000 7f4af87d09c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:17:31.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=0 2024-09-05T01:17:31.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=1 2024-09-05T01:17:31.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=2 2024-09-05T01:17:31.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=3 2024-09-05T01:17:31.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=4 2024-09-05T01:17:31.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=5 2024-09-05T01:17:31.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.105+0000 7f4af87d09c0 20 add_watcher() i=6 2024-09-05T01:17:31.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.109+0000 7f4af87d09c0 20 add_watcher() i=7 2024-09-05T01:17:31.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.109+0000 7f4af87d09c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:17:31.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f49acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:31.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 5 note: GC not initialized 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f49277fe640 20 reqs_thread_entry: start 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 init_complete bucket index max shards: 11 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 Filter name: none 2024-09-05T01:17:31.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f49257fa640 20 reqs_thread_entry: start 2024-09-05T01:17:31.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:17:31.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.113+0000 7f4af87d09c0 20 rados->read ofs=0 len=0 2024-09-05T01:17:31.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:17:31.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:17:31.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:17:31.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:17:31.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:17:31.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:17:31.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:17:31.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.117+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:17:31.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:17:31.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:17:31.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:17:31.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:17:31.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:17:31.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:17:31.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:17:31.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:17:31.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:17:31.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.121+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:17:31.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:17:31.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:17:31.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:17:31.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:17:31.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:17:31.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:17:31.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:17:31.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f4af87d09c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:17:31.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.125+0000 7f49acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:17:31.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.133+0000 7f4af87d09c0 20 remove_watcher() i=0 2024-09-05T01:17:31.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.133+0000 7f4af87d09c0 2 removed watcher, disabling cache 2024-09-05T01:17:31.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.133+0000 7f4af87d09c0 20 remove_watcher() i=1 2024-09-05T01:17:31.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.137+0000 7f4af87d09c0 20 remove_watcher() i=2 2024-09-05T01:17:31.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.137+0000 7f4af87d09c0 20 remove_watcher() i=3 2024-09-05T01:17:31.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.141+0000 7f4af87d09c0 20 remove_watcher() i=4 2024-09-05T01:17:31.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.141+0000 7f4af87d09c0 20 remove_watcher() i=5 2024-09-05T01:17:31.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.141+0000 7f4af87d09c0 20 remove_watcher() i=6 2024-09-05T01:17:31.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:17:31.145+0000 7f4af87d09c0 20 remove_watcher() i=7 2024-09-05T01:18:01.186 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-05T01:18:01.225 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:01.225 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:01.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 realm 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.276+0000 7f39253d69c0 20 searching for the correct realm 2024-09-05T01:18:01.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.280+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:18:01.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.496+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zone default found 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Realm: () 2024-09-05T01:18:01.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zonegroup default 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started sync module instance, tier type = 2024-09-05T01:18:01.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=0 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=1 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=2 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=3 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=4 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=5 2024-09-05T01:18:01.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=6 2024-09-05T01:18:01.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.536+0000 7f39253d69c0 20 add_watcher() i=7 2024-09-05T01:18:01.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.536+0000 7f39253d69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:01.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f37d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:01.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:01.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:01.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 5 note: GC not initialized 2024-09-05T01:18:01.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f3753fff640 20 reqs_thread_entry: start 2024-09-05T01:18:01.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:01.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 Filter name: none 2024-09-05T01:18:01.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f3751ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:01.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:01.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:01.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:01.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:01.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:01.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:01.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.544+0000 7f39253d69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:01.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f39253d69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f39253d69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:01.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94610831926096 notifier 8316 bl.length()=827 2024-09-05T01:18:01.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:01.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:01.568 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f39253d69c0 time 2024-09-05T01:18:01.573136+0000 2024-09-05T01:18:01.568 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3928cb02eb] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.570 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f39253d69c0 time 2024-09-05T01:18:01.573136+0000 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3928cb02eb] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:18:01.571 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:18:01.572 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.572 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:18:01.572 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f39253d69c0 thread_name:radosgw-admin 2024-09-05T01:18:01.586 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.586 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3927b2f520] 2024-09-05T01:18:01.586 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:01.586 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:01.586 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3928cb0345] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f39253d69c0 thread_name:radosgw-admin 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.587 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3927b2f520] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3928cb0345] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:18:01.588 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: dump: 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: dump: 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.590 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 monclient: authenticate success, global_id 7835 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:18:01.248+0000 7f39253d69c0 4 set_mon_vals no callback set 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: shutdown 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) unregister_commands rotate-key 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.591 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.592 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:18:01.248+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 librados: starting msgr at 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 librados: starting objecter 2024-09-05T01:18:01.593 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests hook 0x560c4cfa8010 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: setting wanted keys 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: calling monclient init 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.594 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:18:01.252+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:18:01.252+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key hook 0x560c4cf799a8 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4ce350f0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4ce35ee0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.595 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4cebee00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.712729s 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4ce350f0 auth_method 0 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4ce35ee0 auth_method 0 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.596 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4cebee00 auth_method 0 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:18:01.252+0000 7f3922edc640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.597 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: dump: 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.598 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: dump: 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8307 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:18:01.252+0000 7f3810e09640 4 set_mon_vals no callback set 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: init done 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient: get_auth_request con 0x7f3808070ae0 auth_method 0 2024-09-05T01:18:01.600 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:18:01.256+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4cfc1560 auth_method 0 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:18:01.256+0000 7f3922edc640 10 monclient: get_auth_request con 0x560c4cfc43a0 auth_method 0 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:18:01.256+0000 7f39226db640 10 monclient: get_auth_request con 0x560c4cfc8700 auth_method 0 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:18:01.260+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.601 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.602 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560c4cfd0f50 EEXIST 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.603 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.604 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x560c4cfcbd30 EEXIST 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4cff5100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4cff4a30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4cff3410 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.722305s 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4cff5100 auth_method 0 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.605 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4cff3410 auth_method 0 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4cff4a30 auth_method 0 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.606 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:18:01.260+0000 7f3922edc640 1 monclient: found mon.noname-c 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: dump: 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.607 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 monclient: authenticate success, global_id 7841 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.608 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: dump: 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.609 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:18:01.260+0000 7f3923ede640 4 set_mon_vals no callback set 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: get_monmap_and_config 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:18:01.264+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.610 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.611 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: get_auth_request con 0x7f37fc070a20 auth_method 0 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.612 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.613 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc341e9218 EEXIST 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4d048a90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4d0184b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4d044260 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.614 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.726830s 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4d044260 auth_method 0 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4d0184b0 auth_method 0 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.615 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:18:01.264+0000 7f39226db640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: dump: 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.616 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8313 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.617 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: dump: 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:18:01.264+0000 7f39253d69c0 4 set_mon_vals no callback set 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: shutdown 2024-09-05T01:18:01.618 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.619 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.620 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: starting msgr at 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: starting objecter 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560c4d017150 EEXIST 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: setting wanted keys 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: calling monclient init 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.621 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x560c4cff7068 EEXIST 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:18:01.622 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4d0184b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4d044260 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4d048a90 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.730197s 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4d0184b0 auth_method 0 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4d048a90 auth_method 0 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.623 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4d044260 auth_method 0 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-05T01:18:01.624 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:18:01.268+0000 7f3922edc640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: dump: 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.625 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: dump: 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.626 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8316 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:18:01.268+0000 7f38067fc640 4 set_mon_vals no callback set 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.627 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: init done 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cr dump hook 0x560c4d044a18 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:18:01.272+0000 7f39226db640 10 monclient: get_auth_request con 0x7f37ec070ae0 auth_method 0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:18:01.272+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4d061ea0 auth_method 0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 realm 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:18:01.272+0000 7f39253d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.628 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:18:01.272+0000 7f3922edc640 10 monclient: get_auth_request con 0x560c4d066200 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:18:01.276+0000 7f39226db640 10 monclient: get_auth_request con 0x560c4d069960 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 searching for the correct realm 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:18:01.276+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4d06e720 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:18:01.276+0000 7f3922edc640 10 monclient: get_auth_request con 0x7f391c020040 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:18:01.280+0000 7f39226db640 10 monclient: get_auth_request con 0x7f3914019070 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:18:01.280+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f39180c5410 auth_method 0 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:18:01.280+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:18:01.629 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:18:01.484+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f39180c5410 auth_method 0 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:18:01.488+0000 7f3922edc640 10 monclient: get_auth_request con 0x7f391c0403e0 auth_method 0 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:18:01.496+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:18:01.496+0000 7f3804ff9640 1 client.8316.objecter ms_handle_reset 0x7f39180c5410 session 0x7f39180cb040 osd.4 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:18:01.496+0000 7f3804ff9640 10 monclient: _renew_subs 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:18:01.496+0000 7f3804ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:18:01.496+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f37ec080900 auth_method 0 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.630 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zone default found 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Realm: () 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:18:01.512+0000 7f39253d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zonegroup default 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.631 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started sync module instance, tier type = 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=0 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=1 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=2 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=3 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=4 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=5 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=6 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:18:01.536+0000 7f39253d69c0 20 add_watcher() i=7 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:18:01.536+0000 7f39253d69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:01.632 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.633 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:18:01.540+0000 7f37d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:18:01.540+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache list hook 0x560c4d03f1c0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache inspect hook 0x560c4d03f1c0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache erase hook 0x560c4d03f1c0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache zap hook 0x560c4d03f1c0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 note: GC not initialized 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:18:01.540+0000 7f3753fff640 20 reqs_thread_entry: start 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace show hook 0x7f39180b94b0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace history hook 0x7f39180b94b0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace active hook 0x7f39180b94b0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace active_short hook 0x7f39180b94b0 2024-09-05T01:18:01.634 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 Filter name: none 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:18:01.540+0000 7f3751ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:18:01.544+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:01.635 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94610831926096 notifier 8316 bl.length()=827 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:01.636 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f39253d69c0 time 2024-09-05T01:18:01.573136+0000 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3928cb02eb] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:18:01.637 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f39253d69c0 thread_name:radosgw-admin 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3927b2f520] 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3928cb0345] 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.638 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:18:01.639 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:18:01.640 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:18:01.641 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:18:01.642 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:18:01.643 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:18:01.644 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:18:01.645 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3751ffb640 / http_manager 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3753fff640 / http_manager 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f37d97e2640 / rgw_dt_lg_renew 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3804ff9640 / ms_dispatch 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3805ffb640 / io_context_pool 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f38067fc640 / io_context_pool 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f380ce01640 / ms_dispatch 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f380f606640 / ms_dispatch 2024-09-05T01:18:01.646 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3810e09640 / io_context_pool 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39226db640 / msgr-worker-2 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3922edc640 / msgr-worker-1 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39236dd640 / msgr-worker-0 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3923ede640 / io_context_pool 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39253d69c0 / radosgw-admin 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.144155.log 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: dump: 2024-09-05T01:18:01.647 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.648 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:18:01.248+0000 7f3810e09640 10 monclient: dump: 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 monclient: authenticate success, global_id 7835 2024-09-05T01:18:01.649 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:18:01.248+0000 7f39253d69c0 4 set_mon_vals no callback set 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: shutdown 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) unregister_commands rotate-key 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:18:01.248+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.650 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding auth protocol: cephx 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.651 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: crc 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:18:01.248+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfa2d10) adding con mode: secure 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:18:01.248+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 librados: starting msgr at 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:18:01.248+0000 7f39253d69c0 1 librados: starting objecter 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests hook 0x560c4cfa8010 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: setting wanted keys 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: calling monclient init 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.652 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding auth protocol: cephx 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: crc 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 AuthRegistry(0x560c4cf79860) adding con mode: secure 2024-09-05T01:18:01.653 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:18:01.252+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:18:01.252+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key hook 0x560c4cf799a8 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4ce350f0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4ce35ee0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4cebee00 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.712729s 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4ce350f0 auth_method 0 2024-09-05T01:18:01.654 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4ce35ee0 auth_method 0 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.655 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4cebee00 auth_method 0 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:18:01.252+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 8307 payload 824 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:18:01.252+0000 7f3922edc640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:18:01.252+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: dump: 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.656 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.657 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:18:01.252+0000 7f380f606640 10 monclient: dump: 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:18:01.252+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8307 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.658 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:18:01.252+0000 7f3810e09640 4 set_mon_vals no callback set 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:18:01.252+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:18:01.252+0000 7f39253d69c0 1 librados: init done 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:18:01.252+0000 7f380f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:18:01.252+0000 7f39226db640 10 monclient: get_auth_request con 0x7f3808070ae0 auth_method 0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:18:01.256+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4cfc1560 auth_method 0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:18:01.256+0000 7f3922edc640 10 monclient: get_auth_request con 0x560c4cfc43a0 auth_method 0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:18:01.256+0000 7f39226db640 10 monclient: get_auth_request con 0x560c4cfc8700 auth_method 0 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.659 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:18:01.260+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.660 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding auth protocol: cephx 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: crc 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcd560) adding con mode: secure 2024-09-05T01:18:01.661 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560c4cfd0f50 EEXIST 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding auth protocol: cephx 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.662 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: crc 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 AuthRegistry(0x560c4cfcbbe8) adding con mode: secure 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:18:01.260+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x560c4cfcbd30 EEXIST 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4cff5100 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4cff4a30 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4cff3410 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.663 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.722305s 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4cff5100 auth_method 0 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4cff3410 auth_method 0 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.664 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:18:01.260+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4cff4a30 auth_method 0 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:18:01.260+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.665 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:18:01.260+0000 7f3922edc640 1 monclient: found mon.noname-c 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:18:01.260+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: dump: 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.666 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:18:01.260+0000 7f39253d69c0 5 monclient: authenticate success, global_id 7841 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:18:01.260+0000 7f380ce01640 10 monclient: dump: 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.667 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:18:01.260+0000 7f3923ede640 4 set_mon_vals no callback set 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:18:01.260+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.668 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:18:01.264+0000 7f380ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: get_monmap_and_config 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:18:01.264+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.669 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding auth protocol: cephx 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.670 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: crc 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0145c0) adding con mode: secure 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: get_auth_request con 0x7f37fc070a20 auth_method 0 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding auth protocol: cephx 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.671 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: crc 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e90d0) adding con mode: secure 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:18:01.264+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc341e9218 EEXIST 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.672 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4d048a90 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4d0184b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4d044260 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.726830s 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4d044260 auth_method 0 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4d0184b0 auth_method 0 2024-09-05T01:18:01.673 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:18:01.264+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:18:01.264+0000 7f39226db640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:18:01.264+0000 7f39226db640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.674 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: dump: 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.675 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:18:01.264+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8313 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:18:01.264+0000 7f38067fc640 10 monclient: dump: 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:18:01.264+0000 7f39253d69c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:18:01.264+0000 7f39253d69c0 4 set_mon_vals no callback set 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: shutdown 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: build_initial_monmap 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: monmap: 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:01.677 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding auth protocol: cephx 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.678 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: crc 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4d0394b0) adding con mode: secure 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: starting msgr at 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: starting objecter 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command objecter_requests cmddesc objecter_requests hook 0x560c4d017150 EEXIST 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: setting wanted keys 2024-09-05T01:18:01.679 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: calling monclient init 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: init 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding auth protocol: cephx 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.680 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: crc 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 AuthRegistry(0x560c4cff6f20) adding con mode: secure 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:18:01.268+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command rotate-key cmddesc rotate-key hook 0x560c4cff7068 EEXIST 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-a con 0x560c4d0184b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-b con 0x560c4d044260 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): picked mon.noname-c con 0x560c4d048a90 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.681 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient(hunting): authenticate will time out at 2732.730197s 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): get_auth_request con 0x560c4d0184b0 auth_method 0 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): get_auth_request con 0x560c4d048a90 auth_method 0 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.682 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:18:01.268+0000 7f39236dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): get_auth_request con 0x560c4d044260 auth_method 0 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:18:01.268+0000 7f39226db640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient: _finish_hunting 0 2024-09-05T01:18:01.683 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:18:01.268+0000 7f3922edc640 1 monclient: found mon.noname-a 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:18:01.268+0000 7f3922edc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: dump: 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.684 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: _finish_auth 0 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: _check_auth_tickets 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:18:01.268+0000 7f3804ff9640 10 monclient: dump: 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 monclient: authenticate success, global_id 8316 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:18:01.268+0000 7f38067fc640 4 set_mon_vals no callback set 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _renew_subs 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:18:01.268+0000 7f39253d69c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:18:01.268+0000 7f39253d69c0 1 librados: init done 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:18:01.268+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cr dump hook 0x560c4d044a18 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.686 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:18:01.272+0000 7f3804ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:18:01.272+0000 7f39226db640 10 monclient: get_auth_request con 0x7f37ec070ae0 auth_method 0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:18:01.272+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4d061ea0 auth_method 0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 realm 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:18:01.272+0000 7f39253d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:18:01.272+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:18:01.272+0000 7f3922edc640 10 monclient: get_auth_request con 0x560c4d066200 auth_method 0 2024-09-05T01:18:01.687 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:18:01.276+0000 7f39226db640 10 monclient: get_auth_request con 0x560c4d069960 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:18:01.276+0000 7f39253d69c0 20 searching for the correct realm 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:18:01.276+0000 7f39236dd640 10 monclient: get_auth_request con 0x560c4d06e720 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:18:01.276+0000 7f3922edc640 10 monclient: get_auth_request con 0x7f391c020040 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:18:01.280+0000 7f39226db640 10 monclient: get_auth_request con 0x7f3914019070 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:18:01.280+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f39180c5410 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:18:01.280+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:18:01.484+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f39180c5410 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:18:01.488+0000 7f3922edc640 10 monclient: get_auth_request con 0x7f391c0403e0 auth_method 0 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:18:01.496+0000 7f39236dd640 0 -- 172.21.15.99:0/1625667065 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f39180c5410 msgr2=0x7f39180c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:01.688 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:18:01.496+0000 7f3804ff9640 1 client.8316.objecter ms_handle_reset 0x7f39180c5410 session 0x7f39180cb040 osd.4 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:18:01.496+0000 7f3804ff9640 10 monclient: _renew_subs 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:18:01.496+0000 7f3804ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:18:01.496+0000 7f39236dd640 10 monclient: get_auth_request con 0x7f37ec080900 auth_method 0 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:18:01.508+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.689 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zone default found 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Realm: () 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:18:01.512+0000 7f39253d69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:18:01.512+0000 7f39253d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 zonegroup default 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.690 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started sync module instance, tier type = 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:18:01.512+0000 7f39253d69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=0 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=1 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=2 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=3 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=4 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=5 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:18:01.532+0000 7f39253d69c0 20 add_watcher() i=6 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:18:01.536+0000 7f39253d69c0 20 add_watcher() i=7 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:18:01.536+0000 7f39253d69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.691 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding auth protocol: cephx 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.692 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: crc 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 AuthRegistry(0x7ffc341e95b0) adding con mode: secure 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:18:01.540+0000 7f37d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:18:01.540+0000 7f39253d69c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache list hook 0x560c4d03f1c0 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache inspect hook 0x560c4d03f1c0 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache erase hook 0x560c4d03f1c0 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command cache zap hook 0x560c4d03f1c0 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 note: GC not initialized 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:18:01.540+0000 7f3753fff640 20 reqs_thread_entry: start 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace show hook 0x7f39180b94b0 2024-09-05T01:18:01.693 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace history hook 0x7f39180b94b0 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace active hook 0x7f39180b94b0 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:18:01.540+0000 7f39253d69c0 5 asok(0x560c4cd6c2b0) register_command sync trace active_short hook 0x7f39180b94b0 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 Filter name: none 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:18:01.540+0000 7f3751ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:18:01.540+0000 7f39253d69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:18:01.540+0000 7f39253d69c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.694 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:18:01.544+0000 7f39253d69c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:18:01.544+0000 7f39253d69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:18:01.560+0000 7f39253d69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94610831926096 notifier 8316 bl.length()=827 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.695 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:18:01.560+0000 7f3805ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:18:01.564+0000 7f39253d69c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f39253d69c0 time 2024-09-05T01:18:01.573136+0000 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3928cb02eb] 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.696 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:18:01.572+0000 7f39253d69c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f39253d69c0 thread_name:radosgw-admin 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3927b2f520] 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:01.697 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3928cb0345] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3928cb049f] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560c4b51a681] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x142282c) [0x560c4bf7882c] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x560c4b52fafd] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3927b16d90] 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:01.698 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:18:01.699 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:18:01.700 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:18:01.701 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:18:01.702 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:18:01.703 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:18:01.704 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:18:01.705 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3751ffb640 / http_manager 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3753fff640 / http_manager 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f37d97e2640 / rgw_dt_lg_renew 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3804ff9640 / ms_dispatch 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3805ffb640 / io_context_pool 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f38067fc640 / io_context_pool 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f380ce01640 / ms_dispatch 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f380f606640 / ms_dispatch 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3810e09640 / io_context_pool 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39226db640 / msgr-worker-2 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3922edc640 / msgr-worker-1 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39236dd640 / msgr-worker-0 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f3923ede640 / io_context_pool 2024-09-05T01:18:01.706 INFO:tasks.workunit.client.0.smithi099.stderr: 7f39253d69c0 / radosgw-admin 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:18:01.576201Z_b251d724-44b7-4a8b-a5cf-0a159fea44da/log 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:18:01.707 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 realm 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.656+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.660+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.660+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.660+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.660+0000 7f198c8709c0 20 searching for the correct realm 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.664+0000 7f198ab77640 0 -- 172.21.15.99:0/3882639068 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f1980029040 msgr2=0x7f19800864c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.672+0000 7f198ab77640 0 -- 172.21.15.99:0/3882639068 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f1854080960 msgr2=0x7f1854082d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:01.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:01.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:01.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:01.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.676+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 zone default found 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 4 Realm: () 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 zonegroup default 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 started sync module instance, tier type = 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.680+0000 7f198c8709c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=0 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=1 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=2 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=3 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=4 2024-09-05T01:18:01.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=5 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=6 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 20 add_watcher() i=7 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.696+0000 7f198c8709c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f1840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 5 note: GC not initialized 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f17bb7fe640 20 reqs_thread_entry: start 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 Filter name: none 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f17b97fa640 20 reqs_thread_entry: start 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:01.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.700+0000 7f198c8709c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:18:01.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.704+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:18:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.708+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:18:01.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.712+0000 7f198c8709c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:18:01.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.716+0000 7f1840fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:01.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.720+0000 7f198c8709c0 20 remove_watcher() i=0 2024-09-05T01:18:01.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.720+0000 7f198c8709c0 2 removed watcher, disabling cache 2024-09-05T01:18:01.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.720+0000 7f198c8709c0 20 remove_watcher() i=1 2024-09-05T01:18:01.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.724+0000 7f198c8709c0 20 remove_watcher() i=2 2024-09-05T01:18:01.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.724+0000 7f198c8709c0 20 remove_watcher() i=3 2024-09-05T01:18:01.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.728+0000 7f198c8709c0 20 remove_watcher() i=4 2024-09-05T01:18:01.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.728+0000 7f198c8709c0 20 remove_watcher() i=5 2024-09-05T01:18:01.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.728+0000 7f198c8709c0 20 remove_watcher() i=6 2024-09-05T01:18:01.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:01.732+0000 7f198c8709c0 20 remove_watcher() i=7 2024-09-05T01:18:01.743 INFO:tasks.workunit.client.0.smithi099.stderr: test: duplicated entries can be purged manually 2024-09-05T01:18:31.770 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:18:31.803 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:31.803 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:31.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.847+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 realm 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:31.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.851+0000 7f58ec6199c0 20 searching for the correct realm 2024-09-05T01:18:31.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.859+0000 7f58ea11f640 0 -- 172.21.15.99:0/1565611394 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f58e4008040 msgr2=0x7f58e4008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:31.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.867+0000 7f58ea11f640 0 -- 172.21.15.99:0/1565611394 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f58e4008c20 msgr2=0x7f58e4036920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.871+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 zone default found 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 4 Realm: () 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:31.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:31.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:31.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 zonegroup default 2024-09-05T01:18:31.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 started sync module instance, tier type = 2024-09-05T01:18:31.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.875+0000 7f58ec6199c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:31.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=0 2024-09-05T01:18:31.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=1 2024-09-05T01:18:31.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=2 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=3 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=4 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=5 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=6 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 20 add_watcher() i=7 2024-09-05T01:18:31.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.891+0000 7f58ec6199c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:31.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f57a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 5 note: GC not initialized 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f571b7fe640 20 reqs_thread_entry: start 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 Filter name: none 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f57197fa640 20 reqs_thread_entry: start 2024-09-05T01:18:31.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:31.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.895+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:31.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:18:31.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:31.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:31.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:31.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.899+0000 7f58ec6199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:18:31.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.903+0000 7f57a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:31.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.907+0000 7f58ec6199c0 20 remove_watcher() i=0 2024-09-05T01:18:31.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.907+0000 7f58ec6199c0 2 removed watcher, disabling cache 2024-09-05T01:18:31.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.907+0000 7f58ec6199c0 20 remove_watcher() i=1 2024-09-05T01:18:31.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.911+0000 7f58ec6199c0 20 remove_watcher() i=2 2024-09-05T01:18:31.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.911+0000 7f58ec6199c0 20 remove_watcher() i=3 2024-09-05T01:18:31.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.915+0000 7f58ec6199c0 20 remove_watcher() i=4 2024-09-05T01:18:31.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.915+0000 7f58ec6199c0 20 remove_watcher() i=5 2024-09-05T01:18:31.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.915+0000 7f58ec6199c0 20 remove_watcher() i=6 2024-09-05T01:18:31.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:31.919+0000 7f58ec6199c0 20 remove_watcher() i=7 2024-09-05T01:18:31.931 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:31.931 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:18:31.931 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-05T01:18:31.931 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:31.932 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-05T01:18:31.964 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:31.964 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:32.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 realm 2024-09-05T01:18:32.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:32.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:32.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 searching for the correct realm 2024-09-05T01:18:32.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.015+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.231+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:32.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zone default found 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Realm: () 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zonegroup default 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started sync module instance, tier type = 2024-09-05T01:18:32.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:32.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=0 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=1 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=2 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=3 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=4 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=5 2024-09-05T01:18:32.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=6 2024-09-05T01:18:32.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=7 2024-09-05T01:18:32.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:32.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.275+0000 7f7e817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:32.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:32.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 note: GC not initialized 2024-09-05T01:18:32.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7dfbfff640 20 reqs_thread_entry: start 2024-09-05T01:18:32.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:32.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 Filter name: none 2024-09-05T01:18:32.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7df9ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:32.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:32.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:32.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:32.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:32.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:32.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:32.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.283+0000 7f7fccd1c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:32.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:32.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94088097147840 notifier 8373 bl.length()=827 2024-09-05T01:18:32.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:32.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:32.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:32.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:32.312 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7fccd1c9c0 time 2024-09-05T01:18:32.316257+0000 2024-09-05T01:18:32.312 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:32.314 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.314 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7fd05f62eb] 2024-09-05T01:18:32.314 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.315+0000 7f7fccd1c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7fccd1c9c0 time 2024-09-05T01:18:32.316257+0000 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7fd05f62eb] 2024-09-05T01:18:32.315 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-09-05T01:18:32.316 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7fccd1c9c0 thread_name:radosgw-admin 2024-09-05T01:18:32.317 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.317 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7fcf475520] 2024-09-05T01:18:32.317 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7fd05f6345] 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.319+0000 7f7fccd1c9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:32.318 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7fccd1c9c0 thread_name:radosgw-admin 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7fcf475520] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7fd05f6345] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.319 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:18:32.320 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:18:32.320 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:32.320 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.320 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:18:32.352 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:18:31.987+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:18:31.987+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:18:31.987+0000 7f7fcb023640 1 monclient: found mon.noname-c 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: dump: 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.353 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 7889 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.354 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: dump: 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.355 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 4 set_mon_vals no callback set 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: shutdown 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) unregister_commands rotate-key 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.356 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.357 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: starting msgr at 2024-09-05T01:18:32.358 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: starting objecter 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests hook 0x5592978eca20 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: setting wanted keys 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: calling monclient init 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.359 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.360 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key hook 0x5592978be668 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x55929774bdb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x55929774c190 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x559297776e90 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.450934s 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929774c190 auth_method 0 2024-09-05T01:18:32.361 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x559297776e90 auth_method 0 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.362 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:18:31.987+0000 7f7fcb023640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: dump: 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.363 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: dump: 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.364 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8364 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 4 set_mon_vals no callback set 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.365 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: init done 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:18:31.991+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7eb0070b10 auth_method 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:18:31.991+0000 7f7fca021640 10 monclient: get_auth_request con 0x5592978e6060 auth_method 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:18:31.991+0000 7f7fca822640 10 monclient: get_auth_request con 0x5592979090a0 auth_method 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:18:31.995+0000 7f7fca021640 10 monclient: get_auth_request con 0x55929790d290 auth_method 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.366 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.368 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests cmddesc objecter_requests hook 0x5592979158c0 EEXIST 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.369 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x5592979106b0 EEXIST 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x559297939a70 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x5592979393a0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x559297937d80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.370 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.460575s 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): get_auth_request con 0x559297939a70 auth_method 0 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x5592979393a0 auth_method 0 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.371 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.372 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x559297937d80 auth_method 0 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:18:31.999+0000 7f7fca021640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: dump: 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.373 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.374 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: dump: 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.375 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8367 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:18:31.999+0000 7f7fcb824640 4 set_mon_vals no callback set 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.376 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.377 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7ea4070a20 auth_method 0 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.378 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.379 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x7fff7bbb5318 EEXIST 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x55929795d520 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x55929795ea20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x5592979892a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.380 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.465049s 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929795ea20 auth_method 0 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x5592979892a0 auth_method 0 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.381 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_done global_id 8370 payload 274 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:18:32.003+0000 7f7fca021640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: get_auth_request con 0x55929795d520 auth_method 0 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: dump: 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.382 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.383 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8370 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 4 set_mon_vals no callback set 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: dump: 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.384 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: shutdown 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.385 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: starting msgr at 2024-09-05T01:18:32.387 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: starting objecter 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests cmddesc objecter_requests hook 0x55929797f4b0 EEXIST 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: setting wanted keys 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: calling monclient init 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.388 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x55929793b9d8 EEXIST 2024-09-05T01:18:32.389 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x55929795d520 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x55929795ea20 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x5592979892a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.467543s 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929795ea20 auth_method 0 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.390 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): get_auth_request con 0x55929795d520 auth_method 0 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_done global_id 8373 payload 824 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:18:32.003+0000 7f7fca822640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.391 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: dump: 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.392 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: dump: 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.393 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8373 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:18:32.007+0000 7f7eae7fc640 4 set_mon_vals no callback set 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 1 librados: init done 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cr dump hook 0x55929798d668 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.394 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:18:32.007+0000 7f7fcb023640 10 monclient: get_auth_request con 0x5592979a74a0 auth_method 0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:18:32.007+0000 7f7fca021640 10 monclient: get_auth_request con 0x7f7e94070b10 auth_method 0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 realm 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:18:32.011+0000 7f7fca822640 10 monclient: get_auth_request con 0x5592979ab600 auth_method 0 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.395 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:18:32.011+0000 7f7fca021640 10 monclient: get_auth_request con 0x5592979aeef0 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 searching for the correct realm 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:18:32.011+0000 7f7fcb023640 10 monclient: get_auth_request con 0x5592979b3c90 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:18:32.011+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7fc4062150 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:18:32.015+0000 7f7fca021640 10 monclient: get_auth_request con 0x7f7fbc0e2940 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:18:32.015+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7fc001fb20 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:18:32.015+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:18:32.219+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7fc001fb20 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:18:32.223+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7fc400fbd0 auth_method 0 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:18:32.231+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:18:32.231+0000 7f7eacff9640 1 client.8373.objecter ms_handle_reset 0x7f7fc001fb20 session 0x7f7fc00679c0 osd.4 2024-09-05T01:18:32.396 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:18:32.231+0000 7f7eacff9640 10 monclient: _renew_subs 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:18:32.231+0000 7f7eacff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:18:32.231+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7e94080930 auth_method 0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.397 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zone default found 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Realm: () 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zonegroup default 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.398 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started sync module instance, tier type = 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=0 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=1 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=2 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=3 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=4 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=5 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=6 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=7 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.399 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:18:32.275+0000 7f7e817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.400 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache list hook 0x5592979843c0 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache inspect hook 0x5592979843c0 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache erase hook 0x5592979843c0 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache zap hook 0x5592979843c0 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 note: GC not initialized 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:18:32.279+0000 7f7dfbfff640 20 reqs_thread_entry: start 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace show hook 0x7f7fc0001440 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace history hook 0x7f7fc0001440 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace active hook 0x7f7fc0001440 2024-09-05T01:18:32.401 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace active_short hook 0x7f7fc0001440 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 Filter name: none 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:18:32.279+0000 7f7df9ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.402 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:18:32.283+0000 7f7fccd1c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94088097147840 notifier 8373 bl.length()=827 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.403 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:18:32.315+0000 7f7fccd1c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7fccd1c9c0 time 2024-09-05T01:18:32.316257+0000 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7fd05f62eb] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:18:32.404 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.405 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:18:32.405 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:18:32.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.408 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:18:32.319+0000 7f7fccd1c9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:32.408 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7fccd1c9c0 thread_name:radosgw-admin 2024-09-05T01:18:32.408 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.408 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7fcf475520] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7fd05f6345] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.409 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:18:32.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:18:32.411 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:18:32.412 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:18:32.413 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:18:32.414 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:18:32.415 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:18:32.416 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7df9ffb640 / http_manager 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7dfbfff640 / http_manager 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7e817e2640 / rgw_dt_lg_renew 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eacff9640 / ms_dispatch 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eadffb640 / io_context_pool 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eae7fc640 / io_context_pool 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb4e01640 / ms_dispatch 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb7606640 / ms_dispatch 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb8e09640 / io_context_pool 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fca021640 / msgr-worker-2 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fca822640 / msgr-worker-1 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fcb023640 / msgr-worker-0 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fcb824640 / io_context_pool 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fccd1c9c0 / radosgw-admin 2024-09-05T01:18:32.417 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.145925.log 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-09-05T01:18:31.987+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-09-05T01:18:31.987+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-09-05T01:18:31.987+0000 7f7fcb023640 1 monclient: found mon.noname-c 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.418 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: dump: 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.419 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 7889 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 10 monclient: dump: 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.420 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 4 set_mon_vals no callback set 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: shutdown 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) unregister_commands rotate-key 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.421 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.422 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding auth protocol: cephx 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.423 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: crc 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978c4e70) adding con mode: secure 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: starting msgr at 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: starting objecter 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests hook 0x5592978eca20 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: setting wanted keys 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: calling monclient init 2024-09-05T01:18:32.424 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding auth protocol: cephx 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.425 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: crc 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 AuthRegistry(0x5592978be520) adding con mode: secure 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key hook 0x5592978be668 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x55929774bdb0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x55929774c190 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x559297776e90 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.426 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.450934s 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929774c190 auth_method 0 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x559297776e90 auth_method 0 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.427 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-09-05T01:18:31.987+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-09-05T01:18:31.987+0000 7f7fcb023640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-09-05T01:18:31.987+0000 7f7fcb023640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: dump: 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.428 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-09-05T01:18:31.987+0000 7f7eb7606640 10 monclient: dump: 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8364 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-09-05T01:18:31.987+0000 7f7eb8e09640 4 set_mon_vals no callback set 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.430 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-09-05T01:18:31.987+0000 7f7fccd1c9c0 1 librados: init done 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-09-05T01:18:31.991+0000 7f7eb7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-09-05T01:18:31.991+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7eb0070b10 auth_method 0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-09-05T01:18:31.991+0000 7f7fca021640 10 monclient: get_auth_request con 0x5592978e6060 auth_method 0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-09-05T01:18:31.991+0000 7f7fca822640 10 monclient: get_auth_request con 0x5592979090a0 auth_method 0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-09-05T01:18:31.995+0000 7f7fca021640 10 monclient: get_auth_request con 0x55929790d290 auth_method 0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.431 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding auth protocol: cephx 2024-09-05T01:18:32.432 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: crc 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297911e90) adding con mode: secure 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.433 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests cmddesc objecter_requests hook 0x5592979158c0 EEXIST 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding auth protocol: cephx 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.434 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: crc 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-09-05T01:18:31.995+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297910568) adding con mode: secure 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x5592979106b0 EEXIST 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x559297939a70 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x5592979393a0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x559297937d80 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.435 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.460575s 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): get_auth_request con 0x559297939a70 auth_method 0 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x5592979393a0 auth_method 0 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.436 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x559297937d80 auth_method 0 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-09-05T01:18:31.999+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient(hunting): handle_auth_done global_id 8367 payload 824 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-09-05T01:18:31.999+0000 7f7fca021640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-09-05T01:18:31.999+0000 7f7fca021640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: dump: 2024-09-05T01:18:32.437 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.438 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 10 monclient: dump: 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8367 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-09-05T01:18:31.999+0000 7f7fcb824640 4 set_mon_vals no callback set 2024-09-05T01:18:32.439 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-09-05T01:18:31.999+0000 7f7eb4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.440 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding auth protocol: cephx 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.441 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: crc 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-09-05T01:18:31.999+0000 7f7fccd1c9c0 5 AuthRegistry(0x559297959460) adding con mode: secure 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-09-05T01:18:31.999+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7ea4070a20 auth_method 0 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.442 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding auth protocol: cephx 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: crc 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb51d0) adding con mode: secure 2024-09-05T01:18:32.443 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x7fff7bbb5318 EEXIST 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x55929795d520 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x55929795ea20 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x5592979892a0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.444 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.465049s 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929795ea20 auth_method 0 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): get_auth_request con 0x5592979892a0 auth_method 0 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.445 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-09-05T01:18:32.003+0000 7f7fcb023640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_done global_id 8370 payload 274 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-09-05T01:18:32.003+0000 7f7fca021640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: get_auth_request con 0x55929795d520 auth_method 0 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: dump: 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.446 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8370 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: get_monmap_and_config success 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 4 set_mon_vals no callback set 2024-09-05T01:18:32.447 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-09-05T01:18:32.003+0000 7f7eae7fc640 10 monclient: dump: 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.448 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: shutdown 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: build_initial_monmap 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 build_initial for_mkfs: 0 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: monmap: 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.noname-b 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-09-05T01:18:32.449 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding auth protocol: cephx 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: crc 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929797e140) adding con mode: secure 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: starting msgr at 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: starting objecter 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command objecter_requests cmddesc objecter_requests hook 0x55929797f4b0 EEXIST 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: setting wanted keys 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 1 librados: calling monclient init 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: init 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.451 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding auth protocol: cephx 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: crc 2024-09-05T01:18:32.452 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 AuthRegistry(0x55929793b890) adding con mode: secure 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command rotate-key cmddesc rotate-key hook 0x55929793b9d8 EEXIST 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _reopen_session rank -1 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-a con 0x55929795d520 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-c con 0x55929795ea20 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): picked mon.noname-b con 0x5592979892a0 addr [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): start opening mon connection 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): _renew_subs 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-09-05T01:18:32.003+0000 7f7fccd1c9c0 10 monclient(hunting): authenticate will time out at 2763.467543s 2024-09-05T01:18:32.453 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request con 0x55929795ea20 auth_method 0 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): get_auth_request con 0x55929795d520 auth_method 0 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): _init_auth method 2 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): _init_auth creating new auth 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-09-05T01:18:32.003+0000 7f7fca021640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-05T01:18:32.454 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient(hunting): handle_auth_done global_id 8373 payload 824 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: _finish_hunting 0 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-09-05T01:18:32.003+0000 7f7fca822640 1 monclient: found mon.noname-a 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-09-05T01:18:32.003+0000 7f7fca822640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: dump: 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.455 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: _finish_auth 0 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: _check_auth_tickets 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_config config(0 keys) 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-09-05T01:18:32.007+0000 7f7eacff9640 10 monclient: dump: 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 678d0e28-1db8-4c70-ad6a-8dd16c8db3f1 2024-09-05T01:18:32.456 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-09-05T00:48:17.885524+0000 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon.b 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 5 monclient: authenticate success, global_id 8373 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-09-05T01:18:32.007+0000 7f7eae7fc640 4 set_mon_vals no callback set 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _renew_subs 2024-09-05T01:18:32.457 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 1 librados: init done 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cr dump hook 0x55929798d668 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-09-05T01:18:32.007+0000 7f7eacff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.204:6832/2863914563,v1:172.21.15.204:6833/2863914563] 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-09-05T01:18:32.007+0000 7f7fcb023640 10 monclient: get_auth_request con 0x5592979a74a0 auth_method 0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-09-05T01:18:32.007+0000 7f7fca021640 10 monclient: get_auth_request con 0x7f7e94070b10 auth_method 0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 realm 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.458 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-09-05T01:18:32.007+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-09-05T01:18:32.011+0000 7f7fca822640 10 monclient: get_auth_request con 0x5592979ab600 auth_method 0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-09-05T01:18:32.011+0000 7f7fca021640 10 monclient: get_auth_request con 0x5592979aeef0 auth_method 0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-09-05T01:18:32.011+0000 7f7fccd1c9c0 20 searching for the correct realm 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-09-05T01:18:32.011+0000 7f7fcb023640 10 monclient: get_auth_request con 0x5592979b3c90 auth_method 0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-09-05T01:18:32.011+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7fc4062150 auth_method 0 2024-09-05T01:18:32.459 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-09-05T01:18:32.015+0000 7f7fca021640 10 monclient: get_auth_request con 0x7f7fbc0e2940 auth_method 0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-09-05T01:18:32.015+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7fc001fb20 auth_method 0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-09-05T01:18:32.015+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-09-05T01:18:32.219+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7fc001fb20 auth_method 0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-09-05T01:18:32.223+0000 7f7fca822640 10 monclient: get_auth_request con 0x7f7fc400fbd0 auth_method 0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-09-05T01:18:32.231+0000 7f7fcb023640 0 -- 172.21.15.99:0/1431676217 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fc001fb20 msgr2=0x7f7fc0061e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-09-05T01:18:32.231+0000 7f7eacff9640 1 client.8373.objecter ms_handle_reset 0x7f7fc001fb20 session 0x7f7fc00679c0 osd.4 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-09-05T01:18:32.231+0000 7f7eacff9640 10 monclient: _renew_subs 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-09-05T01:18:32.231+0000 7f7eacff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-09-05T01:18:32.231+0000 7f7fcb023640 10 monclient: get_auth_request con 0x7f7e94080930 auth_method 0 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:32.460 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-09-05T01:18:32.243+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zone default found 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Realm: () 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:32.461 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 zonegroup default 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started sync module instance, tier type = 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-09-05T01:18:32.247+0000 7f7fccd1c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=0 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=1 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=2 2024-09-05T01:18:32.462 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=3 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=4 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=5 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=6 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 20 add_watcher() i=7 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-09-05T01:18:32.271+0000 7f7fccd1c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding auth protocol: cephx 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.463 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-09-05T01:18:32.275+0000 7f7e817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: crc 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 5 AuthRegistry(0x7fff7bbb56b0) adding con mode: secure 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-09-05T01:18:32.275+0000 7f7fccd1c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache list hook 0x5592979843c0 2024-09-05T01:18:32.464 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache inspect hook 0x5592979843c0 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache erase hook 0x5592979843c0 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command cache zap hook 0x5592979843c0 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 note: GC not initialized 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-09-05T01:18:32.279+0000 7f7dfbfff640 20 reqs_thread_entry: start 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace show hook 0x7f7fc0001440 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace history hook 0x7f7fc0001440 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace active hook 0x7f7fc0001440 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 5 asok(0x5592976b32b0) register_command sync trace active_short hook 0x7f7fc0001440 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 Filter name: none 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-09-05T01:18:32.279+0000 7f7df9ffb640 20 reqs_thread_entry: start 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:32.465 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-09-05T01:18:32.279+0000 7f7fccd1c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-09-05T01:18:32.283+0000 7f7fccd1c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.466 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94088097147840 notifier 8373 bl.length()=827 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-09-05T01:18:32.299+0000 7f7eadffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-09-05T01:18:32.299+0000 7f7fccd1c9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-09-05T01:18:32.315+0000 7f7fccd1c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7fccd1c9c0 time 2024-09-05T01:18:32.316257+0000 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.467 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7fd05f62eb] 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-09-05T01:18:32.319+0000 7f7fccd1c9c0 -1 *** Caught signal (Aborted) ** 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7fccd1c9c0 thread_name:radosgw-admin 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.468 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.3.0-4712-gede15070 (ede1507024117d16395cd6d958c594ff4aaf4da5) squid (dev) 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7fcf475520] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7fd05f6345] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7fd05f649f] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5592965aa681] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5592965bfb6a] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7fcf45cd90] 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-05T01:18:32.469 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 3/ 5 mds_quiesce 2024-09-05T01:18:32.470 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-09-05T01:18:32.471 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-09-05T01:18:32.472 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw_notification 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-09-05T01:18:32.473 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-09-05T01:18:32.474 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-09-05T01:18:32.475 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 ceph_dedup 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7df9ffb640 / http_manager 2024-09-05T01:18:32.476 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7dfbfff640 / http_manager 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7e817e2640 / rgw_dt_lg_renew 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eacff9640 / ms_dispatch 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eadffb640 / io_context_pool 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eae7fc640 / io_context_pool 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb4e01640 / ms_dispatch 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb7606640 / ms_dispatch 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7eb8e09640 / io_context_pool 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fca021640 / msgr-worker-2 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fca822640 / msgr-worker-1 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fcb023640 / msgr-worker-0 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fcb824640 / io_context_pool 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7fccd1c9c0 / radosgw-admin 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-09-05T01:18:32.477 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-09-05T01:18:32.478 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-09-05T01:18:32.321846Z_6c23e4c4-0c62-4c99-bb60-1924bcaaf21f/log 2024-09-05T01:18:32.478 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-09-05T01:18:32.478 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-09-05T01:18:32.478 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:18:32.479 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:32.479 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:32.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.403+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 realm 2024-09-05T01:18:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:32.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.607+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.611+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.611+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.611+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:32.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.611+0000 7fc32be209c0 20 searching for the correct realm 2024-09-05T01:18:32.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.619+0000 7fc329926640 0 -- 172.21.15.99:0/1127193338 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fc32405ef70 msgr2=0x7fc32405d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.631+0000 7fc329926640 0 -- 172.21.15.99:0/1127193338 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fc1f4080930 msgr2=0x7fc1f4082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:32.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 zone default found 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 4 Realm: () 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 zonegroup default 2024-09-05T01:18:32.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.643+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.647+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.647+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.647+0000 7fc32be209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.647+0000 7fc32be209c0 20 started sync module instance, tier type = 2024-09-05T01:18:32.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.647+0000 7fc32be209c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=0 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=1 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=2 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=3 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=4 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=5 2024-09-05T01:18:32.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=6 2024-09-05T01:18:32.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 20 add_watcher() i=7 2024-09-05T01:18:32.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.671+0000 7fc32be209c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:32.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.675+0000 7fc1db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:32.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:32.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 5 note: GC not initialized 2024-09-05T01:18:32.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc1da7fc640 20 reqs_thread_entry: start 2024-09-05T01:18:32.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:32.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 Filter name: none 2024-09-05T01:18:32.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc14bfff640 20 reqs_thread_entry: start 2024-09-05T01:18:32.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.679+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:18:32.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.683+0000 7fc32be209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:18:32.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.687+0000 7fc1db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.695+0000 7fc32be209c0 20 remove_watcher() i=0 2024-09-05T01:18:32.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.695+0000 7fc32be209c0 2 removed watcher, disabling cache 2024-09-05T01:18:32.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.695+0000 7fc32be209c0 20 remove_watcher() i=1 2024-09-05T01:18:32.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.699+0000 7fc32be209c0 20 remove_watcher() i=2 2024-09-05T01:18:32.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.699+0000 7fc32be209c0 20 remove_watcher() i=3 2024-09-05T01:18:32.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.703+0000 7fc32be209c0 20 remove_watcher() i=4 2024-09-05T01:18:32.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.703+0000 7fc32be209c0 20 remove_watcher() i=5 2024-09-05T01:18:32.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.703+0000 7fc32be209c0 20 remove_watcher() i=6 2024-09-05T01:18:32.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.707+0000 7fc32be209c0 20 remove_watcher() i=7 2024-09-05T01:18:32.768 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:18:32.795 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:18:32.795 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:18:32.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 realm 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.839+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.843+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.843+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.843+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:18:32.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.843+0000 7f50da0239c0 20 searching for the correct realm 2024-09-05T01:18:32.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.847+0000 7f50d832a640 0 -- 172.21.15.99:0/406061580 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x559c64a6ff40 msgr2=0x559c64a72400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:18:32.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.855+0000 7f50d832a640 0 -- 172.21.15.99:0/406061580 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f50c0036070 msgr2=0x7f50c0037910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:18:32.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.863+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 zone default found 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 4 Realm: () 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 zonegroup default 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:18:32.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 started sync module instance, tier type = 2024-09-05T01:18:32.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.867+0000 7f50da0239c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=0 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=1 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=2 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=3 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=4 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=5 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=6 2024-09-05T01:18:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 20 add_watcher() i=7 2024-09-05T01:18:32.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.883+0000 7f50da0239c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:18:32.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f4f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 5 note: GC not initialized 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f4f8cfe1640 20 reqs_thread_entry: start 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 init_complete bucket index max shards: 11 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 Filter name: none 2024-09-05T01:18:32.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f4f067fc640 20 reqs_thread_entry: start 2024-09-05T01:18:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:18:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:18:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:18:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:18:32.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:18:32.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.887+0000 7f50da0239c0 20 rados->read ofs=0 len=0 2024-09-05T01:18:32.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:18:32.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:18:32.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:18:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:18:32.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:18:32.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:18:32.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:18:32.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.891+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:18:32.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:18:32.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:18:32.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:18:32.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:18:32.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:18:32.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:18:32.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:18:32.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:18:32.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:18:32.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:18:32.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:18:32.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.895+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:18:32.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:18:32.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:18:32.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:18:32.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:18:32.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:18:32.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f50da0239c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:18:32.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.899+0000 7f4f8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:18:32.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.903+0000 7f50da0239c0 20 remove_watcher() i=0 2024-09-05T01:18:32.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.903+0000 7f50da0239c0 2 removed watcher, disabling cache 2024-09-05T01:18:32.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.907+0000 7f50da0239c0 20 remove_watcher() i=1 2024-09-05T01:18:32.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.907+0000 7f50da0239c0 20 remove_watcher() i=2 2024-09-05T01:18:32.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.911+0000 7f50da0239c0 20 remove_watcher() i=3 2024-09-05T01:18:32.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.911+0000 7f50da0239c0 20 remove_watcher() i=4 2024-09-05T01:18:32.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.915+0000 7f50da0239c0 20 remove_watcher() i=5 2024-09-05T01:18:32.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.915+0000 7f50da0239c0 20 remove_watcher() i=6 2024-09-05T01:18:32.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:18:32.915+0000 7f50da0239c0 20 remove_watcher() i=7 2024-09-05T01:19:02.958 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-05T01:19:02.991 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:02.991 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:03.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 realm 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.039+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.043+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.043+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.043+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:03.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.043+0000 7f3fa20839c0 20 searching for the correct realm 2024-09-05T01:19:03.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.047+0000 7f3fa038a640 0 -- 172.21.15.99:0/3209304290 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3f88104070 msgr2=0x7f3f880fc1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.263+0000 7f3fa038a640 0 -- 172.21.15.99:0/3209304290 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3f88104070 msgr2=0x7f3f880fc1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:03.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:03.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:03.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.275+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 zone default found 2024-09-05T01:19:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 4 Realm: () 2024-09-05T01:19:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:03.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:03.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 zonegroup default 2024-09-05T01:19:03.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 started sync module instance, tier type = 2024-09-05T01:19:03.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.279+0000 7f3fa20839c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=0 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=1 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=2 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=3 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=4 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=5 2024-09-05T01:19:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.303+0000 7f3fa20839c0 20 add_watcher() i=6 2024-09-05T01:19:03.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.307+0000 7f3fa20839c0 20 add_watcher() i=7 2024-09-05T01:19:03.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.307+0000 7f3fa20839c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:03.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3e55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3fa20839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:03.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3fa20839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:03.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3fa20839c0 5 note: GC not initialized 2024-09-05T01:19:03.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3e54fe1640 20 reqs_thread_entry: start 2024-09-05T01:19:03.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3fa20839c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:03.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.311+0000 7f3fa20839c0 20 Filter name: none 2024-09-05T01:19:03.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3dce7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:03.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:19:03.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:03.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:19:03.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:19:03.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:19:03.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:19:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:03.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.315+0000 7f3fa20839c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:19:03.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.323+0000 7f3e55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.327+0000 7f3fa20839c0 20 remove_watcher() i=0 2024-09-05T01:19:03.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.327+0000 7f3fa20839c0 2 removed watcher, disabling cache 2024-09-05T01:19:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.327+0000 7f3fa20839c0 20 remove_watcher() i=1 2024-09-05T01:19:03.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.331+0000 7f3fa20839c0 20 remove_watcher() i=2 2024-09-05T01:19:03.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.335+0000 7f3fa20839c0 20 remove_watcher() i=3 2024-09-05T01:19:03.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.335+0000 7f3fa20839c0 20 remove_watcher() i=4 2024-09-05T01:19:03.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.335+0000 7f3fa20839c0 20 remove_watcher() i=5 2024-09-05T01:19:03.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.339+0000 7f3fa20839c0 20 remove_watcher() i=6 2024-09-05T01:19:03.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.339+0000 7f3fa20839c0 20 remove_watcher() i=7 2024-09-05T01:19:03.355 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-05T01:19:03.383 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:03.383 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:03.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.427+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 realm 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:03.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.431+0000 7f8f4ede19c0 20 searching for the correct realm 2024-09-05T01:19:03.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.435+0000 7f8f4d0e8640 0 -- 172.21.15.99:0/481227684 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8f3807e040 msgr2=0x7f8f380636b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.443+0000 7f8f4c8e7640 0 -- 172.21.15.99:0/481227684 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f8f480d6040 msgr2=0x7f8f480e4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:03.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 zone default found 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 4 Realm: () 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 zonegroup default 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 started sync module instance, tier type = 2024-09-05T01:19:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.451+0000 7f8f4ede19c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:03.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=0 2024-09-05T01:19:03.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=1 2024-09-05T01:19:03.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=2 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=3 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=4 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=5 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.467+0000 7f8f4ede19c0 20 add_watcher() i=6 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8f4ede19c0 20 add_watcher() i=7 2024-09-05T01:19:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8f4ede19c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:03.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8e027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8f4ede19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:03.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8f4ede19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:03.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8f4ede19c0 5 note: GC not initialized 2024-09-05T01:19:03.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.471+0000 7f8e017e2640 20 reqs_thread_entry: start 2024-09-05T01:19:03.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:03.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 Filter name: none 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8dfa7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:19:03.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:03.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:03.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.475+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:03.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:03.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:03.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:03.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:03.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:03.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:03.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:03.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:03.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:03.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:03.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:03.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.479+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:03.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:03.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:03.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:03.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:03.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:03.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:03.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:03.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:03.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:03.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.483+0000 7f8f4ede19c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:03.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.487+0000 7f8e027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.491+0000 7f8f4ede19c0 20 remove_watcher() i=0 2024-09-05T01:19:03.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.491+0000 7f8f4ede19c0 2 removed watcher, disabling cache 2024-09-05T01:19:03.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.491+0000 7f8f4ede19c0 20 remove_watcher() i=1 2024-09-05T01:19:03.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.495+0000 7f8f4ede19c0 20 remove_watcher() i=2 2024-09-05T01:19:03.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.495+0000 7f8f4ede19c0 20 remove_watcher() i=3 2024-09-05T01:19:03.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.499+0000 7f8f4ede19c0 20 remove_watcher() i=4 2024-09-05T01:19:03.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.499+0000 7f8f4ede19c0 20 remove_watcher() i=5 2024-09-05T01:19:03.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.503+0000 7f8f4ede19c0 20 remove_watcher() i=6 2024-09-05T01:19:03.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.503+0000 7f8f4ede19c0 20 remove_watcher() i=7 2024-09-05T01:19:03.515 INFO:tasks.workunit.client.0.smithi099.stderr:check reshard logrecord successfully 2024-09-05T01:19:03.515 INFO:tasks.workunit.client.0.smithi099.stderr: test: reshard versioned bucket 2024-09-05T01:19:03.515 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-09-05T01:19:03.542 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:03.542 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:03.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.583+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 realm 2024-09-05T01:19:03.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:03.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.587+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.591+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:03.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.591+0000 7fed26aa59c0 20 searching for the correct realm 2024-09-05T01:19:03.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.595+0000 7fed24dac640 0 -- 172.21.15.99:0/4147363959 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fed18038920 msgr2=0x7fed1800e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.811+0000 7fed24dac640 0 -- 172.21.15.99:0/4147363959 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fed18038920 msgr2=0x7fed1800e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:03.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.823+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 zone default found 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 4 Realm: () 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 zonegroup default 2024-09-05T01:19:03.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 started sync module instance, tier type = 2024-09-05T01:19:03.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.827+0000 7fed26aa59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:03.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=0 2024-09-05T01:19:03.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=1 2024-09-05T01:19:03.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=2 2024-09-05T01:19:03.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=3 2024-09-05T01:19:03.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=4 2024-09-05T01:19:03.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=5 2024-09-05T01:19:03.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.851+0000 7fed26aa59c0 20 add_watcher() i=6 2024-09-05T01:19:03.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.855+0000 7fed26aa59c0 20 add_watcher() i=7 2024-09-05T01:19:03.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.855+0000 7fed26aa59c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:03.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7febdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:03.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:03.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 5 note: GC not initialized 2024-09-05T01:19:03.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7febd9fdb640 20 reqs_thread_entry: start 2024-09-05T01:19:03.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:03.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 20 Filter name: none 2024-09-05T01:19:03.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7feb4b7fe640 20 reqs_thread_entry: start 2024-09-05T01:19:03.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.859+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:03.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:03.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:03.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:03.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:03.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.863+0000 7fed26aa59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:03.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.867+0000 7febdafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:03.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.871+0000 7fed26aa59c0 20 remove_watcher() i=0 2024-09-05T01:19:03.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.871+0000 7fed26aa59c0 2 removed watcher, disabling cache 2024-09-05T01:19:03.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.875+0000 7fed26aa59c0 20 remove_watcher() i=1 2024-09-05T01:19:03.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.879+0000 7fed26aa59c0 20 remove_watcher() i=2 2024-09-05T01:19:03.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.879+0000 7fed26aa59c0 20 remove_watcher() i=3 2024-09-05T01:19:03.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.883+0000 7fed26aa59c0 20 remove_watcher() i=4 2024-09-05T01:19:03.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.883+0000 7fed26aa59c0 20 remove_watcher() i=5 2024-09-05T01:19:03.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.883+0000 7fed26aa59c0 20 remove_watcher() i=6 2024-09-05T01:19:03.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.887+0000 7fed26aa59c0 20 remove_watcher() i=7 2024-09-05T01:19:03.901 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:03.901 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:19:03.901 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-05T01:19:03.901 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:03.902 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-05T01:19:03.937 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:03.937 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:03.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 realm 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.979+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:03.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:03.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:03.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:03.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.983+0000 7fcd4fe909c0 20 searching for the correct realm 2024-09-05T01:19:03.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:03.987+0000 7fcd4e197640 0 -- 172.21.15.99:0/4090137456 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fcd440d8060 msgr2=0x7fcd44117930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:04.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.203+0000 7fcd4e197640 0 -- 172.21.15.99:0/4090137456 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fcd440d8060 msgr2=0x7fcd44117930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:04.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.215+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:04.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 zone default found 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 4 Realm: () 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 zonegroup default 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.219+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.223+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.223+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.223+0000 7fcd4fe909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.223+0000 7fcd4fe909c0 20 started sync module instance, tier type = 2024-09-05T01:19:04.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.223+0000 7fcd4fe909c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=0 2024-09-05T01:19:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=1 2024-09-05T01:19:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=2 2024-09-05T01:19:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=3 2024-09-05T01:19:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=4 2024-09-05T01:19:04.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=5 2024-09-05T01:19:04.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.243+0000 7fcd4fe909c0 20 add_watcher() i=6 2024-09-05T01:19:04.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.247+0000 7fcd4fe909c0 20 add_watcher() i=7 2024-09-05T01:19:04.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.247+0000 7fcd4fe909c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:04.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcbff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:04.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:04.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:04.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 5 note: GC not initialized 2024-09-05T01:19:04.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcbfe7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:04.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:04.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 Filter name: none 2024-09-05T01:19:04.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcb6ffff640 20 reqs_thread_entry: start 2024-09-05T01:19:04.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-05T01:19:04.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : miss 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 adding default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:04.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.251+0000 7fcd4fe909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcc30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94644899841248 notifier 8484 bl.length()=821 2024-09-05T01:19:04.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcc30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcc30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcc30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:04.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:04.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:04.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.263+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:04.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:04.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:04.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.0 2024-09-05T01:19:04.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.275+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1 2024-09-05T01:19:04.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.279+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2 2024-09-05T01:19:04.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.279+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3 2024-09-05T01:19:04.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.279+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.4 2024-09-05T01:19:04.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.279+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.5 2024-09-05T01:19:04.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.283+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.6 2024-09-05T01:19:04.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.283+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.7 2024-09-05T01:19:04.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.283+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.8 2024-09-05T01:19:04.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.283+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.9 2024-09-05T01:19:04.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.10 2024-09-05T01:19:04.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:04.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:04.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcd4fe909c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:04.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcc30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94644899841248 notifier 8484 bl.length()=821 2024-09-05T01:19:04.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcc30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcc30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.287+0000 7fcc30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.291+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:04.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.291+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:04.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.291+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:04.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.291+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:04.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.0 2024-09-05T01:19:04.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1 2024-09-05T01:19:04.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2 2024-09-05T01:19:04.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3 2024-09-05T01:19:04.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.4 2024-09-05T01:19:04.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.299+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.5 2024-09-05T01:19:04.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.303+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.6 2024-09-05T01:19:04.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.303+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.7 2024-09-05T01:19:04.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.303+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.8 2024-09-05T01:19:04.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.303+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.9 2024-09-05T01:19:04.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.303+0000 7fcd4fe909c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.10 2024-09-05T01:19:04.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:04.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcd4fe909c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcc317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94644899841248 notifier 8484 bl.length()=789 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcc317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcc317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:04.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.307+0000 7fcc317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:04.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.311+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:04.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.311+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:04.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.311+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:04.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.311+0000 7fcd4fe909c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:04.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.315+0000 7fcd4fe909c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-05T01:19:04.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.319+0000 7fcbff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:04.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.323+0000 7fcd4fe909c0 20 remove_watcher() i=0 2024-09-05T01:19:04.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.323+0000 7fcd4fe909c0 2 removed watcher, disabling cache 2024-09-05T01:19:04.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.327+0000 7fcd4fe909c0 20 remove_watcher() i=1 2024-09-05T01:19:04.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.327+0000 7fcd4fe909c0 20 remove_watcher() i=2 2024-09-05T01:19:04.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.331+0000 7fcd4fe909c0 20 remove_watcher() i=3 2024-09-05T01:19:04.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.331+0000 7fcd4fe909c0 20 remove_watcher() i=4 2024-09-05T01:19:04.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.335+0000 7fcd4fe909c0 20 remove_watcher() i=5 2024-09-05T01:19:04.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.335+0000 7fcd4fe909c0 20 remove_watcher() i=6 2024-09-05T01:19:04.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.335+0000 7fcd4fe909c0 20 remove_watcher() i=7 2024-09-05T01:19:04.351 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-09-05T01:19:04.382 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:04.383 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:04.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.427+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 realm 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:04.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:04.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:04.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.431+0000 7fa08760d9c0 20 searching for the correct realm 2024-09-05T01:19:04.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.435+0000 7fa084912640 0 -- 172.21.15.99:0/1474607019 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fa07801a040 msgr2=0x7fa07804e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:04.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.647+0000 7fa085113640 0 -- 172.21.15.99:0/1474607019 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fa0800fc8c0 msgr2=0x7fa0800f9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.663+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:04.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:04.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 zone default found 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 4 Realm: () 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 zonegroup default 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.667+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.671+0000 7fa08760d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:04.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.671+0000 7fa08760d9c0 20 started sync module instance, tier type = 2024-09-05T01:19:04.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.671+0000 7fa08760d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:04.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=0 2024-09-05T01:19:04.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=1 2024-09-05T01:19:04.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=2 2024-09-05T01:19:04.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=3 2024-09-05T01:19:04.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=4 2024-09-05T01:19:04.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=5 2024-09-05T01:19:04.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.691+0000 7fa08760d9c0 20 add_watcher() i=6 2024-09-05T01:19:04.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.695+0000 7fa08760d9c0 20 add_watcher() i=7 2024-09-05T01:19:04.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.695+0000 7fa08760d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:04.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7f9f3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:04.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:04.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:04.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 5 note: GC not initialized 2024-09-05T01:19:04.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7f9f3a7e4640 20 reqs_thread_entry: start 2024-09-05T01:19:04.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:04.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 Filter name: none 2024-09-05T01:19:04.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7f9eabfff640 20 reqs_thread_entry: start 2024-09-05T01:19:04.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:04.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.699+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:04.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:04.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:04.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:04.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:04.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.703+0000 7fa08760d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:04.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.707+0000 7f9f3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:04.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.711+0000 7fa08760d9c0 20 remove_watcher() i=0 2024-09-05T01:19:04.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.711+0000 7fa08760d9c0 2 removed watcher, disabling cache 2024-09-05T01:19:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.711+0000 7fa08760d9c0 20 remove_watcher() i=1 2024-09-05T01:19:04.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.715+0000 7fa08760d9c0 20 remove_watcher() i=2 2024-09-05T01:19:04.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.715+0000 7fa08760d9c0 20 remove_watcher() i=3 2024-09-05T01:19:04.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.719+0000 7fa08760d9c0 20 remove_watcher() i=4 2024-09-05T01:19:04.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.719+0000 7fa08760d9c0 20 remove_watcher() i=5 2024-09-05T01:19:04.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.723+0000 7fa08760d9c0 20 remove_watcher() i=6 2024-09-05T01:19:04.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:04.723+0000 7fa08760d9c0 20 remove_watcher() i=7 2024-09-05T01:19:04.737 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:04.737 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:19:04.737 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-05T01:19:04.737 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:04.830 INFO:tasks.workunit.client.0.smithi099.stderr: test: reshard removes olh entries with empty name 2024-09-05T01:19:05.651 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-05T01:19:05.683 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:05.683 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:05.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 realm 2024-09-05T01:19:05.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:05.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.727+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:05.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:05.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.731+0000 7f55d26659c0 20 searching for the correct realm 2024-09-05T01:19:05.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.735+0000 7f55d096c640 0 -- 172.21.15.99:0/4203217476 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f55b8008040 msgr2=0x7f55b80626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:05.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.951+0000 7f55d096c640 0 -- 172.21.15.99:0/4203217476 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f55b8008040 msgr2=0x7f55b80626e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:05.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 zone default found 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 4 Realm: () 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 zonegroup default 2024-09-05T01:19:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.963+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.967+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.967+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.967+0000 7f55d26659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:05.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.967+0000 7f55d26659c0 20 started sync module instance, tier type = 2024-09-05T01:19:05.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.967+0000 7f55d26659c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:05.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=0 2024-09-05T01:19:05.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=1 2024-09-05T01:19:05.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=2 2024-09-05T01:19:05.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=3 2024-09-05T01:19:05.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=4 2024-09-05T01:19:05.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=5 2024-09-05T01:19:05.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.987+0000 7f55d26659c0 20 add_watcher() i=6 2024-09-05T01:19:05.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.991+0000 7f55d26659c0 20 add_watcher() i=7 2024-09-05T01:19:05.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.991+0000 7f55d26659c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:05.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f5486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:05.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:05.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:05.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 5 note: GC not initialized 2024-09-05T01:19:05.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f5485fdb640 20 reqs_thread_entry: start 2024-09-05T01:19:05.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:05.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 Filter name: none 2024-09-05T01:19:05.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f53f77fe640 20 reqs_thread_entry: start 2024-09-05T01:19:05.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:05.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.995+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:05.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:05.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:05.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:05.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:05.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:05.999+0000 7f55d26659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:06.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.003+0000 7f5486fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.007+0000 7f55d26659c0 20 remove_watcher() i=0 2024-09-05T01:19:06.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.007+0000 7f55d26659c0 2 removed watcher, disabling cache 2024-09-05T01:19:06.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.011+0000 7f55d26659c0 20 remove_watcher() i=1 2024-09-05T01:19:06.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.011+0000 7f55d26659c0 20 remove_watcher() i=2 2024-09-05T01:19:06.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.015+0000 7f55d26659c0 20 remove_watcher() i=3 2024-09-05T01:19:06.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.019+0000 7f55d26659c0 20 remove_watcher() i=4 2024-09-05T01:19:06.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.019+0000 7f55d26659c0 20 remove_watcher() i=5 2024-09-05T01:19:06.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.019+0000 7f55d26659c0 20 remove_watcher() i=6 2024-09-05T01:19:06.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.023+0000 7f55d26659c0 20 remove_watcher() i=7 2024-09-05T01:19:06.038 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:06.039 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:19:06.039 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-05T01:19:06.039 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:06.039 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-05T01:19:06.071 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:06.071 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:06.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.115+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 realm 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:06.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.119+0000 7f90e977c9c0 20 searching for the correct realm 2024-09-05T01:19:06.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.123+0000 7f90e7a83640 0 -- 172.21.15.99:0/309392995 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f90dc01a040 msgr2=0x7f90dc05d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:19:06.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.131+0000 7f90e7a83640 0 -- 172.21.15.99:0/309392995 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f8fb00809c0 msgr2=0x7f8fb0082df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.139+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 zone default found 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 4 Realm: () 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 zonegroup default 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 started sync module instance, tier type = 2024-09-05T01:19:06.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.143+0000 7f90e977c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:06.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=0 2024-09-05T01:19:06.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=1 2024-09-05T01:19:06.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=2 2024-09-05T01:19:06.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=3 2024-09-05T01:19:06.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=4 2024-09-05T01:19:06.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=5 2024-09-05T01:19:06.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=6 2024-09-05T01:19:06.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 20 add_watcher() i=7 2024-09-05T01:19:06.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.159+0000 7f90e977c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:06.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f8f9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:06.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:06.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 5 note: GC not initialized 2024-09-05T01:19:06.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f8f9cfe1640 20 reqs_thread_entry: start 2024-09-05T01:19:06.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:06.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 Filter name: none 2024-09-05T01:19:06.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f8f167fc640 20 reqs_thread_entry: start 2024-09-05T01:19:06.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:06.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.163+0000 7f90e977c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.167+0000 7f90e977c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:06.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.167+0000 7f90e977c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:06.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.167+0000 7f8f9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.171+0000 7f90e977c9c0 20 remove_watcher() i=0 2024-09-05T01:19:06.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.171+0000 7f90e977c9c0 2 removed watcher, disabling cache 2024-09-05T01:19:06.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.175+0000 7f90e977c9c0 20 remove_watcher() i=1 2024-09-05T01:19:06.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.175+0000 7f90e977c9c0 20 remove_watcher() i=2 2024-09-05T01:19:06.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.179+0000 7f90e977c9c0 20 remove_watcher() i=3 2024-09-05T01:19:06.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.179+0000 7f90e977c9c0 20 remove_watcher() i=4 2024-09-05T01:19:06.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.183+0000 7f90e977c9c0 20 remove_watcher() i=5 2024-09-05T01:19:06.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.183+0000 7f90e977c9c0 20 remove_watcher() i=6 2024-09-05T01:19:06.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.183+0000 7f90e977c9c0 20 remove_watcher() i=7 2024-09-05T01:19:06.197 INFO:tasks.workunit.client.0.smithi099.stderr:rados -p default.rgw.buckets.index setomapval .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-05T01:19:06.223 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:06.223 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:06.242 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-05T01:19:06.267 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:06.267 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:06.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 realm 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.311+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.315+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.315+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.315+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:06.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.315+0000 7f47825479c0 20 searching for the correct realm 2024-09-05T01:19:06.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.319+0000 7f477f84c640 0 -- 172.21.15.99:0/1911140370 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f4778003020 msgr2=0x7f4778062e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.323+0000 7f478004d640 0 -- 172.21.15.99:0/1911140370 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x5562f8ba4ee0 msgr2=0x7f477005dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.331+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 zone default found 2024-09-05T01:19:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 4 Realm: () 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 zonegroup default 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 started sync module instance, tier type = 2024-09-05T01:19:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.335+0000 7f47825479c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=0 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=1 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=2 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=3 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=4 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=5 2024-09-05T01:19:06.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=6 2024-09-05T01:19:06.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 20 add_watcher() i=7 2024-09-05T01:19:06.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.351+0000 7f47825479c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:06.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f4636fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 5 note: GC not initialized 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f4635fdb640 20 reqs_thread_entry: start 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 Filter name: none 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f45a77fe640 20 reqs_thread_entry: start 2024-09-05T01:19:06.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:06.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.355+0000 7f47825479c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:06.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-05T01:19:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: starting shard=0 2024-09-05T01:19:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T01:19:06.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: starting shard=1 2024-09-05T01:19:06.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 INFO: main: starting shard=2 2024-09-05T01:19:06.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.359+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: starting shard=3 2024-09-05T01:19:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: starting shard=4 2024-09-05T01:19:06.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: starting shard=5 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 INFO: main: starting shard=6 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.363+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: starting shard=7 2024-09-05T01:19:06.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: starting shard=8 2024-09-05T01:19:06.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: starting shard=9 2024-09-05T01:19:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 INFO: main: starting shard=10 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.367+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: starting shard=11 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: starting shard=12 2024-09-05T01:19:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f47825479c0 20 INFO: main: done 2024-09-05T01:19:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.371+0000 7f4636fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.379+0000 7f47825479c0 20 remove_watcher() i=0 2024-09-05T01:19:06.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.379+0000 7f47825479c0 2 removed watcher, disabling cache 2024-09-05T01:19:06.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.379+0000 7f47825479c0 20 remove_watcher() i=1 2024-09-05T01:19:06.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.383+0000 7f47825479c0 20 remove_watcher() i=2 2024-09-05T01:19:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.383+0000 7f47825479c0 20 remove_watcher() i=3 2024-09-05T01:19:06.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.387+0000 7f47825479c0 20 remove_watcher() i=4 2024-09-05T01:19:06.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.387+0000 7f47825479c0 20 remove_watcher() i=5 2024-09-05T01:19:06.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.387+0000 7f47825479c0 20 remove_watcher() i=6 2024-09-05T01:19:06.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.391+0000 7f47825479c0 20 remove_watcher() i=7 2024-09-05T01:19:06.403 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-05T01:19:06.432 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:06.432 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:06.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 realm 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.475+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.479+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.479+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.479+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:06.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.479+0000 7f2726bcb9c0 20 searching for the correct realm 2024-09-05T01:19:06.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.483+0000 7f27246d1640 0 -- 172.21.15.99:0/2133455039 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f271c019b20 msgr2=0x7f271c028930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.491+0000 7f27246d1640 0 -- 172.21.15.99:0/2133455039 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f271c038040 msgr2=0x7f271c017940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:06.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:06.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:06.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:06.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:06.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:06.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 zone default found 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 4 Realm: () 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 zonegroup default 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.499+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.503+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.503+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.503+0000 7f2726bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.503+0000 7f2726bcb9c0 20 started sync module instance, tier type = 2024-09-05T01:19:06.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.503+0000 7f2726bcb9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=0 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=1 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=2 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=3 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=4 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=5 2024-09-05T01:19:06.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=6 2024-09-05T01:19:06.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 20 add_watcher() i=7 2024-09-05T01:19:06.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.519+0000 7f2726bcb9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:06.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f25dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:06.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:06.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 5 note: GC not initialized 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f25d9fdb640 20 reqs_thread_entry: start 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 Filter name: none 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f254b7fe640 20 reqs_thread_entry: start 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-05T01:19:06.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : miss 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:06.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:06.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.523+0000 7f2726bcb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:19:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f2726bcb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f2726bcb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f2726bcb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f2726bcb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:19:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f25faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464360 cookie 94634608895568 notifier 8090 bl.length()=827 2024-09-05T01:19:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f25faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f25faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.531+0000 7f25faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.535+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:19:06.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.535+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:19:06.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.535+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:19:06.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.535+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:19:06.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.547+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:19:06.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.547+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:19:06.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.547+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.547+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-05T01:19:06.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.551+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.555+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:06.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.559+0000 7f2726bcb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:19:06.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f2726bcb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f2726bcb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f2726bcb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f2726bcb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:19:06.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f25faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464361 cookie 94634608895568 notifier 8090 bl.length()=827 2024-09-05T01:19:06.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f25faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f25faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.563+0000 7f25faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.567+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:19:06.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.567+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:19:06.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.567+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:19:06.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.567+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:19:06.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.0 2024-09-05T01:19:06.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.1 2024-09-05T01:19:06.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.2 2024-09-05T01:19:06.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.3 2024-09-05T01:19:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.575+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.4 2024-09-05T01:19:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.5 2024-09-05T01:19:06.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.6 2024-09-05T01:19:06.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.7 2024-09-05T01:19:06.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.8 2024-09-05T01:19:06.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.9 2024-09-05T01:19:06.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.579+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.10 2024-09-05T01:19:06.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.11 2024-09-05T01:19:06.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.2.12 2024-09-05T01:19:06.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:06.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.583+0000 7f2726bcb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 2024-09-05T01:19:06.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17, ofs0, ns] 2024-09-05T01:19:06.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f25faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464362 cookie 94634608895568 notifier 8090 bl.length()=795 2024-09-05T01:19:06.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f25faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 info.flags=0x17 2024-09-05T01:19:06.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f25faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17 to cache LRU end 2024-09-05T01:19:06.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f25faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:06.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_sources= new_sources= 2024-09-05T01:19:06.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential sources added=[] removed=[] 2024-09-05T01:19:06.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): orig_dests= new_dests= 2024-09-05T01:19:06.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.587+0000 7f2726bcb9c0 20 handle_bi_update(): bucket=:a-bucket[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17]): potential dests added=[] removed=[] 2024-09-05T01:19:06.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.595+0000 7f2726bcb9c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-05T01:19:06.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.599+0000 7f25dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.603+0000 7f2726bcb9c0 20 remove_watcher() i=0 2024-09-05T01:19:06.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.603+0000 7f2726bcb9c0 2 removed watcher, disabling cache 2024-09-05T01:19:06.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.603+0000 7f2726bcb9c0 20 remove_watcher() i=1 2024-09-05T01:19:06.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.607+0000 7f2726bcb9c0 20 remove_watcher() i=2 2024-09-05T01:19:06.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.607+0000 7f2726bcb9c0 20 remove_watcher() i=3 2024-09-05T01:19:06.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.611+0000 7f2726bcb9c0 20 remove_watcher() i=4 2024-09-05T01:19:06.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.611+0000 7f2726bcb9c0 20 remove_watcher() i=5 2024-09-05T01:19:06.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.615+0000 7f2726bcb9c0 20 remove_watcher() i=6 2024-09-05T01:19:06.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.615+0000 7f2726bcb9c0 20 remove_watcher() i=7 2024-09-05T01:19:06.628 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-05T01:19:06.655 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:06.655 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:06.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 realm 2024-09-05T01:19:06.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:06.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.699+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.703+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.703+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.703+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:06.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.703+0000 7f33b34569c0 20 searching for the correct realm 2024-09-05T01:19:06.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.707+0000 7f33b175d640 0 -- 172.21.15.99:0/2611398518 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f33a401a040 msgr2=0x7f33a4062b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.923+0000 7f33b175d640 0 -- 172.21.15.99:0/2611398518 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f33a401a040 msgr2=0x7f33a4062b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:06.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.935+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:06.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 zone default found 2024-09-05T01:19:06.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 4 Realm: () 2024-09-05T01:19:06.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:06.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 zonegroup default 2024-09-05T01:19:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:06.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 started sync module instance, tier type = 2024-09-05T01:19:06.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.939+0000 7f33b34569c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=0 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=1 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=2 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=3 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=4 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=5 2024-09-05T01:19:06.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.963+0000 7f33b34569c0 20 add_watcher() i=6 2024-09-05T01:19:06.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.967+0000 7f33b34569c0 20 add_watcher() i=7 2024-09-05T01:19:06.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.967+0000 7f33b34569c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:06.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f3266fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f33b34569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f33b34569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f33b34569c0 5 note: GC not initialized 2024-09-05T01:19:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f3265fe3640 20 reqs_thread_entry: start 2024-09-05T01:19:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f33b34569c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.971+0000 7f33b34569c0 20 Filter name: none 2024-09-05T01:19:06.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f31d77fe640 20 reqs_thread_entry: start 2024-09-05T01:19:06.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-05T01:19:06.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 INFO: main: starting shard=0 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:19:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17.3.0 2024-09-05T01:19:06.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:06.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.975+0000 7f33b34569c0 20 INFO: main: done 2024-09-05T01:19:06.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.979+0000 7f3266fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:06.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.983+0000 7f33b34569c0 20 remove_watcher() i=0 2024-09-05T01:19:06.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.983+0000 7f33b34569c0 2 removed watcher, disabling cache 2024-09-05T01:19:06.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.983+0000 7f33b34569c0 20 remove_watcher() i=1 2024-09-05T01:19:06.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.987+0000 7f33b34569c0 20 remove_watcher() i=2 2024-09-05T01:19:06.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.991+0000 7f33b34569c0 20 remove_watcher() i=3 2024-09-05T01:19:06.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.991+0000 7f33b34569c0 20 remove_watcher() i=4 2024-09-05T01:19:06.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.995+0000 7f33b34569c0 20 remove_watcher() i=5 2024-09-05T01:19:06.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.995+0000 7f33b34569c0 20 remove_watcher() i=6 2024-09-05T01:19:06.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:06.995+0000 7f33b34569c0 20 remove_watcher() i=7 2024-09-05T01:19:07.012 INFO:tasks.workunit.client.0.smithi099.stderr: test: PUT succeeds during reshard 2024-09-05T01:19:07.012 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-09-05T01:19:07.043 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:07.043 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:07.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 realm 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.087+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:07.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:07.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.091+0000 7fd4fd3c69c0 20 searching for the correct realm 2024-09-05T01:19:07.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.095+0000 7fd4fa6cb640 0 -- 172.21.15.99:0/1634865336 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fd4ec008050 msgr2=0x7fd4ec08a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:07.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.307+0000 7fd4faecc640 0 -- 172.21.15.99:0/1634865336 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd4f4016040 msgr2=0x7fd4f408b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.323+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:07.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:07.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 zone default found 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 4 Realm: () 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 zonegroup default 2024-09-05T01:19:07.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.327+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.331+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.331+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.331+0000 7fd4fd3c69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.331+0000 7fd4fd3c69c0 20 started sync module instance, tier type = 2024-09-05T01:19:07.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.331+0000 7fd4fd3c69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:07.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=0 2024-09-05T01:19:07.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=1 2024-09-05T01:19:07.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=2 2024-09-05T01:19:07.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=3 2024-09-05T01:19:07.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=4 2024-09-05T01:19:07.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=5 2024-09-05T01:19:07.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.351+0000 7fd4fd3c69c0 20 add_watcher() i=6 2024-09-05T01:19:07.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.355+0000 7fd4fd3c69c0 20 add_watcher() i=7 2024-09-05T01:19:07.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.355+0000 7fd4fd3c69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:07.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.355+0000 7fd3b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:07.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:07.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:07.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 5 note: GC not initialized 2024-09-05T01:19:07.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd32bfff640 20 reqs_thread_entry: start 2024-09-05T01:19:07.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:07.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 Filter name: none 2024-09-05T01:19:07.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd329ffb640 20 reqs_thread_entry: start 2024-09-05T01:19:07.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:07.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:07.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:07.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.359+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.363+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:07.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.363+0000 7fd4fd3c69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.363+0000 7fd4fd3c69c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:07.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.363+0000 7fd4fd3c69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:07.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.363+0000 7fd3b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:07.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.371+0000 7fd4fd3c69c0 20 remove_watcher() i=0 2024-09-05T01:19:07.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.371+0000 7fd4fd3c69c0 2 removed watcher, disabling cache 2024-09-05T01:19:07.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.371+0000 7fd4fd3c69c0 20 remove_watcher() i=1 2024-09-05T01:19:07.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.375+0000 7fd4fd3c69c0 20 remove_watcher() i=2 2024-09-05T01:19:07.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.379+0000 7fd4fd3c69c0 20 remove_watcher() i=3 2024-09-05T01:19:07.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.379+0000 7fd4fd3c69c0 20 remove_watcher() i=4 2024-09-05T01:19:07.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.379+0000 7fd4fd3c69c0 20 remove_watcher() i=5 2024-09-05T01:19:07.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.383+0000 7fd4fd3c69c0 20 remove_watcher() i=6 2024-09-05T01:19:07.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.383+0000 7fd4fd3c69c0 20 remove_watcher() i=7 2024-09-05T01:19:07.398 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:07.399 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-09-05T01:19:07.399 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-05T01:19:07.399 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:07.399 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-05T01:19:07.431 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:07.431 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:07.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.475+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.475+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.475+0000 7f72617a69c0 20 realm 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.475+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:07.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:07.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.479+0000 7f72617a69c0 20 searching for the correct realm 2024-09-05T01:19:07.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.487+0000 7f725f2ac640 0 -- 172.21.15.99:0/1098714721 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f725001ac00 msgr2=0x7f7250028940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:07.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.495+0000 7f725f2ac640 0 -- 172.21.15.99:0/1098714721 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f7250038040 msgr2=0x7f7250019450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.499+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 zone default found 2024-09-05T01:19:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 4 Realm: () 2024-09-05T01:19:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 zonegroup default 2024-09-05T01:19:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 started sync module instance, tier type = 2024-09-05T01:19:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.503+0000 7f72617a69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=0 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=1 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=2 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=3 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=4 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=5 2024-09-05T01:19:07.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=6 2024-09-05T01:19:07.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 20 add_watcher() i=7 2024-09-05T01:19:07.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.519+0000 7f72617a69c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f7115fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 5 note: GC not initialized 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f7114fe1640 20 reqs_thread_entry: start 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 Filter name: none 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f708e7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : miss 2024-09-05T01:19:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 adding default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.523+0000 7f72617a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:07.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:07.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:07.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:07.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:07.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f71427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94385017230512 notifier 8652 bl.length()=821 2024-09-05T01:19:07.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f71427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:07.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f71427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:07.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f71427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:07.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:07.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:07.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:07.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.535+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:07.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:07.547+0000 7f72617a69c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-05T01:19:08.552 INFO:tasks.workunit.client.0.smithi099.stderr:put object successful 2024-09-05T01:19:12.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:12.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:12.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.546+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:12.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:12.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:12.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:12.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:12.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:12.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.550+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:12.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:12.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:12.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:12.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:12.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:12.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.554+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:12.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:12.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:12.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:12.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:12.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:12.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.558+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:12.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.562+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:12.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.562+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:12.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.562+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:12.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.562+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:12.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.566+0000 7f72617a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:12.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.566+0000 7f72617a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:12.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f72617a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:12.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f72617a69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:12.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f72617a69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:12.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f72617a69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f7142ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94385017230512 notifier 8652 bl.length()=821 2024-09-05T01:19:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f7142ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f7142ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.570+0000 7f7142ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:12.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.574+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:12.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.574+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:12.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.574+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:12.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.574+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:12.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:12.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.0 2024-09-05T01:19:12.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:12.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.1 2024-09-05T01:19:12.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:12.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.582+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.2 2024-09-05T01:19:12.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:12.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.3 2024-09-05T01:19:12.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:12.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.4 2024-09-05T01:19:12.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:12.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.5 2024-09-05T01:19:12.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:12.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.6 2024-09-05T01:19:12.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:12.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.586+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.7 2024-09-05T01:19:12.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:12.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.8 2024-09-05T01:19:12.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:12.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.9 2024-09-05T01:19:12.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:12.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.590+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.10 2024-09-05T01:19:12.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.594+0000 7f72617a69c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:12.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.594+0000 7f72617a69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.1.11 2024-09-05T01:19:12.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.598+0000 7f72617a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:12.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.598+0000 7f72617a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:12.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f72617a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:12.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f72617a69c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f72617a69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f72617a69c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f71427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94385017230512 notifier 8652 bl.length()=789 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f71427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f71427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:12.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.602+0000 7f71427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.606+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.606+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.606+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.606+0000 7f72617a69c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:12.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.614+0000 7f72617a69c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-05T01:19:12.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.622+0000 7f7115fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:12.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.626+0000 7f72617a69c0 20 remove_watcher() i=0 2024-09-05T01:19:12.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.626+0000 7f72617a69c0 2 removed watcher, disabling cache 2024-09-05T01:19:12.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.630+0000 7f72617a69c0 20 remove_watcher() i=1 2024-09-05T01:19:12.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.630+0000 7f72617a69c0 20 remove_watcher() i=2 2024-09-05T01:19:12.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.634+0000 7f72617a69c0 20 remove_watcher() i=3 2024-09-05T01:19:12.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.638+0000 7f72617a69c0 20 remove_watcher() i=4 2024-09-05T01:19:12.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.638+0000 7f72617a69c0 20 remove_watcher() i=5 2024-09-05T01:19:12.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.642+0000 7f72617a69c0 20 remove_watcher() i=6 2024-09-05T01:19:12.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:12.646+0000 7f72617a69c0 20 remove_watcher() i=7 2024-09-05T01:19:13.557 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-05T01:19:13.557 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T01:19:14.427 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-05T01:19:14.884 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-05T01:19:16.514 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T01:19:16.515 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-05T01:19:16.549 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:16.550 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:16.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 realm 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.594+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.598+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.598+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.598+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.598+0000 7f22ab3d99c0 20 searching for the correct realm 2024-09-05T01:19:16.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.602+0000 7f22a96e0640 0 -- 172.21.15.99:0/2924134085 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f2290035030 msgr2=0x7f2290037970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:16.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.818+0000 7f22a96e0640 0 -- 172.21.15.99:0/2924134085 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f2290035030 msgr2=0x7f2290037970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.830+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:16.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 zone default found 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 4 Realm: () 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 zonegroup default 2024-09-05T01:19:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.834+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.838+0000 7f22ab3d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:16.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.838+0000 7f22ab3d99c0 20 started sync module instance, tier type = 2024-09-05T01:19:16.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.838+0000 7f22ab3d99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:16.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=0 2024-09-05T01:19:16.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=1 2024-09-05T01:19:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=2 2024-09-05T01:19:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=3 2024-09-05T01:19:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=4 2024-09-05T01:19:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=5 2024-09-05T01:19:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.858+0000 7f22ab3d99c0 20 add_watcher() i=6 2024-09-05T01:19:16.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.862+0000 7f22ab3d99c0 20 add_watcher() i=7 2024-09-05T01:19:16.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.862+0000 7f22ab3d99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:16.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f215efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:16.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:16.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:16.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 5 note: GC not initialized 2024-09-05T01:19:16.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f215dfe3640 20 reqs_thread_entry: start 2024-09-05T01:19:16.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:16.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 20 Filter name: none 2024-09-05T01:19:16.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f20cf7fe640 20 reqs_thread_entry: start 2024-09-05T01:19:16.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.866+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:16.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: starting shard=0 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:16.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: starting shard=1 2024-09-05T01:19:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:16.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 INFO: main: starting shard=2 2024-09-05T01:19:16.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:16.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.870+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:16.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: starting shard=3 2024-09-05T01:19:16.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:16.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:16.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: starting shard=4 2024-09-05T01:19:16.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:16.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: starting shard=5 2024-09-05T01:19:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T01:19:16.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 INFO: main: starting shard=6 2024-09-05T01:19:16.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:16.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.874+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:16.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: starting shard=7 2024-09-05T01:19:16.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:16.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: starting shard=8 2024-09-05T01:19:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: starting shard=9 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 INFO: main: starting shard=10 2024-09-05T01:19:16.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:16.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.878+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: starting shard=11 2024-09-05T01:19:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:16.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: starting shard=12 2024-09-05T01:19:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:16.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:16.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:16.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f22ab3d99c0 20 INFO: main: done 2024-09-05T01:19:16.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.882+0000 7f215efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:16.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.890+0000 7f22ab3d99c0 20 remove_watcher() i=0 2024-09-05T01:19:16.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.890+0000 7f22ab3d99c0 2 removed watcher, disabling cache 2024-09-05T01:19:16.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.890+0000 7f22ab3d99c0 20 remove_watcher() i=1 2024-09-05T01:19:16.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.894+0000 7f22ab3d99c0 20 remove_watcher() i=2 2024-09-05T01:19:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.898+0000 7f22ab3d99c0 20 remove_watcher() i=3 2024-09-05T01:19:16.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.898+0000 7f22ab3d99c0 20 remove_watcher() i=4 2024-09-05T01:19:16.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.902+0000 7f22ab3d99c0 20 remove_watcher() i=5 2024-09-05T01:19:16.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.902+0000 7f22ab3d99c0 20 remove_watcher() i=6 2024-09-05T01:19:16.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:16.902+0000 7f22ab3d99c0 20 remove_watcher() i=7 2024-09-05T01:19:17.094 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T01:19:17.094 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-05T01:19:17.129 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:17.129 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:17.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 realm 2024-09-05T01:19:17.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:17.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.174+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.178+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:17.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.178+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.178+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:17.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.178+0000 7fb0d2ba49c0 20 searching for the correct realm 2024-09-05T01:19:17.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.182+0000 7fb0d06aa640 0 -- 172.21.15.99:0/1245275072 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fb0c80cf040 msgr2=0x7fb0c80c33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:17.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.190+0000 7fb0d06aa640 0 -- 172.21.15.99:0/1245275072 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fb0c80df920 msgr2=0x7fb0c80c33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:17.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 zone default found 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 4 Realm: () 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 zonegroup default 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.198+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.202+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.202+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.202+0000 7fb0d2ba49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.202+0000 7fb0d2ba49c0 20 started sync module instance, tier type = 2024-09-05T01:19:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.202+0000 7fb0d2ba49c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=0 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=1 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=2 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=3 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=4 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=5 2024-09-05T01:19:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=6 2024-09-05T01:19:17.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 20 add_watcher() i=7 2024-09-05T01:19:17.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.218+0000 7fb0d2ba49c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:17.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7faf85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:17.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 5 note: GC not initialized 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7faf84fe1640 20 reqs_thread_entry: start 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 Filter name: none 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7faefe7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-05T01:19:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: starting shard=0 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: starting shard=1 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: starting shard=2 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 INFO: main: starting shard=3 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.222+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: starting shard=4 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: starting shard=5 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:17.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: starting shard=6 2024-09-05T01:19:17.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:17.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 INFO: main: starting shard=7 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.226+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: starting shard=8 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: starting shard=9 2024-09-05T01:19:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:17.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T01:19:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: starting shard=10 2024-09-05T01:19:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: starting shard=11 2024-09-05T01:19:17.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:17.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 INFO: main: starting shard=12 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.230+0000 7fb0d2ba49c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.234+0000 7fb0d2ba49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.234+0000 7fb0d2ba49c0 20 INFO: main: done 2024-09-05T01:19:17.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.234+0000 7faf85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:17.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.238+0000 7fb0d2ba49c0 20 remove_watcher() i=0 2024-09-05T01:19:17.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.238+0000 7fb0d2ba49c0 2 removed watcher, disabling cache 2024-09-05T01:19:17.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.242+0000 7fb0d2ba49c0 20 remove_watcher() i=1 2024-09-05T01:19:17.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.242+0000 7fb0d2ba49c0 20 remove_watcher() i=2 2024-09-05T01:19:17.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.246+0000 7fb0d2ba49c0 20 remove_watcher() i=3 2024-09-05T01:19:17.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.246+0000 7fb0d2ba49c0 20 remove_watcher() i=4 2024-09-05T01:19:17.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.250+0000 7fb0d2ba49c0 20 remove_watcher() i=5 2024-09-05T01:19:17.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.250+0000 7fb0d2ba49c0 20 remove_watcher() i=6 2024-09-05T01:19:17.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.250+0000 7fb0d2ba49c0 20 remove_watcher() i=7 2024-09-05T01:19:17.434 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T01:19:17.434 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-05T01:19:17.470 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:17.470 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:17.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.722+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 realm 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:17.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.726+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.730+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:17.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.730+0000 7fd2d201e9c0 20 searching for the correct realm 2024-09-05T01:19:17.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.730+0000 7fd2cf323640 0 -- 172.21.15.99:0/1241587616 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fd2b80c4020 msgr2=0x7fd2b81324b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:17.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.738+0000 7fd2cfb24640 0 -- 172.21.15.99:0/1241587616 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fd2c801a040 msgr2=0x7fd2c8035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:19:17.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:17.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:17.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:17.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 zone default found 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 4 Realm: () 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 zonegroup default 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.750+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.754+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.754+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.754+0000 7fd2d201e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.754+0000 7fd2d201e9c0 20 started sync module instance, tier type = 2024-09-05T01:19:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.754+0000 7fd2d201e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=0 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=1 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=2 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=3 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=4 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=5 2024-09-05T01:19:17.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=6 2024-09-05T01:19:17.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 20 add_watcher() i=7 2024-09-05T01:19:17.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.770+0000 7fd2d201e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:17.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:17.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:17.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:17.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 5 note: GC not initialized 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd184fe1640 20 reqs_thread_entry: start 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 Filter name: none 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd0fe7fc640 20 reqs_thread_entry: start 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:17.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:17.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:17.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 INFO: main: starting shard=0 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-05T01:19:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 INFO: main: starting shard=1 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.774+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: starting shard=2 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:17.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: starting shard=3 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: starting shard=4 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: starting shard=5 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 INFO: main: starting shard=6 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.778+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: starting shard=7 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: starting shard=8 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: starting shard=9 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:17.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: starting shard=10 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 INFO: main: starting shard=11 2024-09-05T01:19:17.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:17.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.782+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 20 INFO: main: starting shard=12 2024-09-05T01:19:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T01:19:17.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd2d201e9c0 20 INFO: main: done 2024-09-05T01:19:17.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.786+0000 7fd185fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:17.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.794+0000 7fd2d201e9c0 20 remove_watcher() i=0 2024-09-05T01:19:17.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.794+0000 7fd2d201e9c0 2 removed watcher, disabling cache 2024-09-05T01:19:17.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.794+0000 7fd2d201e9c0 20 remove_watcher() i=1 2024-09-05T01:19:17.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.798+0000 7fd2d201e9c0 20 remove_watcher() i=2 2024-09-05T01:19:17.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.798+0000 7fd2d201e9c0 20 remove_watcher() i=3 2024-09-05T01:19:17.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.802+0000 7fd2d201e9c0 20 remove_watcher() i=4 2024-09-05T01:19:17.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.802+0000 7fd2d201e9c0 20 remove_watcher() i=5 2024-09-05T01:19:17.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.802+0000 7fd2d201e9c0 20 remove_watcher() i=6 2024-09-05T01:19:17.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:17.806+0000 7fd2d201e9c0 20 remove_watcher() i=7 2024-09-05T01:19:17.843 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-05T01:19:18.254 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-05T01:19:18.657 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-05T01:19:18.691 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:18.691 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:18.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 realm 2024-09-05T01:19:18.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:18.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.730+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.734+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:18.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.734+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.734+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:18.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.734+0000 7f22746759c0 20 searching for the correct realm 2024-09-05T01:19:18.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.738+0000 7f227297c640 0 -- 172.21.15.99:0/2340884208 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5594e26937b0 msgr2=0x5594e2695c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:18.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.746+0000 7f227297c640 0 -- 172.21.15.99:0/2340884208 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x5594e2686f80 msgr2=0x5594e26893f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:18.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:18.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:18.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:18.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:18.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:18.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:18.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.750+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 zone default found 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 4 Realm: () 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 zonegroup default 2024-09-05T01:19:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 started sync module instance, tier type = 2024-09-05T01:19:18.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.754+0000 7f22746759c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=0 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=1 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=2 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=3 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=4 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=5 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=6 2024-09-05T01:19:18.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 20 add_watcher() i=7 2024-09-05T01:19:18.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.770+0000 7f22746759c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:18.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f2128fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 5 note: GC not initialized 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f20a37fe640 20 reqs_thread_entry: start 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 Filter name: none 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f20a17fa640 20 reqs_thread_entry: start 2024-09-05T01:19:18.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : miss 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 adding default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:18.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.774+0000 7f22746759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f21557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94097942083392 notifier 8228 bl.length()=821 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f21557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f21557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f21557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.786+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:18.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.0 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.0 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.1 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.1 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.2 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.2 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.3 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.3 2024-09-05T01:19:18.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.4 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.4 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.5 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.5 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.6 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.6 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.7 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.7 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.8 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.8 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.10 2024-09-05T01:19:18.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.10 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.11 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.11 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.12 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.12 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.13 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.13 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.14 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.14 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.15 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.15 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.16 2024-09-05T01:19:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.16 2024-09-05T01:19:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.798+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:18.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:18.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:18.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.802+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:18.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.806+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:18.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.806+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:18.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:18.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f22746759c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f2155ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 94097942083392 notifier 8228 bl.length()=821 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f2155ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f2155ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.810+0000 7f2155ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.814+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:18.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.814+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:18.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.814+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:18.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.814+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:18.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:18.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.0 2024-09-05T01:19:18.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.1 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.2 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.3 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.4 2024-09-05T01:19:18.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:18.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.5 2024-09-05T01:19:18.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:18.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.818+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.6 2024-09-05T01:19:18.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:18.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.7 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.8 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.9 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:18.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.10 2024-09-05T01:19:18.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:18.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.11 2024-09-05T01:19:18.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:18.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.2.12 2024-09-05T01:19:18.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : hit (requested=0x17, cached=0x17) 2024-09-05T01:19:18.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.822+0000 7f22746759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:18.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 10 moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18, ofs0, ns] 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f2155ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94097942083392 notifier 8228 bl.length()=789 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f2155ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f2155ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f2155ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_sources= new_sources= 2024-09-05T01:19:18.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential sources added=[] removed=[] 2024-09-05T01:19:18.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): orig_dests= new_dests= 2024-09-05T01:19:18.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.826+0000 7f22746759c0 20 handle_bi_update(): bucket=:myver[029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18]): potential dests added=[] removed=[] 2024-09-05T01:19:18.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.830+0000 7f22746759c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-05T01:19:18.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.834+0000 7f2128fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:18.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.838+0000 7f22746759c0 20 remove_watcher() i=0 2024-09-05T01:19:18.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.838+0000 7f22746759c0 2 removed watcher, disabling cache 2024-09-05T01:19:18.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.842+0000 7f22746759c0 20 remove_watcher() i=1 2024-09-05T01:19:18.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.842+0000 7f22746759c0 20 remove_watcher() i=2 2024-09-05T01:19:18.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.842+0000 7f22746759c0 20 remove_watcher() i=3 2024-09-05T01:19:18.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.846+0000 7f22746759c0 20 remove_watcher() i=4 2024-09-05T01:19:18.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.846+0000 7f22746759c0 20 remove_watcher() i=5 2024-09-05T01:19:18.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.846+0000 7f22746759c0 20 remove_watcher() i=6 2024-09-05T01:19:18.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.850+0000 7f22746759c0 20 remove_watcher() i=7 2024-09-05T01:19:18.863 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-05T01:19:18.894 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:18.894 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:18.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.930+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 realm 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:18.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.934+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.938+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:18.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.938+0000 7f092742e9c0 20 searching for the correct realm 2024-09-05T01:19:18.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.942+0000 7f0924f34640 0 -- 172.21.15.99:0/2102209690 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f09140b8450 msgr2=0x7f09140b8870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:18.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.946+0000 7f0924f34640 0 -- 172.21.15.99:0/2102209690 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f09140e0900 msgr2=0x7f09140b73e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:18.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:18.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:18.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:18.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:18.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 zone default found 2024-09-05T01:19:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 4 Realm: () 2024-09-05T01:19:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 zonegroup default 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.954+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.958+0000 7f092742e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:18.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.958+0000 7f092742e9c0 20 started sync module instance, tier type = 2024-09-05T01:19:18.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.958+0000 7f092742e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:18.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=0 2024-09-05T01:19:18.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=1 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=2 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=3 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=4 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=5 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=6 2024-09-05T01:19:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 20 add_watcher() i=7 2024-09-05T01:19:18.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.970+0000 7f092742e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:18.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f07db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:18.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 5 note: GC not initialized 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f07da7e4640 20 reqs_thread_entry: start 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 Filter name: none 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f07d37fe640 20 reqs_thread_entry: start 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-05T01:19:18.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-05T01:19:18.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 : miss 2024-09-05T01:19:18.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:18.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:18.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 info.flags=0x17 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 to cache LRU end 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.0 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.0 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.1 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.974+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.1 2024-09-05T01:19:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-05T01:19:18.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.2 2024-09-05T01:19:18.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.2 2024-09-05T01:19:18.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-05T01:19:18.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.3 2024-09-05T01:19:18.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.3 2024-09-05T01:19:18.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-05T01:19:18.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.4 2024-09-05T01:19:18.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.978+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.4 2024-09-05T01:19:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-05T01:19:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.5 2024-09-05T01:19:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.5 2024-09-05T01:19:18.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-05T01:19:18.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.6 2024-09-05T01:19:18.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.6 2024-09-05T01:19:18.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-05T01:19:18.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.7 2024-09-05T01:19:18.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.982+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.7 2024-09-05T01:19:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-05T01:19:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.8 2024-09-05T01:19:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.8 2024-09-05T01:19:18.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-05T01:19:18.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.10 2024-09-05T01:19:18.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.10 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.11 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.11 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.12 2024-09-05T01:19:18.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.986+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.12 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.13 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.13 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.14 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.14 2024-09-05T01:19:18.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.15 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.15 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 10 bucket_obj is .dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.16 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.16 2024-09-05T01:19:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-05T01:19:18.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.990+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:x state=0x55a94dc8fa98 s->prefetch_data=0 2024-09-05T01:19:18.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.994+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to g6g838aehdv5mfm2e7poixk6ra8z0enf 2024-09-05T01:19:18.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.994+0000 7f092742e9c0 20 get_obj_state_impl: setting s->olh_tag to m5k2jy0ijc533zw8p63ee85unbtqr3ls 2024-09-05T01:19:18.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.994+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m5k2jy0ijc533zw8p63ee85unbtqr3ls 2024-09-05T01:19:18.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.994+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.994+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:18.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-05T01:19:18.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=3 key=x[HXL16461N1UTu1RQxlspJ8Q5-Ju4F6j] 2024-09-05T01:19:18.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:HXL16461N1UTu1RQxlspJ8Q5-Ju4F6j_x state=0x55a94dc8ee18 s->prefetch_data=0 2024-09-05T01:19:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 10 manifest: total_size = 9 2024-09-05T01:19:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15514731122495380422 2024-09-05T01:19:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:HXL16461N1UTu1RQxlspJ8Q5-Ju4F6j_x state=0x55a94dc8ee18 s->prefetch_data=0 2024-09-05T01:19:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a94dc8ee18 2024-09-05T01:19:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:18.998+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:19:19.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-05T01:19:19.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T01:19:19.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:HXL16461N1UTu1RQxlspJ8Q5-Ju4F6j_.XuHLqxPMPJvP7dR6OLDgQ0nm3I9Rg8__0 2024-09-05T01:19:19.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T01:19:19.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f07fb7fe640 20 handle_completion(): completion ok for obj=x[HXL16461N1UTu1RQxlspJ8Q5-Ju4F6j] 2024-09-05T01:19:19.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:x state=0x55a94dc8fa98 s->prefetch_data=0 2024-09-05T01:19:19.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.002+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=m5k2jy0ijc533zw8p63ee85unbtqr3ls 2024-09-05T01:19:19.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.006+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:y state=0x55a94dc8fa98 s->prefetch_data=0 2024-09-05T01:19:19.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to nry6rkronpauclba961ofet0soi1w2qd 2024-09-05T01:19:19.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 get_obj_state_impl: setting s->olh_tag to qohkkqlamyocpk0klryc9rhi370ueaso 2024-09-05T01:19:19.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.010+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qohkkqlamyocpk0klryc9rhi370ueaso 2024-09-05T01:19:19.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.014+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-05T01:19:19.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=3 key=y[9Rz1afsW-.XwpI3MYYCw4tufa1E5V8t] 2024-09-05T01:19:19.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:9Rz1afsW-.XwpI3MYYCw4tufa1E5V8t_y state=0x55a94dc8de08 s->prefetch_data=0 2024-09-05T01:19:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 10 manifest: total_size = 22 2024-09-05T01:19:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13299464754954949429 2024-09-05T01:19:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:9Rz1afsW-.XwpI3MYYCw4tufa1E5V8t_y state=0x55a94dc8de08 s->prefetch_data=0 2024-09-05T01:19:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a94dc8de08 2024-09-05T01:19:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.018+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f092742e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:19:19.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f092742e9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T01:19:19.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f092742e9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T01:19:19.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f092742e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:9Rz1afsW-.XwpI3MYYCw4tufa1E5V8t_.k3B251U9-hm4L3TEPNPltlb9sOzkQ-V_0 2024-09-05T01:19:19.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f092742e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T01:19:19.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.026+0000 7f07fb7fe640 20 handle_completion(): completion ok for obj=y[9Rz1afsW-.XwpI3MYYCw4tufa1E5V8t] 2024-09-05T01:19:19.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.030+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:y state=0x55a94dc8fa98 s->prefetch_data=0 2024-09-05T01:19:19.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.030+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qohkkqlamyocpk0klryc9rhi370ueaso 2024-09-05T01:19:19.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.034+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.038+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.038+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.038+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:z state=0x55a94dcc5318 s->prefetch_data=0 2024-09-05T01:19:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.042+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to 83rm30r56qgyrhe1u0sijdsxlwbgmcqv 2024-09-05T01:19:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.042+0000 7f092742e9c0 20 get_obj_state_impl: setting s->olh_tag to ahb8tk48iwnfvpm4sn0i1i4bpzu5v6e3 2024-09-05T01:19:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.042+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ahb8tk48iwnfvpm4sn0i1i4bpzu5v6e3 2024-09-05T01:19:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.042+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-05T01:19:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 olh_log_entry: epoch=2 op=3 key=z[sEFDTQ0nRElv3sZxSysPPGxYaHJQqDV] 2024-09-05T01:19:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:sEFDTQ0nRElv3sZxSysPPGxYaHJQqDV_z state=0x55a94dc8ee18 s->prefetch_data=0 2024-09-05T01:19:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 10 manifest: total_size = 22 2024-09-05T01:19:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 get_obj_state: setting s->obj_tag to 029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5803043637006372573 2024-09-05T01:19:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:_:sEFDTQ0nRElv3sZxSysPPGxYaHJQqDV_z state=0x55a94dc8ee18 s->prefetch_data=0 2024-09-05T01:19:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a94dc8ee18 2024-09-05T01:19:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.046+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f092742e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-05T01:19:19.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f092742e9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-05T01:19:19.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f092742e9c0 0 deleting objects inline since gc isn't initialized 2024-09-05T01:19:19.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f092742e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:sEFDTQ0nRElv3sZxSysPPGxYaHJQqDV_.aX5Ea9mJJwsSg94p-SIakZg4F1Rwb_K_0 2024-09-05T01:19:19.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f092742e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-05T01:19:19.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.054+0000 7f07fb7fe640 20 handle_completion(): completion ok for obj=z[sEFDTQ0nRElv3sZxSysPPGxYaHJQqDV] 2024-09-05T01:19:19.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.058+0000 7f092742e9c0 20 get_obj_state: octx=0x55a94d94c3b0 obj=myver:z state=0x55a94dcc5318 s->prefetch_data=0 2024-09-05T01:19:19.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.058+0000 7f092742e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ahb8tk48iwnfvpm4sn0i1i4bpzu5v6e3 2024-09-05T01:19:19.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.062+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.062+0000 7f092742e9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18.3.9 2024-09-05T01:19:19.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.062+0000 7f092742e9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-05T01:19:19.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.062+0000 7f092742e9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-05T01:19:19.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.066+0000 7f07db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:19.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.070+0000 7f092742e9c0 20 remove_watcher() i=0 2024-09-05T01:19:19.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.070+0000 7f092742e9c0 2 removed watcher, disabling cache 2024-09-05T01:19:19.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.074+0000 7f092742e9c0 20 remove_watcher() i=1 2024-09-05T01:19:19.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.074+0000 7f092742e9c0 20 remove_watcher() i=2 2024-09-05T01:19:19.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.078+0000 7f092742e9c0 20 remove_watcher() i=3 2024-09-05T01:19:19.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.078+0000 7f092742e9c0 20 remove_watcher() i=4 2024-09-05T01:19:19.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.082+0000 7f092742e9c0 20 remove_watcher() i=5 2024-09-05T01:19:19.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.082+0000 7f092742e9c0 20 remove_watcher() i=6 2024-09-05T01:19:19.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.082+0000 7f092742e9c0 20 remove_watcher() i=7 2024-09-05T01:19:19.382 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-09-05T01:19:19.415 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:19.415 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:19.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.458+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 realm 2024-09-05T01:19:19.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:19.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:19.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:19.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.462+0000 7f6e38a609c0 20 searching for the correct realm 2024-09-05T01:19:19.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.466+0000 7f6e36d67640 0 -- 172.21.15.99:0/4185364955 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6e20068800 msgr2=0x7f6e20067270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:19.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.682+0000 7f6e36d67640 0 -- 172.21.15.99:0/4185364955 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f6e20068800 msgr2=0x7f6e20067270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:19.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:19.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:19.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:19.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:19.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.694+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:19.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 zone default found 2024-09-05T01:19:19.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 4 Realm: () 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 zonegroup default 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:19.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 started sync module instance, tier type = 2024-09-05T01:19:19.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.698+0000 7f6e38a609c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=0 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=1 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=2 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=3 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=4 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=5 2024-09-05T01:19:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=6 2024-09-05T01:19:19.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 20 add_watcher() i=7 2024-09-05T01:19:19.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.722+0000 7f6e38a609c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:19.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6cecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:19.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:19.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:19.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 5 note: GC not initialized 2024-09-05T01:19:19.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6c677fe640 20 reqs_thread_entry: start 2024-09-05T01:19:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 20 Filter name: none 2024-09-05T01:19:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6c657fa640 20 reqs_thread_entry: start 2024-09-05T01:19:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.726+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-05T01:19:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:19.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-05T01:19:19.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.730+0000 7f6e38a609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T01:19:19.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.734+0000 7f6cecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:19.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.738+0000 7f6e38a609c0 20 remove_watcher() i=0 2024-09-05T01:19:19.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.738+0000 7f6e38a609c0 2 removed watcher, disabling cache 2024-09-05T01:19:19.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.742+0000 7f6e38a609c0 20 remove_watcher() i=1 2024-09-05T01:19:19.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.746+0000 7f6e38a609c0 20 remove_watcher() i=2 2024-09-05T01:19:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.746+0000 7f6e38a609c0 20 remove_watcher() i=3 2024-09-05T01:19:19.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.750+0000 7f6e38a609c0 20 remove_watcher() i=4 2024-09-05T01:19:19.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.750+0000 7f6e38a609c0 20 remove_watcher() i=5 2024-09-05T01:19:19.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.750+0000 7f6e38a609c0 20 remove_watcher() i=6 2024-09-05T01:19:19.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T01:19:19.754+0000 7f6e38a609c0 20 remove_watcher() i=7 2024-09-05T01:19:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-05T01:19:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket a-bucket 2024-09-05T01:19:19.929 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket myver 2024-09-05T01:19:20.522 INFO:tasks.workunit.client.0.smithi099.stderr:Completed resharding tests 2024-09-05T01:19:20.523 INFO:tasks.workunit.client.0.smithi099.stdout:connected to http://localhost:80 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T01:19:20.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-09-05T01:19:20.642 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-09-05T01:19:20.643 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-09-05T01:19:20.643 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T01:19:20.644 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T01:19:20.737 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-05T01:19:20.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T01:19:21.126 DEBUG:teuthology.parallel:result is None 2024-09-05T01:19:21.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:19:21.140 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:19:21.140 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:19:21.185 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:19:21.185 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-05T01:19:21.205 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-05T01:19:21.205 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-05T01:19:21.206 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-05T01:19:21.206 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-05T01:19:21.233 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-05T01:19:25.772 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-05T01:19:25.773 DEBUG:teuthology.orchestra.run.smithi099:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-05T01:19:25.862 INFO:teuthology.orchestra.run.smithi099.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-05T01:19:25.921 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-05T01:19:26.136 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-05T01:19:26.137 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-05T01:19:26.335 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T01:19:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T01:19:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T01:19:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T01:19:26.335 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T01:19:26.336 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T01:19:26.336 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T01:19:26.336 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-05T01:19:26.337 INFO:teuthology.orchestra.run.smithi099.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-05T01:19:26.338 INFO:teuthology.orchestra.run.smithi099.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-05T01:19:26.339 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-05T01:19:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-05T01:19:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-05T01:19:26.339 INFO:teuthology.orchestra.run.smithi099.stdout: fonts-wqy-zenhei fonts-indic 2024-09-05T01:19:26.374 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-05T01:19:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-05T01:19:26.375 INFO:teuthology.orchestra.run.smithi099.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-05T01:19:26.642 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T01:19:26.642 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 46.0 MB of archives. 2024-09-05T01:19:26.642 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-05T01:19:26.642 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-05T01:19:27.009 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-05T01:19:27.365 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-05T01:19:27.366 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-05T01:19:27.372 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-05T01:19:27.373 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-05T01:19:28.477 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-05T01:19:28.479 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-05T01:19:28.718 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-05T01:19:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: unable to initialize frontend: Dialog 2024-09-05T01:19:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-05T01:19:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: falling back to frontend: Readline 2024-09-05T01:19:29.142 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: unable to initialize frontend: Readline 2024-09-05T01:19:29.142 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-05T01:19:29.142 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: falling back to frontend: Teletype 2024-09-05T01:19:29.145 INFO:teuthology.orchestra.run.smithi099.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-05T01:19:29.179 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 46.0 MB in 2s (18.9 MB/s) 2024-09-05T01:19:29.279 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-05T01:19:29.367 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-05T01:19:29.373 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-05T01:19:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:29.790 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-05T01:19:29.819 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-05T01:19:29.899 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:30.354 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-05T01:19:30.382 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-05T01:19:30.420 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:30.673 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-05T01:19:30.690 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-05T01:19:30.731 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:30.992 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-05T01:19:31.020 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-05T01:19:31.050 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:31.462 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-05T01:19:31.491 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-05T01:19:31.533 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:33.143 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-05T01:19:33.172 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-05T01:19:33.222 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:33.682 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-05T01:19:33.710 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-05T01:19:33.752 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:34.477 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-05T01:19:34.506 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-05T01:19:34.539 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:34.873 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:35.979 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-05T01:19:36.003 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-05T01:19:36.028 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-05T01:19:36.395 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:36.555 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:36.915 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:37.015 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-05T01:19:37.075 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:37.167 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-05T01:19:37.195 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-05T01:19:37.221 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-05T01:19:37.238 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-05T01:19:37.367 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-05T01:19:37.510 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-05T01:19:37.628 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-05T01:19:37.722 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-05T01:19:37.766 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-05T01:19:37.815 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-05T01:19:37.841 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-05T01:19:37.866 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-05T01:19:37.932 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:38.066 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:38.192 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-05T01:19:38.300 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-05T01:19:38.394 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-05T01:19:38.505 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T01:19:39.557 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-05T01:19:39.649 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-05T01:19:39.926 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-05T01:19:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: Gradle will be installed under /opt/gradle 2024-09-05T01:19:40.427 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-09-05 01:19:40-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-05T01:19:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-05T01:19:40.444 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-05T01:19:40.494 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-05T01:19:40.494 INFO:teuthology.orchestra.run.smithi099.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-05T01:19:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-09-05 01:19:40-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-05T01:19:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-05T01:19:40.506 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-05T01:19:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-05T01:19:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240905%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240905T011816Z&X-Amz-Expires=300&X-Amz-Signature=d7c9b6621b2b3a29476bafc4f8caf4c46765351796bb0daddba06d60ea0f12f2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-05T01:19:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-09-05 01:19:40-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240905%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240905T011816Z&X-Amz-Expires=300&X-Amz-Signature=d7c9b6621b2b3a29476bafc4f8caf4c46765351796bb0daddba06d60ea0f12f2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-05T01:19:40.545 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.111.133, 185.199.110.133, ... 2024-09-05T01:19:40.557 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-09-05T01:19:40.646 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-05T01:19:40.646 INFO:teuthology.orchestra.run.smithi099.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-05T01:19:40.646 INFO:teuthology.orchestra.run.smithi099.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-05T01:19:40.647 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T01:19:40.660 INFO:teuthology.orchestra.run.smithi099.stderr: 0K .......... .......... .......... .......... .......... 0% 3.56M 25s 2024-09-05T01:19:40.670 INFO:teuthology.orchestra.run.smithi099.stderr: 50K .......... .......... .......... .......... .......... 0% 4.83M 22s 2024-09-05T01:19:40.673 INFO:teuthology.orchestra.run.smithi099.stderr: 100K .......... .......... .......... .......... .......... 0% 17.1M 17s 2024-09-05T01:19:40.675 INFO:teuthology.orchestra.run.smithi099.stderr: 150K .......... .......... .......... .......... .......... 0% 25.8M 13s 2024-09-05T01:19:40.682 INFO:teuthology.orchestra.run.smithi099.stderr: 200K .......... .......... .......... .......... .......... 0% 7.09M 13s 2024-09-05T01:19:40.683 INFO:teuthology.orchestra.run.smithi099.stderr: 250K .......... .......... .......... .......... .......... 0% 35.1M 11s 2024-09-05T01:19:40.685 INFO:teuthology.orchestra.run.smithi099.stderr: 300K .......... .......... .......... .......... .......... 0% 32.0M 10s 2024-09-05T01:19:40.687 INFO:teuthology.orchestra.run.smithi099.stderr: 350K .......... .......... .......... .......... .......... 0% 28.0M 9s 2024-09-05T01:19:40.693 INFO:teuthology.orchestra.run.smithi099.stderr: 400K .......... .......... .......... .......... .......... 0% 8.25M 9s 2024-09-05T01:19:40.694 INFO:teuthology.orchestra.run.smithi099.stderr: 450K .......... .......... .......... .......... .......... 0% 123M 9s 2024-09-05T01:19:40.694 INFO:teuthology.orchestra.run.smithi099.stderr: 500K .......... .......... .......... .......... .......... 0% 79.0M 8s 2024-09-05T01:19:40.695 INFO:teuthology.orchestra.run.smithi099.stderr: 550K .......... .......... .......... .......... .......... 0% 36.7M 7s 2024-09-05T01:19:40.696 INFO:teuthology.orchestra.run.smithi099.stderr: 600K .......... .......... .......... .......... .......... 0% 36.7M 7s 2024-09-05T01:19:40.696 INFO:teuthology.orchestra.run.smithi099.stderr: 650K .......... .......... .......... .......... .......... 0% 159M 7s 2024-09-05T01:19:40.700 INFO:teuthology.orchestra.run.smithi099.stderr: 700K .......... .......... .......... .......... .......... 0% 60.1M 6s 2024-09-05T01:19:40.700 INFO:teuthology.orchestra.run.smithi099.stderr: 750K .......... .......... .......... .......... .......... 0% 50.4M 6s 2024-09-05T01:19:40.700 INFO:teuthology.orchestra.run.smithi099.stderr: 800K .......... .......... .......... .......... .......... 0% 112M 6s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 850K .......... .......... .......... .......... .......... 0% 9.13M 6s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 900K .......... .......... .......... .......... .......... 1% 118M 6s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 950K .......... .......... .......... .......... .......... 1% 161M 5s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 1000K .......... .......... .......... .......... .......... 1% 120M 5s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 1050K .......... .......... .......... .......... .......... 1% 110M 5s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 1100K .......... .......... .......... .......... .......... 1% 151M 5s 2024-09-05T01:19:41.816 INFO:teuthology.orchestra.run.smithi099.stderr: 1150K .......... .......... .......... .......... .......... 1% 83.1M 5s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1200K .......... .......... .......... .......... .......... 1% 98.0M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1250K .......... .......... .......... .......... .......... 1% 60.1M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1300K .......... .......... .......... .......... .......... 1% 138M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1350K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1400K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1450K .......... .......... .......... .......... .......... 1% 144M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1500K .......... .......... .......... .......... .......... 1% 158M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1550K .......... .......... .......... .......... .......... 1% 141M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1600K .......... .......... .......... .......... .......... 1% 132M 4s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1650K .......... .......... .......... .......... .......... 1% 153M 3s 2024-09-05T01:19:41.817 INFO:teuthology.orchestra.run.smithi099.stderr: 1700K .......... .......... .......... .......... .......... 1% 150M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 1750K .......... .......... .......... .......... .......... 1% 10.5M 4s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 1800K .......... .......... .......... .......... .......... 1% 101M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 1850K .......... .......... .......... .......... .......... 2% 155M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 1900K .......... .......... .......... .......... .......... 2% 163M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 1950K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2000K .......... .......... .......... .......... .......... 2% 125M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2050K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2100K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2150K .......... .......... .......... .......... .......... 2% 166M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2200K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2250K .......... .......... .......... .......... .......... 2% 152M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2300K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-05T01:19:41.818 INFO:teuthology.orchestra.run.smithi099.stderr: 2350K .......... .......... .......... .......... .......... 2% 153M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2400K .......... .......... .......... .......... .......... 2% 132M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2450K .......... .......... .......... .......... .......... 2% 160M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2500K .......... .......... .......... .......... .......... 2% 152M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2550K .......... .......... .......... .......... .......... 2% 156M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2600K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2650K .......... .......... .......... .......... .......... 2% 160M 3s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2700K .......... .......... .......... .......... .......... 2% 165M 2s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2750K .......... .......... .......... .......... .......... 3% 133M 2s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2800K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2850K .......... .......... .......... .......... .......... 3% 160M 2s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2900K .......... .......... .......... .......... .......... 3% 164M 2s 2024-09-05T01:19:41.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2950K .......... .......... .......... .......... .......... 3% 163M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3000K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3050K .......... .......... .......... .......... .......... 3% 164M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3100K .......... .......... .......... .......... .......... 3% 164M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3150K .......... .......... .......... .......... .......... 3% 166M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3200K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3250K .......... .......... .......... .......... .......... 3% 164M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3300K .......... .......... .......... .......... .......... 3% 168M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3350K .......... .......... .......... .......... .......... 3% 167M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3400K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3450K .......... .......... .......... .......... .......... 3% 168M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3500K .......... .......... .......... .......... .......... 3% 168M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3550K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3600K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-05T01:19:41.820 INFO:teuthology.orchestra.run.smithi099.stderr: 3650K .......... .......... .......... .......... .......... 3% 145M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3700K .......... .......... .......... .......... .......... 4% 138M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3750K .......... .......... .......... .......... .......... 4% 122M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3800K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3850K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3900K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 3950K .......... .......... .......... .......... .......... 4% 107M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4000K .......... .......... .......... .......... .......... 4% 135M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4050K .......... .......... .......... .......... .......... 4% 127M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4100K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4150K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4200K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4250K .......... .......... .......... .......... .......... 4% 138M 2s 2024-09-05T01:19:41.821 INFO:teuthology.orchestra.run.smithi099.stderr: 4300K .......... .......... .......... .......... .......... 4% 134M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4350K .......... .......... .......... .......... .......... 4% 110M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4400K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4450K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4500K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4550K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4600K .......... .......... .......... .......... .......... 5% 99.5M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4650K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4700K .......... .......... .......... .......... .......... 5% 137M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4750K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4800K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4850K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4900K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 4950K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 5000K .......... .......... .......... .......... .......... 5% 149M 2s 2024-09-05T01:19:41.822 INFO:teuthology.orchestra.run.smithi099.stderr: 5050K .......... .......... .......... .......... .......... 5% 150M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5100K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5150K .......... .......... .......... .......... .......... 5% 111M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5200K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5250K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5300K .......... .......... .......... .......... .......... 5% 147M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5350K .......... .......... .......... .......... .......... 5% 126M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5400K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5450K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5500K .......... .......... .......... .......... .......... 5% 143M 1s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5550K .......... .......... .......... .......... .......... 6% 115M 1s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5600K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5650K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-05T01:19:41.823 INFO:teuthology.orchestra.run.smithi099.stderr: 5700K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 5750K .......... .......... .......... .......... .......... 6% 125M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 5800K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 5850K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 5900K .......... .......... .......... .......... .......... 6% 143M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 5950K .......... .......... .......... .......... .......... 6% 115M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6000K .......... .......... .......... .......... .......... 6% 145M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6050K .......... .......... .......... .......... .......... 6% 144M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6100K .......... .......... .......... .......... .......... 6% 140M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6150K .......... .......... .......... .......... .......... 6% 135M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6200K .......... .......... .......... .......... .......... 6% 150M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6250K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6300K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-05T01:19:41.824 INFO:teuthology.orchestra.run.smithi099.stderr: 6350K .......... .......... .......... .......... .......... 6% 123M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6400K .......... .......... .......... .......... .......... 6% 147M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6450K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6500K .......... .......... .......... .......... .......... 7% 141M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6550K .......... .......... .......... .......... .......... 7% 127M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6600K .......... .......... .......... .......... .......... 7% 150M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6650K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6700K .......... .......... .......... .......... .......... 7% 162M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6750K .......... .......... .......... .......... .......... 7% 162M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6800K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6850K .......... .......... .......... .......... .......... 7% 138M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6900K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-05T01:19:41.825 INFO:teuthology.orchestra.run.smithi099.stderr: 6950K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7000K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7050K .......... .......... .......... .......... .......... 7% 137M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7100K .......... .......... .......... .......... .......... 7% 136M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7150K .......... .......... .......... .......... .......... 7% 105M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7200K .......... .......... .......... .......... .......... 7% 145M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7250K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7300K .......... .......... .......... .......... .......... 7% 157M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7350K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7400K .......... .......... .......... .......... .......... 8% 162M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7450K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7500K .......... .......... .......... .......... .......... 8% 156M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7550K .......... .......... .......... .......... .......... 8% 142M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7600K .......... .......... .......... .......... .......... 8% 161M 1s 2024-09-05T01:19:41.826 INFO:teuthology.orchestra.run.smithi099.stderr: 7650K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7700K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7750K .......... .......... .......... .......... .......... 8% 143M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7800K .......... .......... .......... .......... .......... 8% 157M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7850K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7900K .......... .......... .......... .......... .......... 8% 180M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 7950K .......... .......... .......... .......... .......... 8% 148M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8000K .......... .......... .......... .......... .......... 8% 161M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8050K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8100K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8150K .......... .......... .......... .......... .......... 8% 162M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8200K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8250K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8300K .......... .......... .......... .......... .......... 8% 142M 1s 2024-09-05T01:19:41.827 INFO:teuthology.orchestra.run.smithi099.stderr: 8350K .......... .......... .......... .......... .......... 9% 147M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8400K .......... .......... .......... .......... .......... 9% 181M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8450K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8500K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8550K .......... .......... .......... .......... .......... 9% 170M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8600K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8650K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8700K .......... .......... .......... .......... .......... 9% 195M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8750K .......... .......... .......... .......... .......... 9% 160M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8800K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8850K .......... .......... .......... .......... .......... 9% 189M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8900K .......... .......... .......... .......... .......... 9% 189M 1s 2024-09-05T01:19:41.828 INFO:teuthology.orchestra.run.smithi099.stderr: 8950K .......... .......... .......... .......... .......... 9% 171M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9000K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9050K .......... .......... .......... .......... .......... 9% 172M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9100K .......... .......... .......... .......... .......... 9% 170M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9150K .......... .......... .......... .......... .......... 9% 132M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9200K .......... .......... .......... .......... .......... 9% 163M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9250K .......... .......... .......... .......... .......... 10% 164M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9300K .......... .......... .......... .......... .......... 10% 180M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9350K .......... .......... .......... .......... .......... 10% 160M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9400K .......... .......... .......... .......... .......... 10% 198M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9450K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9500K .......... .......... .......... .......... .......... 10% 173M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9550K .......... .......... .......... .......... .......... 10% 163M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9600K .......... .......... .......... .......... .......... 10% 178M 1s 2024-09-05T01:19:41.829 INFO:teuthology.orchestra.run.smithi099.stderr: 9650K .......... .......... .......... .......... .......... 10% 192M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9700K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9750K .......... .......... .......... .......... .......... 10% 170M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9800K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9850K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9900K .......... .......... .......... .......... .......... 10% 171M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 9950K .......... .......... .......... .......... .......... 10% 170M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10000K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10050K .......... .......... .......... .......... .......... 10% 218M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10100K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10150K .......... .......... .......... .......... .......... 10% 182M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10200K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10250K .......... .......... .......... .......... .......... 11% 244M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10300K .......... .......... .......... .......... .......... 11% 244M 1s 2024-09-05T01:19:41.830 INFO:teuthology.orchestra.run.smithi099.stderr: 10350K .......... .......... .......... .......... .......... 11% 244M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10400K .......... .......... .......... .......... .......... 11% 187M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10450K .......... .......... .......... .......... .......... 11% 202M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10500K .......... .......... .......... .......... .......... 11% 220M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10550K .......... .......... .......... .......... .......... 11% 198M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10600K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10650K .......... .......... .......... .......... .......... 11% 217M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10700K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10750K .......... .......... .......... .......... .......... 11% 169M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10800K .......... .......... .......... .......... .......... 11% 223M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10850K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10900K .......... .......... .......... .......... .......... 11% 207M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 10950K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 11000K .......... .......... .......... .......... .......... 11% 234M 1s 2024-09-05T01:19:41.831 INFO:teuthology.orchestra.run.smithi099.stderr: 11050K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11100K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11150K .......... .......... .......... .......... .......... 12% 188M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11200K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11250K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11300K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11350K .......... .......... .......... .......... .......... 12% 194M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11400K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11450K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11500K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11550K .......... .......... .......... .......... .......... 12% 164M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11600K .......... .......... .......... .......... .......... 12% 194M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11650K .......... .......... .......... .......... .......... 12% 217M 1s 2024-09-05T01:19:41.832 INFO:teuthology.orchestra.run.smithi099.stderr: 11700K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 11750K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 11800K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 11850K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 11900K .......... .......... .......... .......... .......... 12% 207M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 11950K .......... .......... .......... .......... .......... 12% 191M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12000K .......... .......... .......... .......... .......... 12% 212M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12050K .......... .......... .......... .......... .......... 13% 219M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12100K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12150K .......... .......... .......... .......... .......... 13% 193M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12200K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12250K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12300K .......... .......... .......... .......... .......... 13% 234M 1s 2024-09-05T01:19:41.833 INFO:teuthology.orchestra.run.smithi099.stderr: 12350K .......... .......... .......... .......... .......... 13% 195M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12400K .......... .......... .......... .......... .......... 13% 173M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12450K .......... .......... .......... .......... .......... 13% 207M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12500K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12550K .......... .......... .......... .......... .......... 13% 201M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12600K .......... .......... .......... .......... .......... 13% 241M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12650K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12700K .......... .......... .......... .......... .......... 13% 249M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12750K .......... .......... .......... .......... .......... 13% 209M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12800K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12850K .......... .......... .......... .......... .......... 13% 243M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12900K .......... .......... .......... .......... .......... 13% 205M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 12950K .......... .......... .......... .......... .......... 13% 207M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 13000K .......... .......... .......... .......... .......... 14% 234M 1s 2024-09-05T01:19:41.834 INFO:teuthology.orchestra.run.smithi099.stderr: 13050K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13100K .......... .......... .......... .......... .......... 14% 249M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13150K .......... .......... .......... .......... .......... 14% 200M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13200K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13250K .......... .......... .......... .......... .......... 14% 220M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13300K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13350K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13400K .......... .......... .......... .......... .......... 14% 219M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13450K .......... .......... .......... .......... .......... 14% 232M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13500K .......... .......... .......... .......... .......... 14% 244M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13550K .......... .......... .......... .......... .......... 14% 214M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13600K .......... .......... .......... .......... .......... 14% 280M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13650K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13700K .......... .......... .......... .......... .......... 14% 273M 1s 2024-09-05T01:19:41.835 INFO:teuthology.orchestra.run.smithi099.stderr: 13750K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 13800K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 13850K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 13900K .......... .......... .......... .......... .......... 15% 262M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 13950K .......... .......... .......... .......... .......... 15% 248M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14000K .......... .......... .......... .......... .......... 15% 175M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14050K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14100K .......... .......... .......... .......... .......... 15% 249M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14150K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14200K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14250K .......... .......... .......... .......... .......... 15% 235M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14300K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14350K .......... .......... .......... .......... .......... 15% 158M 1s 2024-09-05T01:19:41.836 INFO:teuthology.orchestra.run.smithi099.stderr: 14400K .......... .......... .......... .......... .......... 15% 214M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14450K .......... .......... .......... .......... .......... 15% 261M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14500K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14550K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14600K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14650K .......... .......... .......... .......... .......... 15% 266M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14700K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14750K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14800K .......... .......... .......... .......... .......... 15% 282M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14850K .......... .......... .......... .......... .......... 16% 275M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14900K .......... .......... .......... .......... .......... 16% 258M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 14950K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 15000K .......... .......... .......... .......... .......... 16% 257M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 15050K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-05T01:19:41.837 INFO:teuthology.orchestra.run.smithi099.stderr: 15100K .......... .......... .......... .......... .......... 16% 283M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15150K .......... .......... .......... .......... .......... 16% 203M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15200K .......... .......... .......... .......... .......... 16% 283M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15250K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15300K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15350K .......... .......... .......... .......... .......... 16% 245M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15400K .......... .......... .......... .......... .......... 16% 234M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15450K .......... .......... .......... .......... .......... 16% 258M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15500K .......... .......... .......... .......... .......... 16% 287M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15550K .......... .......... .......... .......... .......... 16% 240M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15600K .......... .......... .......... .......... .......... 16% 287M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15650K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15700K .......... .......... .......... .......... .......... 16% 276M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15750K .......... .......... .......... .......... .......... 17% 237M 1s 2024-09-05T01:19:41.838 INFO:teuthology.orchestra.run.smithi099.stderr: 15800K .......... .......... .......... .......... .......... 17% 254M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 15850K .......... .......... .......... .......... .......... 17% 270M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 15900K .......... .......... .......... .......... .......... 17% 289M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 15950K .......... .......... .......... .......... .......... 17% 209M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16000K .......... .......... .......... .......... .......... 17% 237M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16050K .......... .......... .......... .......... .......... 17% 287M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16100K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16150K .......... .......... .......... .......... .......... 17% 258M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16200K .......... .......... .......... .......... .......... 17% 259M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16250K .......... .......... .......... .......... .......... 17% 273M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16300K .......... .......... .......... .......... .......... 17% 275M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16350K .......... .......... .......... .......... .......... 17% 241M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16400K .......... .......... .......... .......... .......... 17% 289M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16450K .......... .......... .......... .......... .......... 17% 272M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16500K .......... .......... .......... .......... .......... 17% 135M 1s 2024-09-05T01:19:41.839 INFO:teuthology.orchestra.run.smithi099.stderr: 16550K .......... .......... .......... .......... .......... 17% 192M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16600K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16650K .......... .......... .......... .......... .......... 17% 264M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16700K .......... .......... .......... .......... .......... 18% 36.3M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16750K .......... .......... .......... .......... .......... 18% 170M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16800K .......... .......... .......... .......... .......... 18% 211M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16850K .......... .......... .......... .......... .......... 18% 212M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16900K .......... .......... .......... .......... .......... 18% 215M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 16950K .......... .......... .......... .......... .......... 18% 195M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 17000K .......... .......... .......... .......... .......... 18% 207M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 17050K .......... .......... .......... .......... .......... 18% 199M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 17100K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 17150K .......... .......... .......... .......... .......... 18% 196M 1s 2024-09-05T01:19:41.840 INFO:teuthology.orchestra.run.smithi099.stderr: 17200K .......... .......... .......... .......... .......... 18% 207M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17250K .......... .......... .......... .......... .......... 18% 223M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17300K .......... .......... .......... .......... .......... 18% 229M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17350K .......... .......... .......... .......... .......... 18% 204M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17400K .......... .......... .......... .......... .......... 18% 243M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17450K .......... .......... .......... .......... .......... 18% 195M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17500K .......... .......... .......... .......... .......... 18% 215M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17550K .......... .......... .......... .......... .......... 18% 196M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17600K .......... .......... .......... .......... .......... 18% 231M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17650K .......... .......... .......... .......... .......... 19% 213M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17700K .......... .......... .......... .......... .......... 19% 228M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17750K .......... .......... .......... .......... .......... 19% 203M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17800K .......... .......... .......... .......... .......... 19% 221M 1s 2024-09-05T01:19:41.841 INFO:teuthology.orchestra.run.smithi099.stderr: 17850K .......... .......... .......... .......... .......... 19% 221M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 17900K .......... .......... .......... .......... .......... 19% 222M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 17950K .......... .......... .......... .......... .......... 19% 189M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18000K .......... .......... .......... .......... .......... 19% 242M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18050K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18100K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18150K .......... .......... .......... .......... .......... 19% 206M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18200K .......... .......... .......... .......... .......... 19% 215M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18250K .......... .......... .......... .......... .......... 19% 208M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18300K .......... .......... .......... .......... .......... 19% 224M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18350K .......... .......... .......... .......... .......... 19% 192M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18400K .......... .......... .......... .......... .......... 19% 243M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18450K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18500K .......... .......... .......... .......... .......... 19% 244M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18550K .......... .......... .......... .......... .......... 20% 215M 1s 2024-09-05T01:19:41.842 INFO:teuthology.orchestra.run.smithi099.stderr: 18600K .......... .......... .......... .......... .......... 20% 217M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18650K .......... .......... .......... .......... .......... 20% 221M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18700K .......... .......... .......... .......... .......... 20% 220M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18750K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18800K .......... .......... .......... .......... .......... 20% 245M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18850K .......... .......... .......... .......... .......... 20% 232M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18900K .......... .......... .......... .......... .......... 20% 247M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 18950K .......... .......... .......... .......... .......... 20% 166M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19000K .......... .......... .......... .......... .......... 20% 231M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19050K .......... .......... .......... .......... .......... 20% 238M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19100K .......... .......... .......... .......... .......... 20% 244M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19150K .......... .......... .......... .......... .......... 20% 203M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19200K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19250K .......... .......... .......... .......... .......... 20% 221M 1s 2024-09-05T01:19:41.843 INFO:teuthology.orchestra.run.smithi099.stderr: 19300K .......... .......... .......... .......... .......... 20% 220M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19350K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19400K .......... .......... .......... .......... .......... 20% 219M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19450K .......... .......... .......... .......... .......... 20% 222M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19500K .......... .......... .......... .......... .......... 21% 239M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19550K .......... .......... .......... .......... .......... 21% 171M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19600K .......... .......... .......... .......... .......... 21% 208M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19650K .......... .......... .......... .......... .......... 21% 222M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19700K .......... .......... .......... .......... .......... 21% 234M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19750K .......... .......... .......... .......... .......... 21% 192M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19800K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19850K .......... .......... .......... .......... .......... 21% 222M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19900K .......... .......... .......... .......... .......... 21% 241M 1s 2024-09-05T01:19:41.844 INFO:teuthology.orchestra.run.smithi099.stderr: 19950K .......... .......... .......... .......... .......... 21% 194M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20000K .......... .......... .......... .......... .......... 21% 239M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20050K .......... .......... .......... .......... .......... 21% 223M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20100K .......... .......... .......... .......... .......... 21% 235M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20150K .......... .......... .......... .......... .......... 21% 198M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20200K .......... .......... .......... .......... .......... 21% 209M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20250K .......... .......... .......... .......... .......... 21% 227M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20300K .......... .......... .......... .......... .......... 21% 227M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20350K .......... .......... .......... .......... .......... 21% 201M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20400K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20450K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20500K .......... .......... .......... .......... .......... 22% 248M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20550K .......... .......... .......... .......... .......... 22% 263M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20600K .......... .......... .......... .......... .......... 22% 185M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20650K .......... .......... .......... .......... .......... 22% 205M 1s 2024-09-05T01:19:41.845 INFO:teuthology.orchestra.run.smithi099.stderr: 20700K .......... .......... .......... .......... .......... 22% 231M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 20750K .......... .......... .......... .......... .......... 22% 210M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 20800K .......... .......... .......... .......... .......... 22% 230M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 20850K .......... .......... .......... .......... .......... 22% 210M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 20900K .......... .......... .......... .......... .......... 22% 224M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 20950K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21000K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21050K .......... .......... .......... .......... .......... 22% 210M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21100K .......... .......... .......... .......... .......... 22% 252M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21150K .......... .......... .......... .......... .......... 22% 243M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21200K .......... .......... .......... .......... .......... 22% 188M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21250K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21300K .......... .......... .......... .......... .......... 22% 250M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21350K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21400K .......... .......... .......... .......... .......... 23% 254M 1s 2024-09-05T01:19:41.846 INFO:teuthology.orchestra.run.smithi099.stderr: 21450K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21500K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21550K .......... .......... .......... .......... .......... 23% 178M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21600K .......... .......... .......... .......... .......... 23% 223M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21650K .......... .......... .......... .......... .......... 23% 259M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21700K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21750K .......... .......... .......... .......... .......... 23% 228M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21800K .......... .......... .......... .......... .......... 23% 263M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21850K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21900K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 21950K .......... .......... .......... .......... .......... 23% 196M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 22000K .......... .......... .......... .......... .......... 23% 227M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 22050K .......... .......... .......... .......... .......... 23% 243M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 22100K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-05T01:19:41.847 INFO:teuthology.orchestra.run.smithi099.stderr: 22150K .......... .......... .......... .......... .......... 23% 233M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22200K .......... .......... .......... .......... .......... 23% 242M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22250K .......... .......... .......... .......... .......... 24% 232M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22300K .......... .......... .......... .......... .......... 24% 245M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22350K .......... .......... .......... .......... .......... 24% 207M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22400K .......... .......... .......... .......... .......... 24% 249M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22450K .......... .......... .......... .......... .......... 24% 256M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22500K .......... .......... .......... .......... .......... 24% 238M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22550K .......... .......... .......... .......... .......... 24% 191M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22600K .......... .......... .......... .......... .......... 24% 250M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22650K .......... .......... .......... .......... .......... 24% 272M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22700K .......... .......... .......... .......... .......... 24% 244M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22750K .......... .......... .......... .......... .......... 24% 200M 1s 2024-09-05T01:19:41.848 INFO:teuthology.orchestra.run.smithi099.stderr: 22800K .......... .......... .......... .......... .......... 24% 276M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 22850K .......... .......... .......... .......... .......... 24% 262M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 22900K .......... .......... .......... .......... .......... 24% 240M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 22950K .......... .......... .......... .......... .......... 24% 235M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23000K .......... .......... .......... .......... .......... 24% 239M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23050K .......... .......... .......... .......... .......... 24% 270M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23100K .......... .......... .......... .......... .......... 24% 270M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23150K .......... .......... .......... .......... .......... 24% 225M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23200K .......... .......... .......... .......... .......... 25% 249M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23250K .......... .......... .......... .......... .......... 25% 238M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23300K .......... .......... .......... .......... .......... 25% 253M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23350K .......... .......... .......... .......... .......... 25% 245M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23400K .......... .......... .......... .......... .......... 25% 274M 1s 2024-09-05T01:19:41.849 INFO:teuthology.orchestra.run.smithi099.stderr: 23450K .......... .......... .......... .......... .......... 25% 276M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23500K .......... .......... .......... .......... .......... 25% 267M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23550K .......... .......... .......... .......... .......... 25% 194M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23600K .......... .......... .......... .......... .......... 25% 240M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23650K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23700K .......... .......... .......... .......... .......... 25% 278M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23750K .......... .......... .......... .......... .......... 25% 236M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23800K .......... .......... .......... .......... .......... 25% 282M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23850K .......... .......... .......... .......... .......... 25% 273M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23900K .......... .......... .......... .......... .......... 25% 277M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 23950K .......... .......... .......... .......... .......... 25% 230M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 24000K .......... .......... .......... .......... .......... 25% 268M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 24050K .......... .......... .......... .......... .......... 25% 265M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 24100K .......... .......... .......... .......... .......... 25% 240M 1s 2024-09-05T01:19:41.850 INFO:teuthology.orchestra.run.smithi099.stderr: 24150K .......... .......... .......... .......... .......... 26% 234M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24200K .......... .......... .......... .......... .......... 26% 270M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24250K .......... .......... .......... .......... .......... 26% 265M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24300K .......... .......... .......... .......... .......... 26% 282M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24350K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24400K .......... .......... .......... .......... .......... 26% 264M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24450K .......... .......... .......... .......... .......... 26% 225M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24500K .......... .......... .......... .......... .......... 26% 258M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24550K .......... .......... .......... .......... .......... 26% 208M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24600K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24650K .......... .......... .......... .......... .......... 26% 293M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24700K .......... .......... .......... .......... .......... 26% 245M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24750K .......... .......... .......... .......... .......... 26% 246M 1s 2024-09-05T01:19:41.851 INFO:teuthology.orchestra.run.smithi099.stderr: 24800K .......... .......... .......... .......... .......... 26% 138M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 24850K .......... .......... .......... .......... .......... 26% 282M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 24900K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 24950K .......... .......... .......... .......... .......... 26% 266M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25000K .......... .......... .......... .......... .......... 26% 294M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25050K .......... .......... .......... .......... .......... 27% 299M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25100K .......... .......... .......... .......... .......... 27% 280M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25150K .......... .......... .......... .......... .......... 27% 241M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25200K .......... .......... .......... .......... .......... 27% 309M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25250K .......... .......... .......... .......... .......... 27% 6.88M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25300K .......... .......... .......... .......... .......... 27% 178M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25350K .......... .......... .......... .......... .......... 27% 221M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25400K .......... .......... .......... .......... .......... 27% 24.1M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25450K .......... .......... .......... .......... .......... 27% 218M 1s 2024-09-05T01:19:41.852 INFO:teuthology.orchestra.run.smithi099.stderr: 25500K .......... .......... .......... .......... .......... 27% 227M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25550K .......... .......... .......... .......... .......... 27% 5.23M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25600K .......... .......... .......... .......... .......... 27% 197M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25650K .......... .......... .......... .......... .......... 27% 236M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25700K .......... .......... .......... .......... .......... 27% 240M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25750K .......... .......... .......... .......... .......... 27% 18.9M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25800K .......... .......... .......... .......... .......... 27% 145M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25850K .......... .......... .......... .......... .......... 27% 185M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25900K .......... .......... .......... .......... .......... 27% 213M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 25950K .......... .......... .......... .......... .......... 27% 77.9M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 26000K .......... .......... .......... .......... .......... 28% 165M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 26050K .......... .......... .......... .......... .......... 28% 192M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 26100K .......... .......... .......... .......... .......... 28% 209M 1s 2024-09-05T01:19:41.853 INFO:teuthology.orchestra.run.smithi099.stderr: 26150K .......... .......... .......... .......... .......... 28% 187M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26200K .......... .......... .......... .......... .......... 28% 182M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26250K .......... .......... .......... .......... .......... 28% 172M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26300K .......... .......... .......... .......... .......... 28% 205M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26350K .......... .......... .......... .......... .......... 28% 116M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26400K .......... .......... .......... .......... .......... 28% 184M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26450K .......... .......... .......... .......... .......... 28% 203M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26500K .......... .......... .......... .......... .......... 28% 200M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26550K .......... .......... .......... .......... .......... 28% 159M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26600K .......... .......... .......... .......... .......... 28% 183M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26650K .......... .......... .......... .......... .......... 28% 180M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26700K .......... .......... .......... .......... .......... 28% 178M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26750K .......... .......... .......... .......... .......... 28% 148M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26800K .......... .......... .......... .......... .......... 28% 201M 1s 2024-09-05T01:19:41.854 INFO:teuthology.orchestra.run.smithi099.stderr: 26850K .......... .......... .......... .......... .......... 28% 205M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 26900K .......... .......... .......... .......... .......... 29% 179M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 26950K .......... .......... .......... .......... .......... 29% 171M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27000K .......... .......... .......... .......... .......... 29% 195M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27050K .......... .......... .......... .......... .......... 29% 187M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27100K .......... .......... .......... .......... .......... 29% 187M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27150K .......... .......... .......... .......... .......... 29% 170M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27200K .......... .......... .......... .......... .......... 29% 199M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27250K .......... .......... .......... .......... .......... 29% 182M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27300K .......... .......... .......... .......... .......... 29% 198M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27350K .......... .......... .......... .......... .......... 29% 171M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27400K .......... .......... .......... .......... .......... 29% 185M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27450K .......... .......... .......... .......... .......... 29% 183M 1s 2024-09-05T01:19:41.855 INFO:teuthology.orchestra.run.smithi099.stderr: 27500K .......... .......... .......... .......... .......... 29% 177M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27550K .......... .......... .......... .......... .......... 29% 160M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27600K .......... .......... .......... .......... .......... 29% 181M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27650K .......... .......... .......... .......... .......... 29% 183M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27700K .......... .......... .......... .......... .......... 29% 196M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27750K .......... .......... .......... .......... .......... 29% 165M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27800K .......... .......... .......... .......... .......... 29% 192M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27850K .......... .......... .......... .......... .......... 30% 196M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27900K .......... .......... .......... .......... .......... 30% 197M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 27950K .......... .......... .......... .......... .......... 30% 163M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 28000K .......... .......... .......... .......... .......... 30% 208M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 28050K .......... .......... .......... .......... .......... 30% 191M 1s 2024-09-05T01:19:41.856 INFO:teuthology.orchestra.run.smithi099.stderr: 28100K .......... .......... .......... .......... .......... 30% 209M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28150K .......... .......... .......... .......... .......... 30% 177M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28200K .......... .......... .......... .......... .......... 30% 201M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28250K .......... .......... .......... .......... .......... 30% 195M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28300K .......... .......... .......... .......... .......... 30% 194M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28350K .......... .......... .......... .......... .......... 30% 151M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28400K .......... .......... .......... .......... .......... 30% 200M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28450K .......... .......... .......... .......... .......... 30% 188M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28500K .......... .......... .......... .......... .......... 30% 180M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28550K .......... .......... .......... .......... .......... 30% 172M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28600K .......... .......... .......... .......... .......... 30% 192M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28650K .......... .......... .......... .......... .......... 30% 193M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28700K .......... .......... .......... .......... .......... 30% 192M 1s 2024-09-05T01:19:41.857 INFO:teuthology.orchestra.run.smithi099.stderr: 28750K .......... .......... .......... .......... .......... 31% 131M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 28800K .......... .......... .......... .......... .......... 31% 200M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 28850K .......... .......... .......... .......... .......... 31% 189M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 28900K .......... .......... .......... .......... .......... 31% 218M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 28950K .......... .......... .......... .......... .......... 31% 163M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29000K .......... .......... .......... .......... .......... 31% 198M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29050K .......... .......... .......... .......... .......... 31% 199M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29100K .......... .......... .......... .......... .......... 31% 206M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29150K .......... .......... .......... .......... .......... 31% 177M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29200K .......... .......... .......... .......... .......... 31% 198M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29250K .......... .......... .......... .......... .......... 31% 191M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29300K .......... .......... .......... .......... .......... 31% 211M 1s 2024-09-05T01:19:41.858 INFO:teuthology.orchestra.run.smithi099.stderr: 29350K .......... .......... .......... .......... .......... 31% 202M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29400K .......... .......... .......... .......... .......... 31% 227M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29450K .......... .......... .......... .......... .......... 31% 215M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29500K .......... .......... .......... .......... .......... 31% 206M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29550K .......... .......... .......... .......... .......... 31% 181M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29600K .......... .......... .......... .......... .......... 31% 214M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29650K .......... .......... .......... .......... .......... 31% 203M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29700K .......... .......... .......... .......... .......... 32% 226M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29750K .......... .......... .......... .......... .......... 32% 191M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29800K .......... .......... .......... .......... .......... 32% 205M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29850K .......... .......... .......... .......... .......... 32% 197M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29900K .......... .......... .......... .......... .......... 32% 191M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 29950K .......... .......... .......... .......... .......... 32% 178M 0s 2024-09-05T01:19:41.859 INFO:teuthology.orchestra.run.smithi099.stderr: 30000K .......... .......... .......... .......... .......... 32% 207M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30050K .......... .......... .......... .......... .......... 32% 200M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30100K .......... .......... .......... .......... .......... 32% 174M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30150K .......... .......... .......... .......... .......... 32% 206M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30200K .......... .......... .......... .......... .......... 32% 199M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30250K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30300K .......... .......... .......... .......... .......... 32% 206M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30350K .......... .......... .......... .......... .......... 32% 204M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30400K .......... .......... .......... .......... .......... 32% 242M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30450K .......... .......... .......... .......... .......... 32% 245M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30500K .......... .......... .......... .......... .......... 32% 213M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30550K .......... .......... .......... .......... .......... 32% 213M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30600K .......... .......... .......... .......... .......... 32% 249M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30650K .......... .......... .......... .......... .......... 33% 243M 0s 2024-09-05T01:19:41.860 INFO:teuthology.orchestra.run.smithi099.stderr: 30700K .......... .......... .......... .......... .......... 33% 210M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 30750K .......... .......... .......... .......... .......... 33% 199M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 30800K .......... .......... .......... .......... .......... 33% 238M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 30850K .......... .......... .......... .......... .......... 33% 238M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 30900K .......... .......... .......... .......... .......... 33% 238M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 30950K .......... .......... .......... .......... .......... 33% 183M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31000K .......... .......... .......... .......... .......... 33% 214M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31050K .......... .......... .......... .......... .......... 33% 234M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31100K .......... .......... .......... .......... .......... 33% 229M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31150K .......... .......... .......... .......... .......... 33% 209M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31200K .......... .......... .......... .......... .......... 33% 222M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31250K .......... .......... .......... .......... .......... 33% 228M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31300K .......... .......... .......... .......... .......... 33% 248M 0s 2024-09-05T01:19:41.861 INFO:teuthology.orchestra.run.smithi099.stderr: 31350K .......... .......... .......... .......... .......... 33% 210M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31400K .......... .......... .......... .......... .......... 33% 248M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31450K .......... .......... .......... .......... .......... 33% 251M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31500K .......... .......... .......... .......... .......... 33% 251M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31550K .......... .......... .......... .......... .......... 34% 205M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31600K .......... .......... .......... .......... .......... 34% 227M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31650K .......... .......... .......... .......... .......... 34% 238M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31700K .......... .......... .......... .......... .......... 34% 255M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31750K .......... .......... .......... .......... .......... 34% 225M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31800K .......... .......... .......... .......... .......... 34% 239M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31850K .......... .......... .......... .......... .......... 34% 209M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31900K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 31950K .......... .......... .......... .......... .......... 34% 216M 0s 2024-09-05T01:19:41.862 INFO:teuthology.orchestra.run.smithi099.stderr: 32000K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32050K .......... .......... .......... .......... .......... 34% 240M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32100K .......... .......... .......... .......... .......... 34% 229M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32150K .......... .......... .......... .......... .......... 34% 235M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32200K .......... .......... .......... .......... .......... 34% 258M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32250K .......... .......... .......... .......... .......... 34% 225M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32300K .......... .......... .......... .......... .......... 34% 245M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32350K .......... .......... .......... .......... .......... 34% 214M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32400K .......... .......... .......... .......... .......... 34% 237M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32450K .......... .......... .......... .......... .......... 34% 225M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32500K .......... .......... .......... .......... .......... 35% 241M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32550K .......... .......... .......... .......... .......... 35% 222M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32600K .......... .......... .......... .......... .......... 35% 250M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32650K .......... .......... .......... .......... .......... 35% 242M 0s 2024-09-05T01:19:41.863 INFO:teuthology.orchestra.run.smithi099.stderr: 32700K .......... .......... .......... .......... .......... 35% 264M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 32750K .......... .......... .......... .......... .......... 35% 178M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 32800K .......... .......... .......... .......... .......... 35% 238M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 32850K .......... .......... .......... .......... .......... 35% 201M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 32900K .......... .......... .......... .......... .......... 35% 231M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 32950K .......... .......... .......... .......... .......... 35% 245M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33000K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33050K .......... .......... .......... .......... .......... 35% 272M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33100K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33150K .......... .......... .......... .......... .......... 35% 227M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33200K .......... .......... .......... .......... .......... 35% 272M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33250K .......... .......... .......... .......... .......... 35% 242M 0s 2024-09-05T01:19:41.864 INFO:teuthology.orchestra.run.smithi099.stderr: 33300K .......... .......... .......... .......... .......... 35% 244M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33350K .......... .......... .......... .......... .......... 35% 239M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33400K .......... .......... .......... .......... .......... 36% 257M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33450K .......... .......... .......... .......... .......... 36% 237M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33500K .......... .......... .......... .......... .......... 36% 268M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33550K .......... .......... .......... .......... .......... 36% 220M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33600K .......... .......... .......... .......... .......... 36% 269M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33650K .......... .......... .......... .......... .......... 36% 268M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33700K .......... .......... .......... .......... .......... 36% 256M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33750K .......... .......... .......... .......... .......... 36% 142M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33800K .......... .......... .......... .......... .......... 36% 169M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33850K .......... .......... .......... .......... .......... 36% 237M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33900K .......... .......... .......... .......... .......... 36% 255M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 33950K .......... .......... .......... .......... .......... 36% 217M 0s 2024-09-05T01:19:41.865 INFO:teuthology.orchestra.run.smithi099.stderr: 34000K .......... .......... .......... .......... .......... 36% 255M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34050K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34100K .......... .......... .......... .......... .......... 36% 269M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34150K .......... .......... .......... .......... .......... 36% 241M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34200K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34250K .......... .......... .......... .......... .......... 36% 296M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34300K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34350K .......... .......... .......... .......... .......... 37% 237M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34400K .......... .......... .......... .......... .......... 37% 246M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34450K .......... .......... .......... .......... .......... 37% 275M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34500K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34550K .......... .......... .......... .......... .......... 37% 266M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34600K .......... .......... .......... .......... .......... 37% 291M 0s 2024-09-05T01:19:41.866 INFO:teuthology.orchestra.run.smithi099.stderr: 34650K .......... .......... .......... .......... .......... 37% 274M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34700K .......... .......... .......... .......... .......... 37% 253M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34750K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34800K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34850K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34900K .......... .......... .......... .......... .......... 37% 261M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 34950K .......... .......... .......... .......... .......... 37% 247M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35000K .......... .......... .......... .......... .......... 37% 283M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35050K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35100K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35150K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35200K .......... .......... .......... .......... .......... 37% 289M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35250K .......... .......... .......... .......... .......... 37% 265M 0s 2024-09-05T01:19:41.867 INFO:teuthology.orchestra.run.smithi099.stderr: 35300K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35350K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35400K .......... .......... .......... .......... .......... 38% 269M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35450K .......... .......... .......... .......... .......... 38% 291M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35500K .......... .......... .......... .......... .......... 38% 310M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35550K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35600K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35650K .......... .......... .......... .......... .......... 38% 312M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35700K .......... .......... .......... .......... .......... 38% 278M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35750K .......... .......... .......... .......... .......... 38% 273M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35800K .......... .......... .......... .......... .......... 38% 284M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35850K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35900K .......... .......... .......... .......... .......... 38% 300M 0s 2024-09-05T01:19:41.868 INFO:teuthology.orchestra.run.smithi099.stderr: 35950K .......... .......... .......... .......... .......... 38% 240M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36000K .......... .......... .......... .......... .......... 38% 259M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36050K .......... .......... .......... .......... .......... 38% 52.8M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36100K .......... .......... .......... .......... .......... 38% 237M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36150K .......... .......... .......... .......... .......... 38% 249M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36200K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36250K .......... .......... .......... .......... .......... 39% 295M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36300K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36350K .......... .......... .......... .......... .......... 39% 222M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36400K .......... .......... .......... .......... .......... 39% 271M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36450K .......... .......... .......... .......... .......... 39% 286M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36500K .......... .......... .......... .......... .......... 39% 308M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36550K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36600K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36650K .......... .......... .......... .......... .......... 39% 282M 0s 2024-09-05T01:19:41.869 INFO:teuthology.orchestra.run.smithi099.stderr: 36700K .......... .......... .......... .......... .......... 39% 281M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 36750K .......... .......... .......... .......... .......... 39% 266M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 36800K .......... .......... .......... .......... .......... 39% 297M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 36850K .......... .......... .......... .......... .......... 39% 301M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 36900K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 36950K .......... .......... .......... .......... .......... 39% 191M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37000K .......... .......... .......... .......... .......... 39% 290M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37050K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37100K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37150K .......... .......... .......... .......... .......... 40% 222M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37200K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37250K .......... .......... .......... .......... .......... 40% 318M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37300K .......... .......... .......... .......... .......... 40% 313M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37350K .......... .......... .......... .......... .......... 40% 132M 0s 2024-09-05T01:19:41.870 INFO:teuthology.orchestra.run.smithi099.stderr: 37400K .......... .......... .......... .......... .......... 40% 258M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37450K .......... .......... .......... .......... .......... 40% 236M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37500K .......... .......... .......... .......... .......... 40% 306M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37550K .......... .......... .......... .......... .......... 40% 249M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37600K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37650K .......... .......... .......... .......... .......... 40% 279M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37700K .......... .......... .......... .......... .......... 40% 258M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37750K .......... .......... .......... .......... .......... 40% 261M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37800K .......... .......... .......... .......... .......... 40% 299M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37850K .......... .......... .......... .......... .......... 40% 273M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37900K .......... .......... .......... .......... .......... 40% 260M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 37950K .......... .......... .......... .......... .......... 40% 226M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 38000K .......... .......... .......... .......... .......... 40% 272M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 38050K .......... .......... .......... .......... .......... 41% 269M 0s 2024-09-05T01:19:41.871 INFO:teuthology.orchestra.run.smithi099.stderr: 38100K .......... .......... .......... .......... .......... 41% 278M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38150K .......... .......... .......... .......... .......... 41% 255M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38200K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38250K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38300K .......... .......... .......... .......... .......... 41% 276M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38350K .......... .......... .......... .......... .......... 41% 231M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38400K .......... .......... .......... .......... .......... 41% 251M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38450K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38500K .......... .......... .......... .......... .......... 41% 282M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38550K .......... .......... .......... .......... .......... 41% 256M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38600K .......... .......... .......... .......... .......... 41% 271M 0s 2024-09-05T01:19:41.872 INFO:teuthology.orchestra.run.smithi099.stderr: 38650K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38700K .......... .......... .......... .......... .......... 41% 254M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38750K .......... .......... .......... .......... .......... 41% 234M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38800K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38850K .......... .......... .......... .......... .......... 41% 280M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38900K .......... .......... .......... .......... .......... 41% 267M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 38950K .......... .......... .......... .......... .......... 41% 262M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39000K .......... .......... .......... .......... .......... 42% 47.6M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39050K .......... .......... .......... .......... .......... 42% 198M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39100K .......... .......... .......... .......... .......... 42% 271M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39150K .......... .......... .......... .......... .......... 42% 239M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39200K .......... .......... .......... .......... .......... 42% 260M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39250K .......... .......... .......... .......... .......... 42% 277M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39300K .......... .......... .......... .......... .......... 42% 274M 0s 2024-09-05T01:19:41.873 INFO:teuthology.orchestra.run.smithi099.stderr: 39350K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39400K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39450K .......... .......... .......... .......... .......... 42% 281M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39500K .......... .......... .......... .......... .......... 42% 272M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39550K .......... .......... .......... .......... .......... 42% 218M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39600K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39650K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39700K .......... .......... .......... .......... .......... 42% 280M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39750K .......... .......... .......... .......... .......... 42% 248M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39800K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39850K .......... .......... .......... .......... .......... 42% 236M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39900K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 39950K .......... .......... .......... .......... .......... 43% 218M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 40000K .......... .......... .......... .......... .......... 43% 260M 0s 2024-09-05T01:19:41.874 INFO:teuthology.orchestra.run.smithi099.stderr: 40050K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40100K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40150K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40200K .......... .......... .......... .......... .......... 43% 215M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40250K .......... .......... .......... .......... .......... 43% 268M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40300K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40350K .......... .......... .......... .......... .......... 43% 243M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40400K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40450K .......... .......... .......... .......... .......... 43% 276M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40500K .......... .......... .......... .......... .......... 43% 270M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40550K .......... .......... .......... .......... .......... 43% 232M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40600K .......... .......... .......... .......... .......... 43% 275M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40650K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40700K .......... .......... .......... .......... .......... 43% 271M 0s 2024-09-05T01:19:41.875 INFO:teuthology.orchestra.run.smithi099.stderr: 40750K .......... .......... .......... .......... .......... 43% 225M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 40800K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 40850K .......... .......... .......... .......... .......... 44% 291M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 40900K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 40950K .......... .......... .......... .......... .......... 44% 256M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41000K .......... .......... .......... .......... .......... 44% 278M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41050K .......... .......... .......... .......... .......... 44% 225M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41100K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41150K .......... .......... .......... .......... .......... 44% 220M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41200K .......... .......... .......... .......... .......... 44% 287M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41250K .......... .......... .......... .......... .......... 44% 273M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41300K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41350K .......... .......... .......... .......... .......... 44% 223M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41400K .......... .......... .......... .......... .......... 44% 262M 0s 2024-09-05T01:19:41.876 INFO:teuthology.orchestra.run.smithi099.stderr: 41450K .......... .......... .......... .......... .......... 44% 254M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41500K .......... .......... .......... .......... .......... 44% 288M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41550K .......... .......... .......... .......... .......... 44% 231M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41600K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41650K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41700K .......... .......... .......... .......... .......... 44% 281M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41750K .......... .......... .......... .......... .......... 44% 257M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41800K .......... .......... .......... .......... .......... 45% 287M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41850K .......... .......... .......... .......... .......... 45% 291M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41900K .......... .......... .......... .......... .......... 45% 75.4M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 41950K .......... .......... .......... .......... .......... 45% 202M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 42000K .......... .......... .......... .......... .......... 45% 304M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 42050K .......... .......... .......... .......... .......... 45% 284M 0s 2024-09-05T01:19:41.877 INFO:teuthology.orchestra.run.smithi099.stderr: 42100K .......... .......... .......... .......... .......... 45% 262M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42150K .......... .......... .......... .......... .......... 45% 234M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42200K .......... .......... .......... .......... .......... 45% 271M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42250K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42300K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42350K .......... .......... .......... .......... .......... 45% 240M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42400K .......... .......... .......... .......... .......... 45% 212M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42450K .......... .......... .......... .......... .......... 45% 259M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42500K .......... .......... .......... .......... .......... 45% 227M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42550K .......... .......... .......... .......... .......... 45% 259M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42600K .......... .......... .......... .......... .......... 45% 273M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42650K .......... .......... .......... .......... .......... 45% 265M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42700K .......... .......... .......... .......... .......... 46% 261M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42750K .......... .......... .......... .......... .......... 46% 228M 0s 2024-09-05T01:19:41.878 INFO:teuthology.orchestra.run.smithi099.stderr: 42800K .......... .......... .......... .......... .......... 46% 278M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 42850K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 42900K .......... .......... .......... .......... .......... 46% 288M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 42950K .......... .......... .......... .......... .......... 46% 240M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43000K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43050K .......... .......... .......... .......... .......... 46% 263M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43100K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43150K .......... .......... .......... .......... .......... 46% 98.2M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43200K .......... .......... .......... .......... .......... 46% 286M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43250K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43300K .......... .......... .......... .......... .......... 46% 295M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43350K .......... .......... .......... .......... .......... 46% 246M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43400K .......... .......... .......... .......... .......... 46% 269M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43450K .......... .......... .......... .......... .......... 46% 293M 0s 2024-09-05T01:19:41.879 INFO:teuthology.orchestra.run.smithi099.stderr: 43500K .......... .......... .......... .......... .......... 46% 268M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43550K .......... .......... .......... .......... .......... 46% 253M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43600K .......... .......... .......... .......... .......... 46% 277M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43650K .......... .......... .......... .......... .......... 47% 289M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43700K .......... .......... .......... .......... .......... 47% 270M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43750K .......... .......... .......... .......... .......... 47% 252M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43800K .......... .......... .......... .......... .......... 47% 300M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43850K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43900K .......... .......... .......... .......... .......... 47% 270M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 43950K .......... .......... .......... .......... .......... 47% 209M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 44000K .......... .......... .......... .......... .......... 47% 225M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 44050K .......... .......... .......... .......... .......... 47% 274M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 44100K .......... .......... .......... .......... .......... 47% 261M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 44150K .......... .......... .......... .......... .......... 47% 268M 0s 2024-09-05T01:19:41.880 INFO:teuthology.orchestra.run.smithi099.stderr: 44200K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44250K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44300K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44350K .......... .......... .......... .......... .......... 47% 248M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44400K .......... .......... .......... .......... .......... 47% 302M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44450K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44500K .......... .......... .......... .......... .......... 47% 259M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44550K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44600K .......... .......... .......... .......... .......... 48% 263M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44650K .......... .......... .......... .......... .......... 48% 271M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44700K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44750K .......... .......... .......... .......... .......... 48% 55.2M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44800K .......... .......... .......... .......... .......... 48% 244M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44850K .......... .......... .......... .......... .......... 48% 258M 0s 2024-09-05T01:19:41.881 INFO:teuthology.orchestra.run.smithi099.stderr: 44900K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 44950K .......... .......... .......... .......... .......... 48% 255M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45000K .......... .......... .......... .......... .......... 48% 253M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45050K .......... .......... .......... .......... .......... 48% 267M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45100K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45150K .......... .......... .......... .......... .......... 48% 200M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45200K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45250K .......... .......... .......... .......... .......... 48% 281M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45300K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45350K .......... .......... .......... .......... .......... 48% 269M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45400K .......... .......... .......... .......... .......... 48% 308M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45450K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45500K .......... .......... .......... .......... .......... 49% 267M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45550K .......... .......... .......... .......... .......... 49% 241M 0s 2024-09-05T01:19:41.882 INFO:teuthology.orchestra.run.smithi099.stderr: 45600K .......... .......... .......... .......... .......... 49% 289M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45650K .......... .......... .......... .......... .......... 49% 296M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45700K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45750K .......... .......... .......... .......... .......... 49% 277M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45800K .......... .......... .......... .......... .......... 49% 261M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45850K .......... .......... .......... .......... .......... 49% 316M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45900K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 45950K .......... .......... .......... .......... .......... 49% 244M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46000K .......... .......... .......... .......... .......... 49% 272M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46050K .......... .......... .......... .......... .......... 49% 120M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46100K .......... .......... .......... .......... .......... 49% 277M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46150K .......... .......... .......... .......... .......... 49% 261M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46200K .......... .......... .......... .......... .......... 49% 297M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46250K .......... .......... .......... .......... .......... 49% 204M 0s 2024-09-05T01:19:41.883 INFO:teuthology.orchestra.run.smithi099.stderr: 46300K .......... .......... .......... .......... .......... 49% 261M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46350K .......... .......... .......... .......... .......... 49% 224M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46400K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46450K .......... .......... .......... .......... .......... 50% 298M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46500K .......... .......... .......... .......... .......... 50% 263M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46550K .......... .......... .......... .......... .......... 50% 244M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46600K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46650K .......... .......... .......... .......... .......... 50% 278M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46700K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46750K .......... .......... .......... .......... .......... 50% 239M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46800K .......... .......... .......... .......... .......... 50% 271M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46850K .......... .......... .......... .......... .......... 50% 281M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46900K .......... .......... .......... .......... .......... 50% 298M 0s 2024-09-05T01:19:41.884 INFO:teuthology.orchestra.run.smithi099.stderr: 46950K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47000K .......... .......... .......... .......... .......... 50% 252M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47050K .......... .......... .......... .......... .......... 50% 250M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47100K .......... .......... .......... .......... .......... 50% 311M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47150K .......... .......... .......... .......... .......... 50% 255M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47200K .......... .......... .......... .......... .......... 50% 278M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47250K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47300K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47350K .......... .......... .......... .......... .......... 51% 265M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47400K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47450K .......... .......... .......... .......... .......... 51% 314M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47500K .......... .......... .......... .......... .......... 51% 240M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47550K .......... .......... .......... .......... .......... 51% 203M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47600K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-05T01:19:41.885 INFO:teuthology.orchestra.run.smithi099.stderr: 47650K .......... .......... .......... .......... .......... 51% 289M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47700K .......... .......... .......... .......... .......... 51% 56.2M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47750K .......... .......... .......... .......... .......... 51% 223M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47800K .......... .......... .......... .......... .......... 51% 302M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47850K .......... .......... .......... .......... .......... 51% 295M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47900K .......... .......... .......... .......... .......... 51% 270M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 47950K .......... .......... .......... .......... .......... 51% 254M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48000K .......... .......... .......... .......... .......... 51% 302M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48050K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48100K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48150K .......... .......... .......... .......... .......... 51% 177M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48200K .......... .......... .......... .......... .......... 51% 284M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48250K .......... .......... .......... .......... .......... 51% 306M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48300K .......... .......... .......... .......... .......... 52% 308M 0s 2024-09-05T01:19:41.886 INFO:teuthology.orchestra.run.smithi099.stderr: 48350K .......... .......... .......... .......... .......... 52% 267M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48400K .......... .......... .......... .......... .......... 52% 209M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48450K .......... .......... .......... .......... .......... 52% 281M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48500K .......... .......... .......... .......... .......... 52% 291M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48550K .......... .......... .......... .......... .......... 52% 278M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48600K .......... .......... .......... .......... .......... 52% 279M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48650K .......... .......... .......... .......... .......... 52% 272M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48700K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48750K .......... .......... .......... .......... .......... 52% 247M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48800K .......... .......... .......... .......... .......... 52% 321M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48850K .......... .......... .......... .......... .......... 52% 306M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48900K .......... .......... .......... .......... .......... 52% 299M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 48950K .......... .......... .......... .......... .......... 52% 260M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 49000K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-05T01:19:41.887 INFO:teuthology.orchestra.run.smithi099.stderr: 49050K .......... .......... .......... .......... .......... 52% 292M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49100K .......... .......... .......... .......... .......... 52% 197M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49150K .......... .......... .......... .......... .......... 52% 121M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49200K .......... .......... .......... .......... .......... 53% 241M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49250K .......... .......... .......... .......... .......... 53% 260M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49300K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49350K .......... .......... .......... .......... .......... 53% 258M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49400K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49450K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49500K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49550K .......... .......... .......... .......... .......... 53% 252M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49600K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49650K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-05T01:19:41.888 INFO:teuthology.orchestra.run.smithi099.stderr: 49700K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 49750K .......... .......... .......... .......... .......... 53% 257M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 49800K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 49850K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 49900K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 49950K .......... .......... .......... .......... .......... 53% 258M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50000K .......... .......... .......... .......... .......... 53% 215M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50050K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50100K .......... .......... .......... .......... .......... 53% 274M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50150K .......... .......... .......... .......... .......... 54% 286M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50200K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50250K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50300K .......... .......... .......... .......... .......... 54% 260M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50350K .......... .......... .......... .......... .......... 54% 241M 0s 2024-09-05T01:19:41.889 INFO:teuthology.orchestra.run.smithi099.stderr: 50400K .......... .......... .......... .......... .......... 54% 318M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50450K .......... .......... .......... .......... .......... 54% 132M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50500K .......... .......... .......... .......... .......... 54% 274M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50550K .......... .......... .......... .......... .......... 54% 278M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50600K .......... .......... .......... .......... .......... 54% 335M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50650K .......... .......... .......... .......... .......... 54% 58.6M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50700K .......... .......... .......... .......... .......... 54% 275M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50750K .......... .......... .......... .......... .......... 54% 263M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50800K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50850K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50900K .......... .......... .......... .......... .......... 54% 289M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 50950K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 51000K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 51050K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-05T01:19:41.890 INFO:teuthology.orchestra.run.smithi099.stderr: 51100K .......... .......... .......... .......... .......... 55% 221M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51150K .......... .......... .......... .......... .......... 55% 264M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51200K .......... .......... .......... .......... .......... 55% 106M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51250K .......... .......... .......... .......... .......... 55% 323M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51300K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51350K .......... .......... .......... .......... .......... 55% 267M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51400K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51450K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51500K .......... .......... .......... .......... .......... 55% 321M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51550K .......... .......... .......... .......... .......... 55% 257M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51600K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51650K .......... .......... .......... .......... .......... 55% 314M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51700K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51750K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-05T01:19:41.891 INFO:teuthology.orchestra.run.smithi099.stderr: 51800K .......... .......... .......... .......... .......... 55% 277M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 51850K .......... .......... .......... .......... .......... 55% 289M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 51900K .......... .......... .......... .......... .......... 55% 318M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 51950K .......... .......... .......... .......... .......... 55% 173M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52000K .......... .......... .......... .......... .......... 56% 252M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52050K .......... .......... .......... .......... .......... 56% 320M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52100K .......... .......... .......... .......... .......... 56% 293M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52150K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52200K .......... .......... .......... .......... .......... 56% 10.5M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52250K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52300K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52350K .......... .......... .......... .......... .......... 56% 281M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52400K .......... .......... .......... .......... .......... 56% 224M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52450K .......... .......... .......... .......... .......... 56% 127M 0s 2024-09-05T01:19:41.892 INFO:teuthology.orchestra.run.smithi099.stderr: 52500K .......... .......... .......... .......... .......... 56% 92.2M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52550K .......... .......... .......... .......... .......... 56% 257M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52600K .......... .......... .......... .......... .......... 56% 206M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52650K .......... .......... .......... .......... .......... 56% 15.2M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52700K .......... .......... .......... .......... .......... 56% 294M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52750K .......... .......... .......... .......... .......... 56% 76.0M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52800K .......... .......... .......... .......... .......... 56% 254M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52850K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52900K .......... .......... .......... .......... .......... 56% 329M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 52950K .......... .......... .......... .......... .......... 57% 287M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 53000K .......... .......... .......... .......... .......... 57% 293M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 53050K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 53100K .......... .......... .......... .......... .......... 57% 233M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 53150K .......... .......... .......... .......... .......... 57% 262M 0s 2024-09-05T01:19:41.893 INFO:teuthology.orchestra.run.smithi099.stderr: 53200K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53250K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53300K .......... .......... .......... .......... .......... 57% 65.1M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53350K .......... .......... .......... .......... .......... 57% 225M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53400K .......... .......... .......... .......... .......... 57% 82.8M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53450K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53500K .......... .......... .......... .......... .......... 57% 202M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53550K .......... .......... .......... .......... .......... 57% 226M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53600K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53650K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53700K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53750K .......... .......... .......... .......... .......... 57% 278M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53800K .......... .......... .......... .......... .......... 57% 291M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53850K .......... .......... .......... .......... .......... 58% 266M 0s 2024-09-05T01:19:41.894 INFO:teuthology.orchestra.run.smithi099.stderr: 53900K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 53950K .......... .......... .......... .......... .......... 58% 227M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54000K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54050K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54100K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54150K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54200K .......... .......... .......... .......... .......... 58% 278M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54250K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54300K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54350K .......... .......... .......... .......... .......... 58% 230M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54400K .......... .......... .......... .......... .......... 58% 284M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54450K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54500K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-05T01:19:41.895 INFO:teuthology.orchestra.run.smithi099.stderr: 54550K .......... .......... .......... .......... .......... 58% 273M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54600K .......... .......... .......... .......... .......... 58% 282M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54650K .......... .......... .......... .......... .......... 58% 308M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54700K .......... .......... .......... .......... .......... 58% 264M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54750K .......... .......... .......... .......... .......... 58% 240M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54800K .......... .......... .......... .......... .......... 59% 323M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54850K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54900K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 54950K .......... .......... .......... .......... .......... 59% 300M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 55000K .......... .......... .......... .......... .......... 59% 329M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 55050K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 55100K .......... .......... .......... .......... .......... 59% 314M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 55150K .......... .......... .......... .......... .......... 59% 254M 0s 2024-09-05T01:19:41.896 INFO:teuthology.orchestra.run.smithi099.stderr: 55200K .......... .......... .......... .......... .......... 59% 300M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55250K .......... .......... .......... .......... .......... 59% 330M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55300K .......... .......... .......... .......... .......... 59% 322M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55350K .......... .......... .......... .......... .......... 59% 273M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55400K .......... .......... .......... .......... .......... 59% 307M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55450K .......... .......... .......... .......... .......... 59% 328M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55500K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55550K .......... .......... .......... .......... .......... 59% 212M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55600K .......... .......... .......... .......... .......... 59% 324M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55650K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55700K .......... .......... .......... .......... .......... 60% 105M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55750K .......... .......... .......... .......... .......... 60% 215M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55800K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-05T01:19:41.897 INFO:teuthology.orchestra.run.smithi099.stderr: 55850K .......... .......... .......... .......... .......... 60% 288M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 55900K .......... .......... .......... .......... .......... 60% 296M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 55950K .......... .......... .......... .......... .......... 60% 261M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56000K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56050K .......... .......... .......... .......... .......... 60% 146M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56100K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56150K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56200K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56250K .......... .......... .......... .......... .......... 60% 93.5M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56300K .......... .......... .......... .......... .......... 60% 293M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56350K .......... .......... .......... .......... .......... 60% 63.5M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56400K .......... .......... .......... .......... .......... 60% 278M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56450K .......... .......... .......... .......... .......... 60% 294M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56500K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-05T01:19:41.898 INFO:teuthology.orchestra.run.smithi099.stderr: 56550K .......... .......... .......... .......... .......... 60% 139M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56600K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56650K .......... .......... .......... .......... .......... 61% 302M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56700K .......... .......... .......... .......... .......... 61% 305M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56750K .......... .......... .......... .......... .......... 61% 267M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56800K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56850K .......... .......... .......... .......... .......... 61% 284M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56900K .......... .......... .......... .......... .......... 61% 300M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 56950K .......... .......... .......... .......... .......... 61% 270M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 57000K .......... .......... .......... .......... .......... 61% 299M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 57050K .......... .......... .......... .......... .......... 61% 308M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 57100K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 57150K .......... .......... .......... .......... .......... 61% 284M 0s 2024-09-05T01:19:41.899 INFO:teuthology.orchestra.run.smithi099.stderr: 57200K .......... .......... .......... .......... .......... 61% 298M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57250K .......... .......... .......... .......... .......... 61% 252M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57300K .......... .......... .......... .......... .......... 61% 299M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57350K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57400K .......... .......... .......... .......... .......... 61% 306M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57450K .......... .......... .......... .......... .......... 61% 214M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57500K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57550K .......... .......... .......... .......... .......... 62% 255M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57600K .......... .......... .......... .......... .......... 62% 320M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57650K .......... .......... .......... .......... .......... 62% 294M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57700K .......... .......... .......... .......... .......... 62% 301M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57750K .......... .......... .......... .......... .......... 62% 291M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57800K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57850K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-05T01:19:41.900 INFO:teuthology.orchestra.run.smithi099.stderr: 57900K .......... .......... .......... .......... .......... 62% 333M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 57950K .......... .......... .......... .......... .......... 62% 283M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58000K .......... .......... .......... .......... .......... 62% 90.9M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58050K .......... .......... .......... .......... .......... 62% 41.3M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58100K .......... .......... .......... .......... .......... 62% 287M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58150K .......... .......... .......... .......... .......... 62% 247M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58200K .......... .......... .......... .......... .......... 62% 274M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58250K .......... .......... .......... .......... .......... 62% 272M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58300K .......... .......... .......... .......... .......... 62% 289M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58350K .......... .......... .......... .......... .......... 62% 226M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58400K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58450K .......... .......... .......... .......... .......... 62% 297M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58500K .......... .......... .......... .......... .......... 63% 266M 0s 2024-09-05T01:19:41.901 INFO:teuthology.orchestra.run.smithi099.stderr: 58550K .......... .......... .......... .......... .......... 63% 283M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58600K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58650K .......... .......... .......... .......... .......... 63% 313M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58700K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58750K .......... .......... .......... .......... .......... 63% 233M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58800K .......... .......... .......... .......... .......... 63% 318M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58850K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58900K .......... .......... .......... .......... .......... 63% 271M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 58950K .......... .......... .......... .......... .......... 63% 254M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59000K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59050K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59100K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59150K .......... .......... .......... .......... .......... 63% 273M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59200K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-05T01:19:41.902 INFO:teuthology.orchestra.run.smithi099.stderr: 59250K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59300K .......... .......... .......... .......... .......... 63% 318M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59350K .......... .......... .......... .......... .......... 63% 247M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59400K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59450K .......... .......... .......... .......... .......... 64% 306M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59500K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59550K .......... .......... .......... .......... .......... 64% 256M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59600K .......... .......... .......... .......... .......... 64% 246M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59650K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59700K .......... .......... .......... .......... .......... 64% 283M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59750K .......... .......... .......... .......... .......... 64% 183M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59800K .......... .......... .......... .......... .......... 64% 310M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59850K .......... .......... .......... .......... .......... 64% 290M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59900K .......... .......... .......... .......... .......... 64% 320M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 59950K .......... .......... .......... .......... .......... 64% 245M 0s 2024-09-05T01:19:41.903 INFO:teuthology.orchestra.run.smithi099.stderr: 60000K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60050K .......... .......... .......... .......... .......... 64% 162M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60100K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60150K .......... .......... .......... .......... .......... 64% 264M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60200K .......... .......... .......... .......... .......... 64% 331M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60250K .......... .......... .......... .......... .......... 64% 265M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60300K .......... .......... .......... .......... .......... 64% 301M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60350K .......... .......... .......... .......... .......... 65% 269M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60400K .......... .......... .......... .......... .......... 65% 331M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60450K .......... .......... .......... .......... .......... 65% 306M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60500K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60550K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60600K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-05T01:19:41.904 INFO:teuthology.orchestra.run.smithi099.stderr: 60650K .......... .......... .......... .......... .......... 65% 328M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60700K .......... .......... .......... .......... .......... 65% 211M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60750K .......... .......... .......... .......... .......... 65% 251M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60800K .......... .......... .......... .......... .......... 65% 62.4M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60850K .......... .......... .......... .......... .......... 65% 289M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60900K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 60950K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61000K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61050K .......... .......... .......... .......... .......... 65% 50.4M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61100K .......... .......... .......... .......... .......... 65% 134M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61150K .......... .......... .......... .......... .......... 65% 88.8M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61200K .......... .......... .......... .......... .......... 65% 316M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61250K .......... .......... .......... .......... .......... 65% 291M 0s 2024-09-05T01:19:41.905 INFO:teuthology.orchestra.run.smithi099.stderr: 61300K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61350K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61400K .......... .......... .......... .......... .......... 66% 299M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61450K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61500K .......... .......... .......... .......... .......... 66% 289M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61550K .......... .......... .......... .......... .......... 66% 199M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61600K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61650K .......... .......... .......... .......... .......... 66% 336M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61700K .......... .......... .......... .......... .......... 66% 317M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61750K .......... .......... .......... .......... .......... 66% 274M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61800K .......... .......... .......... .......... .......... 66% 290M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61850K .......... .......... .......... .......... .......... 66% 330M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61900K .......... .......... .......... .......... .......... 66% 316M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 61950K .......... .......... .......... .......... .......... 66% 256M 0s 2024-09-05T01:19:41.906 INFO:teuthology.orchestra.run.smithi099.stderr: 62000K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62050K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62100K .......... .......... .......... .......... .......... 66% 304M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62150K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62200K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62250K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62300K .......... .......... .......... .......... .......... 67% 318M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62350K .......... .......... .......... .......... .......... 67% 266M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62400K .......... .......... .......... .......... .......... 67% 299M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62450K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62500K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62550K .......... .......... .......... .......... .......... 67% 249M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62600K .......... .......... .......... .......... .......... 67% 305M 0s 2024-09-05T01:19:41.907 INFO:teuthology.orchestra.run.smithi099.stderr: 62650K .......... .......... .......... .......... .......... 67% 330M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62700K .......... .......... .......... .......... .......... 67% 287M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62750K .......... .......... .......... .......... .......... 67% 253M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62800K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62850K .......... .......... .......... .......... .......... 67% 324M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62900K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 62950K .......... .......... .......... .......... .......... 67% 285M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63000K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63050K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63100K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63150K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63200K .......... .......... .......... .......... .......... 68% 300M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63250K .......... .......... .......... .......... .......... 68% 7.89M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63300K .......... .......... .......... .......... .......... 68% 262M 0s 2024-09-05T01:19:41.908 INFO:teuthology.orchestra.run.smithi099.stderr: 63350K .......... .......... .......... .......... .......... 68% 277M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63400K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63450K .......... .......... .......... .......... .......... 68% 343M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63500K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63550K .......... .......... .......... .......... .......... 68% 21.3M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63600K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63650K .......... .......... .......... .......... .......... 68% 305M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63700K .......... .......... .......... .......... .......... 68% 311M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63750K .......... .......... .......... .......... .......... 68% 272M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63800K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63850K .......... .......... .......... .......... .......... 68% 58.7M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63900K .......... .......... .......... .......... .......... 68% 32.3M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 63950K .......... .......... .......... .......... .......... 68% 244M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 64000K .......... .......... .......... .......... .......... 68% 275M 0s 2024-09-05T01:19:41.909 INFO:teuthology.orchestra.run.smithi099.stderr: 64050K .......... .......... .......... .......... .......... 68% 86.2M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64100K .......... .......... .......... .......... .......... 69% 286M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64150K .......... .......... .......... .......... .......... 69% 65.7M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64200K .......... .......... .......... .......... .......... 69% 168M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64250K .......... .......... .......... .......... .......... 69% 264M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64300K .......... .......... .......... .......... .......... 69% 281M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64350K .......... .......... .......... .......... .......... 69% 153M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64400K .......... .......... .......... .......... .......... 69% 195M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64450K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64500K .......... .......... .......... .......... .......... 69% 23.5M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64550K .......... .......... .......... .......... .......... 69% 249M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64600K .......... .......... .......... .......... .......... 69% 186M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64650K .......... .......... .......... .......... .......... 69% 278M 0s 2024-09-05T01:19:41.910 INFO:teuthology.orchestra.run.smithi099.stderr: 64700K .......... .......... .......... .......... .......... 69% 34.7M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 64750K .......... .......... .......... .......... .......... 69% 194M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 64800K .......... .......... .......... .......... .......... 69% 13.5M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 64850K .......... .......... .......... .......... .......... 69% 237M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 64900K .......... .......... .......... .......... .......... 69% 273M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 64950K .......... .......... .......... .......... .......... 69% 50.2M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65000K .......... .......... .......... .......... .......... 70% 273M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65050K .......... .......... .......... .......... .......... 70% 276M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65100K .......... .......... .......... .......... .......... 70% 272M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65150K .......... .......... .......... .......... .......... 70% 156M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65200K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65250K .......... .......... .......... .......... .......... 70% 108M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65300K .......... .......... .......... .......... .......... 70% 207M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65350K .......... .......... .......... .......... .......... 70% 83.5M 0s 2024-09-05T01:19:41.911 INFO:teuthology.orchestra.run.smithi099.stderr: 65400K .......... .......... .......... .......... .......... 70% 104M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65450K .......... .......... .......... .......... .......... 70% 266M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65500K .......... .......... .......... .......... .......... 70% 39.6M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65550K .......... .......... .......... .......... .......... 70% 184M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65600K .......... .......... .......... .......... .......... 70% 273M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65650K .......... .......... .......... .......... .......... 70% 215M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65700K .......... .......... .......... .......... .......... 70% 270M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65750K .......... .......... .......... .......... .......... 70% 129M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65800K .......... .......... .......... .......... .......... 70% 252M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65850K .......... .......... .......... .......... .......... 70% 224M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65900K .......... .......... .......... .......... .......... 70% 226M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 65950K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 66000K .......... .......... .......... .......... .......... 71% 257M 0s 2024-09-05T01:19:41.912 INFO:teuthology.orchestra.run.smithi099.stderr: 66050K .......... .......... .......... .......... .......... 71% 287M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66100K .......... .......... .......... .......... .......... 71% 285M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66150K .......... .......... .......... .......... .......... 71% 67.5M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66200K .......... .......... .......... .......... .......... 71% 257M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66250K .......... .......... .......... .......... .......... 71% 278M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66300K .......... .......... .......... .......... .......... 71% 104M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66350K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66400K .......... .......... .......... .......... .......... 71% 294M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66450K .......... .......... .......... .......... .......... 71% 31.2M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66500K .......... .......... .......... .......... .......... 71% 229M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66550K .......... .......... .......... .......... .......... 71% 82.9M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66600K .......... .......... .......... .......... .......... 71% 109M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66650K .......... .......... .......... .......... .......... 71% 220M 0s 2024-09-05T01:19:41.913 INFO:teuthology.orchestra.run.smithi099.stderr: 66700K .......... .......... .......... .......... .......... 71% 218M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 66750K .......... .......... .......... .......... .......... 71% 211M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 66800K .......... .......... .......... .......... .......... 71% 95.2M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 66850K .......... .......... .......... .......... .......... 72% 232M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 66900K .......... .......... .......... .......... .......... 72% 195M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 66950K .......... .......... .......... .......... .......... 72% 178M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67000K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67050K .......... .......... .......... .......... .......... 72% 236M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67100K .......... .......... .......... .......... .......... 72% 217M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67150K .......... .......... .......... .......... .......... 72% 176M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67200K .......... .......... .......... .......... .......... 72% 220M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67250K .......... .......... .......... .......... .......... 72% 221M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67300K .......... .......... .......... .......... .......... 72% 220M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67350K .......... .......... .......... .......... .......... 72% 171M 0s 2024-09-05T01:19:41.914 INFO:teuthology.orchestra.run.smithi099.stderr: 67400K .......... .......... .......... .......... .......... 72% 216M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67450K .......... .......... .......... .......... .......... 72% 250M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67500K .......... .......... .......... .......... .......... 72% 258M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67550K .......... .......... .......... .......... .......... 72% 224M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67600K .......... .......... .......... .......... .......... 72% 236M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67650K .......... .......... .......... .......... .......... 72% 198M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67700K .......... .......... .......... .......... .......... 72% 214M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67750K .......... .......... .......... .......... .......... 72% 237M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67800K .......... .......... .......... .......... .......... 73% 244M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67850K .......... .......... .......... .......... .......... 73% 202M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67900K .......... .......... .......... .......... .......... 73% 232M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 67950K .......... .......... .......... .......... .......... 73% 239M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 68000K .......... .......... .......... .......... .......... 73% 242M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 68050K .......... .......... .......... .......... .......... 73% 204M 0s 2024-09-05T01:19:41.915 INFO:teuthology.orchestra.run.smithi099.stderr: 68100K .......... .......... .......... .......... .......... 73% 243M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68150K .......... .......... .......... .......... .......... 73% 234M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68200K .......... .......... .......... .......... .......... 73% 243M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68250K .......... .......... .......... .......... .......... 73% 240M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68300K .......... .......... .......... .......... .......... 73% 228M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68350K .......... .......... .......... .......... .......... 73% 214M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68400K .......... .......... .......... .......... .......... 73% 224M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68450K .......... .......... .......... .......... .......... 73% 239M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68500K .......... .......... .......... .......... .......... 73% 247M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68550K .......... .......... .......... .......... .......... 73% 234M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68600K .......... .......... .......... .......... .......... 73% 252M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68650K .......... .......... .......... .......... .......... 73% 246M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68700K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-05T01:19:41.916 INFO:teuthology.orchestra.run.smithi099.stderr: 68750K .......... .......... .......... .......... .......... 74% 196M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 68800K .......... .......... .......... .......... .......... 74% 209M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 68850K .......... .......... .......... .......... .......... 74% 265M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 68900K .......... .......... .......... .......... .......... 74% 247M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 68950K .......... .......... .......... .......... .......... 74% 216M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69000K .......... .......... .......... .......... .......... 74% 270M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69050K .......... .......... .......... .......... .......... 74% 228M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69100K .......... .......... .......... .......... .......... 74% 262M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69150K .......... .......... .......... .......... .......... 74% 225M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69200K .......... .......... .......... .......... .......... 74% 253M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69250K .......... .......... .......... .......... .......... 74% 274M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69300K .......... .......... .......... .......... .......... 74% 290M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69350K .......... .......... .......... .......... .......... 74% 260M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69400K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-05T01:19:41.917 INFO:teuthology.orchestra.run.smithi099.stderr: 69450K .......... .......... .......... .......... .......... 74% 272M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69500K .......... .......... .......... .......... .......... 74% 270M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69550K .......... .......... .......... .......... .......... 74% 234M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69600K .......... .......... .......... .......... .......... 74% 271M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69650K .......... .......... .......... .......... .......... 75% 251M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69700K .......... .......... .......... .......... .......... 75% 268M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69750K .......... .......... .......... .......... .......... 75% 186M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69800K .......... .......... .......... .......... .......... 75% 266M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69850K .......... .......... .......... .......... .......... 75% 263M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69900K .......... .......... .......... .......... .......... 75% 230M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 69950K .......... .......... .......... .......... .......... 75% 226M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 70000K .......... .......... .......... .......... .......... 75% 274M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 70050K .......... .......... .......... .......... .......... 75% 245M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 70100K .......... .......... .......... .......... .......... 75% 265M 0s 2024-09-05T01:19:41.918 INFO:teuthology.orchestra.run.smithi099.stderr: 70150K .......... .......... .......... .......... .......... 75% 244M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70200K .......... .......... .......... .......... .......... 75% 252M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70250K .......... .......... .......... .......... .......... 75% 283M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70300K .......... .......... .......... .......... .......... 75% 276M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70350K .......... .......... .......... .......... .......... 75% 240M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70400K .......... .......... .......... .......... .......... 75% 273M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70450K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70500K .......... .......... .......... .......... .......... 75% 274M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70550K .......... .......... .......... .......... .......... 75% 256M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70600K .......... .......... .......... .......... .......... 76% 278M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70650K .......... .......... .......... .......... .......... 76% 272M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70700K .......... .......... .......... .......... .......... 76% 286M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70750K .......... .......... .......... .......... .......... 76% 236M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70800K .......... .......... .......... .......... .......... 76% 295M 0s 2024-09-05T01:19:41.919 INFO:teuthology.orchestra.run.smithi099.stderr: 70850K .......... .......... .......... .......... .......... 76% 253M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 70900K .......... .......... .......... .......... .......... 76% 277M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 70950K .......... .......... .......... .......... .......... 76% 261M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71000K .......... .......... .......... .......... .......... 76% 305M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71050K .......... .......... .......... .......... .......... 76% 297M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71100K .......... .......... .......... .......... .......... 76% 303M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71150K .......... .......... .......... .......... .......... 76% 199M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71200K .......... .......... .......... .......... .......... 76% 243M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71250K .......... .......... .......... .......... .......... 76% 291M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71300K .......... .......... .......... .......... .......... 76% 303M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71350K .......... .......... .......... .......... .......... 76% 276M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71400K .......... .......... .......... .......... .......... 76% 280M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71450K .......... .......... .......... .......... .......... 76% 280M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71500K .......... .......... .......... .......... .......... 77% 300M 0s 2024-09-05T01:19:41.920 INFO:teuthology.orchestra.run.smithi099.stderr: 71550K .......... .......... .......... .......... .......... 77% 247M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71600K .......... .......... .......... .......... .......... 77% 293M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71650K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71700K .......... .......... .......... .......... .......... 77% 74.9M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71750K .......... .......... .......... .......... .......... 77% 236M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71800K .......... .......... .......... .......... .......... 77% 265M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71850K .......... .......... .......... .......... .......... 77% 287M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71900K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 71950K .......... .......... .......... .......... .......... 77% 234M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72000K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72050K .......... .......... .......... .......... .......... 77% 305M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72100K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72150K .......... .......... .......... .......... .......... 77% 263M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72200K .......... .......... .......... .......... .......... 77% 289M 0s 2024-09-05T01:19:41.921 INFO:teuthology.orchestra.run.smithi099.stderr: 72250K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72300K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72350K .......... .......... .......... .......... .......... 77% 253M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72400K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72450K .......... .......... .......... .......... .......... 78% 147M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72500K .......... .......... .......... .......... .......... 78% 209M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72550K .......... .......... .......... .......... .......... 78% 253M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72600K .......... .......... .......... .......... .......... 78% 281M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72650K .......... .......... .......... .......... .......... 78% 298M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72700K .......... .......... .......... .......... .......... 78% 310M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72750K .......... .......... .......... .......... .......... 78% 207M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72800K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72850K .......... .......... .......... .......... .......... 78% 176M 0s 2024-09-05T01:19:41.922 INFO:teuthology.orchestra.run.smithi099.stderr: 72900K .......... .......... .......... .......... .......... 78% 190M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 72950K .......... .......... .......... .......... .......... 78% 161M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73000K .......... .......... .......... .......... .......... 78% 155M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73050K .......... .......... .......... .......... .......... 78% 169M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73100K .......... .......... .......... .......... .......... 78% 178M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73150K .......... .......... .......... .......... .......... 78% 141M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73200K .......... .......... .......... .......... .......... 78% 186M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73250K .......... .......... .......... .......... .......... 78% 162M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73300K .......... .......... .......... .......... .......... 78% 188M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73350K .......... .......... .......... .......... .......... 79% 161M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73400K .......... .......... .......... .......... .......... 79% 191M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73450K .......... .......... .......... .......... .......... 79% 179M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73500K .......... .......... .......... .......... .......... 79% 173M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73550K .......... .......... .......... .......... .......... 79% 159M 0s 2024-09-05T01:19:41.923 INFO:teuthology.orchestra.run.smithi099.stderr: 73600K .......... .......... .......... .......... .......... 79% 168M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73650K .......... .......... .......... .......... .......... 79% 178M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73700K .......... .......... .......... .......... .......... 79% 167M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73750K .......... .......... .......... .......... .......... 79% 160M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73800K .......... .......... .......... .......... .......... 79% 182M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73850K .......... .......... .......... .......... .......... 79% 151M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73900K .......... .......... .......... .......... .......... 79% 186M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 73950K .......... .......... .......... .......... .......... 79% 156M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74000K .......... .......... .......... .......... .......... 79% 185M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74050K .......... .......... .......... .......... .......... 79% 181M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74100K .......... .......... .......... .......... .......... 79% 167M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74150K .......... .......... .......... .......... .......... 79% 169M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74200K .......... .......... .......... .......... .......... 79% 170M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74250K .......... .......... .......... .......... .......... 79% 177M 0s 2024-09-05T01:19:41.924 INFO:teuthology.orchestra.run.smithi099.stderr: 74300K .......... .......... .......... .......... .......... 80% 155M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74350K .......... .......... .......... .......... .......... 80% 148M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74400K .......... .......... .......... .......... .......... 80% 180M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74450K .......... .......... .......... .......... .......... 80% 167M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74500K .......... .......... .......... .......... .......... 80% 181M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74550K .......... .......... .......... .......... .......... 80% 167M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74600K .......... .......... .......... .......... .......... 80% 176M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74650K .......... .......... .......... .......... .......... 80% 174M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74700K .......... .......... .......... .......... .......... 80% 179M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74750K .......... .......... .......... .......... .......... 80% 143M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74800K .......... .......... .......... .......... .......... 80% 183M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74850K .......... .......... .......... .......... .......... 80% 175M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74900K .......... .......... .......... .......... .......... 80% 188M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 74950K .......... .......... .......... .......... .......... 80% 173M 0s 2024-09-05T01:19:41.925 INFO:teuthology.orchestra.run.smithi099.stderr: 75000K .......... .......... .......... .......... .......... 80% 181M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75050K .......... .......... .......... .......... .......... 80% 180M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75100K .......... .......... .......... .......... .......... 80% 190M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75150K .......... .......... .......... .......... .......... 80% 156M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75200K .......... .......... .......... .......... .......... 81% 188M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75250K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75300K .......... .......... .......... .......... .......... 81% 199M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75350K .......... .......... .......... .......... .......... 81% 172M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75400K .......... .......... .......... .......... .......... 81% 188M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75450K .......... .......... .......... .......... .......... 81% 205M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75500K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75550K .......... .......... .......... .......... .......... 81% 160M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75600K .......... .......... .......... .......... .......... 81% 195M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75650K .......... .......... .......... .......... .......... 81% 174M 0s 2024-09-05T01:19:41.926 INFO:teuthology.orchestra.run.smithi099.stderr: 75700K .......... .......... .......... .......... .......... 81% 178M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 75750K .......... .......... .......... .......... .......... 81% 148M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 75800K .......... .......... .......... .......... .......... 81% 197M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 75850K .......... .......... .......... .......... .......... 81% 207M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 75900K .......... .......... .......... .......... .......... 81% 179M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 75950K .......... .......... .......... .......... .......... 81% 154M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76000K .......... .......... .......... .......... .......... 81% 196M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76050K .......... .......... .......... .......... .......... 81% 206M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76100K .......... .......... .......... .......... .......... 81% 206M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76150K .......... .......... .......... .......... .......... 82% 151M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76200K .......... .......... .......... .......... .......... 82% 207M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76250K .......... .......... .......... .......... .......... 82% 193M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76300K .......... .......... .......... .......... .......... 82% 196M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76350K .......... .......... .......... .......... .......... 82% 164M 0s 2024-09-05T01:19:41.927 INFO:teuthology.orchestra.run.smithi099.stderr: 76400K .......... .......... .......... .......... .......... 82% 198M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76450K .......... .......... .......... .......... .......... 82% 183M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76500K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76550K .......... .......... .......... .......... .......... 82% 175M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76600K .......... .......... .......... .......... .......... 82% 194M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76650K .......... .......... .......... .......... .......... 82% 170M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76700K .......... .......... .......... .......... .......... 82% 215M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76750K .......... .......... .......... .......... .......... 82% 166M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76800K .......... .......... .......... .......... .......... 82% 215M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76850K .......... .......... .......... .......... .......... 82% 196M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76900K .......... .......... .......... .......... .......... 82% 213M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 76950K .......... .......... .......... .......... .......... 82% 188M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 77000K .......... .......... .......... .......... .......... 82% 201M 0s 2024-09-05T01:19:41.928 INFO:teuthology.orchestra.run.smithi099.stderr: 77050K .......... .......... .......... .......... .......... 82% 214M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77100K .......... .......... .......... .......... .......... 83% 212M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77150K .......... .......... .......... .......... .......... 83% 170M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77200K .......... .......... .......... .......... .......... 83% 190M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77250K .......... .......... .......... .......... .......... 83% 190M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77300K .......... .......... .......... .......... .......... 83% 216M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77350K .......... .......... .......... .......... .......... 83% 160M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77400K .......... .......... .......... .......... .......... 83% 210M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77450K .......... .......... .......... .......... .......... 83% 192M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77500K .......... .......... .......... .......... .......... 83% 206M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77550K .......... .......... .......... .......... .......... 83% 167M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77600K .......... .......... .......... .......... .......... 83% 205M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77650K .......... .......... .......... .......... .......... 83% 208M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77700K .......... .......... .......... .......... .......... 83% 192M 0s 2024-09-05T01:19:41.929 INFO:teuthology.orchestra.run.smithi099.stderr: 77750K .......... .......... .......... .......... .......... 83% 190M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 77800K .......... .......... .......... .......... .......... 83% 208M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 77850K .......... .......... .......... .......... .......... 83% 188M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 77900K .......... .......... .......... .......... .......... 83% 183M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 77950K .......... .......... .......... .......... .......... 83% 145M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78000K .......... .......... .......... .......... .......... 84% 215M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78050K .......... .......... .......... .......... .......... 84% 220M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78100K .......... .......... .......... .......... .......... 84% 218M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78150K .......... .......... .......... .......... .......... 84% 182M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78200K .......... .......... .......... .......... .......... 84% 181M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78250K .......... .......... .......... .......... .......... 84% 206M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78300K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78350K .......... .......... .......... .......... .......... 84% 208M 0s 2024-09-05T01:19:41.930 INFO:teuthology.orchestra.run.smithi099.stderr: 78400K .......... .......... .......... .......... .......... 84% 286M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78450K .......... .......... .......... .......... .......... 84% 263M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78500K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78550K .......... .......... .......... .......... .......... 84% 242M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78600K .......... .......... .......... .......... .......... 84% 252M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78650K .......... .......... .......... .......... .......... 84% 243M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78700K .......... .......... .......... .......... .......... 84% 269M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78750K .......... .......... .......... .......... .......... 84% 243M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78800K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78850K .......... .......... .......... .......... .......... 84% 272M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78900K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 78950K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 79000K .......... .......... .......... .......... .......... 85% 296M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 79050K .......... .......... .......... .......... .......... 85% 290M 0s 2024-09-05T01:19:41.931 INFO:teuthology.orchestra.run.smithi099.stderr: 79100K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79150K .......... .......... .......... .......... .......... 85% 222M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79200K .......... .......... .......... .......... .......... 85% 290M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79250K .......... .......... .......... .......... .......... 85% 272M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79300K .......... .......... .......... .......... .......... 85% 282M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79350K .......... .......... .......... .......... .......... 85% 243M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79400K .......... .......... .......... .......... .......... 85% 286M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79450K .......... .......... .......... .......... .......... 85% 347M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79500K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79550K .......... .......... .......... .......... .......... 85% 293M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79600K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79650K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79700K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79750K .......... .......... .......... .......... .......... 85% 307M 0s 2024-09-05T01:19:41.932 INFO:teuthology.orchestra.run.smithi099.stderr: 79800K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 79850K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 79900K .......... .......... .......... .......... .......... 86% 378M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 79950K .......... .......... .......... .......... .......... 86% 322M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80000K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80050K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80100K .......... .......... .......... .......... .......... 86% 355M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80150K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80200K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80250K .......... .......... .......... .......... .......... 86% 357M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80300K .......... .......... .......... .......... .......... 86% 376M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80350K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80400K .......... .......... .......... .......... .......... 86% 382M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80450K .......... .......... .......... .......... .......... 86% 390M 0s 2024-09-05T01:19:41.933 INFO:teuthology.orchestra.run.smithi099.stderr: 80500K .......... .......... .......... .......... .......... 86% 383M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80550K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80600K .......... .......... .......... .......... .......... 86% 394M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80650K .......... .......... .......... .......... .......... 86% 139M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80700K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80750K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80800K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80850K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80900K .......... .......... .......... .......... .......... 87% 373M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 80950K .......... .......... .......... .......... .......... 87% 275M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 81000K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 81050K .......... .......... .......... .......... .......... 87% 82.0M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 81100K .......... .......... .......... .......... .......... 87% 354M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 81150K .......... .......... .......... .......... .......... 87% 129M 0s 2024-09-05T01:19:41.934 INFO:teuthology.orchestra.run.smithi099.stderr: 81200K .......... .......... .......... .......... .......... 87% 52.5M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81250K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81300K .......... .......... .......... .......... .......... 87% 193M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81350K .......... .......... .......... .......... .......... 87% 176M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81400K .......... .......... .......... .......... .......... 87% 188M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81450K .......... .......... .......... .......... .......... 87% 212M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81500K .......... .......... .......... .......... .......... 87% 206M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81550K .......... .......... .......... .......... .......... 87% 160M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81600K .......... .......... .......... .......... .......... 87% 196M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81650K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81700K .......... .......... .......... .......... .......... 87% 188M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81750K .......... .......... .......... .......... .......... 88% 178M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81800K .......... .......... .......... .......... .......... 88% 197M 0s 2024-09-05T01:19:41.935 INFO:teuthology.orchestra.run.smithi099.stderr: 81850K .......... .......... .......... .......... .......... 88% 215M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 81900K .......... .......... .......... .......... .......... 88% 200M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 81950K .......... .......... .......... .......... .......... 88% 163M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82000K .......... .......... .......... .......... .......... 88% 169M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82050K .......... .......... .......... .......... .......... 88% 214M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82100K .......... .......... .......... .......... .......... 88% 173M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82150K .......... .......... .......... .......... .......... 88% 172M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82200K .......... .......... .......... .......... .......... 88% 214M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82250K .......... .......... .......... .......... .......... 88% 187M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82300K .......... .......... .......... .......... .......... 88% 196M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82350K .......... .......... .......... .......... .......... 88% 176M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82400K .......... .......... .......... .......... .......... 88% 193M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82450K .......... .......... .......... .......... .......... 88% 213M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82500K .......... .......... .......... .......... .......... 88% 192M 0s 2024-09-05T01:19:41.936 INFO:teuthology.orchestra.run.smithi099.stderr: 82550K .......... .......... .......... .......... .......... 88% 175M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82600K .......... .......... .......... .......... .......... 88% 207M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82650K .......... .......... .......... .......... .......... 89% 200M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82700K .......... .......... .......... .......... .......... 89% 203M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82750K .......... .......... .......... .......... .......... 89% 174M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82800K .......... .......... .......... .......... .......... 89% 197M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82850K .......... .......... .......... .......... .......... 89% 207M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82900K .......... .......... .......... .......... .......... 89% 193M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 82950K .......... .......... .......... .......... .......... 89% 170M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 83000K .......... .......... .......... .......... .......... 89% 204M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 83050K .......... .......... .......... .......... .......... 89% 199M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 83100K .......... .......... .......... .......... .......... 89% 212M 0s 2024-09-05T01:19:41.937 INFO:teuthology.orchestra.run.smithi099.stderr: 83150K .......... .......... .......... .......... .......... 89% 174M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83200K .......... .......... .......... .......... .......... 89% 181M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83250K .......... .......... .......... .......... .......... 89% 197M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83300K .......... .......... .......... .......... .......... 89% 207M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83350K .......... .......... .......... .......... .......... 89% 175M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83400K .......... .......... .......... .......... .......... 89% 228M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83450K .......... .......... .......... .......... .......... 89% 178M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83500K .......... .......... .......... .......... .......... 89% 210M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83550K .......... .......... .......... .......... .......... 89% 166M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83600K .......... .......... .......... .......... .......... 90% 188M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83650K .......... .......... .......... .......... .......... 90% 209M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83700K .......... .......... .......... .......... .......... 90% 213M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83750K .......... .......... .......... .......... .......... 90% 176M 0s 2024-09-05T01:19:41.938 INFO:teuthology.orchestra.run.smithi099.stderr: 83800K .......... .......... .......... .......... .......... 90% 172M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 83850K .......... .......... .......... .......... .......... 90% 192M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 83900K .......... .......... .......... .......... .......... 90% 215M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 83950K .......... .......... .......... .......... .......... 90% 160M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84000K .......... .......... .......... .......... .......... 90% 208M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84050K .......... .......... .......... .......... .......... 90% 209M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84100K .......... .......... .......... .......... .......... 90% 194M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84150K .......... .......... .......... .......... .......... 90% 194M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84200K .......... .......... .......... .......... .......... 90% 180M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84250K .......... .......... .......... .......... .......... 90% 208M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84300K .......... .......... .......... .......... .......... 90% 206M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84350K .......... .......... .......... .......... .......... 90% 173M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84400K .......... .......... .......... .......... .......... 90% 201M 0s 2024-09-05T01:19:41.939 INFO:teuthology.orchestra.run.smithi099.stderr: 84450K .......... .......... .......... .......... .......... 90% 209M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84500K .......... .......... .......... .......... .......... 91% 192M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84550K .......... .......... .......... .......... .......... 91% 188M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84600K .......... .......... .......... .......... .......... 91% 201M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84650K .......... .......... .......... .......... .......... 91% 205M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84700K .......... .......... .......... .......... .......... 91% 216M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84750K .......... .......... .......... .......... .......... 91% 179M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84800K .......... .......... .......... .......... .......... 91% 191M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84850K .......... .......... .......... .......... .......... 91% 214M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84900K .......... .......... .......... .......... .......... 91% 209M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 84950K .......... .......... .......... .......... .......... 91% 191M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 85000K .......... .......... .......... .......... .......... 91% 216M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 85050K .......... .......... .......... .......... .......... 91% 210M 0s 2024-09-05T01:19:41.940 INFO:teuthology.orchestra.run.smithi099.stderr: 85100K .......... .......... .......... .......... .......... 91% 190M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85150K .......... .......... .......... .......... .......... 91% 179M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85200K .......... .......... .......... .......... .......... 91% 199M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85250K .......... .......... .......... .......... .......... 91% 208M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85300K .......... .......... .......... .......... .......... 91% 213M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85350K .......... .......... .......... .......... .......... 91% 168M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85400K .......... .......... .......... .......... .......... 91% 208M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85450K .......... .......... .......... .......... .......... 92% 209M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85500K .......... .......... .......... .......... .......... 92% 177M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85550K .......... .......... .......... .......... .......... 92% 176M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85600K .......... .......... .......... .......... .......... 92% 211M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85650K .......... .......... .......... .......... .......... 92% 196M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85700K .......... .......... .......... .......... .......... 92% 218M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85750K .......... .......... .......... .......... .......... 92% 180M 0s 2024-09-05T01:19:41.941 INFO:teuthology.orchestra.run.smithi099.stderr: 85800K .......... .......... .......... .......... .......... 92% 220M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 85850K .......... .......... .......... .......... .......... 92% 203M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 85900K .......... .......... .......... .......... .......... 92% 202M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 85950K .......... .......... .......... .......... .......... 92% 172M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86000K .......... .......... .......... .......... .......... 92% 212M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86050K .......... .......... .......... .......... .......... 92% 203M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86100K .......... .......... .......... .......... .......... 92% 166M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86150K .......... .......... .......... .......... .......... 92% 192M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86200K .......... .......... .......... .......... .......... 92% 194M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86250K .......... .......... .......... .......... .......... 92% 205M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86300K .......... .......... .......... .......... .......... 92% 191M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86350K .......... .......... .......... .......... .......... 93% 152M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86400K .......... .......... .......... .......... .......... 93% 192M 0s 2024-09-05T01:19:41.942 INFO:teuthology.orchestra.run.smithi099.stderr: 86450K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86500K .......... .......... .......... .......... .......... 93% 211M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86550K .......... .......... .......... .......... .......... 93% 188M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86600K .......... .......... .......... .......... .......... 93% 202M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86650K .......... .......... .......... .......... .......... 93% 192M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86700K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86750K .......... .......... .......... .......... .......... 93% 177M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86800K .......... .......... .......... .......... .......... 93% 205M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86850K .......... .......... .......... .......... .......... 93% 205M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86900K .......... .......... .......... .......... .......... 93% 198M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 86950K .......... .......... .......... .......... .......... 93% 171M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 87000K .......... .......... .......... .......... .......... 93% 209M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 87050K .......... .......... .......... .......... .......... 93% 204M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 87100K .......... .......... .......... .......... .......... 93% 199M 0s 2024-09-05T01:19:41.943 INFO:teuthology.orchestra.run.smithi099.stderr: 87150K .......... .......... .......... .......... .......... 93% 164M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87200K .......... .......... .......... .......... .......... 93% 205M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87250K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87300K .......... .......... .......... .......... .......... 94% 200M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87350K .......... .......... .......... .......... .......... 94% 185M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87400K .......... .......... .......... .......... .......... 94% 212M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87450K .......... .......... .......... .......... .......... 94% 206M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87500K .......... .......... .......... .......... .......... 94% 202M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87550K .......... .......... .......... .......... .......... 94% 172M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87600K .......... .......... .......... .......... .......... 94% 190M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87650K .......... .......... .......... .......... .......... 94% 218M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87700K .......... .......... .......... .......... .......... 94% 201M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87750K .......... .......... .......... .......... .......... 94% 175M 0s 2024-09-05T01:19:41.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87800K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 87850K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 87900K .......... .......... .......... .......... .......... 94% 203M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 87950K .......... .......... .......... .......... .......... 94% 186M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88000K .......... .......... .......... .......... .......... 94% 217M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88050K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88100K .......... .......... .......... .......... .......... 94% 208M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88150K .......... .......... .......... .......... .......... 94% 173M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88200K .......... .......... .......... .......... .......... 94% 217M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88250K .......... .......... .......... .......... .......... 95% 200M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88300K .......... .......... .......... .......... .......... 95% 208M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88350K .......... .......... .......... .......... .......... 95% 179M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88400K .......... .......... .......... .......... .......... 95% 218M 0s 2024-09-05T01:19:41.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88450K .......... .......... .......... .......... .......... 95% 180M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88500K .......... .......... .......... .......... .......... 95% 223M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88550K .......... .......... .......... .......... .......... 95% 178M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88600K .......... .......... .......... .......... .......... 95% 214M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88650K .......... .......... .......... .......... .......... 95% 213M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88700K .......... .......... .......... .......... .......... 95% 210M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88750K .......... .......... .......... .......... .......... 95% 180M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88800K .......... .......... .......... .......... .......... 95% 208M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88850K .......... .......... .......... .......... .......... 95% 211M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88900K .......... .......... .......... .......... .......... 95% 221M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 88950K .......... .......... .......... .......... .......... 95% 189M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 89000K .......... .......... .......... .......... .......... 95% 201M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 89050K .......... .......... .......... .......... .......... 95% 215M 0s 2024-09-05T01:19:41.946 INFO:teuthology.orchestra.run.smithi099.stderr: 89100K .......... .......... .......... .......... .......... 95% 209M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89150K .......... .......... .......... .......... .......... 96% 181M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89200K .......... .......... .......... .......... .......... 96% 213M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89250K .......... .......... .......... .......... .......... 96% 211M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89300K .......... .......... .......... .......... .......... 96% 194M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89350K .......... .......... .......... .......... .......... 96% 185M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89400K .......... .......... .......... .......... .......... 96% 216M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89450K .......... .......... .......... .......... .......... 96% 199M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89500K .......... .......... .......... .......... .......... 96% 209M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89550K .......... .......... .......... .......... .......... 96% 177M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89600K .......... .......... .......... .......... .......... 96% 189M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89650K .......... .......... .......... .......... .......... 96% 215M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89700K .......... .......... .......... .......... .......... 96% 203M 0s 2024-09-05T01:19:41.947 INFO:teuthology.orchestra.run.smithi099.stderr: 89750K .......... .......... .......... .......... .......... 96% 190M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 89800K .......... .......... .......... .......... .......... 96% 219M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 89850K .......... .......... .......... .......... .......... 96% 199M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 89900K .......... .......... .......... .......... .......... 96% 206M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 89950K .......... .......... .......... .......... .......... 96% 172M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90000K .......... .......... .......... .......... .......... 96% 197M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90050K .......... .......... .......... .......... .......... 96% 206M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90100K .......... .......... .......... .......... .......... 97% 186M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90150K .......... .......... .......... .......... .......... 97% 172M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90200K .......... .......... .......... .......... .......... 97% 169M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90250K .......... .......... .......... .......... .......... 97% 204M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90300K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90350K .......... .......... .......... .......... .......... 97% 175M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90400K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-05T01:19:41.948 INFO:teuthology.orchestra.run.smithi099.stderr: 90450K .......... .......... .......... .......... .......... 97% 196M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90500K .......... .......... .......... .......... .......... 97% 209M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90550K .......... .......... .......... .......... .......... 97% 175M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90600K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90650K .......... .......... .......... .......... .......... 97% 215M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90700K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90750K .......... .......... .......... .......... .......... 97% 176M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90800K .......... .......... .......... .......... .......... 97% 183M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90850K .......... .......... .......... .......... .......... 97% 215M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90900K .......... .......... .......... .......... .......... 97% 206M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 90950K .......... .......... .......... .......... .......... 97% 182M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 91000K .......... .......... .......... .......... .......... 98% 206M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 91050K .......... .......... .......... .......... .......... 98% 214M 0s 2024-09-05T01:19:41.949 INFO:teuthology.orchestra.run.smithi099.stderr: 91100K .......... .......... .......... .......... .......... 98% 221M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91150K .......... .......... .......... .......... .......... 98% 166M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91200K .......... .......... .......... .......... .......... 98% 239M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91250K .......... .......... .......... .......... .......... 98% 176M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91300K .......... .......... .......... .......... .......... 98% 204M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91350K .......... .......... .......... .......... .......... 98% 197M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91400K .......... .......... .......... .......... .......... 98% 187M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91450K .......... .......... .......... .......... .......... 98% 209M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91500K .......... .......... .......... .......... .......... 98% 204M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91550K .......... .......... .......... .......... .......... 98% 155M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91600K .......... .......... .......... .......... .......... 98% 198M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91650K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91700K .......... .......... .......... .......... .......... 98% 207M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91750K .......... .......... .......... .......... .......... 98% 178M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91800K .......... .......... .......... .......... .......... 98% 211M 0s 2024-09-05T01:19:41.950 INFO:teuthology.orchestra.run.smithi099.stderr: 91850K .......... .......... .......... .......... .......... 98% 215M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 91900K .......... .......... .......... .......... .......... 98% 183M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 91950K .......... .......... .......... .......... .......... 99% 173M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92000K .......... .......... .......... .......... .......... 99% 218M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92050K .......... .......... .......... .......... .......... 99% 208M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92100K .......... .......... .......... .......... .......... 99% 223M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92150K .......... .......... .......... .......... .......... 99% 215M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92200K .......... .......... .......... .......... .......... 99% 193M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92250K .......... .......... .......... .......... .......... 99% 223M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92300K .......... .......... .......... .......... .......... 99% 199M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92350K .......... .......... .......... .......... .......... 99% 183M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92400K .......... .......... .......... .......... .......... 99% 220M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92450K .......... .......... .......... .......... .......... 99% 217M 0s 2024-09-05T01:19:41.951 INFO:teuthology.orchestra.run.smithi099.stderr: 92500K .......... .......... .......... .......... .......... 99% 210M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92550K .......... .......... .......... .......... .......... 99% 196M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92600K .......... .......... .......... .......... .......... 99% 130M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92650K .......... .......... .......... .......... .......... 99% 147M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92700K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92750K .......... .......... .......... .......... .......... 99% 125M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92800K .......... .......... .......... .......... .......... 99% 129M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92850K .......... .......... .......... .......... .......... 99% 156M 0s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 92900K 100% 134G=0.5s 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05 01:19:41 (169 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-05T01:19:41.952 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-05T01:19:41.979 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-05T01:19:41.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-05T01:19:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-05T01:19:41.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-05T01:19:41.983 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-05T01:19:41.984 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-05T01:19:41.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-05T01:19:41.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-05T01:19:41.987 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-05T01:19:41.988 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-05T01:19:41.989 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-05T01:19:41.990 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-05T01:19:41.991 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-05T01:19:41.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-05T01:19:41.993 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-05T01:19:41.994 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-05T01:19:41.995 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-05T01:19:41.996 INFO:teuthology.orchestra.run.smithi099.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-05T01:19:42.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.362 INFO:teuthology.orchestra.run.smithi099.stdout:Welcome to Gradle 6.0.1! 2024-09-05T01:19:42.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.362 INFO:teuthology.orchestra.run.smithi099.stdout:Here are the highlights of this release: 2024-09-05T01:19:42.362 INFO:teuthology.orchestra.run.smithi099.stdout: - Substantial improvements in dependency management, including 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Advanced control of transitive versions 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for optional features and dependencies 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Rules to tweak published metadata 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for Java 13 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Faster incremental Java and Groovy compilation 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - New Zinc compiler for Scala 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - VS2019 support 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-05T01:19:42.363 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:------------------------------------------------------------ 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Gradle 6.0.1 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:------------------------------------------------------------ 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Kotlin: 1.3.50 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Groovy: 2.5.8 2024-09-05T01:19:42.364 INFO:teuthology.orchestra.run.smithi099.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-05T01:19:42.365 INFO:teuthology.orchestra.run.smithi099.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-05T01:19:42.365 INFO:teuthology.orchestra.run.smithi099.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-05T01:19:42.365 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.381 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-05T01:19:42.381 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-05T01:19:42.381 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T01:19:42.381 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-05T01:19:42.381 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T01:19:42.381 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-05T01:19:42.566 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-05T01:19:42.567 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-05T01:19:42.567 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'TWFNPDHPMMHJLRYHPMNM', 'access_secret': 'Bgt57QKVfH11tNZWgUcwCrkiBS8HngTMXa8pHlYltEhSv+0x3hx+bg==', 'region': 'mexico', 'endpoint': 'smithi099.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi099.front.sepia.ceph.com'} 2024-09-05T01:19:42.567 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-05T01:19:42.567 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'TWFNPDHPMMHJLRYHPMNM', '--secret', 'Bgt57QKVfH11tNZWgUcwCrkiBS8HngTMXa8pHlYltEhSv+0x3hx+bg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-05T01:19:42.567 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key TWFNPDHPMMHJLRYHPMNM --secret Bgt57QKVfH11tNZWgUcwCrkiBS8HngTMXa8pHlYltEhSv+0x3hx+bg== --email tester.client.0_test@test.test --cluster ceph 2024-09-05T01:19:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 realm 2024-09-05T01:19:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.642+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.646+0000 7f39bf42b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.646+0000 7f39bf42b9c0 20 searching for the correct realm 2024-09-05T01:19:42.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.650+0000 7f39bd732640 0 -- 172.21.15.99:0/1175776085 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x5648bdde5c10 msgr2=0x5648bdde80d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:42.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.658+0000 7f39bd732640 0 -- 172.21.15.99:0/1175776085 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x5648bddd9270 msgr2=0x5648bdddb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:42.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:42.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.662+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:42.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 zone default found 2024-09-05T01:19:42.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 4 Realm: () 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 zonegroup default 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 started sync module instance, tier type = 2024-09-05T01:19:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.666+0000 7f39bf42b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:42.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=0 2024-09-05T01:19:42.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=1 2024-09-05T01:19:42.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=2 2024-09-05T01:19:42.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=3 2024-09-05T01:19:42.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=4 2024-09-05T01:19:42.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=5 2024-09-05T01:19:42.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=6 2024-09-05T01:19:42.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 20 add_watcher() i=7 2024-09-05T01:19:42.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.682+0000 7f39bf42b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:42.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f38737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 5 note: GC not initialized 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f38727e4640 20 reqs_thread_entry: start 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 Filter name: none 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f386b7fe640 20 reqs_thread_entry: start 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-05T01:19:42.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-05T01:19:42.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-05T01:19:42.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-05T01:19:42.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache get: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM : miss 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM info.flags=0x0 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 adding default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM to cache LRU end 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache get: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM : hit (negative entry) 2024-09-05T01:19:42.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.686+0000 7f39bf42b9c0 10 cache get: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM : hit (negative entry) 2024-09-05T01:19:42.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-05T01:19:42.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f39bf42b9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-05T01:19:42.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f39bf42b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-05T01:19:42.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f3893fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94870423119920 notifier 8282 bl.length()=670 2024-09-05T01:19:42.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f3893fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-05T01:19:42.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.690+0000 7f3893fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-05T01:19:42.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-05T01:19:42.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f39bf42b9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-05T01:19:42.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f39bf42b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-05T01:19:42.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f3893fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464292 cookie 94870423112592 notifier 8282 bl.length()=200 2024-09-05T01:19:42.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f3893fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-05T01:19:42.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.694+0000 7f3893fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f39bf42b9c0 10 cache put: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM info.flags=0x7 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f39bf42b9c0 10 moving default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM to cache LRU end 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f39bf42b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:TWFNPDHPMMHJLRYHPMNM, ofs0, ns] 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f3893fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94870423055568 notifier 8282 bl.length()=189 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f3893fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM info.flags=0x7 2024-09-05T01:19:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f3893fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TWFNPDHPMMHJLRYHPMNM to cache LRU end 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "tester.client.0", 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Ms. tester.client.0", 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "tester.client.0_test@test.test", 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:19:42.699 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "tester.client.0", 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "TWFNPDHPMMHJLRYHPMNM", 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "Bgt57QKVfH11tNZWgUcwCrkiBS8HngTMXa8pHlYltEhSv+0x3hx+bg==", 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:19:42.691711Z" 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:19:42.700 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:19:42.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:19:42.691700Z", 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:19:42.702 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:19:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.698+0000 7f38737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.702+0000 7f39bf42b9c0 20 remove_watcher() i=0 2024-09-05T01:19:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.702+0000 7f39bf42b9c0 2 removed watcher, disabling cache 2024-09-05T01:19:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.706+0000 7f39bf42b9c0 20 remove_watcher() i=1 2024-09-05T01:19:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.710+0000 7f39bf42b9c0 20 remove_watcher() i=2 2024-09-05T01:19:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.710+0000 7f39bf42b9c0 20 remove_watcher() i=3 2024-09-05T01:19:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.710+0000 7f39bf42b9c0 20 remove_watcher() i=4 2024-09-05T01:19:42.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.714+0000 7f39bf42b9c0 20 remove_watcher() i=5 2024-09-05T01:19:42.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.714+0000 7f39bf42b9c0 20 remove_watcher() i=6 2024-09-05T01:19:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.718+0000 7f39bf42b9c0 20 remove_watcher() i=7 2024-09-05T01:19:42.730 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:19:42.730 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-05T01:19:42.776 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-05T01:19:42.776 DEBUG:teuthology.orchestra.run.smithi099:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-05T01:19:42.821 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:19:42.893 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:42.893 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:42.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 realm 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:42.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.934+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.938+0000 7f3c979159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:42.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.938+0000 7f3c979159c0 20 searching for the correct realm 2024-09-05T01:19:42.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.942+0000 7f3c95c1c640 0 -- 172.21.15.99:0/609940104 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x556fab3d1a30 msgr2=0x556fab3d3ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:19:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.950+0000 7f3c95c1c640 0 -- 172.21.15.99:0/609940104 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x7f3b60080880 msgr2=0x7f3b60082cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.954+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 zone default found 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 4 Realm: () 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 zonegroup default 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 started sync module instance, tier type = 2024-09-05T01:19:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.958+0000 7f3c979159c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:42.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=0 2024-09-05T01:19:42.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=1 2024-09-05T01:19:42.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=2 2024-09-05T01:19:42.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=3 2024-09-05T01:19:42.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=4 2024-09-05T01:19:42.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=5 2024-09-05T01:19:42.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=6 2024-09-05T01:19:42.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 20 add_watcher() i=7 2024-09-05T01:19:42.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.978+0000 7f3c979159c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:42.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.982+0000 7f3b4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:42.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.982+0000 7f3c979159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:42.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:42.982+0000 7f3c979159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3b4a7e4640 20 reqs_thread_entry: start 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 Filter name: none 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3abbfff640 20 reqs_thread_entry: start 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3521803568740206760', time=2024-09-05T03:10:06.321312+0000, chain.objs.size()=3 2024-09-05T01:19:43.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.1 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.2 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-LUKEWARM.2~VEj4dXVtBYjb5bc7gCgqgwICwJJtQwn.3 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10479437700997497505', time=2024-09-05T03:11:25.836404+0000, chain.objs.size()=1 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.KnrQ-mGpQ2lxtfTTZU77bj1Dzcs52k8_0 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5037354128572708917', time=2024-09-05T03:11:30.145234+0000, chain.objs.size()=1 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.5kx8LbcrBX_Dl0DgVViIVOOcQx91Yz-_0 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14884908068547601345', time=2024-09-05T03:12:48.029612+0000, chain.objs.size()=1 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.quEtCNBrdFFdBZ30XmntPoNJERj0KKa_0 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2675397930032606541', time=2024-09-05T03:12:53.566742+0000, chain.objs.size()=1 2024-09-05T01:19:43.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.i1c_8VBhVLiCirCPrfCliUgQYXosCHx_0 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13098359431448387988', time=2024-09-05T03:13:32.932757+0000, chain.objs.size()=1 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.Taz4m7mhY-95WLW8D3J2L5HeJJCsBbH_0 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17623662916316266015', time=2024-09-05T03:14:59.358977+0000, chain.objs.size()=1 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.SikUGDyzBLnDeY0SJOxfcioQ0EXDvg9_0 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1187853288684502219', time=2024-09-05T03:16:13.801897+0000, chain.objs.size()=1 2024-09-05T01:19:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.9Y-VnOI-kxm4wGVDQpy45oCmDc6qD6u_0 2024-09-05T01:19:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1392146688283750582', time=2024-09-05T03:16:13.865600+0000, chain.objs.size()=1 2024-09-05T01:19:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.5HwTzvApJPqjzgsyV_1aXoV1T_S4nx5_0 2024-09-05T01:19:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11119592459082814971', time=2024-09-05T03:16:57.709331+0000, chain.objs.size()=1 2024-09-05T01:19:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.046+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.44w58f1UrgR3gqU4Y2GPxa9jN-qzDKV_0 2024-09-05T01:19:43.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.058+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.058+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:19:43.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:19:43.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18000657430471178240', time=2024-09-05T03:10:06.311085+0000, chain.objs.size()=3 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.1 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.2 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-STANDARD.2~KUCQ1BltOl9ZrA7AgMc8Z_7mD4Pz8Tv.3 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12428601493434174483', time=2024-09-05T03:12:13.251761+0000, chain.objs.size()=1 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.Kt9YAxq-9PXrjcOwqDPMHNYnfUmZkLM_0 2024-09-05T01:19:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3162179874363121434', time=2024-09-05T03:12:53.558552+0000, chain.objs.size()=1 2024-09-05T01:19:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.5iTHrYqdi4QcCYHBIxaiCDWDyuWSpXY_0 2024-09-05T01:19:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12143104977030712782', time=2024-09-05T03:13:32.963517+0000, chain.objs.size()=1 2024-09-05T01:19:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.LwZib_NDpKN4BN-ndxmJi2SW42hy7BV_0 2024-09-05T01:19:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13015617308444448170', time=2024-09-05T03:13:37.444594+0000, chain.objs.size()=1 2024-09-05T01:19:43.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.062+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.JbU9pc8O7DEsj35LdGgl98_9xU316G4_0 2024-09-05T01:19:43.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.066+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.070+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:19:43.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.070+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12344406964333775863', time=2024-09-05T03:10:06.615441+0000, chain.objs.size()=1 2024-09-05T01:19:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.wcv1C3q03KgAXnoymr0DcpeJPG10cEN_0 2024-09-05T01:19:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.772246138704658491', time=2024-09-05T03:11:24.804975+0000, chain.objs.size()=1 2024-09-05T01:19:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.Flb3x9D8VLN5yFksYTWpCZdiAVadxGA_0 2024-09-05T01:19:43.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7350482557769931146', time=2024-09-05T03:11:25.884068+0000, chain.objs.size()=1 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.5sepS5MeKFEtveox4AEvgFdHcOirsI8_0 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2243488498517920513', time=2024-09-05T03:11:30.186904+0000, chain.objs.size()=1 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.--_hqxdMdTgfCalP5J9VC3Q6895djzy_0 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8454062856277467131', time=2024-09-05T03:12:05.176539+0000, chain.objs.size()=1 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.yZ9caGpUX8t-71SEZvml1Gh98TjtSy6_0 2024-09-05T01:19:43.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1281292794350617719', time=2024-09-05T03:12:05.178544+0000, chain.objs.size()=1 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.5YjKlcWGytLPwwLv1lVvg5P3C05Kzqn_0 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15624994745863966281', time=2024-09-05T03:12:09.345463+0000, chain.objs.size()=1 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.tictoX0ujHkLTRwdpEZUXHMHCEZJqHW_0 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7430343237680866100', time=2024-09-05T03:12:13.292291+0000, chain.objs.size()=1 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.a-V3jt25RF3CBbU0FYrK4gCWbXQdgWG_0 2024-09-05T01:19:43.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12390588321623229277', time=2024-09-05T03:12:53.610887+0000, chain.objs.size()=1 2024-09-05T01:19:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.cUBPX14cY14TeXe6QszRYH96xKC09el_0 2024-09-05T01:19:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2158665679504954977', time=2024-09-05T03:14:20.301070+0000, chain.objs.size()=1 2024-09-05T01:19:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.cbzdyuJQ0vQSDwrlo1PHfKIvDTYWkpu_0 2024-09-05T01:19:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12756934761873850347', time=2024-09-05T03:14:58.565133+0000, chain.objs.size()=1 2024-09-05T01:19:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.NqKOeVKbMaYidsUspYOCTbWxlhHtoVj_0 2024-09-05T01:19:43.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4284530065571176059', time=2024-09-05T03:15:34.383508+0000, chain.objs.size()=1 2024-09-05T01:19:43.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.074+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.guYDjTEMUl9zhhEHyeEbyVpu8J56bIJ_0 2024-09-05T01:19:43.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5362472820764107839', time=2024-09-05T03:15:38.920610+0000, chain.objs.size()=1 2024-09-05T01:19:43.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.xGkqNKvMTvFY0-BKWEHDDRU3Bn-oDPS_0 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1968447566963128959', time=2024-09-05T03:15:39.053191+0000, chain.objs.size()=1 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.J7jTBv2TcN5rlz1ySeZrdwF1GfJbSz1_0 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5810353180936222820', time=2024-09-05T03:16:17.695785+0000, chain.objs.size()=1 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.YZGu3KWuPWAjy4yGnZ5r5eYzGZ-peZO_0 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15964243011776755741', time=2024-09-05T03:16:19.023884+0000, chain.objs.size()=1 2024-09-05T01:19:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.vGvUIjD_FWbTQwmpRxYaHaXF6KJ0hbn_0 2024-09-05T01:19:43.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12459685636920553318', time=2024-09-05T03:16:57.924770+0000, chain.objs.size()=1 2024-09-05T01:19:43.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.LeeBO--bFtoyhvGSYokZ2UOVSISC3gf_0 2024-09-05T01:19:43.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.078+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.086+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:19:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.086+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_5csROZQbFsooY8goYmTHHYIZPigE_Sd', time=2024-09-05T03:10:06.158192+0000, chain.objs.size()=2 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.fQPKGGwarp9B_PiPm42uq1bA6v8cvTW_0 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.fQPKGGwarp9B_PiPm42uq1bA6v8cvTW_1 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13355130790663199936', time=2024-09-05T03:10:06.632308+0000, chain.objs.size()=1 2024-09-05T01:19:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.UF89HM9M-3agaPvbJS4FuGJkbi-8q9N_0 2024-09-05T01:19:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11548722125208461132', time=2024-09-05T03:11:25.946769+0000, chain.objs.size()=1 2024-09-05T01:19:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.4pdinfmDMUn7rsF-QV2PoOaunDYWkkA_0 2024-09-05T01:19:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17725759191731503530', time=2024-09-05T03:11:30.360516+0000, chain.objs.size()=1 2024-09-05T01:19:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.hM0ABBiQn_Fjio2o-BzZrvsbEurgqyB_0 2024-09-05T01:19:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281071993302371016', time=2024-09-05T03:12:13.319964+0000, chain.objs.size()=1 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.qc0aQ9UIJ21aGEq-C50kyMHjNt6S-jr_0 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8926100328786832672', time=2024-09-05T03:13:32.959023+0000, chain.objs.size()=1 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.-CVbDO-e3Gqx3PCAjUz6Cnp2UjIBvaH_0 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10998680375259856417', time=2024-09-05T03:14:16.723648+0000, chain.objs.size()=1 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.ZLs361tcve26ZvIbu4QyevdNJFjxZeb_0 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7221774057304403191', time=2024-09-05T03:14:16.763114+0000, chain.objs.size()=1 2024-09-05T01:19:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.O_Pr-78blUhxnK6RVS1HQ75X6MgD3Km_0 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6273554541638635410', time=2024-09-05T03:14:53.898289+0000, chain.objs.size()=1 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.T4yFy4QVdwFhRwBlRx_VVasmgepL--t_0 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5842921126975700123', time=2024-09-05T03:14:59.336481+0000, chain.objs.size()=1 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.rL9lwVUErZesj_Fz2wh4hZ6-X78JEsU_0 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14514622388758273524', time=2024-09-05T03:16:22.964249+0000, chain.objs.size()=1 2024-09-05T01:19:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.090+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.lcwliSwo-dPvXws1bDFBbeJG8eXnalp_0 2024-09-05T01:19:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.098+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5891393092000975452', time=2024-09-05T03:16:57.669763+0000, chain.objs.size()=1 2024-09-05T01:19:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.098+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.jpuc7PDi4S9PLjWkj55qaldLswBu3kc_0 2024-09-05T01:19:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.098+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16376577701781095559', time=2024-09-05T03:16:57.893494+0000, chain.objs.size()=1 2024-09-05T01:19:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.098+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.cIIieN5ATs-SOFKXV2S-FLTTIwxEbAS_0 2024-09-05T01:19:43.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.098+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.106+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:19:43.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.106+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_fSQYzeyn46WkiuxXEpaBL4CfcKdKvOJ', time=2024-09-05T03:10:05.973834+0000, chain.objs.size()=1 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.klgllJbceEG6UZp9ZuOzIHxLFmQLe68_0 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_nxQ89Z2yWKkCMv8jGFc7sUjEMOhaLgD', time=2024-09-05T03:10:06.000762+0000, chain.objs.size()=1 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.AvZ7ef-n-BvrobKs1iwbzyk-wP9CLgV_0 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_E7VOEF4eiM0P8nzp0u8S0J9FSeCTfic', time=2024-09-05T03:10:06.030589+0000, chain.objs.size()=1 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.KxXtmeSzhbft4NrbOIpgc1pDQIkj0BM_0 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_C7n8HT4KMEgdqq8aDhNWRydjftKEmbN', time=2024-09-05T03:10:06.132551+0000, chain.objs.size()=1 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.u1VUGUMcHKEcg8bPMnp1gZXTPeNYCZi_0 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12254539166388788464', time=2024-09-05T03:10:06.301946+0000, chain.objs.size()=3 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.1 2024-09-05T01:19:43.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.2 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14__multipart_foo-FROZEN.2~_74RbDhVM5TlBvI8-2841Q3C14FW4XI.3 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7748063838056236226', time=2024-09-05T03:11:30.185090+0000, chain.objs.size()=1 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.LF4qyPFrweD-GAhqS_vFnkFdLMg8KiY_0 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12956585969873592398', time=2024-09-05T03:12:13.312987+0000, chain.objs.size()=1 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.kKjCdxwKteW0gPiGVH8mBym2_8jf37G_0 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7167890831374807801', time=2024-09-05T03:12:47.901733+0000, chain.objs.size()=1 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.P0kYZ9F2sJ4eFHDr2lm5ElrC9JTZ9-c_0 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14210335458139964315', time=2024-09-05T03:12:48.031531+0000, chain.objs.size()=1 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.xnJf-VexV2586De7Y2f_wgyAWgELFIc_0 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.595440210177877931', time=2024-09-05T03:12:53.498424+0000, chain.objs.size()=1 2024-09-05T01:19:43.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.110+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.MieHwnc0ePbCrDaf_pKN0raDhAMTZP3_0 2024-09-05T01:19:43.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9900525328622074982', time=2024-09-05T03:13:37.492754+0000, chain.objs.size()=1 2024-09-05T01:19:43.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.26vsiuJ7pu_Y1Z1ZKgEvmZur8hvSAGp_0 2024-09-05T01:19:43.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4416542574941362947', time=2024-09-05T03:14:12.678865+0000, chain.objs.size()=1 2024-09-05T01:19:43.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.i_X0KvFygFUNfmVuMcaf8Q8sk-RimFQ_0 2024-09-05T01:19:43.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15494263823961688410', time=2024-09-05T03:14:12.681096+0000, chain.objs.size()=1 2024-09-05T01:19:43.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.p2J0VZ4Vn_oVcTPFLJcU4o7Wuq-xVUu_0 2024-09-05T01:19:43.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1597828921523564394', time=2024-09-05T03:14:16.884803+0000, chain.objs.size()=1 2024-09-05T01:19:43.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.tQMZYkAjzfgEb3UKgb7uaAsaQjUmFcS_0 2024-09-05T01:19:43.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3841230444125621148', time=2024-09-05T03:14:55.269931+0000, chain.objs.size()=1 2024-09-05T01:19:43.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.CF7_lYeiF-KjkdcIsbBeRxSe__z4UTv_0 2024-09-05T01:19:43.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8286400651817544954', time=2024-09-05T03:14:55.271486+0000, chain.objs.size()=1 2024-09-05T01:19:43.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.EEMw1PcXjsI4vUMyK3gckU5q3y6tTAs_0 2024-09-05T01:19:43.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15774629946750110626', time=2024-09-05T03:14:59.439379+0000, chain.objs.size()=1 2024-09-05T01:19:43.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.UqdF12zygNHk0gaydgZYkmFhy4501IM_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17448540875107290386', time=2024-09-05T03:15:02.917094+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.Xb3mQRVACR0arbl0Y7gpk70jwyee7IA_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12848871405920363810', time=2024-09-05T03:15:34.402874+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.VSMTs64nzRhhYDv6LjRoPloAUocS_rN_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12246731715888891549', time=2024-09-05T03:15:38.116944+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.XfnOgNU2tZpGAspEYNCyXJGzrf2c_4g_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16777614842876591655', time=2024-09-05T03:15:38.995320+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.ifczLfFtw638MswkKWH4bNmq_96T7kb_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1353588394957799050', time=2024-09-05T03:16:14.066609+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.fooSvqx877SJNumBv2reVagFwakeTML_0 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12638137469924626598', time=2024-09-05T03:16:18.916570+0000, chain.objs.size()=1 2024-09-05T01:19:43.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.118+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.MlK-UT6kDt2ZPg-euvJIIcAwjrHF8AG_0 2024-09-05T01:19:43.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12847779646754997728', time=2024-09-05T03:16:57.881856+0000, chain.objs.size()=1 2024-09-05T01:19:43.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.IKwKNmRU5h7xPQ5GStGhW5zJa3yV6ZT_0 2024-09-05T01:19:43.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2578373760775096379', time=2024-09-05T03:16:57.884087+0000, chain.objs.size()=1 2024-09-05T01:19:43.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.caeN4BhHYo0yqLjpRQ3eDsfPmWOP_Vj_0 2024-09-05T01:19:43.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13275451084910457004', time=2024-09-05T03:19:05.632442+0000, chain.objs.size()=1 2024-09-05T01:19:43.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.122+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.wt5CpLZFfj6FVwmPkcBAvyd5Yt4v03W_0 2024-09-05T01:19:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.126+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.130+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:19:43.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.134+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.134+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9605514229856008163', time=2024-09-05T03:10:06.055634+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.lMhwU9AOTraPxrYesThfzO--yxl2MLe_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4483455916637858788', time=2024-09-05T03:11:26.038684+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.AbAsf0m4Q8p6nST6--dp6owYLbCFp2N_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3316101853376300138', time=2024-09-05T03:12:09.442485+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.pSM9wxW9YaQdcmoCxjicC4XZBVIQxDk_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8267411228735701130', time=2024-09-05T03:12:13.206621+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.ouWOEymWHsbRdS679dwRTIJOChrQTc9_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7446347658755360041', time=2024-09-05T03:12:13.386800+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.PqENViViB_pYuGGwMG43SEC4_9rVeV5_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7707702447514816474', time=2024-09-05T03:13:37.287512+0000, chain.objs.size()=1 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.U3xpNPDSS-7V-UclyAZrv25hASvg8S8_0 2024-09-05T01:19:43.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9557339796723511884', time=2024-09-05T03:14:12.839967+0000, chain.objs.size()=1 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.8VhFNHW7GMbINrr-jMZdjjlTwg8LGr6_0 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2567604709580285922', time=2024-09-05T03:14:16.715552+0000, chain.objs.size()=1 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.fNzWYCs0G_9m_XJb0ObfApzzLJZXiAf_0 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9233312421312385726', time=2024-09-05T03:14:20.407406+0000, chain.objs.size()=1 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.oR8vGt4zi9SaWYh2mAgsyieNlHQhBca_0 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2799190198513287695', time=2024-09-05T03:14:55.342082+0000, chain.objs.size()=1 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.zb_GYAAbZ4CE8JZ6tIuWtqW4hJiEkOs_0 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2936525736584149074', time=2024-09-05T03:15:34.384199+0000, chain.objs.size()=1 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.6J1mBG6iu-pkPprUw2nVpM8bkuLpUOZ_0 2024-09-05T01:19:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15768416572951573729', time=2024-09-05T03:16:18.904532+0000, chain.objs.size()=1 2024-09-05T01:19:43.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.138+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.KwrhmbKk5IhqEcWrQeZrFCKFb4VkFKx_0 2024-09-05T01:19:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.142+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.146+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:19:43.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16255708623802208783', time=2024-09-05T03:10:06.375454+0000, chain.objs.size()=2 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.tW6CEBVw07S3FvQ0CaSJimCQgoa8uJK_0 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.tW6CEBVw07S3FvQ0CaSJimCQgoa8uJK_1 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12125827753912646241', time=2024-09-05T03:11:30.144118+0000, chain.objs.size()=1 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.34xCiTLs8neY5-lkzqPdV5dIbbej2ky_0 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18404194191226602641', time=2024-09-05T03:11:30.225424+0000, chain.objs.size()=1 2024-09-05T01:19:43.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.VWFWLZtE4BpByDUcoVl2j0yiqy5xrvd_0 2024-09-05T01:19:43.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12387271404093347361', time=2024-09-05T03:11:30.332547+0000, chain.objs.size()=1 2024-09-05T01:19:43.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.hoFURp-i85dIJpseBAXeFgxh71Pljfc_0 2024-09-05T01:19:43.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4325492416934397849', time=2024-09-05T03:12:13.292520+0000, chain.objs.size()=1 2024-09-05T01:19:43.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.ygxo4jSPGtBhKX7sFAStwvttd2cWjRG_0 2024-09-05T01:19:43.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12169065605346019897', time=2024-09-05T03:12:13.401796+0000, chain.objs.size()=1 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.W4TbbrzhAStWu2E7095ymKHtFGoK_bA_0 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14794628143790661910', time=2024-09-05T03:12:47.874790+0000, chain.objs.size()=1 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.p9SjuZc2ntSxRXG_AePWzGz8UA2i5eq_0 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18444904602131679377', time=2024-09-05T03:12:57.685867+0000, chain.objs.size()=1 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.5riM_45NRkEfpXNHWxn_JKE62_ON06n_0 2024-09-05T01:19:43.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15488749386398120770', time=2024-09-05T03:14:12.793229+0000, chain.objs.size()=1 2024-09-05T01:19:43.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.iu7_vZloY5ywpv3AWF0-R80UZ82jKUf_0 2024-09-05T01:19:43.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4050900497659372671', time=2024-09-05T03:14:12.795433+0000, chain.objs.size()=1 2024-09-05T01:19:43.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.CUkDwWAaov-AFi71Mag6qzriHyYq77__0 2024-09-05T01:19:43.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17319540018225058305', time=2024-09-05T03:14:12.880276+0000, chain.objs.size()=1 2024-09-05T01:19:43.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.150+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.Dwoh88ZKd2s2shg827cH96OKA0aLXqD_0 2024-09-05T01:19:43.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.154+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17297297784796855521', time=2024-09-05T03:14:20.301027+0000, chain.objs.size()=1 2024-09-05T01:19:43.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.154+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.NSMY3yIcZvJImdVXproNg19gvZtEALx_0 2024-09-05T01:19:43.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3267437534587915534', time=2024-09-05T03:14:20.304018+0000, chain.objs.size()=1 2024-09-05T01:19:43.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.4h10rNbG_nG0sK0lt9v05Z5Kw9uvefC_0 2024-09-05T01:19:43.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16753903420635889874', time=2024-09-05T03:14:20.363530+0000, chain.objs.size()=1 2024-09-05T01:19:43.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.zsdSzVyYQFGEDPIuiUx8dnOEvBexNqn_0 2024-09-05T01:19:43.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10305811657996676125', time=2024-09-05T03:14:20.419143+0000, chain.objs.size()=1 2024-09-05T01:19:43.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.zGzQmallZU_8iAMfrub6IKMxE5wY7xc_0 2024-09-05T01:19:43.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10954640477504763162', time=2024-09-05T03:15:34.526420+0000, chain.objs.size()=1 2024-09-05T01:19:43.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.Y56A6kcLHY7b3FvA1WXKTSZUfe52txi_0 2024-09-05T01:19:43.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16784150573673161088', time=2024-09-05T03:16:22.827357+0000, chain.objs.size()=1 2024-09-05T01:19:43.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.zMwWB8US_o_kuCsAfK0wNiJolLgoTK1_0 2024-09-05T01:19:43.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.158+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.162+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:19:43.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.166+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.166+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6965215702217022954', time=2024-09-05T03:10:05.644317+0000, chain.objs.size()=1 2024-09-05T01:19:43.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.pl650VNxkNk4uxWQqXRjD_Y-MqCo-oD_0 2024-09-05T01:19:43.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8287307433883874622', time=2024-09-05T03:10:06.197659+0000, chain.objs.size()=3 2024-09-05T01:19:43.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.2 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.3 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7014871332984568212', time=2024-09-05T03:11:26.059710+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.dBY_UiYyUHag3EUgy0ZQbDCxqHBF7os_0 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17232558293384052438', time=2024-09-05T03:11:30.119945+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.c1Z6BP8OkWLBhnSEy174KhGCwhSLlrc_0 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5017755644297337533', time=2024-09-05T03:12:05.075021+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.8TPaJFIkXvDyxUEmDSzFlV_pFpBeGD5_0 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13818479764104267193', time=2024-09-05T03:12:05.188197+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.FsO7MrhotrP-fjI2pBAuQYNI3rZC5-3_0 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2791341621232198571', time=2024-09-05T03:12:09.549570+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.1hnkC36D8RplIvfylaLfJ8As9b-uWko_0 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14270897633818840161', time=2024-09-05T03:12:53.727175+0000, chain.objs.size()=1 2024-09-05T01:19:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.qOQGlYnBOybxWs8D4xQSNEO_aYCS1pz_0 2024-09-05T01:19:43.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12942531812073110314', time=2024-09-05T03:12:57.857945+0000, chain.objs.size()=1 2024-09-05T01:19:43.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.8enh9IE1pLkWBjrecJMryCUrmUfTYWr_0 2024-09-05T01:19:43.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17216200505405001447', time=2024-09-05T03:13:32.959148+0000, chain.objs.size()=1 2024-09-05T01:19:43.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.WhM7YFRn-KIC23wZ3UWnOpwFQhhUgGJ_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7025382703452505940', time=2024-09-05T03:13:33.071604+0000, chain.objs.size()=1 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.DZEYGaZ9vS0a1RyxfmRqfd1HXguP3nj_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8428427043848194431', time=2024-09-05T03:13:36.511187+0000, chain.objs.size()=1 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.2hKVVmWif4IMRrKCt5j1txURZ6i5eSp_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1193961847280929092', time=2024-09-05T03:13:37.443775+0000, chain.objs.size()=1 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.Rd2I56NN4crJb3f20PSKAug-SPYJ1ik_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5387689533447440806', time=2024-09-05T03:13:37.513567+0000, chain.objs.size()=1 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.GT9ty0Xj38cflIW1o6SlupukeojwJkT_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14824349221494427649', time=2024-09-05T03:14:12.716337+0000, chain.objs.size()=1 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.ffrqlc25fcd-uf5GsRBcz6sGVqN5rBl_0 2024-09-05T01:19:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1782747745982207030', time=2024-09-05T03:16:13.946990+0000, chain.objs.size()=1 2024-09-05T01:19:43.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.8L_xTCuAB5_fW4-H094AlV9zbx4P6e1_0 2024-09-05T01:19:43.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2385070188302246397', time=2024-09-05T03:19:19.298770+0000, chain.objs.size()=1 2024-09-05T01:19:43.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.170+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:IfkNvfe2MFqhT67Ney7odxxfPirbsCS_.4vYk8lniGluEivNf2reaZ8urbl2k3iv_0 2024-09-05T01:19:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.178+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.182+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:19:43.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-05T01:19:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500997209762498296', time=2024-09-05T03:10:05.696046+0000, chain.objs.size()=1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.hx0Wj36YMeAZP7GS0fBRGMhuebA_UN1_0 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5707781085993080936', time=2024-09-05T03:10:06.178011+0000, chain.objs.size()=3 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.2 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.3 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7611703922326225883', time=2024-09-05T03:11:30.138915+0000, chain.objs.size()=1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.eVYPzsnOrKNtvGtLus7HP_UEy_6AP_M_0 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7599145569458857278', time=2024-09-05T03:12:48.002702+0000, chain.objs.size()=1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.wh9Z2sRUCMmIYMbgUSIxK4bZ6MH_2N6_0 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17866574107889033534', time=2024-09-05T03:12:48.006029+0000, chain.objs.size()=1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.t_fdczoyXrSkyvk-CFDmcyAhmwtyWNy_0 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6688580485653344247', time=2024-09-05T03:13:37.377035+0000, chain.objs.size()=1 2024-09-05T01:19:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.-Kj4XuL4vZufp1ebKyfgiDVYarTeKXi_0 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14847734773426372592', time=2024-09-05T03:14:20.422150+0000, chain.objs.size()=1 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.RZ_5d1hshEIcDbi-CnVlOaLd7DzA8UO_0 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12087182478228329591', time=2024-09-05T03:14:59.340632+0000, chain.objs.size()=1 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.uHvncNaXqltsoRTbDjTykud9dh6wSvY_0 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15303656796940323639', time=2024-09-05T03:15:34.378747+0000, chain.objs.size()=1 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.3F2zxgcoK5kfk_FFDpUWDfTmEOySSIi_0 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11715829997523917260', time=2024-09-05T03:16:19.086990+0000, chain.objs.size()=1 2024-09-05T01:19:43.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.186+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.cQYudP8wTVQiIYgrC7mXVbTLJJbsNQi_0 2024-09-05T01:19:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.190+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18171011013496495710', time=2024-09-05T03:16:57.844225+0000, chain.objs.size()=1 2024-09-05T01:19:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.190+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.k75GFP1BWJO8jfbmBVuw_9qH7XqMPGO_0 2024-09-05T01:19:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.194+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.198+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:19:43.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.202+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.202+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1099060099966263244', time=2024-09-05T03:12:09.448586+0000, chain.objs.size()=1 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.ofSbDFERcHNLr0MOGqQdxWgY8lY5U_q_0 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13024889624838448999', time=2024-09-05T03:13:37.376919+0000, chain.objs.size()=1 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.M_eEnl6m9LKgFzSS88mD1BP30iDS45X_0 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3728737695959182764', time=2024-09-05T03:14:12.687047+0000, chain.objs.size()=1 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.yIdElsDKs7EFXdmXHZK8teAp-9md5Hr_0 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14963377943412571802', time=2024-09-05T03:14:20.418665+0000, chain.objs.size()=1 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.rQ94BtETha3tEJOtUrX2RAj5_MJWuYb_0 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7490331463798637742', time=2024-09-05T03:14:20.422057+0000, chain.objs.size()=1 2024-09-05T01:19:43.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.9hk-fXpeaGVMiPfUtDAow_7-9tZVKTR_0 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1899508299109160712', time=2024-09-05T03:14:59.340520+0000, chain.objs.size()=1 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.S7A4Nu4B83CtKngUJSlXT9G4wLQ86qg_0 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14337564846193399960', time=2024-09-05T03:16:14.065948+0000, chain.objs.size()=1 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.krHu7EZSiEuv2u0N3eUs6wc-e6EooOs_0 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14040541213082668837', time=2024-09-05T03:16:26.761896+0000, chain.objs.size()=1 2024-09-05T01:19:43.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.206+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.mmuoIUZ3YxVyyMmm1Q2G0XrwdoYRKoV_0 2024-09-05T01:19:43.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.210+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.214+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:19:43.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4766710560680778957', time=2024-09-05T03:11:30.096574+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.WIQCv3AczabxeyML7Y_tIguRUfX_i_a_0 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.975954237055408092', time=2024-09-05T03:12:53.558495+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.O9pHJtjvG-UujUWL-PC0MM3cO9gJYp__0 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13311696928273479158', time=2024-09-05T03:12:57.656000+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.-IOD10MOLZKdNgVMnEVrD-4IUnaKP_c_0 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5286187984660190270', time=2024-09-05T03:12:57.657689+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.UzmtfH4XRO1yGf2JKFlOBFhIJ1TmqPz_0 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15801962329634863675', time=2024-09-05T03:12:57.692560+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.uOr6IAmxcONYEvF5XjZgP-HdlXaVVt2_0 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.758973310289042721', time=2024-09-05T03:13:37.445707+0000, chain.objs.size()=1 2024-09-05T01:19:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.cqHbZ2snF_XuK-EhzBI2qI4uHVuIj25_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7047676040948988765', time=2024-09-05T03:14:16.740600+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.tyscX9K-vaV40X_4su8I-Anu66xh1nY_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2393535635088493383', time=2024-09-05T03:14:55.302889+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.OmXlEZfOzIq0d-95hETbQvb0ZVUHWoV_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6125481741822152527', time=2024-09-05T03:15:34.400042+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.sIneKTnyJvk-LVrrZT6MOINHRfeLhze_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6669201168831721490', time=2024-09-05T03:15:34.402218+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.f5V2uirOv4Gx7zgxQRbdcihKmmBKvHQ_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12711615578771316885', time=2024-09-05T03:15:34.548476+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.XhImjEVbf_9b_FLDzvSGH00OFZI4ckO_0 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7576831828560570500', time=2024-09-05T03:15:38.855830+0000, chain.objs.size()=1 2024-09-05T01:19:43.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.218+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.X9d4h0GgWMFSGxyZfSNkRApGGXuf68i_0 2024-09-05T01:19:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.306058691507167253', time=2024-09-05T03:15:39.064890+0000, chain.objs.size()=1 2024-09-05T01:19:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.ryqbZ0vicI-AcU4DPDg19Hiitos45fD_0 2024-09-05T01:19:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9918696141711205218', time=2024-09-05T03:16:13.881353+0000, chain.objs.size()=1 2024-09-05T01:19:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.hg-Mvov-CqVkZanNvJYxlKhVDx6MNC1_0 2024-09-05T01:19:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2399501395642281215', time=2024-09-05T03:16:18.856555+0000, chain.objs.size()=1 2024-09-05T01:19:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.AWBUqgJEan96UY3U8FhQ3nxoD3OhLiw_0 2024-09-05T01:19:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11371296687898449167', time=2024-09-05T03:16:22.785848+0000, chain.objs.size()=1 2024-09-05T01:19:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.HSwiVJNUCE6IEhRHHSk_bbSaGdBK-N4_0 2024-09-05T01:19:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14300471165356482082', time=2024-09-05T03:16:22.788557+0000, chain.objs.size()=1 2024-09-05T01:19:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.222+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.u0k_ZyKdmnJgvGK9BU3MHSceDuLb2c__0 2024-09-05T01:19:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.226+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.230+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:19:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.234+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10183154386455481755', time=2024-09-05T03:10:05.912908+0000, chain.objs.size()=4 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.1 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.2 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.3 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9__multipart_foo.2~NL-ZKQgWs2w4nmQZiPfN9O8VMsdS08i.4 2024-09-05T01:19:43.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11281808572328586686', time=2024-09-05T03:11:25.830247+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.u88JB-5P2o4hnGnI8Kj2zPzOqdFf9e8_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3369328453124834471', time=2024-09-05T03:11:30.138908+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.6p2rzqHpys-c-uI7h612Ma8abJ5hv0H_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2301424592530174984', time=2024-09-05T03:11:30.205320+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.pWBA895gBYLrQchR9Xx57bg7rEuZu1z_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2514832933247726977', time=2024-09-05T03:11:30.344373+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.5-6Hmq694630Zux-e655dI9Y9FNReKg_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5371689435291341948', time=2024-09-05T03:12:48.103420+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.NSoT2JOcDos9WQJPngtuMnV0EgYCjGG_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8970038761440522583', time=2024-09-05T03:12:48.105152+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.vlNhuULHPeL7vvPO_0YfXLhQs2pZAEL_0 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.919399267157075994', time=2024-09-05T03:13:37.293123+0000, chain.objs.size()=1 2024-09-05T01:19:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.eRU-YpscMngckZKmNcaHoOyJh_ql36m_0 2024-09-05T01:19:43.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7039582940676319249', time=2024-09-05T03:14:12.716253+0000, chain.objs.size()=1 2024-09-05T01:19:43.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.238+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.5-4iyKGRhODouPdAbzxoMvloBNFpgD5_0 2024-09-05T01:19:43.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1631707330322041752', time=2024-09-05T03:14:12.790505+0000, chain.objs.size()=1 2024-09-05T01:19:43.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.5h_dBj00i9oYwPgZNkc7K0aB9wnc8y__0 2024-09-05T01:19:43.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2925779867656728752', time=2024-09-05T03:14:12.794139+0000, chain.objs.size()=1 2024-09-05T01:19:43.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.LgSlZoeeAZbhsd3vb5E2lV1pzd2jTmk_0 2024-09-05T01:19:43.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.170245851517592272', time=2024-09-05T03:16:18.978365+0000, chain.objs.size()=1 2024-09-05T01:19:43.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.urBCN-lL422mGzozViGyebZEgN4vnSz_0 2024-09-05T01:19:43.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9834521361024972386', time=2024-09-05T03:16:19.099771+0000, chain.objs.size()=1 2024-09-05T01:19:43.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.vCGRpq4gpGM01RRPfnN54hyxHdCxDbo_0 2024-09-05T01:19:43.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10144205183622037021', time=2024-09-05T03:16:57.724593+0000, chain.objs.size()=1 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.zW8US4CCu5ECq1-DfFrPab0HaIE8jSi_0 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13819191744257004778', time=2024-09-05T03:16:57.847736+0000, chain.objs.size()=1 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.A8cs8abnjexMgAm4NDdmiHbM_OS5uAj_0 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14746962011130404819', time=2024-09-05T03:16:57.849141+0000, chain.objs.size()=1 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.i11Fc38hRBBKLZ-4pLgVMysDp5rseM4_0 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14306028883644179484', time=2024-09-05T03:19:19.309993+0000, chain.objs.size()=1 2024-09-05T01:19:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.242+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:udLUCKw5yRhurnGC-5jqNdeqJv.-Fcm_.rmGtL7fxCPS3OEbrcGc3HgCrKZwwDgN_0 2024-09-05T01:19:43.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.246+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.254+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:19:43.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.254+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-05T01:19:43.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16005636143140881131', time=2024-09-05T03:11:25.865138+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.dR1nJZtIcLgW1mSFRpi4TYvuiP3TPWh_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4196196545029934440', time=2024-09-05T03:11:25.953138+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.7MU03CbiD_8T68FhM8-UMo-I58o_S_2_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.669405511714854869', time=2024-09-05T03:12:05.076104+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.4hJT3QMTviSF1sbzyRiugvLN6yRCvSZ_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10586768717074785775', time=2024-09-05T03:12:05.183755+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.gsRZq75zEBKPrrvVE_WHpUYuAOxLVLw_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2131008205854109529', time=2024-09-05T03:12:09.453113+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.EcEPM4SihHfOJooUqlZ50wkIgGF8oHB_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13222239208425028439', time=2024-09-05T03:12:09.531140+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.-CJu6WwfSxV3Ha4AOz9sd2m5g3L2GIs_0 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17972988111207834044', time=2024-09-05T03:12:13.190262+0000, chain.objs.size()=1 2024-09-05T01:19:43.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.7bwIL2Ogr5nzPISAr-C2vpThOmMUyzc_0 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18385366281653845753', time=2024-09-05T03:12:13.312787+0000, chain.objs.size()=1 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.uQ4rmVD-mlIKmdgDiJE_rskVngWwm0s_0 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2850210952368880023', time=2024-09-05T03:12:53.605870+0000, chain.objs.size()=1 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.6zM6yFX3K0izlfKgfasFglb9qX3WRLx_0 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11924683401732851978', time=2024-09-05T03:12:57.647339+0000, chain.objs.size()=1 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.aGT7EMKX40O44p0fe0iVsmSPB0dHu28_0 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2472936872309978546', time=2024-09-05T03:12:57.772842+0000, chain.objs.size()=1 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.DOCgZ6mJarY6QfgJqRVN1X3ZcSjsl-Z_0 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18308362110208139074', time=2024-09-05T03:12:57.901206+0000, chain.objs.size()=1 2024-09-05T01:19:43.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.258+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.p8FqtJL72R9gzWQYDON2ClgAHoBBUay_0 2024-09-05T01:19:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3385926896447166807', time=2024-09-05T03:13:33.025608+0000, chain.objs.size()=1 2024-09-05T01:19:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.Ry4e7fkzpS-rUlvojKhiOPsanc0j_1x_0 2024-09-05T01:19:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18092438670647393552', time=2024-09-05T03:13:41.072730+0000, chain.objs.size()=1 2024-09-05T01:19:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.5QsHeqDc16VoVIzvuoxYNJBRrUfNrFV_0 2024-09-05T01:19:43.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17216636941922081443', time=2024-09-05T03:14:20.402249+0000, chain.objs.size()=1 2024-09-05T01:19:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.ZTrlTe07v7JRK2kSu4_h-m3C05FC0Q__0 2024-09-05T01:19:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14748852466516800626', time=2024-09-05T03:14:20.404239+0000, chain.objs.size()=1 2024-09-05T01:19:43.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.vTFLlwlROR7XExg3vahmESZ_0LR_CTc_0 2024-09-05T01:19:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9374122862078971678', time=2024-09-05T03:14:55.269921+0000, chain.objs.size()=1 2024-09-05T01:19:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.oY2polvZuqbmIPrqWJO0PtuZRgOljpI_0 2024-09-05T01:19:43.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15526698532630560234', time=2024-09-05T03:14:55.355985+0000, chain.objs.size()=1 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_._QhbfMdHxONZQZ7B9BVnnrQIFXMAQQS_0 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15150293028457429102', time=2024-09-05T03:14:59.561916+0000, chain.objs.size()=1 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.9YNkcKjnev5XGfnvL0fD1BTfMVQp4sm_0 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2619896382121553569', time=2024-09-05T03:16:13.865750+0000, chain.objs.size()=1 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.HwSXBNoAeH9OL41sre9FGJNZ7uFoUFf_0 2024-09-05T01:19:43.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15983490824260621784', time=2024-09-05T03:16:57.881869+0000, chain.objs.size()=1 2024-09-05T01:19:43.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.CiiCxv-a8pg2tOXgNDBXxmPo3cWzQcf_0 2024-09-05T01:19:43.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4431806114802039635', time=2024-09-05T03:16:57.883936+0000, chain.objs.size()=1 2024-09-05T01:19:43.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.jRYwI_c0U8IQV9ml8EU8735ntdRQTK9_0 2024-09-05T01:19:43.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4599623897079796656', time=2024-09-05T03:19:05.585768+0000, chain.objs.size()=1 2024-09-05T01:19:43.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.262+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.jOJtcY_iSEF_KR5COrs8AsdsZ65thJ1_0 2024-09-05T01:19:43.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.266+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.270+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:19:43.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5360737146472862007', time=2024-09-05T03:10:05.630560+0000, chain.objs.size()=1 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.n52wD4oJi8KUV6wBpJlsZgIjC1DiTBG_0 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001367318395975513', time=2024-09-05T03:10:06.521611+0000, chain.objs.size()=1 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.Pd4Mc0JzzNK7CEg-qiG19Y_-AjRcsu8_0 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1437920514412221380', time=2024-09-05T03:13:37.368196+0000, chain.objs.size()=1 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.plDRudADE--Y2DOOykFVmYkK_tIU4lH_0 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.592443059760465427', time=2024-09-05T03:14:16.954781+0000, chain.objs.size()=1 2024-09-05T01:19:43.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_._hUshptme8Oit0Lq8bb9FjMemBV121i_0 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2745455931805131003', time=2024-09-05T03:14:55.299058+0000, chain.objs.size()=1 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.rQm0UL5IZI5abRC-U5wEzLsj01_LAPR_0 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8530557103740575348', time=2024-09-05T03:15:34.381677+0000, chain.objs.size()=1 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.NQezitSnLt87iD9ASCb87KuD3vVvqRW_0 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6105799436309116453', time=2024-09-05T03:16:13.836233+0000, chain.objs.size()=1 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.zB7Lw8g0CdGBcP6WNqICptsiBgY3A8M_0 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5263998899720698783', time=2024-09-05T03:16:22.973233+0000, chain.objs.size()=1 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.hSrW8TpPEOMObHHgxxnHa_z1iF_kda9_0 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7445228402994193747', time=2024-09-05T03:16:57.715910+0000, chain.objs.size()=1 2024-09-05T01:19:43.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.274+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.hwLzw-erjB9e_ddNjtW5CMq7qPOly0s_0 2024-09-05T01:19:43.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.278+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.282+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:19:43.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.286+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13978116125858224168', time=2024-09-05T03:10:05.669590+0000, chain.objs.size()=1 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.xsi_RSaeSTCcLXo-wbjepHOCfIYQM0k_0 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8743401770686673936', time=2024-09-05T03:12:05.049785+0000, chain.objs.size()=1 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.XnwS8WI4hEwdrxP7453Cc_4kw5TB-Rs_0 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6320670662925337888', time=2024-09-05T03:12:05.185936+0000, chain.objs.size()=1 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.wPz9T9tYWB-0FJ9I1ZYor_Ap1Ye3P-t_0 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12696133711129585499', time=2024-09-05T03:12:09.291697+0000, chain.objs.size()=1 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.vw2gzeHvAeZTV0uBJyuoeoTnHGgzsV7_0 2024-09-05T01:19:43.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4196450721036067873', time=2024-09-05T03:12:13.184346+0000, chain.objs.size()=1 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.VgWY_pKU98HZtWWMDpPEFisSlqgIt5d_0 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14110305606445758686', time=2024-09-05T03:12:13.307881+0000, chain.objs.size()=1 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.qXUE7x119ZCWuQ0aDpwpkHMbv0t8-8A_0 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13087502107247440160', time=2024-09-05T03:13:32.964142+0000, chain.objs.size()=1 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.iUmVye6QdOu5rLg6oFRKEATOW1n4BgY_0 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1346339586635760549', time=2024-09-05T03:13:32.976023+0000, chain.objs.size()=1 2024-09-05T01:19:43.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.0dor56J0LW-NVHPO8tlISH9PDAqAGxd_0 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6979748460558496042', time=2024-09-05T03:13:37.289929+0000, chain.objs.size()=1 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.1rov9J6e_OlVM1AHIdt3zuhOsO3Adzm_0 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3835255715609924782', time=2024-09-05T03:13:37.452048+0000, chain.objs.size()=1 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.OWKIxAAE3D9WWQQOQDP22TxDozZS3LW_0 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16589810310389061303', time=2024-09-05T03:14:16.784634+0000, chain.objs.size()=1 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.KK_TbldQ2V6uoKqoIE-ZHACv83zGQ9W_0 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14117792067905428432', time=2024-09-05T03:14:59.354090+0000, chain.objs.size()=1 2024-09-05T01:19:43.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.290+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.-EXeTFSEkoUf99vHfm2DrxbTNZWGcCj_0 2024-09-05T01:19:43.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3083397980567315989', time=2024-09-05T03:14:59.530600+0000, chain.objs.size()=1 2024-09-05T01:19:43.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.vllCvWuBXjGQZjI0RSROvRIW4SytTqM_0 2024-09-05T01:19:43.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3555157308817992164', time=2024-09-05T03:15:34.389079+0000, chain.objs.size()=1 2024-09-05T01:19:43.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.WDK4K5dpEwap6zFKfDnxHH4kzsMXiNT_0 2024-09-05T01:19:43.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16216987053869298402', time=2024-09-05T03:15:38.902994+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_._dPFY54HYc4_IZ-HeUJXhGIu5m_InQ-_0 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3834551608193847895', time=2024-09-05T03:15:38.906461+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.lkBO5EGhZ49_vRJRS-INNaUy5dHZ6Tl_0 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11466716749479983348', time=2024-09-05T03:15:42.621781+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.9lh2pMlpod_DwBzrQRNBN5W_5fE9D0L_0 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8507651045709793051', time=2024-09-05T03:16:22.823512+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.iGI0SOMW8xR3Tk5opqtGgKIe70iiaSz_0 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11031159567253111683', time=2024-09-05T03:16:57.754683+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.U7neUe_M1JOBXFElCZS8euuB7Of6p_E_0 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7412008847334730401', time=2024-09-05T03:19:05.585147+0000, chain.objs.size()=1 2024-09-05T01:19:43.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.U4xah5B1lXMRLg6scjfRZ008jQ_4IIv_0 2024-09-05T01:19:43.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16354664847677389815', time=2024-09-05T03:19:05.586607+0000, chain.objs.size()=1 2024-09-05T01:19:43.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.294+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.Mpo_mpEp6_BEBmbs_GFkzLelTbzfTns_0 2024-09-05T01:19:43.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.298+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.306+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:19:43.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.306+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16694781775375984546', time=2024-09-05T03:10:05.795535+0000, chain.objs.size()=4 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.1 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.2 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.3 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12__multipart_foo.2~k0CTtnDaFz7FIwPVq7WJtT_61rl36eI.4 2024-09-05T01:19:43.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6222190009468008677', time=2024-09-05T03:10:06.218767+0000, chain.objs.size()=3 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.1 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.2 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-LUKEWARM.2~D5yxS1hsaWMCGMwnPga-FmGZ6ECwiCa.3 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7136433473784685290', time=2024-09-05T03:10:06.622166+0000, chain.objs.size()=1 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.zCQ4Ib0AMnmtb7Sqfm3vs5kgR45m0O7_0 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8982600498768605116', time=2024-09-05T03:11:30.181815+0000, chain.objs.size()=1 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.Zi332BHIYl_NTDZDeFNf51b44whJ1SX_0 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3257417834348725768', time=2024-09-05T03:12:09.446835+0000, chain.objs.size()=1 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.BF0VNsZzHRrB2UYdyCxGjhua70g9wRI_0 2024-09-05T01:19:43.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9999401261750319250', time=2024-09-05T03:12:09.535545+0000, chain.objs.size()=1 2024-09-05T01:19:43.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.kjOqA5P1iqrIzTgnAWj-cLTJ7bihc2K_0 2024-09-05T01:19:43.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7087855694969572486', time=2024-09-05T03:12:48.016685+0000, chain.objs.size()=1 2024-09-05T01:19:43.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.310+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.gEzppLmCVTUwoaOv3AldC5jp6N6qjn8_0 2024-09-05T01:19:43.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5197901234531314538', time=2024-09-05T03:14:20.553347+0000, chain.objs.size()=1 2024-09-05T01:19:43.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.L58zGaoiPULXOELG6bK9iwrgxslo3Hs_0 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2139599990092006505', time=2024-09-05T03:14:55.271095+0000, chain.objs.size()=1 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.uNS5n9oieQ-Pbu3cmJVTu0IMlt4R3s9_0 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3021223886753316601', time=2024-09-05T03:15:38.996641+0000, chain.objs.size()=1 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.yB260cuTYQPIlcpeY7fX2HIsQfXm_Ey_0 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6387937158923845932', time=2024-09-05T03:16:57.933732+0000, chain.objs.size()=1 2024-09-05T01:19:43.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.314+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.6zAztGAK6ru2kaTr6GEPomGsgZIz99h_0 2024-09-05T01:19:43.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.318+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1960614801727892080', time=2024-09-05T03:19:05.581280+0000, chain.objs.size()=1 2024-09-05T01:19:43.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.318+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.gOhYjs-rUvzYPQ30MEj_nyjon5NACeo_0 2024-09-05T01:19:43.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.322+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.326+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:19:43.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6897108773326181130', time=2024-09-05T03:11:25.865038+0000, chain.objs.size()=1 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.aQ1jdWb0fpgK9XX94XzHOUuLwO7kKMd_0 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10282654812715492035', time=2024-09-05T03:11:25.953346+0000, chain.objs.size()=1 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.a6ZvWwNmjyam89Nl7FXYKxem1xRGyQj_0 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13974869697883211524', time=2024-09-05T03:12:05.181540+0000, chain.objs.size()=1 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.zETBdV3_TdtVNiV4hY2-igZuRJN8_iQ_0 2024-09-05T01:19:43.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11767706946925168388', time=2024-09-05T03:12:09.453122+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.dcTcMhBNgMpnSfKSPZv7HRxtMtJUk2l_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15579145716417131876', time=2024-09-05T03:12:57.647145+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.UXZoR07r2-OSCsOYR9scQCv_eTR-Qrn_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7063262476830294886', time=2024-09-05T03:12:57.885634+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.d2mtGymqIMgafc8DsWnPXHDroQ6FRhp_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12213108775891803524', time=2024-09-05T03:14:16.882999+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.NWUlCnu0UqF0E09I6xJ2nCHt7Ys4WYw_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1582733054203273846', time=2024-09-05T03:14:16.941839+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.2HBXx50lekN-Gqg2-kPT4Py8MK7o9W5_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13776856031993981404', time=2024-09-05T03:14:55.177308+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.ycHhLvcBElQzvACXDXx7pJE5jgVKrMR_0 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1249085138757174744', time=2024-09-05T03:16:22.733700+0000, chain.objs.size()=1 2024-09-05T01:19:43.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.a3mlK1UKvSq6TgwS6x64rB0E-P1-z6w_0 2024-09-05T01:19:43.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14511617359161698963', time=2024-09-05T03:16:22.840999+0000, chain.objs.size()=1 2024-09-05T01:19:43.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.rzRsEWQkCUMFZLs60T4B0Ta1wUm79YT_0 2024-09-05T01:19:43.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6947674877713334763', time=2024-09-05T03:16:22.843381+0000, chain.objs.size()=1 2024-09-05T01:19:43.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.330+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.WY3B70c05-zYAwgEydKVoVmyiln7ojW_0 2024-09-05T01:19:43.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.338+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.342+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:19:43.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5150567859213767056', time=2024-09-05T03:10:06.539099+0000, chain.objs.size()=1 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.H6z-5Wy5gcUgIjOZpYv7RWrMNcg5yCu_0 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15444068161255193630', time=2024-09-05T03:10:06.602542+0000, chain.objs.size()=1 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8__shadow_.HcEErA8zVxxaw0mC4brunZgWWcObrHl_0 2024-09-05T01:19:43.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10528752027370530214', time=2024-09-05T03:12:53.475167+0000, chain.objs.size()=1 2024-09-05T01:19:43.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.WdLYKVkb6UjRz2WzsAw_NlR9qfHTG5w_0 2024-09-05T01:19:43.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1811058843608463435', time=2024-09-05T03:12:53.599724+0000, chain.objs.size()=1 2024-09-05T01:19:43.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.x4cnu-EVksqRGaSf8D3JQbgocAX6qsw_0 2024-09-05T01:19:43.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12019764216225307584', time=2024-09-05T03:12:57.704874+0000, chain.objs.size()=1 2024-09-05T01:19:43.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_._aftWFDdcW4Sc6T4uxsTvLT_kE9Ka9R_0 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8667974053553609957', time=2024-09-05T03:12:57.754563+0000, chain.objs.size()=1 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.kLw9jX4iuS0prhjJMjPlgtDvHdfDbxo_0 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17590152436622917500', time=2024-09-05T03:13:32.976135+0000, chain.objs.size()=1 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.eqWkIMzWslxdLXWrbMJFo28O5njzcV3_0 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6229390153282264939', time=2024-09-05T03:13:33.145270+0000, chain.objs.size()=1 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.PxuhwyJabNtCgmMRF2L4m7iEUA7MZyx_0 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15440356004856922070', time=2024-09-05T03:14:16.735118+0000, chain.objs.size()=1 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.vqjjwJvt4stwSt1nDIYuF4R1ANi8NvU_0 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3751203168501993063', time=2024-09-05T03:14:59.530580+0000, chain.objs.size()=1 2024-09-05T01:19:43.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.m0oz0Tx5VoQ9lWPCtWkmiCyY91iUvL5_0 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4629015099386477519', time=2024-09-05T03:16:13.948830+0000, chain.objs.size()=1 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.b15SFWyZQg7iqBHO9RnoW5q2tg4aQLI_0 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11038791027943384795', time=2024-09-05T03:16:18.934862+0000, chain.objs.size()=1 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.346+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.xKu1Jv3zzcfkihSN1_xA3jd2oHrgyTN_0 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6182850534934722088', time=2024-09-05T03:16:22.707162+0000, chain.objs.size()=1 2024-09-05T01:19:43.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.hn_e7K4rgarmc6zhjbx4g7fcrPaUnzO_0 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8808457582473719366', time=2024-09-05T03:16:57.810444+0000, chain.objs.size()=1 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.TeUlzMXn6fwMKDMEit06RY4hReauutw_0 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1434863270489632577', time=2024-09-05T03:19:05.582527+0000, chain.objs.size()=1 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.5fak4mmUvymL9rnobWp0A7Ng7G9F4EK_0 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12738941854164781602', time=2024-09-05T03:19:05.586496+0000, chain.objs.size()=1 2024-09-05T01:19:43.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.350+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.r5GRT8aBaJm_OkTff2gqd1bPp9b1QJn_0 2024-09-05T01:19:43.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.354+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.358+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:19:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.362+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.362+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15236986691882653649', time=2024-09-05T03:10:05.747809+0000, chain.objs.size()=4 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.1 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.2 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.3 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11__multipart_foo.2~_J4hpNd2xvpmc5f7D_6N6BOMN91hGaO.4 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4129416303264031892', time=2024-09-05T03:10:06.020302+0000, chain.objs.size()=1 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.o-Bv5CGcGcf4ZabBZA3f4-6AXBrk4F7_0 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_4dzndw2vrvyMPlRSTjaTLmuuvDBvLN6', time=2024-09-05T03:10:06.232828+0000, chain.objs.size()=1 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.mTUJfUl8cWeL-A3iK48FvGc8E_Ev7H3_0 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2379914310299331161', time=2024-09-05T03:11:30.103879+0000, chain.objs.size()=1 2024-09-05T01:19:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.YAd46HoftQluSt0npvE638vvb9XYU1k_0 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12983162127653774703', time=2024-09-05T03:12:09.423805+0000, chain.objs.size()=1 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.pm-fQkvx6JD0tkQUDJk4mJTI4GqmFeq_0 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2642629267863272787', time=2024-09-05T03:12:47.966096+0000, chain.objs.size()=1 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.OfN_QtQbyaWw0UB-EqWWXpZ1Ky1aXIT_0 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4826066240540085837', time=2024-09-05T03:12:53.612550+0000, chain.objs.size()=1 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.yxfASnwviOA3EBuzTXpVmOchYuqWgZn_0 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12361033737482100981', time=2024-09-05T03:13:32.974366+0000, chain.objs.size()=1 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.Zqt5dI0mZzjNkJZ_NoHVaE8_JRrwoCn_0 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3139872685488716759', time=2024-09-05T03:14:12.678123+0000, chain.objs.size()=1 2024-09-05T01:19:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.366+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.4YXmibObvGz_cyYuQVxXI5OupBptYj9_0 2024-09-05T01:19:43.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17446831108261509546', time=2024-09-05T03:14:20.545282+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.BzkJFnVQTVIh6zUX6-i3O_BJ7zKxS_P_0 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13210452048740387988', time=2024-09-05T03:14:55.167859+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.ujMQQipULJoG7cRpoGgm56GIofAdh12_0 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2184829663228158474', time=2024-09-05T03:15:34.384917+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_._afacSlYsrHCTfq3UcielduP0d3qU70_0 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17028146963797427580', time=2024-09-05T03:15:38.816145+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.npMFEDuzZMKz1bfu7cORX-VUMMRlpT4_0 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9233626510433657406', time=2024-09-05T03:16:13.966758+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.YoTbS5b7tkItrl2R23tXQF0S6n1H3Px_0 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15864294853147282685', time=2024-09-05T03:16:18.958303+0000, chain.objs.size()=1 2024-09-05T01:19:43.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.370+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.QrRv57vsDm2oZLcriFVjNZ-ADx9Rjb-_0 2024-09-05T01:19:43.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.374+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.382+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:19:43.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.382+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-05T01:19:43.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11124631860956160393', time=2024-09-05T03:10:06.037214+0000, chain.objs.size()=1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.lMhwU9AOTraPxrYesThfzO--yxl2MLe_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='__tt0u8oY0nfck3e2Grz9q5rIF8zqi2U', time=2024-09-05T03:10:06.138637+0000, chain.objs.size()=2 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.Hajri9YGaBLlmThwOmFQ7QftQRn-RNa_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.Hajri9YGaBLlmThwOmFQ7QftQRn-RNa_1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11575496361987943604', time=2024-09-05T03:10:06.529742+0000, chain.objs.size()=1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.7k_WJ-uQ3IaHw3ik2LunTKTeTrHlYzs_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11465319061695066986', time=2024-09-05T03:11:25.910522+0000, chain.objs.size()=1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.zrfuDkNxWhlGdMuGZzjED3ZXOigYupa_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2278037569560419736', time=2024-09-05T03:11:30.081547+0000, chain.objs.size()=1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.B_nyR8Eh91-8XHY4U60C_YllPxViqPm_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12250947617910958290', time=2024-09-05T03:11:30.175242+0000, chain.objs.size()=1 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.jrcn3tJMDiEJCCjP4X5gWyfBEJf9zrO_0 2024-09-05T01:19:43.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16641858896616534809', time=2024-09-05T03:12:05.187773+0000, chain.objs.size()=1 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.AZbA3oKeUPf5IA1od45y6hSWOAYhXBN_0 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15150488639978708772', time=2024-09-05T03:12:05.247067+0000, chain.objs.size()=1 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.gHLiR5W578ELzzfljQoGVaAbCyecZJ6_0 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8009165823062331887', time=2024-09-05T03:12:09.293715+0000, chain.objs.size()=1 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.khyn5iQK0l0u0nVBNqA6Bae0vRMrjMO_0 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18499268988432486', time=2024-09-05T03:12:47.947831+0000, chain.objs.size()=1 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.6Pq2qlFgiWXxxG-2McBQQJtD5GSzKPP_0 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1415871616154818086', time=2024-09-05T03:12:48.012597+0000, chain.objs.size()=1 2024-09-05T01:19:43.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.386+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.KEB7YVfYV_xTWzt01brnjdIqgiNBz07_0 2024-09-05T01:19:43.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.390+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12689346634732479687', time=2024-09-05T03:12:52.279717+0000, chain.objs.size()=1 2024-09-05T01:19:43.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.390+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.3pyQ5aaifaj_M0Alo4fTefzxZN1erno_0 2024-09-05T01:19:43.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7855327654549349220', time=2024-09-05T03:12:57.912684+0000, chain.objs.size()=1 2024-09-05T01:19:43.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.up2H8fiOxEFdAT-kkyN0jcR-EPC6BaD_0 2024-09-05T01:19:43.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13560059472436506989', time=2024-09-05T03:13:32.967286+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.OPy-WCuDBxU2ltmez4sTiiT3_qxLI6T_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11700892151876977070', time=2024-09-05T03:14:12.666689+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.FdfHAnmJOvHZhprLUkdt9PZnBPuAlp__0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13192546331697211496', time=2024-09-05T03:14:16.925155+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.S3MBGhtr380kKuEfaOB8-LvJxRo-RVf_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6790566695227847347', time=2024-09-05T03:14:20.303974+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.bIRbwAKwsfsbPW8TCpqy3MVVnW9aY2P_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8899144711971589367', time=2024-09-05T03:14:20.335761+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.pW22YILZ-NyHgrHoPb386d83EDiZU5e_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15071587697347774013', time=2024-09-05T03:14:55.096637+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.aEW1eXJpYfjT8SQ0pY7tghkpMddepIo_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12790218933674460816', time=2024-09-05T03:14:55.151555+0000, chain.objs.size()=1 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.3ax_UbFENhZc-8_VmSRte5IGzbB6_3D_0 2024-09-05T01:19:43.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17109834687701365351', time=2024-09-05T03:14:59.553853+0000, chain.objs.size()=1 2024-09-05T01:19:43.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.1vPRqgUi4H-AXx79fKjQ3vkp_rF4uxJ_0 2024-09-05T01:19:43.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2711451217767493644', time=2024-09-05T03:16:13.945301+0000, chain.objs.size()=1 2024-09-05T01:19:43.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.MK4CjKu2MfasEdHIUFx6Drz7AgGpRX__0 2024-09-05T01:19:43.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2062388099517482948', time=2024-09-05T03:16:18.917737+0000, chain.objs.size()=1 2024-09-05T01:19:43.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.394+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.-uplbhtmWxwCBS3yIqk82QxnisLw5ob_0 2024-09-05T01:19:43.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.398+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14098758006879168550', time=2024-09-05T03:19:05.582413+0000, chain.objs.size()=1 2024-09-05T01:19:43.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.398+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.bmqKSnGpnzNjNO0TnIGcgPZ5V3yVKXE_0 2024-09-05T01:19:43.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.398+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.402+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:19:43.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.406+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10658245198731629351', time=2024-09-05T03:10:05.677984+0000, chain.objs.size()=1 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.WYf4p-9h1G_LGjCVRi19KVbtOd5bHat_0 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_MSu-Unzofn7nt336uxLitAZwAUi4CSa', time=2024-09-05T03:10:06.065399+0000, chain.objs.size()=1 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.hzr0GnFgDeIGSTvfv7rMzFTKkaRhd7f_0 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17481851516998467727', time=2024-09-05T03:10:06.240157+0000, chain.objs.size()=3 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.1 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.2 2024-09-05T01:19:43.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.3 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17295588271356144941', time=2024-09-05T03:11:25.948865+0000, chain.objs.size()=1 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.IYlNH-LoDv1qG5Ge5iKiFWl6FmnlsaP_0 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13384782368809805236', time=2024-09-05T03:12:13.308694+0000, chain.objs.size()=1 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.GfggGDa-PvxHJx568vxSJeotM2u9A-__0 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.835567334918198224', time=2024-09-05T03:12:16.715083+0000, chain.objs.size()=1 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.75VzgmRHSWDCJRN7_KG1BDp4kdetP_8_0 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13022595677739422669', time=2024-09-05T03:12:53.559398+0000, chain.objs.size()=1 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.v-qUZpzdBv8Hm1wLM-9gLCQP3mK9-fC_0 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17055043586627726522', time=2024-09-05T03:12:57.709029+0000, chain.objs.size()=1 2024-09-05T01:19:43.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.GF800YI8K5YcOKxnij-r9w3RwG09LRR_0 2024-09-05T01:19:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17232678924927015613', time=2024-09-05T03:13:37.289758+0000, chain.objs.size()=1 2024-09-05T01:19:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.gqhDSu0PCtkZrt6yncJObGtPBamszQn_0 2024-09-05T01:19:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6501066660302136505', time=2024-09-05T03:13:37.375669+0000, chain.objs.size()=1 2024-09-05T01:19:43.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.410+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.DIVRNcF7mr_H83CyU4qE_XUx8VA8i3N_0 2024-09-05T01:19:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2866347481228757971', time=2024-09-05T03:14:12.804761+0000, chain.objs.size()=1 2024-09-05T01:19:43.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.HWQCA2I5wMJl1BPzH2BnQGXKuIrHRJf_0 2024-09-05T01:19:43.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4124033172468162484', time=2024-09-05T03:14:16.869710+0000, chain.objs.size()=1 2024-09-05T01:19:43.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.RBFbDtfYixjkCz5HUqjfnZ5qoPZO0yH_0 2024-09-05T01:19:43.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6753238000531338155', time=2024-09-05T03:14:55.286277+0000, chain.objs.size()=1 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.SxsywmJstMUHr1s4gIIojVJ-Meeyg4q_0 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15350611387537935557', time=2024-09-05T03:14:59.574187+0000, chain.objs.size()=1 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.2KdoQd8yx7Fz-c8LDi8u_r3EPIiXEQP_0 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18194674890077168071', time=2024-09-05T03:15:34.389168+0000, chain.objs.size()=1 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.tHINDQI2uacbrWwhAL2RtUz5eJL4QX__0 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9399053531996949145', time=2024-09-05T03:15:38.910938+0000, chain.objs.size()=1 2024-09-05T01:19:43.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.WLoNl1WEcFCjyKB6zfoouaigGNB6SIb_0 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1317444852073856457', time=2024-09-05T03:16:13.859406+0000, chain.objs.size()=1 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.uZhoDP8mRfwy3t_uCljPBww5tZ1rhuP_0 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12787773091720876537', time=2024-09-05T03:16:14.039121+0000, chain.objs.size()=1 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.w3b79XHbu1x8Q1ldSjkHkpcau5ITHOr_0 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9757246187907083019', time=2024-09-05T03:16:18.924365+0000, chain.objs.size()=1 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.uk-g-HIYduGdZpkM47cJkIfiqTVOaDH_0 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15026634703875002464', time=2024-09-05T03:16:18.927430+0000, chain.objs.size()=1 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.ExuVtHYUL7MOl3t3SMk5_zeEDYMMuiu_0 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5413647221834610958', time=2024-09-05T03:16:57.754693+0000, chain.objs.size()=1 2024-09-05T01:19:43.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.414+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.HAbTUZkzUAq45cCxYB0AJ-2s6fdXuwm_0 2024-09-05T01:19:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.422+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.426+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:19:43.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6144351570603768781', time=2024-09-05T03:10:06.049685+0000, chain.objs.size()=1 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.o-Bv5CGcGcf4ZabBZA3f4-6AXBrk4F7_0 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2859794314876010631', time=2024-09-05T03:11:30.320828+0000, chain.objs.size()=1 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.mk0Q_EuHTq_-ZY26daRznlqlEhDRz7Q_0 2024-09-05T01:19:43.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14165123413835031023', time=2024-09-05T03:12:53.558533+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.2z8AZ1-OY69i8jUZftoAHYqETDLWqp7_0 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1530285769484180913', time=2024-09-05T03:12:53.639706+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.lwonHpJX7VtWmI7iqegJBpQGyxfX9vN_0 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6837517151887087240', time=2024-09-05T03:12:57.656340+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.Vhz2-kkrovc4Pv4He390zhKcpAGY1do_0 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7923617196141228705', time=2024-09-05T03:13:33.130681+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.9tYj0fRrGfRE45DdrvKRQ-849GkpWej_0 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2222988740514881406', time=2024-09-05T03:14:16.813739+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.ZMVLU6Oh4gFi5ddNMWxtBGTBLBpjQl9_0 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.845563588747442136', time=2024-09-05T03:14:59.454472+0000, chain.objs.size()=1 2024-09-05T01:19:43.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.pbvG2_8xYeZnYQtXMpAc-p3-2Jz3rab_0 2024-09-05T01:19:43.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16512501337761542169', time=2024-09-05T03:16:14.012526+0000, chain.objs.size()=1 2024-09-05T01:19:43.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.iMIRh3Bjl2geK_yyPxjfiCFjSPEONJq_0 2024-09-05T01:19:43.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14164571836933646173', time=2024-09-05T03:16:22.821211+0000, chain.objs.size()=1 2024-09-05T01:19:43.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.430+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.XPDNLet-loEtMGsJdMtqFsQUXs-j-QR_0 2024-09-05T01:19:43.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.434+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.438+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:19:43.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.442+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.442+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16621685333194820943', time=2024-09-05T03:10:05.658754+0000, chain.objs.size()=1 2024-09-05T01:19:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.O8_VIa7wLQjYEwoJSFuXVZWeqJYA07B_0 2024-09-05T01:19:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3978121913462792569', time=2024-09-05T03:10:05.686691+0000, chain.objs.size()=1 2024-09-05T01:19:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.kxDrRm38kJTZJ816SS4GJjoHZyl4Lvq_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13860053386438999487', time=2024-09-05T03:10:06.076093+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vQ7_nopfdghOLajorIzAcwQzuBpyRzR_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15662214197212414557', time=2024-09-05T03:11:25.946459+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.gFKp9j92MlmxzUzCGKVNSb4Q-fv6cX2_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16376822576962767049', time=2024-09-05T03:12:05.294973+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.O6w58yB83bVc3Vxlhp3r8jk458s576T_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6640520181432405847', time=2024-09-05T03:12:09.446524+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.qRVAcO1zZO-ANZxUZKYMeKKFy1Q-egZ_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2382478616967904732', time=2024-09-05T03:12:13.122107+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.T90FgzQ_ELwS27gPKcCZ8HnzRW3gWsl_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14506913618051692412', time=2024-09-05T03:12:48.102939+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.vRUp2vA31tXcu2guyrR_p3yp8TDOOZi_0 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17475011740940245295', time=2024-09-05T03:14:12.800297+0000, chain.objs.size()=1 2024-09-05T01:19:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.P525XtENO-8Dew_-cb4RXBOItpDXZCG_0 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16395278032646940623', time=2024-09-05T03:14:55.183591+0000, chain.objs.size()=1 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.LrGHukD254supQ84-caQxY6Bi5fC5Wr_0 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13123202189140304188', time=2024-09-05T03:14:55.271289+0000, chain.objs.size()=1 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.Ir-BvCqBlaoxzNKCzi_N5oMVHWxImCL_0 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8143339465218528867', time=2024-09-05T03:14:55.369098+0000, chain.objs.size()=1 2024-09-05T01:19:43.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.jRhGcBRlpbH8qowv9So3M6JEoDC3SWv_0 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5844329930222961213', time=2024-09-05T03:15:34.383661+0000, chain.objs.size()=1 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.446+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.d-Vd9rdGnYM8tuDezpt-AT4i3c5BrY1_0 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8562801022026667681', time=2024-09-05T03:15:34.385859+0000, chain.objs.size()=1 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.D7I99-G3clVrUGvw_b9yD9w4knchQ1v_0 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12433901631927520447', time=2024-09-05T03:15:38.996832+0000, chain.objs.size()=1 2024-09-05T01:19:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.nqdah5ECVg9l-BdUFNoMG7aa16hdHkn_0 2024-09-05T01:19:43.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1082885040653257570', time=2024-09-05T03:19:13.777785+0000, chain.objs.size()=1 2024-09-05T01:19:43.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:mxNEt0WHRXB4POi6nMYifzDigWCxpGv_.nzHdmUhBuup8aWV9VH8iS_V_Chg_GLQ_0 2024-09-05T01:19:43.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7133434682676926694', time=2024-09-05T03:19:19.336310+0000, chain.objs.size()=1 2024-09-05T01:19:43.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.450+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18__shadow:1YdLU5XT7XOA1qEBLzgUsvVgZjnNh9V_.MQUfNYZX4uueVt0fJ7wk-9NGHkkRxQ9_0 2024-09-05T01:19:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.454+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.458+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:19:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-05T01:19:43.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4676307135320287945', time=2024-09-05T03:11:30.153158+0000, chain.objs.size()=1 2024-09-05T01:19:43.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.OJNQ82sQ1Z-oVvP5C9GNsL-bidwsDix_0 2024-09-05T01:19:43.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17882989972870352263', time=2024-09-05T03:12:13.114589+0000, chain.objs.size()=1 2024-09-05T01:19:43.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.uPBvvfhZu9PquW4wDTVA4C9Ni8s25o__0 2024-09-05T01:19:43.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8375428014722681314', time=2024-09-05T03:12:57.799083+0000, chain.objs.size()=1 2024-09-05T01:19:43.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.cDJ3hbW5xIk_HfI1MM8bgvg1fZBFryQ_0 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10080063706660431266', time=2024-09-05T03:13:32.898899+0000, chain.objs.size()=1 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.tk3_Cyw62asoHuVC_YVhVrer9eQH46Z_0 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3286482053941398332', time=2024-09-05T03:13:33.036578+0000, chain.objs.size()=1 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.7C4KO0MPXbE89XzNiQ-m6JehVyto6FQ_0 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5128181403950141698', time=2024-09-05T03:13:33.086569+0000, chain.objs.size()=1 2024-09-05T01:19:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.GLeSkzjJp4RJRqX3jFq751jI0-PRetN_0 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2522666160195561251', time=2024-09-05T03:14:12.899978+0000, chain.objs.size()=1 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.afKJ4WZ5Q19BAKvN1TiSHKehZcWOn2D_0 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16370127078574978969', time=2024-09-05T03:14:59.351744+0000, chain.objs.size()=1 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.YJmbCLWQEP-wmSRnQIHEwb9BXae15z7_0 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13655922084468927663', time=2024-09-05T03:15:38.855921+0000, chain.objs.size()=1 2024-09-05T01:19:43.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.Eor5ojDTsQR3seRcEMb85r8qWdHD3bL_0 2024-09-05T01:19:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9536723491723371208', time=2024-09-05T03:16:18.903201+0000, chain.objs.size()=1 2024-09-05T01:19:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.UtJy6rV-T6K2IU0hZF5r5gkrMjS0kfW_0 2024-09-05T01:19:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7394740027385936449', time=2024-09-05T03:16:18.979109+0000, chain.objs.size()=1 2024-09-05T01:19:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.QtdJe82uZPoLK9LMvrfnuSSV5w8D_x7_0 2024-09-05T01:19:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4887978959926416530', time=2024-09-05T03:16:22.739075+0000, chain.objs.size()=1 2024-09-05T01:19:43.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.462+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.CO4SNa-H1302ZyxUnoG7_A09SNUyaLb_0 2024-09-05T01:19:43.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.466+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.991519640317277531', time=2024-09-05T03:19:05.599550+0000, chain.objs.size()=1 2024-09-05T01:19:43.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.466+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.T156ryrFIDQpZ0pblOg8jAorkOWzFpL_0 2024-09-05T01:19:43.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.470+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.474+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:19:43.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_-vo__BHAhNefio7ThU8x1_0VVtz_VcR', time=2024-09-05T03:10:06.191067+0000, chain.objs.size()=2 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.nu1Yd8-rePnG34ntFq-LqFJyxK24nLy_0 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.nu1Yd8-rePnG34ntFq-LqFJyxK24nLy_1 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2566247111333826164', time=2024-09-05T03:10:06.393680+0000, chain.objs.size()=2 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.kT3Zm728dvhDTVXuPIxuGcC3UoJqgwr_0 2024-09-05T01:19:43.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.kT3Zm728dvhDTVXuPIxuGcC3UoJqgwr_1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10692244507510626509', time=2024-09-05T03:12:05.181543+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.gkDT_jRW92omLLnFENJwAB58enMxGUN_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16842144577182647963', time=2024-09-05T03:12:05.274585+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.RTw3axuf17i_0OboT3fMzEJX-uGBk-I_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14597856390298488439', time=2024-09-05T03:12:47.899621+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.nRzJ864dl5SS40Q6uNLRKSHnezp0KFY_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14060907643520083439', time=2024-09-05T03:12:48.029490+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.273ewq50IOdfgA2s4xw84dsbeNXoW09_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13708197002211644198', time=2024-09-05T03:12:57.772745+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.vuIfDFolt5i9VonuDw4K9wJhUBeWuiM_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1067194738765041651', time=2024-09-05T03:13:33.075628+0000, chain.objs.size()=1 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.eqdJgUSucuLRdoLeF1Y5hLctsVlo--B_0 2024-09-05T01:19:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11715929892802489461', time=2024-09-05T03:14:16.883122+0000, chain.objs.size()=1 2024-09-05T01:19:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.po1r4_nscdKf62GAF3LFk71nh_CfxKJ_0 2024-09-05T01:19:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2684527884326560288', time=2024-09-05T03:14:59.358979+0000, chain.objs.size()=1 2024-09-05T01:19:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.478+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.cr0PW-dQhsEvTKseQs9foR-Ef2EF0CQ_0 2024-09-05T01:19:43.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16384237419282329245', time=2024-09-05T03:14:59.360059+0000, chain.objs.size()=1 2024-09-05T01:19:43.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.0JmfG_nBLngSPQWwHrDMT0d2CHhN9pk_0 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4000052149435148089', time=2024-09-05T03:15:38.871090+0000, chain.objs.size()=1 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.pWlZXcPodnGCAUkW3cVXwrPVeMH9G54_0 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15984293474029985482', time=2024-09-05T03:15:38.901542+0000, chain.objs.size()=1 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.-6jlDvSEuFSabstrT8BFCcrAcIJTfCt_0 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14081244479253738442', time=2024-09-05T03:15:38.991109+0000, chain.objs.size()=1 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.mG2e1QAurO3B7FCLuIH7QvVeRtK5b1R_0 2024-09-05T01:19:43.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14295227106689965760', time=2024-09-05T03:16:13.865895+0000, chain.objs.size()=1 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.SEmfBf28N_NQf_tWe8adXvMp3l8cOH0_0 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1585454242222457232', time=2024-09-05T03:16:18.918487+0000, chain.objs.size()=1 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.o39E456LYkU2oRU4lxmzCV9d_C3_Jvf_0 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17390256327671498523', time=2024-09-05T03:16:18.985306+0000, chain.objs.size()=1 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.ivtOv8fdrej32724bXiacIP2RKlDE-p_0 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11752682803972507587', time=2024-09-05T03:16:22.841009+0000, chain.objs.size()=1 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.ZzrEoXUKiNWilPH0fWNeERFQeT8eCHR_0 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6992991174575259393', time=2024-09-05T03:16:22.843540+0000, chain.objs.size()=1 2024-09-05T01:19:43.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.486+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.4jjjvhjfY14GMDrTkrPSchlFBi8bYon_0 2024-09-05T01:19:43.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.490+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.494+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:19:43.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-05T01:19:43.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15652254066488290558', time=2024-09-05T03:10:05.653573+0000, chain.objs.size()=1 2024-09-05T01:19:43.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.LAedQ0kvOVTKuUuXHLa9E_fZRkxjkho_0 2024-09-05T01:19:43.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10088861936559393297', time=2024-09-05T03:10:05.991170+0000, chain.objs.size()=1 2024-09-05T01:19:43.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vQ7_nopfdghOLajorIzAcwQzuBpyRzR_0 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13707966863178081194', time=2024-09-05T03:10:06.211243+0000, chain.objs.size()=3 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.1 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.2 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-STANDARD.2~uGiSfilyxTilwNVy9Ymtnb4cab-dEcS.3 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4598290129645863839', time=2024-09-05T03:11:25.808856+0000, chain.objs.size()=1 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.C5jibXtHnmgzwQfUB0SJFxKBUDmVg8W_0 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8280492399178371203', time=2024-09-05T03:11:25.888770+0000, chain.objs.size()=1 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.Qzlmhndy-KPYXBouP2QfmaHxZR92sk0_0 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14237842235241504588', time=2024-09-05T03:12:05.164528+0000, chain.objs.size()=1 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.ogbCwfdldLlb4DjaXSnch8Clc_76AHr_0 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15854193176373283744', time=2024-09-05T03:12:05.167040+0000, chain.objs.size()=1 2024-09-05T01:19:43.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.bkUQNByVgHtCxobG_eOfj8gDJVifS4f_0 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16430963210886660831', time=2024-09-05T03:12:13.161591+0000, chain.objs.size()=1 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.GRjuSI0GrxwbKY47d4zTTvk96zVLu64_0 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9418440828930238444', time=2024-09-05T03:12:13.387823+0000, chain.objs.size()=1 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.o2gg6TmhaUpEfiKgWnCLfFwig9gVxXa_0 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1846927358256873965', time=2024-09-05T03:12:47.956863+0000, chain.objs.size()=1 2024-09-05T01:19:43.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.498+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.EKRCR9stB8Sgc-UWK-V3IZjXhzFvdbm_0 2024-09-05T01:19:43.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.502+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.897129760473120110', time=2024-09-05T03:12:47.959116+0000, chain.objs.size()=1 2024-09-05T01:19:43.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.502+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.I4-R2BLBauV-WptO7HTEVQ1VnEOuPOf_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9469403615306102943', time=2024-09-05T03:12:57.656022+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.QuOOswI73m9weFiYwmLZk86uyirNNHV_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15737895385971463385', time=2024-09-05T03:13:01.393802+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.oWHfqGm-dGZUv7DKr2cVD_szKbw8BUA_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1456480201178398568', time=2024-09-05T03:13:32.963343+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.RtrZcL0Y9XCSMh6SfvVyuwMkVND_0jy_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15517288615145016624', time=2024-09-05T03:13:33.158970+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27__shadow_.RNiqbW7NdV_vAmZFVVmSC3a7d9BsF5a_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3168792230123354360', time=2024-09-05T03:13:37.308260+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.iVXiVrT25ZoKr4JEgyeHahHa_Qn3V_3_0 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16730810688980730099', time=2024-09-05T03:13:37.444656+0000, chain.objs.size()=1 2024-09-05T01:19:43.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.FggbIM9yYg2PRTvTPbFzNzjsAHPWbwB_0 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7715097436192690685', time=2024-09-05T03:14:12.802505+0000, chain.objs.size()=1 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.v79VBcl1r-uteHclXWDvocYRiZ7QrYI_0 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12260284715803624317', time=2024-09-05T03:14:20.557678+0000, chain.objs.size()=1 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.3Q1nj-nwocfC15gX2dKrjnGKnN-DP9s_0 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5593817890578878097', time=2024-09-05T03:14:55.158463+0000, chain.objs.size()=1 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.3WsmrrOnQO4NyrhyutpXWqfxKgm25by_0 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4766003135376518991', time=2024-09-05T03:14:55.183289+0000, chain.objs.size()=1 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.iyKxF55SV3twcTbKofgA8s1W_G3Gtz3_0 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1290362025921762438', time=2024-09-05T03:15:34.502257+0000, chain.objs.size()=1 2024-09-05T01:19:43.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.506+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.U9wHwV9qq2Ljaz2N4MnGlo1OY38G170_0 2024-09-05T01:19:43.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11419399087423267273', time=2024-09-05T03:16:13.951567+0000, chain.objs.size()=1 2024-09-05T01:19:43.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.uYAwkJSf84uSepnBM9C8DzXsbAGv_Dt_0 2024-09-05T01:19:43.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5577640849122954304', time=2024-09-05T03:16:23.008233+0000, chain.objs.size()=1 2024-09-05T01:19:43.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.BOvsbn6mzIuDs5UV_PU1vYrveLPGaBu_0 2024-09-05T01:19:43.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.705346068560962190', time=2024-09-05T03:16:57.825458+0000, chain.objs.size()=1 2024-09-05T01:19:43.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.Qj2A_wB7kH9H--VUP6OK7xjPs9PgPka_0 2024-09-05T01:19:43.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.510+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.514+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:19:43.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14644710430629889991', time=2024-09-05T03:12:13.182387+0000, chain.objs.size()=1 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.l_l3qcvGQ9TAEjyo5Gnh1QfYYfIKuxc_0 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.954379294295515963', time=2024-09-05T03:12:53.700152+0000, chain.objs.size()=1 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.Z_xcR5c0B0F6Jl4Drr7qQVwXxtE7RlK_0 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12519696428973085084', time=2024-09-05T03:14:20.524156+0000, chain.objs.size()=1 2024-09-05T01:19:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.BRPe1_C4GDbaRWIxiV3KhR6wjt0kwlE_0 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6133097044719017267', time=2024-09-05T03:15:34.545572+0000, chain.objs.size()=1 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.DrvoXAQLg5AT8Ee1o-5ixhu5TuKWYM7_0 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17313063779633555137', time=2024-09-05T03:15:38.802846+0000, chain.objs.size()=1 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.HsNPgWTqvoPSpeR1dExUyAcOVor8-PL_0 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10875907873139354973', time=2024-09-05T03:16:13.998909+0000, chain.objs.size()=1 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.IAwassEFoJ695IYGmHp3KTeZHlkgMLV_0 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7449298631470531686', time=2024-09-05T03:16:19.074121+0000, chain.objs.size()=1 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.egghjAJSXTNXSs3uYMlU0VgjFKC9g3__0 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.427319011856100640', time=2024-09-05T03:16:22.766313+0000, chain.objs.size()=1 2024-09-05T01:19:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.518+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.GcQYfb-3savL6UCZmN-3Q9Y-zjISyhj_0 2024-09-05T01:19:43.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.522+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.526+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:19:43.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-05T01:19:43.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_AwKWe1oh4MnuLKv844Why5PdIHYh-Vk', time=2024-09-05T03:10:05.982467+0000, chain.objs.size()=1 2024-09-05T01:19:43.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.vnbgahXgd7pgErSuH6VhK5OLcR7SCMg_0 2024-09-05T01:19:43.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7578588400178707669', time=2024-09-05T03:10:06.551950+0000, chain.objs.size()=1 2024-09-05T01:19:43.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7__shadow_.PsfIK4ef5eeYWDZxwzllg6JiE1JZTgD_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12596818373638635189', time=2024-09-05T03:12:53.610834+0000, chain.objs.size()=1 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.KGp-WUVE1ItdJEA6o8pAyMeX7esgMGl_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1246614156015787194', time=2024-09-05T03:12:53.612207+0000, chain.objs.size()=1 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.-Nj5xJFVi2dSJxZCklgOCKGmhHGVAmL_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11030049449106372904', time=2024-09-05T03:13:37.310279+0000, chain.objs.size()=1 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.n6U-MVL3_cgxqtzwbf7N4N0KcsiG5sa_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14865599067333311167', time=2024-09-05T03:13:37.455991+0000, chain.objs.size()=1 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.-Org9tk-lJpB4OIFmEYxh1JXeu7XToL_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6349692548841580463', time=2024-09-05T03:13:37.525524+0000, chain.objs.size()=1 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.28__shadow_.t7jZdPy7Ms4eaF6tV5wzg-gXCUOfXIB_0 2024-09-05T01:19:43.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6598442164928775179', time=2024-09-05T03:14:16.768485+0000, chain.objs.size()=1 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.b1jilydD_u76sYLXXFEhwf8tkVGEsmW_0 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13425507853020561579', time=2024-09-05T03:14:59.453455+0000, chain.objs.size()=1 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.fa9N6qNCrXzqIpXGCFciOzWqowTBmqE_0 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3072076794120986096', time=2024-09-05T03:14:59.455669+0000, chain.objs.size()=1 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.KaNBi-AA58qYTQKb42WfhBo2-N1xg18_0 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.206267989758408610', time=2024-09-05T03:15:38.920793+0000, chain.objs.size()=1 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.RMowukfvy5lOnPT9-c-n6iXOIMo4WXJ_0 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13541064476590987630', time=2024-09-05T03:16:13.966602+0000, chain.objs.size()=1 2024-09-05T01:19:43.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.530+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.7xAphA3DRmFY7s94t7ddbRgxtEQZPc0_0 2024-09-05T01:19:43.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.538+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9982736059081387697', time=2024-09-05T03:16:22.992606+0000, chain.objs.size()=1 2024-09-05T01:19:43.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.538+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.SIEFz6tQvYyIdODByaV-ZeJRH5iNZbO_0 2024-09-05T01:19:43.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.538+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.542+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:19:43.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11426558387926407928', time=2024-09-05T03:11:25.911912+0000, chain.objs.size()=1 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.TPf-qJ238msk4XjWhi_GFFw0jlZPX2w_0 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14143948752274592182', time=2024-09-05T03:11:30.083087+0000, chain.objs.size()=1 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20__shadow_.6Ln6uv-2dxaI1wrxIRbKX76-vM-2rqc_0 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.527603600054057935', time=2024-09-05T03:12:09.453006+0000, chain.objs.size()=1 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.WGu_OcXx4iR8w8rmBh8RmRcnO7oPR4Y_0 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7284366123426587681', time=2024-09-05T03:12:53.475203+0000, chain.objs.size()=1 2024-09-05T01:19:43.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.9m5MCUGmdXXHq0nWEfQvT4Ny29VkA5O_0 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17886172605049407636', time=2024-09-05T03:12:57.754772+0000, chain.objs.size()=1 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.NK42wjALr4GuL-kmvonCB7GvepJKzb9_0 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6264398724996726184', time=2024-09-05T03:12:57.756551+0000, chain.objs.size()=1 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.26__shadow_.1Mui0RlI83hjmSYyeoCDJwpMGcmUTlD_0 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1127841798694323228', time=2024-09-05T03:14:16.735156+0000, chain.objs.size()=1 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.rF4ecKb_SqKCkVJsL8mAMKbN9QaPayD_0 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12502157442729784661', time=2024-09-05T03:14:16.869697+0000, chain.objs.size()=1 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.Pq243nXpBjJkYkUjYuzip3LT_5gxLx8_0 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2329205500212057966', time=2024-09-05T03:14:20.404010+0000, chain.objs.size()=1 2024-09-05T01:19:43.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.546+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.USmWLz4EX0VKaL25IFvT9d8yCsaAEhX_0 2024-09-05T01:19:43.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.550+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.554+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:19:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4475935799551089626', time=2024-09-05T03:10:06.151723+0000, chain.objs.size()=3 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.1 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.2 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__multipart_foo-FROZEN.2~VuBYtez1GP5gRe5RnZu_Vh804sbV3lP.3 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2170491625195277061', time=2024-09-05T03:10:06.385063+0000, chain.objs.size()=1 2024-09-05T01:19:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13__shadow_.9AMjpInNsDmMTqTwhqkkjTSGYonF67m_0 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17341750803656627357', time=2024-09-05T03:12:05.181713+0000, chain.objs.size()=1 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.-_loNG54fljkyLGvcV3BUZ2gERxjoJP_0 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3762454876866150241', time=2024-09-05T03:12:05.299119+0000, chain.objs.size()=1 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.vmZjorUtBwmCbCwgz6m5gVpKoHnfg9n_0 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2761168063035451667', time=2024-09-05T03:12:08.602155+0000, chain.objs.size()=1 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.TIki7McStKF8vFZGIinO8CiZRezm6z1_0 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9049024332769309166', time=2024-09-05T03:12:48.030370+0000, chain.objs.size()=1 2024-09-05T01:19:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.X3MgjXNyExCz-UFo804M_CE8ER_0VBH_0 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10109498093053704699', time=2024-09-05T03:12:53.604453+0000, chain.objs.size()=1 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.WhAkQuu70Mw8tBEkf-Yh1g4ahi8Narm_0 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1508660766341212095', time=2024-09-05T03:14:12.885899+0000, chain.objs.size()=1 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.aIcPBZmVJQ9DedmReEmTgqmBPyVQBHy_0 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7867683626974010299', time=2024-09-05T03:14:20.406478+0000, chain.objs.size()=1 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.m4Mm8CtUiSo16itr2nmxwJkEZx-wY6I_0 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14550619504323811506', time=2024-09-05T03:14:59.439381+0000, chain.objs.size()=1 2024-09-05T01:19:43.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.558+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.8tA-wo61DcUK8kW3qd_NyJTJ780m3Su_0 2024-09-05T01:19:43.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11026096744739825843', time=2024-09-05T03:14:59.484975+0000, chain.objs.size()=1 2024-09-05T01:19:43.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.33__shadow_.wQsBrzbTqUnF8WU53S1KnDaoVXNv7uv_0 2024-09-05T01:19:43.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7466036370262264220', time=2024-09-05T03:15:34.403011+0000, chain.objs.size()=1 2024-09-05T01:19:43.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.Zx6cAN32C3Jxj7-63Z-iMqaAJgQG4MD_0 2024-09-05T01:19:43.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12764057389511755121', time=2024-09-05T03:15:34.473904+0000, chain.objs.size()=1 2024-09-05T01:19:43.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.7K2zA5aXCz1ZkwXVtk2A0pRPFmJ3yME_0 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12172826065471997592', time=2024-09-05T03:16:18.916415+0000, chain.objs.size()=1 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.9ONlMOy94Dp6OP7xqU-2Ao802To9NDY_0 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9318679996765297384', time=2024-09-05T03:16:22.894552+0000, chain.objs.size()=1 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.KVfhIhsp-kMKZ31rzyoG_ML8TgTCc6K_0 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17166644370480944132', time=2024-09-05T03:16:22.896525+0000, chain.objs.size()=1 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.XKQ_BEtGtnads7bhRPUVPAzaJ1ZQIo2_0 2024-09-05T01:19:43.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4978563819010213312', time=2024-09-05T03:19:05.642537+0000, chain.objs.size()=1 2024-09-05T01:19:43.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.566+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.ORZ62Oo_CdjzUzQEu7QOyzfSp_IA89p_0 2024-09-05T01:19:43.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.570+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.574+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:19:43.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.574+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.574+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.574+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-05T01:19:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.574+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.482269032258279181', time=2024-09-05T03:10:05.857847+0000, chain.objs.size()=4 2024-09-05T01:19:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.1 2024-09-05T01:19:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.2 2024-09-05T01:19:43.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.3 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10__multipart_foo.2~Fl0wUIQlZ4ySLF53oHSJCFeEBPM92EH.4 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7318968119617751089', time=2024-09-05T03:11:25.824552+0000, chain.objs.size()=1 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.AAngsrHl6KIuZh2b4hTpUrE9xnWOAPy_0 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11758017107050577134', time=2024-09-05T03:11:26.053844+0000, chain.objs.size()=1 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.TnssSxqpq1M9FKNdTfG49K2c21g6Rsa_0 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8435382945993429644', time=2024-09-05T03:12:05.247769+0000, chain.objs.size()=1 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.cSWbRq2ewezjvl0XqVNK0uQT2Y8S8Iw_0 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13339235700984285484', time=2024-09-05T03:12:09.439439+0000, chain.objs.size()=1 2024-09-05T01:19:43.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.RUts5WELVVhil8t9C8KCizDSfWj8eS-_0 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.60818258665411543', time=2024-09-05T03:12:09.441279+0000, chain.objs.size()=1 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.0n6HiJiPE8EZhZPNQTg8ufaMRny4752_0 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4095327989181259696', time=2024-09-05T03:12:09.507196+0000, chain.objs.size()=1 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.0iLBJ6fZbhP62xubud4ek2JMZCD6G0d_0 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4426726554670223113', time=2024-09-05T03:12:13.420698+0000, chain.objs.size()=1 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.zVRcvMhgMjuwUbep0GwUPEhJEctBtZk_0 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6406535900133261378', time=2024-09-05T03:14:12.805560+0000, chain.objs.size()=1 2024-09-05T01:19:43.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.578+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.29__shadow_.ZDgw3MDHTHKlf7tFiiJzTtMk9d46W6s_0 2024-09-05T01:19:43.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1892369045522748812', time=2024-09-05T03:14:16.015593+0000, chain.objs.size()=1 2024-09-05T01:19:43.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.wftfQQpBmXpOWh4pscnoPFQkz7JjRLS_0 2024-09-05T01:19:43.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8447923380117001611', time=2024-09-05T03:14:16.876444+0000, chain.objs.size()=1 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.kcEoP8zNLxpE1OQ8BaaSoUP0kM4fxYO_0 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8450018348414054773', time=2024-09-05T03:15:34.309185+0000, chain.objs.size()=1 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.34__shadow_.536akdCpFePgDiLo87RzhV2QlztcVCO_0 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8680506947803108247', time=2024-09-05T03:15:38.915622+0000, chain.objs.size()=1 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.n0A9WecV2Qn13qGtqT2NqGKYSTdxgGO_0 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3798454990342320611', time=2024-09-05T03:16:18.987173+0000, chain.objs.size()=1 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.37__shadow_.e9pKknNyY3yY-MdNvCMy0n0LHjHSUYq_0 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10254791591341228757', time=2024-09-05T03:19:05.573087+0000, chain.objs.size()=1 2024-09-05T01:19:43.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.MFNDe5rcRX6eDyYodAbJCwWBeMTwUZc_0 2024-09-05T01:19:43.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15950886825983556323', time=2024-09-05T03:19:05.575600+0000, chain.objs.size()=1 2024-09-05T01:19:43.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.582+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17__shadow_.yIg3dr1ay2Uuo7pPfCagBmPrlMNadzU_0 2024-09-05T01:19:43.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.586+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.586+0000 7f3c979159c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:19:43.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:43.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:43.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-05T01:19:43.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3583638071865055093', time=2024-09-05T03:10:05.635372+0000, chain.objs.size()=1 2024-09-05T01:19:43.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4__shadow_.POL2xrRwwG6FhFmA_de0NibmSzzKhZu_0 2024-09-05T01:19:43.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_xlj2KJnOLsX8T8wsGDSULWgxQd2SwBT', time=2024-09-05T03:10:06.007520+0000, chain.objs.size()=1 2024-09-05T01:19:43.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15__shadow_.uERGW9tqtbK3HFtIpi62yFF2YiIBdB9_0 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='_7rV3EEYip-dcMHoigWmc-s_RhWAPaIG', time=2024-09-05T03:10:06.167762+0000, chain.objs.size()=2 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.YJ6_RLjl3ZAolBfUdkEuNuomLPh0E8B_0 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16__shadow_.YJ6_RLjl3ZAolBfUdkEuNuomLPh0E8B_1 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2858822160748374384', time=2024-09-05T03:11:25.948690+0000, chain.objs.size()=1 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.19__shadow_.ek2EALwFOXI1dApzZsIlfECCTKA6IgY_0 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10534745020377579345', time=2024-09-05T03:11:33.687739+0000, chain.objs.size()=1 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.21__shadow_.mpz1qrjMZVVVGrKfUFyhInuLcqSURyL_0 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10560212550376337253', time=2024-09-05T03:12:09.450949+0000, chain.objs.size()=1 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.PkgDQGJ-tY3YlGfOgQJz8Q70plS4kYx_0 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1067862892728517606', time=2024-09-05T03:12:09.453307+0000, chain.objs.size()=1 2024-09-05T01:19:43.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.22__shadow_.-aNAyWW8SL9AaKIN6JAoqj1k5EoMSnC_0 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1657237844361585697', time=2024-09-05T03:12:13.163918+0000, chain.objs.size()=1 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.23__shadow_.712PNICzlubZlp_wD-UgWWn7IJog2sx_0 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9705858958804168529', time=2024-09-05T03:12:47.886240+0000, chain.objs.size()=1 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.24__shadow_.ytoFZYGe_h6KejbJos4oOTEleWRYp2C_0 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1380649312310254757', time=2024-09-05T03:12:53.712952+0000, chain.objs.size()=1 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.25__shadow_.dWqjbnoBxexrJ9Kl_lw05m2T9DfW_TM_0 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1974771809767569693', time=2024-09-05T03:14:16.716213+0000, chain.objs.size()=1 2024-09-05T01:19:43.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.590+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.30__shadow_.BO2HX1oYXYSqRIoIzdT4yNdrx3gygLK_0 2024-09-05T01:19:43.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.594+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16253325173179302319', time=2024-09-05T03:14:20.304176+0000, chain.objs.size()=1 2024-09-05T01:19:43.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.594+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.31__shadow_.N3kxyp2J8ABGw5Phult3A7WY6HPT025_0 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3361141245087296783', time=2024-09-05T03:14:55.151379+0000, chain.objs.size()=1 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.32__shadow_.vxlEMaCtyN1eX9NZGU76iwNX6FE61qO_0 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3870608222406953501', time=2024-09-05T03:15:39.040684+0000, chain.objs.size()=1 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.35__shadow_.IMWzZYNnv90cmOI6zPF3Tb56tSLe68l_0 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11415376391721956036', time=2024-09-05T03:16:13.952003+0000, chain.objs.size()=1 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36__shadow_.fLY5-SPbEeVEuEqQMNEoJIY0GBbUxa1_0 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9135973237360891834', time=2024-09-05T03:16:22.819643+0000, chain.objs.size()=1 2024-09-05T01:19:43.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38__shadow_.k5DzwcXz6S-3S-hF0yA0iPAQomQ2z88_0 2024-09-05T01:19:43.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14924985965406703308', time=2024-09-05T03:16:57.810386+0000, chain.objs.size()=1 2024-09-05T01:19:43.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.598+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39__shadow_.6e39I-dG_kDC6bht_d5dUla2Iy_2XgD_0 2024-09-05T01:19:43.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.602+0000 7f3c979159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:19:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.606+0000 7f3b4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:43.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.610+0000 7f3c979159c0 20 remove_watcher() i=0 2024-09-05T01:19:43.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.610+0000 7f3c979159c0 2 removed watcher, disabling cache 2024-09-05T01:19:43.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.614+0000 7f3c979159c0 20 remove_watcher() i=1 2024-09-05T01:19:43.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.614+0000 7f3c979159c0 20 remove_watcher() i=2 2024-09-05T01:19:43.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.618+0000 7f3c979159c0 20 remove_watcher() i=3 2024-09-05T01:19:43.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.622+0000 7f3c979159c0 20 remove_watcher() i=4 2024-09-05T01:19:43.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.622+0000 7f3c979159c0 20 remove_watcher() i=5 2024-09-05T01:19:43.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.626+0000 7f3c979159c0 20 remove_watcher() i=6 2024-09-05T01:19:43.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.626+0000 7f3c979159c0 20 remove_watcher() i=7 2024-09-05T01:19:43.645 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:19:43.719 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:19:43.720 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:19:43.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 realm 2024-09-05T01:19:43.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:19:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.766+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:43.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:43.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:43.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:19:43.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.770+0000 7f4f993449c0 20 searching for the correct realm 2024-09-05T01:19:43.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.774+0000 7f4f9764b640 0 -- 172.21.15.99:0/183797388 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4f8c043040 msgr2=0x7f4f8c043420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:43.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:43.990+0000 7f4f9764b640 0 -- 172.21.15.99:0/183797388 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4f8c043040 msgr2=0x7f4f8c043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:19:44.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:19:44.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:19:44.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:19:44.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:19:44.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:19:44.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:19:44.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:44.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:19:44.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 zone default found 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 4 Realm: () 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 zonegroup default 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.002+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:44.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:44.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 rados->read ofs=0 len=0 2024-09-05T01:19:44.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:19:44.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 started sync module instance, tier type = 2024-09-05T01:19:44.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.006+0000 7f4f993449c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:19:44.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=0 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=1 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=2 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=3 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=4 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=5 2024-09-05T01:19:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=6 2024-09-05T01:19:44.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 20 add_watcher() i=7 2024-09-05T01:19:44.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.030+0000 7f4f993449c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:19:44.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.034+0000 7f4e4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.038+0000 7f4f993449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:19:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.038+0000 7f4f993449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:19:44.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4dc7fff640 20 reqs_thread_entry: start 2024-09-05T01:19:44.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4f993449c0 20 init_complete bucket index max shards: 11 2024-09-05T01:19:44.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4f993449c0 20 Filter name: none 2024-09-05T01:19:44.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4dc5ffb640 20 reqs_thread_entry: start 2024-09-05T01:19:44.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:19:44.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.130+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.134+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.134+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:19:44.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.138+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.138+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.142+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.142+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:19:44.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.146+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.146+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.146+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.150+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:19:44.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.150+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.154+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.154+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.154+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:19:44.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.158+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.158+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.162+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.162+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:19:44.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.166+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.166+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.170+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.170+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:19:44.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.174+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.174+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.174+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.178+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:19:44.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.182+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.182+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.182+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.186+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:19:44.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.190+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.190+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.190+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.194+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:19:44.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.198+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.202+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.202+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.202+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:19:44.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.210+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.210+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.210+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.214+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:19:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.218+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.218+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.218+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.222+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:19:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.226+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.226+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.230+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.230+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:19:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.234+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.234+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.238+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.238+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:19:44.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.242+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.246+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.246+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.250+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:19:44.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.254+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.254+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.254+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.258+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:19:44.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.262+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.262+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.266+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.266+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:19:44.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.270+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.274+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.274+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.278+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:19:44.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.282+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.282+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.282+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.286+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:19:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.290+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.290+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.290+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.294+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:19:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.298+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.298+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.302+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.302+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:19:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.306+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.310+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.310+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.314+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:19:44.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.318+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.318+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.322+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.322+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:19:44.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.326+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.326+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.330+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.330+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:19:44.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.334+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.338+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.338+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.342+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:19:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.346+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.350+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.350+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.354+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:19:44.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.354+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.358+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.358+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.362+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:19:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.366+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.366+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.366+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.370+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:19:44.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.374+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.374+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.374+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.378+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:19:44.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.382+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.382+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.386+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.386+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:19:44.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.390+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.394+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.394+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.398+0000 7f4f993449c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:19:44.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.402+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.402+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:19:44.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.402+0000 7f4f993449c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:19:44.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.406+0000 7f4e4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:19:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.414+0000 7f4f993449c0 20 remove_watcher() i=0 2024-09-05T01:19:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.414+0000 7f4f993449c0 2 removed watcher, disabling cache 2024-09-05T01:19:44.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.414+0000 7f4f993449c0 20 remove_watcher() i=1 2024-09-05T01:19:44.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.418+0000 7f4f993449c0 20 remove_watcher() i=2 2024-09-05T01:19:44.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.422+0000 7f4f993449c0 20 remove_watcher() i=3 2024-09-05T01:19:44.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.422+0000 7f4f993449c0 20 remove_watcher() i=4 2024-09-05T01:19:44.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.426+0000 7f4f993449c0 20 remove_watcher() i=5 2024-09-05T01:19:44.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.426+0000 7f4f993449c0 20 remove_watcher() i=6 2024-09-05T01:19:44.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:19:44.430+0000 7f4f993449c0 20 remove_watcher() i=7 2024-09-05T01:19:44.448 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-05T01:19:45.136 INFO:teuthology.orchestra.run.smithi099.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-05T01:19:49.734 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean UP-TO-DATE 2024-09-05T01:20:08.632 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-09-05T01:20:08.633 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-09-05T01:20:08.633 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-09-05T01:20:09.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:09.633 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-09-05T01:20:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-05T01:20:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-05T01:20:09.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:09.634 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-09-05T01:20:09.634 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-09-05T01:20:15.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:15.733 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-09-05T01:20:15.733 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:15.733 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-05T01:20:23.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:23.433 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-05T01:20:24.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:24.232 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-05T01:20:24.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:24.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-05T01:20:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:25.332 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-05T01:20:35.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:35.833 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-05T01:20:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:36.732 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-05T01:20:36.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:36.733 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-05T01:20:36.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:36.932 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-05T01:20:37.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:37.132 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-05T01:20:37.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:37.932 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-05T01:20:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:47.032 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-05T01:20:48.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:48.732 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-05T01:20:49.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:20:49.233 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-05T01:20:49.233 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05 01:20:49,150 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-05T01:21:43.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:43.633 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-05T01:21:45.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:45.232 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-05T01:21:45.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:45.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-05T01:21:46.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:46.232 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-05T01:21:46.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:46.532 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-05T01:21:47.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:47.832 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-05T01:21:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:56.533 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-05T01:21:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:57.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-05T01:21:57.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:57.532 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-05T01:21:57.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:21:57.732 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-05T01:22:07.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:07.833 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-05T01:22:08.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:08.632 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-05T01:22:34.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:34.133 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-05T01:22:35.332 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:35.332 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-05T01:22:39.232 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:39.232 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-05T01:22:40.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:22:40.132 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-05T01:24:43.433 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:24:43.433 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-05T01:24:44.331 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:24:44.332 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-05T01:24:53.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:24:53.632 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-05T01:24:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:24:54.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-05T01:25:02.032 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:02.032 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-05T01:25:02.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:02.932 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-05T01:25:06.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:06.132 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-05T01:25:20.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:20.732 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-05T01:25:21.032 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:21.032 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-05T01:25:21.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:21.932 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-05T01:25:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:22.132 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-05T01:25:23.032 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:23.032 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-05T01:25:23.332 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:23.332 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-05T01:25:24.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:24.132 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-05T01:25:24.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:24.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-05T01:25:25.332 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:25.332 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-05T01:25:25.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:25.532 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-05T01:25:26.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:26.432 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-05T01:25:26.732 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:26.732 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-05T01:25:27.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:27.532 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-05T01:25:27.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:27.832 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-05T01:25:28.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:28.632 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-05T01:25:46.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:46.933 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-05T01:25:47.832 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:47.832 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-09-05T01:25:47.832 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-05T01:25:47.832 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-09-05T01:25:47.930 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 6m 3s 2024-09-05T01:25:47.931 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-05T01:25:48.255 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:25:48.287 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:25:48.287 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:25:48.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.329+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 realm 2024-09-05T01:25:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:25:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.537+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.541+0000 7f7ff50909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:48.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.541+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.541+0000 7f7ff50909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:25:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.541+0000 7f7ff50909c0 20 searching for the correct realm 2024-09-05T01:25:48.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.549+0000 7f7ff3397640 0 -- 172.21.15.99:0/3978042053 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fdc0c1020 msgr2=0x7f7fdc0c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:48.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.765+0000 7f7ff3397640 0 -- 172.21.15.99:0/3978042053 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f7fdc0c1020 msgr2=0x7f7fdc0c23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:25:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:25:48.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.777+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:48.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:25:48.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 zone default found 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 4 Realm: () 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 zonegroup default 2024-09-05T01:25:48.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 started sync module instance, tier type = 2024-09-05T01:25:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.781+0000 7f7ff50909c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:25:48.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=0 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=1 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=2 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=3 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=4 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=5 2024-09-05T01:25:48.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.805+0000 7f7ff50909c0 20 add_watcher() i=6 2024-09-05T01:25:48.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.809+0000 7f7ff50909c0 20 add_watcher() i=7 2024-09-05T01:25:48.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.809+0000 7f7ff50909c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:25:48.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.813+0000 7f7ea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:48.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.813+0000 7f7ff50909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:25:48.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.813+0000 7f7ff50909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:25:48.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.913+0000 7f7e23fff640 20 reqs_thread_entry: start 2024-09-05T01:25:48.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 init_complete bucket index max shards: 11 2024-09-05T01:25:48.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 Filter name: none 2024-09-05T01:25:48.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7e21ffb640 20 reqs_thread_entry: start 2024-09-05T01:25:48.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:25:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1349445117106035057', time=2024-09-05T03:21:43.908918+0000, chain.objs.size()=5 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~7EM88cIaXz9ID_Bu1Y3YUic_nI617TK.1 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~7EM88cIaXz9ID_Bu1Y3YUic_nI617TK.1_1 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~7EM88cIaXz9ID_Bu1Y3YUic_nI617TK.2 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~7EM88cIaXz9ID_Bu1Y3YUic_nI617TK.2_1 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~7EM88cIaXz9ID_Bu1Y3YUic_nI617TK.3 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9975685759258739963', time=2024-09-05T03:22:08.023457+0000, chain.objs.size()=5 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.52__multipart_key1.2~16HKy4-9z5f8CjjWKZNVocgo7xcwHcd.1 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.917+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.52__multipart_key1.2~16HKy4-9z5f8CjjWKZNVocgo7xcwHcd.2 2024-09-05T01:25:48.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.921+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.52__multipart_key1.2~16HKy4-9z5f8CjjWKZNVocgo7xcwHcd.3 2024-09-05T01:25:48.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.921+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.52__multipart_key1.2~16HKy4-9z5f8CjjWKZNVocgo7xcwHcd.4 2024-09-05T01:25:48.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.921+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.52__multipart_key1.2~16HKy4-9z5f8CjjWKZNVocgo7xcwHcd.5 2024-09-05T01:25:48.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.921+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3326217798143308811', time=2024-09-05T03:25:23.526385+0000, chain.objs.size()=1 2024-09-05T01:25:48.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.921+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.61__shadow_.Qc6R1zeJS8mgTtkx5c2Ci3_I3IWuLbz_0 2024-09-05T01:25:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.929+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:48.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.933+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:25:48.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.937+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2673028912760227884', time=2024-09-05T03:21:21.118788+0000, chain.objs.size()=5 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~tcg2NqGfUBC1_PVKCYw8U9ulW6ukxtw.1 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~tcg2NqGfUBC1_PVKCYw8U9ulW6ukxtw.2 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~tcg2NqGfUBC1_PVKCYw8U9ulW6ukxtw.3 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~tcg2NqGfUBC1_PVKCYw8U9ulW6ukxtw.4 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~tcg2NqGfUBC1_PVKCYw8U9ulW6ukxtw.5 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7701959921780618445', time=2024-09-05T03:21:34.590998+0000, chain.objs.size()=5 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~0iNoRc6oNtilCgr5jiyrYH-EAD2uln3.1 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~0iNoRc6oNtilCgr5jiyrYH-EAD2uln3.2 2024-09-05T01:25:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~0iNoRc6oNtilCgr5jiyrYH-EAD2uln3.3 2024-09-05T01:25:48.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~0iNoRc6oNtilCgr5jiyrYH-EAD2uln3.4 2024-09-05T01:25:48.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.941+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~0iNoRc6oNtilCgr5jiyrYH-EAD2uln3.5 2024-09-05T01:25:48.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.953+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.957+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:25:48.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.961+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.961+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.961+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.965+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:25:48.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.965+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.122192028453037832', time=2024-09-05T03:21:39.059645+0000, chain.objs.size()=5 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~Up0Fa3IFxzZGi2VCQy_O0JJLYvxmU8E.1 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~Up0Fa3IFxzZGi2VCQy_O0JJLYvxmU8E.1_1 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~Up0Fa3IFxzZGi2VCQy_O0JJLYvxmU8E.2 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~Up0Fa3IFxzZGi2VCQy_O0JJLYvxmU8E.2_1 2024-09-05T01:25:48.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.969+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~Up0Fa3IFxzZGi2VCQy_O0JJLYvxmU8E.3 2024-09-05T01:25:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.977+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.981+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:25:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.985+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:48.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.985+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq', time=2024-09-05T03:25:17.848810+0000, chain.objs.size()=58 2024-09-05T01:25:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.1 2024-09-05T01:25:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.2 2024-09-05T01:25:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.3 2024-09-05T01:25:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.4 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.5 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.6 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.7 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.8 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.9 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.10 2024-09-05T01:25:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.11 2024-09-05T01:25:48.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.12 2024-09-05T01:25:48.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.13 2024-09-05T01:25:48.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.989+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.14 2024-09-05T01:25:48.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.15 2024-09-05T01:25:48.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.16 2024-09-05T01:25:48.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.17 2024-09-05T01:25:48.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.18 2024-09-05T01:25:48.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.19 2024-09-05T01:25:48.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.20 2024-09-05T01:25:48.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.21 2024-09-05T01:25:48.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.22 2024-09-05T01:25:48.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.23 2024-09-05T01:25:48.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.993+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.24 2024-09-05T01:25:48.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:48.997+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.25 2024-09-05T01:25:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.26 2024-09-05T01:25:49.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.27 2024-09-05T01:25:49.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.28 2024-09-05T01:25:49.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.29 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.30 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.31 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.32 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.001+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.33 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.005+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.34 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.005+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.35 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.005+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.36 2024-09-05T01:25:49.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.005+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.37 2024-09-05T01:25:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.38 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.39 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.40 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.41 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.42 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.43 2024-09-05T01:25:49.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.44 2024-09-05T01:25:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.45 2024-09-05T01:25:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.46 2024-09-05T01:25:49.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.47 2024-09-05T01:25:49.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.009+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.48 2024-09-05T01:25:49.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.013+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.49 2024-09-05T01:25:49.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.013+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.50 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.51 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.52 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.53 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.54 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.55 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.56 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.57 2024-09-05T01:25:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.017+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.58__multipart_key1.2~hvRPNacFe2EM3wo_y9B3ndB1aHAqXZq.58 2024-09-05T01:25:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.021+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.025+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:25:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.815270431955466756', time=2024-09-05T03:24:43.642890+0000, chain.objs.size()=11 2024-09-05T01:25:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.1 2024-09-05T01:25:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.1_1 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.2 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.2_1 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.3 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.3_1 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.4 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.4_1 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.5 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.5_1 2024-09-05T01:25:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.029+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~u0Ci7I5ObugWy0jyk0awZ9luJ8grXao.6 2024-09-05T01:25:49.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.045+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.049+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:25:49.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.049+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.053+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.053+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.053+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:25:49.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.057+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.057+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:25:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9643695742079963586', time=2024-09-05T03:21:15.412680+0000, chain.objs.size()=5 2024-09-05T01:25:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~8ygAkyF4GsTQk3sK0qmDyTPRcf0lo9N.1 2024-09-05T01:25:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~8ygAkyF4GsTQk3sK0qmDyTPRcf0lo9N.2 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~8ygAkyF4GsTQk3sK0qmDyTPRcf0lo9N.3 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~8ygAkyF4GsTQk3sK0qmDyTPRcf0lo9N.4 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~8ygAkyF4GsTQk3sK0qmDyTPRcf0lo9N.5 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.427548714947071685', time=2024-09-05T03:22:34.744536+0000, chain.objs.size()=1 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__shadow_.gf_2B_ETjGlVA8G_N-76uEv4kWkqHZj_0 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3739716645995786700', time=2024-09-05T03:24:53.745196+0000, chain.objs.size()=5 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__multipart_key1.2~NUDSYIuRZji8DrJtZpsVHcOvutfN6PX.1 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__multipart_key1.2~NUDSYIuRZji8DrJtZpsVHcOvutfN6PX.2 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__multipart_key1.2~NUDSYIuRZji8DrJtZpsVHcOvutfN6PX.3 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__multipart_key1.2~NUDSYIuRZji8DrJtZpsVHcOvutfN6PX.4 2024-09-05T01:25:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.061+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__multipart_key1.2~NUDSYIuRZji8DrJtZpsVHcOvutfN6PX.5 2024-09-05T01:25:49.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.069+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.073+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:25:49.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.077+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.077+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.077+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.081+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:25:49.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9925355087493765979', time=2024-09-05T03:21:56.789303+0000, chain.objs.size()=5 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.51__multipart_key1.2~aXdvTivqzufhfuG_qUI6gSC8_qXNWv6.1 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.51__multipart_key1.2~aXdvTivqzufhfuG_qUI6gSC8_qXNWv6.2 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.51__multipart_key1.2~aXdvTivqzufhfuG_qUI6gSC8_qXNWv6.3 2024-09-05T01:25:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.51__multipart_key1.2~aXdvTivqzufhfuG_qUI6gSC8_qXNWv6.4 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.51__multipart_key1.2~aXdvTivqzufhfuG_qUI6gSC8_qXNWv6.5 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3136188601216350009', time=2024-09-05T03:25:02.326918+0000, chain.objs.size()=5 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.57__multipart_key1.2~Apr_dnjm4ngebVFfoCzyVC5KM0wbM6K.1 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.57__multipart_key1.2~Apr_dnjm4ngebVFfoCzyVC5KM0wbM6K.2 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.57__multipart_key1.2~Apr_dnjm4ngebVFfoCzyVC5KM0wbM6K.3 2024-09-05T01:25:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.57__multipart_key1.2~Apr_dnjm4ngebVFfoCzyVC5KM0wbM6K.4 2024-09-05T01:25:49.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.085+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.57__multipart_key1.2~Apr_dnjm4ngebVFfoCzyVC5KM0wbM6K.5 2024-09-05T01:25:49.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.093+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.101+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:25:49.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.101+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16157320607071937439', time=2024-09-05T03:20:36.060125+0000, chain.objs.size()=5 2024-09-05T01:25:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.42__multipart_key1.2~tzwgs3dbuL3DgOQ356FOTnSJTS0ZSc3.1 2024-09-05T01:25:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.42__multipart_key1.2~tzwgs3dbuL3DgOQ356FOTnSJTS0ZSc3.2 2024-09-05T01:25:49.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.42__multipart_key1.2~tzwgs3dbuL3DgOQ356FOTnSJTS0ZSc3.3 2024-09-05T01:25:49.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.42__multipart_key1.2~tzwgs3dbuL3DgOQ356FOTnSJTS0ZSc3.4 2024-09-05T01:25:49.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.42__multipart_key1.2~tzwgs3dbuL3DgOQ356FOTnSJTS0ZSc3.5 2024-09-05T01:25:49.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7099608593431985775', time=2024-09-05T03:22:34.496215+0000, chain.objs.size()=1 2024-09-05T01:25:49.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.105+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__shadow_.N6ArHieK_RTchIK_75u5wrCFDXCHnwO_0 2024-09-05T01:25:49.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.113+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.117+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:25:49.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.117+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.121+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.121+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.121+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12605851256617112430', time=2024-09-05T03:22:34.657470+0000, chain.objs.size()=1 2024-09-05T01:25:49.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.121+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__shadow_.BzgqGoCVG1EbEIFobtCShTG0NaHNZA3_0 2024-09-05T01:25:49.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.121+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.125+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:25:49.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.129+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.550083340589877966', time=2024-09-05T03:22:34.403987+0000, chain.objs.size()=5 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file.mpg.2~NtsCSq73Q-q-xMtLfBfqHwb1m5u0BLm.1 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file.mpg.2~NtsCSq73Q-q-xMtLfBfqHwb1m5u0BLm.2 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file.mpg.2~NtsCSq73Q-q-xMtLfBfqHwb1m5u0BLm.3 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file.mpg.2~NtsCSq73Q-q-xMtLfBfqHwb1m5u0BLm.4 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file.mpg.2~NtsCSq73Q-q-xMtLfBfqHwb1m5u0BLm.5 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10967849840839491423', time=2024-09-05T03:25:26.936046+0000, chain.objs.size()=1 2024-09-05T01:25:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.133+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.64__shadow_.WMgfqo5K-yhpqs7d0oN-G9iDrx_rdPh_0 2024-09-05T01:25:49.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.141+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.145+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:25:49.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.149+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10140932386488961990', time=2024-09-05T03:21:43.539083+0000, chain.objs.size()=5 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~KPVlbqZ1yWcnnUL7OYRNABk7mG2NukB.1 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~KPVlbqZ1yWcnnUL7OYRNABk7mG2NukB.1_1 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~KPVlbqZ1yWcnnUL7OYRNABk7mG2NukB.2 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__shadow_key1.2~KPVlbqZ1yWcnnUL7OYRNABk7mG2NukB.2_1 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.47__multipart_key1.2~KPVlbqZ1yWcnnUL7OYRNABk7mG2NukB.3 2024-09-05T01:25:49.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14216047650430263719', time=2024-09-05T03:24:08.552988+0000, chain.objs.size()=10 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.1 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.2 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.3 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.4 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.5 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.6 2024-09-05T01:25:49.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.153+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.7 2024-09-05T01:25:49.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.161+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.8 2024-09-05T01:25:49.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.161+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.9 2024-09-05T01:25:49.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.161+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~evrXNw7IiVlops0EwFL8NrlFeyYBM8u.10 2024-09-05T01:25:49.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.161+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2800208942663251777', time=2024-09-05T03:25:22.399181+0000, chain.objs.size()=1 2024-09-05T01:25:49.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.161+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.60__shadow_.Eoe4ErbO8WbIqssj57hXkqZo77BS5Z3_0 2024-09-05T01:25:49.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.169+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.173+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:25:49.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.177+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.177+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4ZFk4fLPNQW5yoUCovD5xzY4f2dXAxF', time=2024-09-05T03:22:39.789640+0000, chain.objs.size()=3 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.54__multipart_key1.2~4ZFk4fLPNQW5yoUCovD5xzY4f2dXAxF.7 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.54__multipart_key1.2~4ZFk4fLPNQW5yoUCovD5xzY4f2dXAxF.10 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.54__multipart_key1.2~4ZFk4fLPNQW5yoUCovD5xzY4f2dXAxF.13 2024-09-05T01:25:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13937311231375716791', time=2024-09-05T03:24:25.492273+0000, chain.objs.size()=11 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.1 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.1_1 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.2 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.2_1 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.3 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.3_1 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.4 2024-09-05T01:25:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.4_1 2024-09-05T01:25:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.181+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.5 2024-09-05T01:25:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.185+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.5_1 2024-09-05T01:25:49.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.193+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~r6a1p-mhgG7barRJ4fVsaXG0ZwHoYfR.6 2024-09-05T01:25:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.201+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.205+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:25:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.209+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.209+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.209+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.213+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:25:49.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15797008982399687675', time=2024-09-05T03:22:34.572127+0000, chain.objs.size()=5 2024-09-05T01:25:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file2.mpg.2~unRDs-_L0wrjcz9yrCU4MFvWdrXlD5B.1 2024-09-05T01:25:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file2.mpg.2~unRDs-_L0wrjcz9yrCU4MFvWdrXlD5B.2 2024-09-05T01:25:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file2.mpg.2~unRDs-_L0wrjcz9yrCU4MFvWdrXlD5B.3 2024-09-05T01:25:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file2.mpg.2~unRDs-_L0wrjcz9yrCU4MFvWdrXlD5B.4 2024-09-05T01:25:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.217+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.53__multipart_file2.mpg.2~unRDs-_L0wrjcz9yrCU4MFvWdrXlD5B.5 2024-09-05T01:25:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.225+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.229+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:25:49.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.233+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.233+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.233+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.237+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:25:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.893121289814809545', time=2024-09-05T03:25:21.263110+0000, chain.objs.size()=1 2024-09-05T01:25:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.59__shadow_.gjV482Iiq9BUauwwIykq88iXmcOcIZA_0 2024-09-05T01:25:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9578848164821860560', time=2024-09-05T03:25:24.667121+0000, chain.objs.size()=1 2024-09-05T01:25:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.241+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.62__shadow_.MHm2jas_MVjK-vnCdztNxJbHyQO784j_0 2024-09-05T01:25:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.245+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.249+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:25:49.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-05T01:25:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16866342253655955240', time=2024-09-05T03:20:47.327113+0000, chain.objs.size()=5 2024-09-05T01:25:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.1 2024-09-05T01:25:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.2 2024-09-05T01:25:49.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.3 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.4 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.5 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9839668773581101896', time=2024-09-05T03:21:44.600649+0000, chain.objs.size()=4 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.46__shadow_.gzoOtptUpfP5Zlk_TsEPC0gMrLPIPZw_0 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.46__shadow_.gzoOtptUpfP5Zlk_TsEPC0gMrLPIPZw_1 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.46__shadow_.gzoOtptUpfP5Zlk_TsEPC0gMrLPIPZw_2 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.46__shadow_.gzoOtptUpfP5Zlk_TsEPC0gMrLPIPZw_3 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9045050600078343135', time=2024-09-05T03:23:51.934364+0000, chain.objs.size()=11 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.1 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.2 2024-09-05T01:25:49.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.253+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.3 2024-09-05T01:25:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.261+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.4 2024-09-05T01:25:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.261+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.5 2024-09-05T01:25:49.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.261+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.6 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.7 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.8 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.9 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.10 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~7X-ZUQoTEFuPA8wdgMG5BppWpgO8jQ7.11 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5877413954981318470', time=2024-09-05T03:24:51.852838+0000, chain.objs.size()=1 2024-09-05T01:25:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.265+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.56__shadow_.hcIk0qCWDeYZkYWAU83plfuHZInNJ_-_0 2024-09-05T01:25:49.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.273+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.277+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:25:49.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.281+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.281+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.285+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.285+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:25:49.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.289+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.289+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12480810871610565911', time=2024-09-05T03:24:43.299573+0000, chain.objs.size()=11 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.1 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.1_1 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.2 2024-09-05T01:25:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.2_1 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.3 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.3_1 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.4 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.4_1 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.5 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__shadow_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.5_1 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~phzcQbRhEnTkCh7lEiAbYXrxaAWkow2.6 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116597527777564640', time=2024-09-05T03:25:25.789597+0000, chain.objs.size()=1 2024-09-05T01:25:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.293+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.63__shadow_.1b2S4lfSFe9u4mia6RWqSZZW2mGzwCw_0 2024-09-05T01:25:49.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.301+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.309+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:25:49.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.313+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.313+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.313+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.313+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:25:49.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.317+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.317+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6027823583185889993', time=2024-09-05T03:25:47.133826+0000, chain.objs.size()=11 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.1 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.2 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.3 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.4 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.5 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.6 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.7 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.8 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.9 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.10 2024-09-05T01:25:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.321+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.66__multipart_key1.2~peBwOR7OzmFMvF0seyv7GGHyh-oTFFt.11 2024-09-05T01:25:49.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.329+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.333+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:25:49.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.337+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4100209489641263322', time=2024-09-05T03:20:48.051848+0000, chain.objs.size()=5 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.1 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.2 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.3 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.4 2024-09-05T01:25:49.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.341+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.44__multipart_key1.2~rn6XENiAPqzEvGsYLjgVCAXqtK4of13.5 2024-09-05T01:25:49.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.349+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.353+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:25:49.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.357+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.357+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.357+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.361+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:25:49.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.361+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12105362972249501951', time=2024-09-05T03:23:14.091661+0000, chain.objs.size()=11 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.1 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.2 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.3 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.4 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.5 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.6 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.7 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.8 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.9 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.10 2024-09-05T01:25:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.365+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55__multipart_key1.2~UzBrBW9BTYYbCjxBdFX3COLLiGfoy9_.11 2024-09-05T01:25:49.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.377+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.381+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:25:49.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.385+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.385+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.389+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.389+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:25:49.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.393+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.393+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.393+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.397+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:25:49.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 20 garbage collection: RGWGC::process iterating over entry tag='2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V', time=2024-09-05T03:20:23.327726+0000, chain.objs.size()=5 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.40__multipart_key1.2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V.1 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.40__multipart_key1.2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V.2 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.40__multipart_key1.2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V.3 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.40__multipart_key1.2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V.4 2024-09-05T01:25:49.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.401+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.40__multipart_key1.2~X7_x-h1c0sOBhhuG3fl4XL0JSLwqa4V.5 2024-09-05T01:25:49.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.413+0000 7f7ff50909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:25:49.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.417+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:25:49.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.421+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.421+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.421+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.425+0000 7f7ff50909c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:25:49.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.429+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.433+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.433+0000 7f7ff50909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.437+0000 7f7ea97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:49.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.441+0000 7f7ff50909c0 20 remove_watcher() i=0 2024-09-05T01:25:49.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.441+0000 7f7ff50909c0 2 removed watcher, disabling cache 2024-09-05T01:25:49.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.445+0000 7f7ff50909c0 20 remove_watcher() i=1 2024-09-05T01:25:49.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.445+0000 7f7ff50909c0 20 remove_watcher() i=2 2024-09-05T01:25:49.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.449+0000 7f7ff50909c0 20 remove_watcher() i=3 2024-09-05T01:25:49.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.449+0000 7f7ff50909c0 20 remove_watcher() i=4 2024-09-05T01:25:49.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.453+0000 7f7ff50909c0 20 remove_watcher() i=5 2024-09-05T01:25:49.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.453+0000 7f7ff50909c0 20 remove_watcher() i=6 2024-09-05T01:25:49.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.457+0000 7f7ff50909c0 20 remove_watcher() i=7 2024-09-05T01:25:49.476 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:25:49.547 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:25:49.548 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:25:49.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.589+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 realm 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:49.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:25:49.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.593+0000 7f3fc4d999c0 20 searching for the correct realm 2024-09-05T01:25:49.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.597+0000 7f3fc30a0640 0 -- 172.21.15.99:0/993011565 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3fb80d8020 msgr2=0x7f3fb8105980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:49.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.813+0000 7f3fc30a0640 0 -- 172.21.15.99:0/993011565 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3fb80d8020 msgr2=0x7f3fb8105980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:49.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:25:49.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:25:49.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:25:49.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:25:49.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:25:49.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:25:49.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:49.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.825+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 zone default found 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 4 Realm: () 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:25:49.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:25:49.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 zonegroup default 2024-09-05T01:25:49.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:49.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:49.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 started sync module instance, tier type = 2024-09-05T01:25:49.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.829+0000 7f3fc4d999c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=0 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=1 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=2 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=3 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=4 2024-09-05T01:25:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=5 2024-09-05T01:25:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=6 2024-09-05T01:25:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 20 add_watcher() i=7 2024-09-05T01:25:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.853+0000 7f3fc4d999c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:25:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.857+0000 7f3e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:49.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.861+0000 7f3fc4d999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:25:49.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.861+0000 7f3fc4d999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:25:49.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.945+0000 7f3df3fff640 20 reqs_thread_entry: start 2024-09-05T01:25:49.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.945+0000 7f3fc4d999c0 20 init_complete bucket index max shards: 11 2024-09-05T01:25:49.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.945+0000 7f3fc4d999c0 20 Filter name: none 2024-09-05T01:25:49.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.945+0000 7f3df1ffb640 20 reqs_thread_entry: start 2024-09-05T01:25:49.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.945+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:25:49.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.949+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.949+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.949+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.953+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:25:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.957+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.957+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.957+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.961+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:25:49.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.961+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.965+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.965+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.965+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:25:49.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.969+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.969+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.969+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.973+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:25:49.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.977+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.977+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.977+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.977+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:25:49.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.981+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.981+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.981+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.985+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:25:49.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.989+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.989+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.989+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.989+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:25:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.993+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.997+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.997+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:49.997+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:25:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.001+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.001+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.001+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.005+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:25:50.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.009+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.009+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.009+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.013+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:25:50.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.013+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.017+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.017+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.017+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:25:50.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.021+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.021+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.021+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.021+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:25:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.025+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.025+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.029+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.029+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:25:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.033+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.033+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.033+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.033+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:25:50.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.037+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.037+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.037+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.037+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:25:50.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.041+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.041+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.041+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.045+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:25:50.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.049+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.049+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.053+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.053+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:25:50.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.057+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.057+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.057+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.057+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:25:50.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.061+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.061+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.065+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.065+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:25:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.069+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.069+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.069+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.069+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:25:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.073+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.077+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.077+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.077+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:25:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.081+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.081+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.085+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.085+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:25:50.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.089+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.093+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.093+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.093+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:25:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.097+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.097+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.097+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.097+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:25:50.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.101+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.105+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.105+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.105+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:25:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.109+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.109+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.109+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.109+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:25:50.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.113+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.113+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.117+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.117+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:25:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.121+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.121+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.121+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.125+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:25:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.129+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.129+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.129+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.133+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:25:50.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.133+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.137+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.137+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.137+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:25:50.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.141+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.141+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.141+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.145+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:25:50.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.149+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.149+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.149+0000 7f3fc4d999c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.153+0000 7f3e797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:50.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.157+0000 7f3fc4d999c0 20 remove_watcher() i=0 2024-09-05T01:25:50.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.157+0000 7f3fc4d999c0 2 removed watcher, disabling cache 2024-09-05T01:25:50.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.157+0000 7f3fc4d999c0 20 remove_watcher() i=1 2024-09-05T01:25:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.161+0000 7f3fc4d999c0 20 remove_watcher() i=2 2024-09-05T01:25:50.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.161+0000 7f3fc4d999c0 20 remove_watcher() i=3 2024-09-05T01:25:50.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.165+0000 7f3fc4d999c0 20 remove_watcher() i=4 2024-09-05T01:25:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.165+0000 7f3fc4d999c0 20 remove_watcher() i=5 2024-09-05T01:25:50.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.169+0000 7f3fc4d999c0 20 remove_watcher() i=6 2024-09-05T01:25:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.169+0000 7f3fc4d999c0 20 remove_watcher() i=7 2024-09-05T01:25:50.188 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:25:50.259 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:25:50.260 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:25:50.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 realm 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.305+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.309+0000 7fe18cae59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:25:50.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.309+0000 7fe18cae59c0 20 searching for the correct realm 2024-09-05T01:25:50.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.313+0000 7fe18adec640 0 -- 172.21.15.99:0/359225328 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55b6970cd610 msgr2=0x55b6970cfad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:25:50.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.321+0000 7fe18a5eb640 0 -- 172.21.15.99:0/359225328 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fe184008040 msgr2=0x7fe18402b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:25:50.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.325+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 zone default found 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 4 Realm: () 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 zonegroup default 2024-09-05T01:25:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 started sync module instance, tier type = 2024-09-05T01:25:50.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.329+0000 7fe18cae59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=0 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=1 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=2 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=3 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=4 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=5 2024-09-05T01:25:50.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=6 2024-09-05T01:25:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 20 add_watcher() i=7 2024-09-05T01:25:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.345+0000 7fe18cae59c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:25:50.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.349+0000 7fe040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:50.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.349+0000 7fe18cae59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:25:50.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.349+0000 7fe18cae59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:25:50.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.425+0000 7fdfbb7fe640 20 reqs_thread_entry: start 2024-09-05T01:25:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.425+0000 7fe18cae59c0 20 init_complete bucket index max shards: 11 2024-09-05T01:25:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.425+0000 7fe18cae59c0 20 Filter name: none 2024-09-05T01:25:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.425+0000 7fdfb97fa640 20 reqs_thread_entry: start 2024-09-05T01:25:50.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.425+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:25:50.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.429+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.429+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.433+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.433+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:25:50.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.437+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.437+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.437+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.441+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:25:50.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.441+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.445+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.445+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.449+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:25:50.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.449+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.453+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.453+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.457+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:25:50.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.461+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.461+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.461+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.465+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:25:50.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.469+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.469+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.469+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.469+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:25:50.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.473+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.473+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.473+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.477+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:25:50.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.481+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.481+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.481+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.481+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:25:50.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.485+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.485+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.485+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.489+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:25:50.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.493+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.493+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.493+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.497+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:25:50.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.501+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.501+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.501+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.505+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:25:50.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.509+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.509+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.509+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.509+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:25:50.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.513+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.517+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.517+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.517+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:25:50.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.521+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.521+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.521+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.525+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:25:50.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.529+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.529+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.529+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.533+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:25:50.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.537+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.537+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.537+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.541+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:25:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.545+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.545+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.545+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.549+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:25:50.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.553+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.553+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.553+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.557+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:25:50.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.561+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.561+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.561+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.565+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:25:50.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.569+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.569+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.569+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.573+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:25:50.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.577+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.577+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.577+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.581+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:25:50.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.585+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.585+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.585+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.589+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:25:50.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.593+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.593+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.593+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.597+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:25:50.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.601+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.601+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.601+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.605+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:25:50.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.609+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.609+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.609+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.613+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:25:50.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.613+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.613+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.617+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.617+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:25:50.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.621+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.621+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.621+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.625+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:25:50.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.629+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.629+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.629+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.633+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:25:50.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.633+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.637+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.637+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.637+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:25:50.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.641+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.645+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.645+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.645+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:25:50.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.649+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.653+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.653+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.657+0000 7fe18cae59c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:25:50.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.661+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.661+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.661+0000 7fe18cae59c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.665+0000 7fe040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:50.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.673+0000 7fe18cae59c0 20 remove_watcher() i=0 2024-09-05T01:25:50.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.673+0000 7fe18cae59c0 2 removed watcher, disabling cache 2024-09-05T01:25:50.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.673+0000 7fe18cae59c0 20 remove_watcher() i=1 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.677+0000 7fe18cae59c0 20 remove_watcher() i=2 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.681+0000 7fe18cae59c0 20 remove_watcher() i=3 2024-09-05T01:25:50.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.681+0000 7fe18cae59c0 20 remove_watcher() i=4 2024-09-05T01:25:50.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.685+0000 7fe18cae59c0 20 remove_watcher() i=5 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.685+0000 7fe18cae59c0 20 remove_watcher() i=6 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.689+0000 7fe18cae59c0 20 remove_watcher() i=7 2024-09-05T01:25:50.711 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:25:50.784 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:25:50.784 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:25:50.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.825+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 realm 2024-09-05T01:25:50.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:25:50.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:50.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:25:50.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.829+0000 7fe4612b79c0 20 searching for the correct realm 2024-09-05T01:25:50.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.837+0000 7fe45edbd640 0 -- 172.21.15.99:0/808290979 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fe450008040 msgr2=0x7fe450008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:25:50.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.845+0000 7fe45edbd640 0 -- 172.21.15.99:0/808290979 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fe450035910 msgr2=0x7fe450018400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:25:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:25:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:25:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 zone default found 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 4 Realm: () 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 zonegroup default 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados->read ofs=0 len=0 2024-09-05T01:25:50.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:25:50.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 started sync module instance, tier type = 2024-09-05T01:25:50.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.853+0000 7fe4612b79c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:25:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=0 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=1 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=2 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=3 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=4 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=5 2024-09-05T01:25:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.869+0000 7fe4612b79c0 20 add_watcher() i=6 2024-09-05T01:25:50.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.873+0000 7fe4612b79c0 20 add_watcher() i=7 2024-09-05T01:25:50.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.873+0000 7fe4612b79c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:25:50.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.873+0000 7fe315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:50.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.873+0000 7fe4612b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:25:50.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.873+0000 7fe4612b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:25:50.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.945+0000 7fe314fe1640 20 reqs_thread_entry: start 2024-09-05T01:25:50.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.945+0000 7fe4612b79c0 20 init_complete bucket index max shards: 11 2024-09-05T01:25:50.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.945+0000 7fe4612b79c0 20 Filter name: none 2024-09-05T01:25:50.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.945+0000 7fe30dffb640 20 reqs_thread_entry: start 2024-09-05T01:25:50.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.945+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:25:50.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.949+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.949+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.949+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.953+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:25:50.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.953+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.957+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.957+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.961+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:25:50.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.961+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.961+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.961+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.965+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:25:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.969+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.969+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.969+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.973+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:25:50.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.981+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.981+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.985+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.985+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:25:50.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.989+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.993+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:50.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.993+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:50.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.997+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:25:50.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.997+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:50.997+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.001+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.001+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:25:51.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.005+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.005+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.005+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.009+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:25:51.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.013+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.013+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.013+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.013+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:25:51.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.017+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.017+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.017+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.021+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:25:51.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.025+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.025+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.025+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.029+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:25:51.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.033+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.033+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.033+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.037+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:25:51.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.041+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.041+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.041+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.045+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:25:51.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.049+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.049+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.049+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.053+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:25:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.053+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.053+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.053+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.057+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:25:51.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.061+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.061+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.065+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.065+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:25:51.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.069+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.073+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.073+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.077+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:25:51.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.077+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.081+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.081+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.081+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:25:51.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.085+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.085+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.089+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.089+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:25:51.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.093+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.093+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.093+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.097+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:25:51.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.101+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.101+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.101+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.105+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:25:51.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.105+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.109+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.109+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.109+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:25:51.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.113+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.117+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.117+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.117+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:25:51.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.121+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.121+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.121+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.125+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:25:51.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.129+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.129+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.129+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.133+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:25:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.133+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.137+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.137+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.137+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:25:51.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.141+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.141+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.141+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.145+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:25:51.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.149+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.149+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.149+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.153+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:25:51.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.153+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.157+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.157+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.157+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:25:51.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.161+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.161+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.161+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.165+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:25:51.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.169+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.169+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.169+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.173+0000 7fe4612b79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:25:51.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.173+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.177+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:25:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.177+0000 7fe4612b79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:25:51.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.181+0000 7fe315fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:25:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.185+0000 7fe4612b79c0 20 remove_watcher() i=0 2024-09-05T01:25:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.185+0000 7fe4612b79c0 2 removed watcher, disabling cache 2024-09-05T01:25:51.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.189+0000 7fe4612b79c0 20 remove_watcher() i=1 2024-09-05T01:25:51.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.193+0000 7fe4612b79c0 20 remove_watcher() i=2 2024-09-05T01:25:51.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.193+0000 7fe4612b79c0 20 remove_watcher() i=3 2024-09-05T01:25:51.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.197+0000 7fe4612b79c0 20 remove_watcher() i=4 2024-09-05T01:25:51.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.197+0000 7fe4612b79c0 20 remove_watcher() i=5 2024-09-05T01:25:51.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.201+0000 7fe4612b79c0 20 remove_watcher() i=6 2024-09-05T01:25:51.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:25:51.201+0000 7fe4612b79c0 20 remove_watcher() i=7 2024-09-05T01:25:51.222 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-05T01:25:51.968 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean 2024-09-05T01:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-09-05T01:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-09-05T01:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-09-05T01:25:53.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:53.265 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-09-05T01:25:53.266 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-05T01:25:53.266 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-05T01:25:53.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:53.266 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-09-05T01:25:53.266 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-09-05T01:25:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.265 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-09-05T01:25:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.265 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests STANDARD_OUT 2024-09-05T01:25:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05 01:25:54,642 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-05T01:25:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.266 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-05T01:25:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.267 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-05T01:25:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.565 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-05T01:25:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:55.665 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-05T01:25:56.365 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:56.365 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-05T01:25:56.464 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:56.465 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-05T01:25:57.165 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:57.165 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-05T01:25:57.665 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:57.665 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-05T01:25:57.865 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:57.865 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-05T01:25:58.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:58.265 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-05T01:25:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:59.068 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-05T01:25:59.068 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:59.068 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-05T01:25:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:59.265 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-05T01:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-05T01:26:00.965 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:00.965 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-05T01:26:01.165 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:01.165 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-05T01:26:01.864 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:01.865 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-05T01:26:01.965 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:01.965 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-05T01:26:02.128 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:02.128 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------- 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------- 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 10s 2024-09-05T01:26:02.129 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 5 executed 2024-09-05T01:26:02.137 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:26:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:26:02.165 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:26:02.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.205+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 realm 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:02.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.209+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.213+0000 7ff82914c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:26:02.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.213+0000 7ff82914c9c0 20 searching for the correct realm 2024-09-05T01:26:02.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.217+0000 7ff827453640 0 -- 172.21.15.99:0/75364434 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff81c008040 msgr2=0x7ff81c02f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:02.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.225+0000 7ff827453640 0 -- 172.21.15.99:0/75364434 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff6f0080900 msgr2=0x7ff6f0082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.229+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 zone default found 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 4 Realm: () 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 zonegroup default 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 started sync module instance, tier type = 2024-09-05T01:26:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.233+0000 7ff82914c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:26:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=0 2024-09-05T01:26:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=1 2024-09-05T01:26:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=2 2024-09-05T01:26:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=3 2024-09-05T01:26:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=4 2024-09-05T01:26:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=5 2024-09-05T01:26:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=6 2024-09-05T01:26:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 20 add_watcher() i=7 2024-09-05T01:26:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.249+0000 7ff82914c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:26:02.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.253+0000 7ff6dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.253+0000 7ff82914c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:26:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.253+0000 7ff82914c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:26:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.321+0000 7ff657fff640 20 reqs_thread_entry: start 2024-09-05T01:26:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.321+0000 7ff82914c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:26:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.321+0000 7ff82914c9c0 20 Filter name: none 2024-09-05T01:26:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.321+0000 7ff655ffb640 20 reqs_thread_entry: start 2024-09-05T01:26:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.321+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:26:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.325+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.325+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.325+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.329+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:26:02.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.329+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.333+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.333+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.333+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:26:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.341+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.341+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.341+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.341+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:26:02.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.345+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.349+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.349+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.349+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:26:02.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.353+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.353+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.353+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.357+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:26:02.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.361+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.361+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.361+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.365+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:26:02.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.365+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.369+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.369+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:26:02.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.369+0000 7ff82914c9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4065772591137442907', time=2024-09-05T03:25:58.433034+0000, chain.objs.size()=1 2024-09-05T01:26:02.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.369+0000 7ff82914c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.71__shadow_.Uf7aldD3JxEVkOuk3ONXorTFT5Evant_0 2024-09-05T01:26:02.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.369+0000 7ff82914c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:26:02.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.373+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:26:02.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.377+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.377+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.377+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.377+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:26:02.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.381+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.385+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.385+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.389+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:26:02.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.389+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.389+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.389+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.393+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:26:02.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.397+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.397+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.397+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.397+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:26:02.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.401+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.401+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.405+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.405+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:26:02.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.409+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.413+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.413+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.417+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:26:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.417+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.421+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.421+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.421+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:26:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.425+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.429+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.429+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.429+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:26:02.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.433+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.437+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.437+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.437+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:26:02.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.441+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.445+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.445+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.449+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:26:02.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.449+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.453+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.453+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.461+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:26:02.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.465+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.465+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.465+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.465+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:26:02.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.469+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.469+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.469+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.469+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:26:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.473+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.477+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.477+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:26:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.477+0000 7ff82914c9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7499451138007922978', time=2024-09-05T03:26:00.352109+0000, chain.objs.size()=1 2024-09-05T01:26:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.477+0000 7ff82914c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.72__shadow_.ro2LvIffNPoqXcEoKzxHFFApWgQh9FL_0 2024-09-05T01:26:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.481+0000 7ff82914c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:26:02.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.489+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:26:02.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.493+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.493+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.493+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.493+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:26:02.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.497+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.501+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.501+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.501+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:26:02.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.505+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.509+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.509+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.509+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:26:02.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.513+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.517+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.517+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.525+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:26:02.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.525+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.525+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.525+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.529+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:26:02.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.533+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.533+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.533+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.537+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:26:02.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.541+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.541+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.541+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.545+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:26:02.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.549+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.549+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.549+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.553+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:26:02.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.557+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.557+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.561+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.561+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:26:02.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.565+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.569+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.569+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.569+0000 7ff82914c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:26:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.573+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.577+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.577+0000 7ff82914c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.581+0000 7ff6dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:02.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.589+0000 7ff82914c9c0 20 remove_watcher() i=0 2024-09-05T01:26:02.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.589+0000 7ff82914c9c0 2 removed watcher, disabling cache 2024-09-05T01:26:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.589+0000 7ff82914c9c0 20 remove_watcher() i=1 2024-09-05T01:26:02.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.593+0000 7ff82914c9c0 20 remove_watcher() i=2 2024-09-05T01:26:02.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.597+0000 7ff82914c9c0 20 remove_watcher() i=3 2024-09-05T01:26:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.597+0000 7ff82914c9c0 20 remove_watcher() i=4 2024-09-05T01:26:02.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.601+0000 7ff82914c9c0 20 remove_watcher() i=5 2024-09-05T01:26:02.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.605+0000 7ff82914c9c0 20 remove_watcher() i=6 2024-09-05T01:26:02.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.605+0000 7ff82914c9c0 20 remove_watcher() i=7 2024-09-05T01:26:02.627 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:26:02.699 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:26:02.700 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:26:02.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 realm 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:26:02.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.745+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.749+0000 7f28559e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.749+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.749+0000 7f28559e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:26:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.749+0000 7f28559e99c0 20 searching for the correct realm 2024-09-05T01:26:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.749+0000 7f2852cee640 0 -- 172.21.15.99:0/141034901 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f284403a060 msgr2=0x7f2844063960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:26:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.757+0000 7f28534ef640 0 -- 172.21.15.99:0/141034901 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f284c126040 msgr2=0x7f284c0f6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 zone default found 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 4 Realm: () 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 zonegroup default 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 started sync module instance, tier type = 2024-09-05T01:26:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.769+0000 7f28559e99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=0 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=1 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=2 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=3 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=4 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=5 2024-09-05T01:26:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.785+0000 7f28559e99c0 20 add_watcher() i=6 2024-09-05T01:26:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.789+0000 7f28559e99c0 20 add_watcher() i=7 2024-09-05T01:26:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.789+0000 7f28559e99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:26:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.789+0000 7f270a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.793+0000 7f28559e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:26:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.793+0000 7f28559e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:26:02.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f27097e2640 20 reqs_thread_entry: start 2024-09-05T01:26:02.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f28559e99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:26:02.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f28559e99c0 20 Filter name: none 2024-09-05T01:26:02.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f27027fc640 20 reqs_thread_entry: start 2024-09-05T01:26:02.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:26:02.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.869+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.873+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.873+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.873+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:26:02.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.877+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.881+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.881+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.881+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:26:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.885+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.889+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.889+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.893+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:26:02.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.893+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.893+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.893+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.893+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:26:02.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.897+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.897+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.901+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.901+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:26:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.905+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.905+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.905+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.909+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:26:02.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.909+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.909+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.909+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.913+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:26:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.917+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.917+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.917+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.917+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:26:02.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.921+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.925+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.925+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.929+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:26:02.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.933+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.933+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.933+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.937+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:26:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.937+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.941+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.941+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.941+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:26:02.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.945+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.945+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.945+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.949+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:26:02.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.953+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.953+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.953+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.953+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:26:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.957+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.957+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.961+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.961+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:26:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.965+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.965+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.965+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.969+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:26:02.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.969+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.973+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.973+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.973+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:26:02.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.977+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.981+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.981+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.981+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:26:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.985+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.989+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.989+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.993+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:26:02.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.993+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:02.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.997+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:02.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.997+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:02.997+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:26:03.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.001+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.005+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.005+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.009+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:26:03.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.013+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.013+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.013+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.017+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:26:03.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.021+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.021+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.025+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.025+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:26:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.029+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.033+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.033+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.033+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:26:03.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.037+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.045+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.045+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.049+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:26:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.049+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.049+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.049+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.049+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:26:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.053+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.057+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.057+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.065+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:26:03.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.065+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.065+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.065+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.065+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:26:03.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.069+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.073+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.073+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.077+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:26:03.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.081+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.081+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.089+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.089+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:26:03.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.089+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.097+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.097+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.101+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:26:03.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.101+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.101+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.101+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.105+0000 7f28559e99c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:26:03.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.109+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.109+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.109+0000 7f28559e99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.117+0000 7f270a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.121+0000 7f28559e99c0 20 remove_watcher() i=0 2024-09-05T01:26:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.121+0000 7f28559e99c0 2 removed watcher, disabling cache 2024-09-05T01:26:03.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.125+0000 7f28559e99c0 20 remove_watcher() i=1 2024-09-05T01:26:03.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.125+0000 7f28559e99c0 20 remove_watcher() i=2 2024-09-05T01:26:03.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.129+0000 7f28559e99c0 20 remove_watcher() i=3 2024-09-05T01:26:03.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.133+0000 7f28559e99c0 20 remove_watcher() i=4 2024-09-05T01:26:03.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.133+0000 7f28559e99c0 20 remove_watcher() i=5 2024-09-05T01:26:03.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.137+0000 7f28559e99c0 20 remove_watcher() i=6 2024-09-05T01:26:03.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.137+0000 7f28559e99c0 20 remove_watcher() i=7 2024-09-05T01:26:03.159 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:26:03.235 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:26:03.236 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:26:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 realm 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.285+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.289+0000 7f8ce04d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:03.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.289+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.289+0000 7f8ce04d29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:26:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.289+0000 7f8ce04d29c0 20 searching for the correct realm 2024-09-05T01:26:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.293+0000 7f8cddfd8640 0 -- 172.21.15.99:0/60844675 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f8cd8008040 msgr2=0x7f8cd805fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.301+0000 7f8cddfd8640 0 -- 172.21.15.99:0/60844675 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f8ba8080900 msgr2=0x7f8ba8082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:26:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:26:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.309+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 zone default found 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 4 Realm: () 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 zonegroup default 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 started sync module instance, tier type = 2024-09-05T01:26:03.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.313+0000 7f8ce04d29c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=0 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=1 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=2 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=3 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=4 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=5 2024-09-05T01:26:03.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=6 2024-09-05T01:26:03.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 20 add_watcher() i=7 2024-09-05T01:26:03.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.329+0000 7f8ce04d29c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:26:03.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.333+0000 7f8b8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:03.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.333+0000 7f8ce04d29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:26:03.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.333+0000 7f8ce04d29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:26:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.405+0000 7f8b8e7fc640 20 reqs_thread_entry: start 2024-09-05T01:26:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.405+0000 7f8ce04d29c0 20 init_complete bucket index max shards: 11 2024-09-05T01:26:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.405+0000 7f8ce04d29c0 20 Filter name: none 2024-09-05T01:26:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.405+0000 7f8afffff640 20 reqs_thread_entry: start 2024-09-05T01:26:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.405+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:26:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.409+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.409+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.409+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.413+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:26:03.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.413+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.417+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.417+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.425+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:26:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.425+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.425+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.425+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.425+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:26:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.429+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.429+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.429+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.433+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:26:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.437+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.437+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.437+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.437+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:26:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.441+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.441+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.441+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.445+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:26:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.445+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.449+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.449+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.453+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:26:03.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.453+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.453+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.453+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.457+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:26:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.457+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.461+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.461+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.461+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:26:03.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.465+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.465+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.465+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.469+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:26:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.473+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.473+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.473+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.481+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:26:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.481+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.481+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.481+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.481+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:26:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.485+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.489+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.489+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.493+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:26:03.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.493+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.497+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.497+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.497+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:26:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.501+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.501+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.505+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.505+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:26:03.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.513+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.517+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.517+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.521+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:26:03.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.521+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.521+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.521+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.525+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:26:03.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.529+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.529+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.529+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.533+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:26:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.541+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.541+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.541+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.541+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:26:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.545+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.545+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.549+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.549+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:26:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.553+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.553+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.553+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.557+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:26:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.561+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.565+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.565+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.569+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:26:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.573+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.573+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.573+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.581+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:26:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.581+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.585+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.585+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.589+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:26:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.589+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.593+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.593+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.597+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:26:03.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.601+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.601+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.601+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.605+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:26:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.609+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.609+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.613+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.613+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:26:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.617+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.621+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.621+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.629+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:26:03.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.629+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.629+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.629+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.633+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:26:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.637+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.637+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.637+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.641+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:26:03.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.645+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.645+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.649+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.649+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:26:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.653+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.657+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.657+0000 7f8ce04d29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.661+0000 7f8b8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.665+0000 7f8ce04d29c0 20 remove_watcher() i=0 2024-09-05T01:26:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.665+0000 7f8ce04d29c0 2 removed watcher, disabling cache 2024-09-05T01:26:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.669+0000 7f8ce04d29c0 20 remove_watcher() i=1 2024-09-05T01:26:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.673+0000 7f8ce04d29c0 20 remove_watcher() i=2 2024-09-05T01:26:03.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.673+0000 7f8ce04d29c0 20 remove_watcher() i=3 2024-09-05T01:26:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.677+0000 7f8ce04d29c0 20 remove_watcher() i=4 2024-09-05T01:26:03.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.681+0000 7f8ce04d29c0 20 remove_watcher() i=5 2024-09-05T01:26:03.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.681+0000 7f8ce04d29c0 20 remove_watcher() i=6 2024-09-05T01:26:03.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.685+0000 7f8ce04d29c0 20 remove_watcher() i=7 2024-09-05T01:26:03.711 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:26:03.785 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:26:03.786 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:26:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 realm 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.829+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.833+0000 7ff42433b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.833+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.833+0000 7ff42433b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:26:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.833+0000 7ff42433b9c0 20 searching for the correct realm 2024-09-05T01:26:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:03.837+0000 7ff422642640 0 -- 172.21.15.99:0/165616721 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff418033040 msgr2=0x7ff418037a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.057+0000 7ff422642640 0 -- 172.21.15.99:0/165616721 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff418033040 msgr2=0x7ff418037a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:26:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:26:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:26:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 zone default found 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 4 Realm: () 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 zonegroup default 2024-09-05T01:26:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.069+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.073+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.073+0000 7ff42433b9c0 20 rados->read ofs=0 len=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.073+0000 7ff42433b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.073+0000 7ff42433b9c0 20 started sync module instance, tier type = 2024-09-05T01:26:04.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.073+0000 7ff42433b9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=0 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=1 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=2 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=3 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=4 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=5 2024-09-05T01:26:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=6 2024-09-05T01:26:04.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 20 add_watcher() i=7 2024-09-05T01:26:04.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.093+0000 7ff42433b9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:26:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.097+0000 7ff2d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:04.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.097+0000 7ff42433b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:26:04.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.097+0000 7ff42433b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:26:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.189+0000 7ff2d27fc640 20 reqs_thread_entry: start 2024-09-05T01:26:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.189+0000 7ff42433b9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:26:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.189+0000 7ff42433b9c0 20 Filter name: none 2024-09-05T01:26:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.189+0000 7ff243fff640 20 reqs_thread_entry: start 2024-09-05T01:26:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.189+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:26:04.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.193+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.193+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.193+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.193+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:26:04.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.197+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.201+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.201+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.201+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:26:04.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.205+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.209+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.209+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.213+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:26:04.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.213+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.213+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.217+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.217+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:26:04.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.221+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.221+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.221+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.225+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:26:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.225+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.229+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.229+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.229+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:26:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.233+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.237+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.237+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.241+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:26:04.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.245+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.245+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.245+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.249+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:26:04.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.253+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.253+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.253+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.253+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:26:04.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.257+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.261+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.261+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.265+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:26:04.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.265+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.269+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.269+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.269+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:26:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.273+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.273+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.273+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.277+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:26:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.281+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.281+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.285+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.285+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:26:04.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.289+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.289+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.293+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.293+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:26:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.297+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.297+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.297+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.301+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:26:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.305+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.305+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.305+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.309+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:26:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.313+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.313+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.313+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.317+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:26:04.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.317+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.321+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.321+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.321+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:26:04.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.325+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.329+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.329+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.329+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:26:04.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.333+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.333+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.333+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.337+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:26:04.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.341+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.341+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.341+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.345+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:26:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.345+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.349+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.349+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.353+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:26:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.353+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.357+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.357+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.361+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:26:04.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.365+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.365+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.365+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.369+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:26:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.373+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.373+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.373+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.377+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:26:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.381+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.381+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.381+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.385+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:26:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.389+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.389+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.389+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.393+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:26:04.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.397+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.401+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.401+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.405+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:26:04.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.409+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.409+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.409+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.413+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:26:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.417+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.417+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.421+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.421+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:26:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.425+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.429+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.429+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.429+0000 7ff42433b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:26:04.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.433+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.433+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:26:04.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.437+0000 7ff42433b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:26:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.441+0000 7ff2d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:26:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.449+0000 7ff42433b9c0 20 remove_watcher() i=0 2024-09-05T01:26:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.449+0000 7ff42433b9c0 2 removed watcher, disabling cache 2024-09-05T01:26:04.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.449+0000 7ff42433b9c0 20 remove_watcher() i=1 2024-09-05T01:26:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.453+0000 7ff42433b9c0 20 remove_watcher() i=2 2024-09-05T01:26:04.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.453+0000 7ff42433b9c0 20 remove_watcher() i=3 2024-09-05T01:26:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.457+0000 7ff42433b9c0 20 remove_watcher() i=4 2024-09-05T01:26:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.461+0000 7ff42433b9c0 20 remove_watcher() i=5 2024-09-05T01:26:04.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.461+0000 7ff42433b9c0 20 remove_watcher() i=6 2024-09-05T01:26:04.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:26:04.465+0000 7ff42433b9c0 20 remove_watcher() i=7 2024-09-05T01:26:04.483 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-05T01:26:05.187 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean 2024-09-05T01:26:05.985 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-09-05T01:26:05.985 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-09-05T01:26:05.985 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-09-05T01:26:06.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:06.385 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-09-05T01:26:06.385 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-05T01:26:06.386 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-05T01:26:06.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:06.386 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-09-05T01:26:06.386 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-09-05T01:26:08.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:08.385 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-09-05T01:26:08.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:08.386 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests STANDARD_OUT 2024-09-05T01:26:08.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05 01:26:07,809 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-05T01:26:08.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:08.387 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-05T01:26:08.387 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:08.387 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-05T01:26:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:09.485 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-05T01:26:09.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:09.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-05T01:26:10.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:10.485 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-05T01:26:10.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:10.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-05T01:26:11.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:11.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-05T01:26:15.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:15.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-05T01:26:16.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:16.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-05T01:26:16.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:16.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-05T01:26:16.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:16.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-05T01:26:17.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:17.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-05T01:26:18.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:18.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-05T01:26:18.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:18.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-05T01:26:18.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:18.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-05T01:26:18.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:18.485 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-05T01:26:19.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:19.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-05T01:26:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:21.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-05T01:26:22.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:22.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-05T01:26:22.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:22.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-05T01:26:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:23.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-05T01:26:23.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:23.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-05T01:26:24.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:24.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-05T01:26:24.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:24.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-05T01:26:24.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:24.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-05T01:26:25.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:25.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-05T01:26:25.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:25.886 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-05T01:26:26.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:26.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-05T01:26:26.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:26.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-05T01:26:27.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:27.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-05T01:26:27.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:27.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-05T01:26:28.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:28.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-05T01:26:28.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:28.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-05T01:26:32.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:32.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-05T01:26:34.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:26:34.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-05T01:27:25.586 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:25.586 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-05T01:27:26.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:26.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-05T01:27:26.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:26.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-05T01:27:27.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:27.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-05T01:27:27.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:27.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-05T01:27:28.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:28.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-05T01:27:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:32.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-05T01:27:33.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:33.786 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-05T01:27:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-05T01:27:33.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:33.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-05T01:27:48.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:48.586 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-05T01:27:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:49.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests STANDARD_OUT 2024-09-05T01:27:49.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05 01:27:49,740 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-05T01:27:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:50.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-05T01:27:57.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:57.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-05T01:27:58.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:27:58.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-05T01:28:01.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:01.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-05T01:28:02.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:02.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-05T01:28:39.386 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:39.387 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-05T01:28:40.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:40.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-05T01:28:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:44.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-05T01:28:45.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:45.485 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-05T01:28:49.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:49.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-05T01:28:50.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:50.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-05T01:28:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:28:53.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-05T01:29:13.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:13.886 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-05T01:29:13.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:13.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-05T01:29:14.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-05T01:29:14.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:14.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-05T01:29:15.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:15.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-05T01:29:15.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-05T01:29:15.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:15.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-05T01:29:16.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:16.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-05T01:29:16.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:16.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-05T01:29:16.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:16.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-05T01:29:17.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:17.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-05T01:29:17.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:17.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-05T01:29:18.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:18.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-05T01:29:18.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:18.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-05T01:29:19.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:19.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-05T01:29:20.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:20.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-05T01:29:21.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:21.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-05T01:29:21.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:21.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-05T01:29:22.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:22.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-05T01:29:23.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:23.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-05T01:29:24.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:24.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-05T01:29:24.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:24.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-05T01:29:25.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:25.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-05T01:29:26.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:26.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-05T01:29:27.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:27.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-05T01:29:27.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:27.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-05T01:29:28.688 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:28.688 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-05T01:29:29.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:29.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-05T01:29:30.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:30.230 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-05T01:29:30.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:30.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-05T01:29:31.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:31.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-05T01:29:32.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:32.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-05T01:29:33.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:33.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-05T01:29:33.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:33.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-05T01:29:34.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:34.786 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-05T01:29:35.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:35.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-05T01:29:36.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:36.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-05T01:29:36.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:36.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-05T01:29:37.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:37.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-05T01:29:38.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:38.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-05T01:29:39.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:39.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-05T01:29:39.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:39.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-05T01:29:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:40.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-05T01:29:41.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:41.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-05T01:29:42.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:42.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-05T01:29:42.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:42.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-05T01:29:43.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:43.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-05T01:29:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:44.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-05T01:29:45.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:45.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-05T01:29:45.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:45.602 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-05T01:29:46.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:46.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-05T01:29:47.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:47.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-05T01:29:47.985 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:47.985 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-05T01:29:48.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:48.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-05T01:29:49.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:49.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-05T01:29:49.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:49.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-05T01:29:50.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:50.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-05T01:29:51.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:51.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-05T01:29:52.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:52.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-05T01:29:52.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:52.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-05T01:29:52.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:52.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-05T01:29:53.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:53.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-05T01:29:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:53.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-05T01:29:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:54.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-05T01:29:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:54.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-05T01:29:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:55.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-05T01:29:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:55.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-05T01:29:56.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:56.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-05T01:29:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:57.085 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-05T01:29:57.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:57.185 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-05T01:29:57.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:57.286 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-05T01:29:57.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:57.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-05T01:29:58.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:58.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-05T01:29:58.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:58.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-05T01:29:59.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:59.485 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-05T01:29:59.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:29:59.785 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-05T01:30:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:00.486 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-05T01:30:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:00.585 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-05T01:30:01.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:01.285 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-05T01:30:04.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:04.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-05T01:30:05.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:05.685 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-05T01:30:09.385 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:09.385 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-05T01:30:10.375 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-05T01:30:10.376 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-05T01:30:10.376 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:10.376 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 4m 5s 2024-09-05T01:30:10.376 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 5 executed 2024-09-05T01:30:10.395 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:30:10.425 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:10.425 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:10.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.470+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.470+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.470+0000 7fc4f324f9c0 20 realm 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.470+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:10.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:10.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.474+0000 7fc4f324f9c0 20 searching for the correct realm 2024-09-05T01:30:10.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.482+0000 7fc4f0d55640 0 -- 172.21.15.99:0/3987676853 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fc4ec020040 msgr2=0x7fc4ec02e920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:10.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.490+0000 7fc4f0d55640 0 -- 172.21.15.99:0/3987676853 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fc3bc080930 msgr2=0x7fc3bc082d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 zone default found 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 4 Realm: () 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 zonegroup default 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.494+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 started sync module instance, tier type = 2024-09-05T01:30:10.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.498+0000 7fc4f324f9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=0 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=1 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=2 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=3 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=4 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=5 2024-09-05T01:30:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=6 2024-09-05T01:30:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 20 add_watcher() i=7 2024-09-05T01:30:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.514+0000 7fc4f324f9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:10.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.518+0000 7fc3a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:10.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.518+0000 7fc4f324f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:10.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.518+0000 7fc4f324f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.586+0000 7fc3a5fe3640 20 reqs_thread_entry: start 2024-09-05T01:30:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.586+0000 7fc4f324f9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.586+0000 7fc4f324f9c0 20 Filter name: none 2024-09-05T01:30:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.586+0000 7fc3177fe640 20 reqs_thread_entry: start 2024-09-05T01:30:10.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.586+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:30:10.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-05T01:30:10.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13987013072058009703', time=2024-09-05T03:29:29.409715+0000, chain.objs.size()=1 2024-09-05T01:30:10.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.118__shadow_.HqouYC0QfJ2mVz1WxX0G2tieDSaSW1z_0 2024-09-05T01:30:10.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17357719191821037217', time=2024-09-05T03:29:31.071453+0000, chain.objs.size()=1 2024-09-05T01:30:10.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.119__shadow_.1mbm24AS0ISzUirlvN-cdYQU5XzrJqF_0 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13983043909248007656', time=2024-09-05T03:29:35.520594+0000, chain.objs.size()=1 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.122__shadow_.kN4afFj2ApUEPF7wvXceu1yf8UENDqP_0 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14066618779240143161', time=2024-09-05T03:29:38.492351+0000, chain.objs.size()=1 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.124__shadow_.LGvhgSPa6fGBnnuf2wl8hjD1tLttj55_0 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7543088772420644826', time=2024-09-05T03:29:39.822073+0000, chain.objs.size()=1 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.125__shadow_.Yfx0cGQTbYi7DmajStoDa5YcaQjkGpF_0 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18435656122992706848', time=2024-09-05T03:29:50.053756+0000, chain.objs.size()=1 2024-09-05T01:30:10.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.590+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.132__shadow_.RBb4JURvNXlW_La_NiqCYVvQ0Kzhh19_0 2024-09-05T01:30:10.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.594+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.602+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:30:10.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.602+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6461293165189762739', time=2024-09-05T03:29:31.144689+0000, chain.objs.size()=1 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.119__shadow_.5DMaxFO1jmFIuRIA1_TrWV2KdIF9NCY_0 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8702232724552334543', time=2024-09-05T03:29:34.246525+0000, chain.objs.size()=1 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121__shadow_.joarQQEd9s495FPc_1HMC26UEaIAtox_0 2024-09-05T01:30:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16418493773128065044', time=2024-09-05T03:29:42.855110+0000, chain.objs.size()=1 2024-09-05T01:30:10.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.127__shadow_.tgw3Bqk0qfOm4c1EVSS9Tuoymlbe9zu_0 2024-09-05T01:30:10.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.606+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.610+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:30:10.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.614+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.614+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:30:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11683381143269578331', time=2024-09-05T03:29:20.355034+0000, chain.objs.size()=1 2024-09-05T01:30:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.112__shadow_.SIz4iBjCZ-E1_kg2eR9Ldj-P2uJoRAl_0 2024-09-05T01:30:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11014489107503071186', time=2024-09-05T03:29:51.329151+0000, chain.objs.size()=1 2024-09-05T01:30:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.133__shadow_.MFawOuWjhFfV7nf0_QBPznTbmfWs1eA_0 2024-09-05T01:30:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.618+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.622+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:30:10.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17703234525486206739', time=2024-09-05T03:26:33.011003+0000, chain.objs.size()=5 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.1 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.2 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.3 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.4 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.5 2024-09-05T01:30:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4223687389825613906', time=2024-09-05T03:26:33.612552+0000, chain.objs.size()=5 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.1 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.2 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.3 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.4 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.91__multipart_key1.2~5ueg8EXO8REQMpvGGVkWXG7CrRJvKsr.5 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1420766437560131671', time=2024-09-05T03:29:30.927210+0000, chain.objs.size()=1 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.119__shadow_.Bs91hB8EO1bIkOooMAyG9I8odGzLXda_0 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8195235587503841185', time=2024-09-05T03:29:40.027429+0000, chain.objs.size()=1 2024-09-05T01:30:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.626+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.125__shadow_.uwcH6HHgO_03aJKWd2A6dxP_yYkTIfn_0 2024-09-05T01:30:10.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.638+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.642+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:30:10.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.642+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9984740316959289333', time=2024-09-05T03:27:20.620760+0000, chain.objs.size()=5 2024-09-05T01:30:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~CinTwpqm8wmByrkgwII50MyJj3m6fiT.1 2024-09-05T01:30:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~CinTwpqm8wmByrkgwII50MyJj3m6fiT.1_1 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~CinTwpqm8wmByrkgwII50MyJj3m6fiT.2 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~CinTwpqm8wmByrkgwII50MyJj3m6fiT.2_1 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~CinTwpqm8wmByrkgwII50MyJj3m6fiT.3 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2830191888719773595', time=2024-09-05T03:29:21.865499+0000, chain.objs.size()=1 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.113__shadow_.H8V0Upuvp57PcJEArFMykvlJs2SdUmr_0 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6431898357229838096', time=2024-09-05T03:29:41.513666+0000, chain.objs.size()=1 2024-09-05T01:30:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.646+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.126__shadow_.ZRA22IYsSo3WLXOVGQNr5LJk_PDflu-_0 2024-09-05T01:30:10.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.654+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.658+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:30:10.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-05T01:30:10.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7439178340162606141', time=2024-09-05T03:26:21.604185+0000, chain.objs.size()=2 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.83__shadow_.Od1Jztfktr0G2ECahyehLU-JIo8bX5p_0 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.83__shadow_.Od1Jztfktr0G2ECahyehLU-JIo8bX5p_1 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14894003649949304374', time=2024-09-05T03:27:49.652362+0000, chain.objs.size()=5 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.99__multipart_key1.2~AlDM0KPm2A_hAYODBfWku0GR5gaXQfH.1 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.99__multipart_key1.2~AlDM0KPm2A_hAYODBfWku0GR5gaXQfH.2 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.99__multipart_key1.2~AlDM0KPm2A_hAYODBfWku0GR5gaXQfH.3 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.99__multipart_key1.2~AlDM0KPm2A_hAYODBfWku0GR5gaXQfH.4 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.99__multipart_key1.2~AlDM0KPm2A_hAYODBfWku0GR5gaXQfH.5 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5147203185568811326', time=2024-09-05T03:29:24.900804+0000, chain.objs.size()=1 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.115__shadow_.9vPCaq9ot7F4lTIja0chsGOFFNGvJuh_0 2024-09-05T01:30:10.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4371472675838930984', time=2024-09-05T03:29:35.738516+0000, chain.objs.size()=1 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.122__shadow_.cjNO8miu95kuVARyFewFHpftfaAFyC9_0 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17340123032673159769', time=2024-09-05T03:29:37.053648+0000, chain.objs.size()=1 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.123__shadow_.zgoUYe0XDmxguiMEggkxEy_9CudhSZ6_0 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3665077514651619722', time=2024-09-05T03:29:38.348362+0000, chain.objs.size()=1 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.124__shadow_.S-cNaGGNZ_e-WAqtQWhnFMW3SYNrM5q_0 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8044222593276960264', time=2024-09-05T03:29:45.820609+0000, chain.objs.size()=1 2024-09-05T01:30:10.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.662+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.129__shadow_.dBy6332iwQAuIWTBD7h3EOlm10mmub8_0 2024-09-05T01:30:10.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.674+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.682+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:30:10.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.682+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.682+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3432154717056438135', time=2024-09-05T03:29:37.126131+0000, chain.objs.size()=1 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.123__shadow_.2-exv0k_d2mkbUEQ6cfvvc5n3IkLA4p_0 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3953682374750932555', time=2024-09-05T03:29:41.445404+0000, chain.objs.size()=1 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.126__shadow_.FCU6k0I3TjyL7HB5OdjOQWpCYbA2PH3_0 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18208376293010722210', time=2024-09-05T03:29:51.403239+0000, chain.objs.size()=1 2024-09-05T01:30:10.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.133__shadow_.gyOFi86pVfyhpDRkO6tp-b3fzj2WNIw_0 2024-09-05T01:30:10.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.686+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.690+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:30:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.690+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:10.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8', time=2024-09-05T03:28:02.380436+0000, chain.objs.size()=5 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.101__multipart_key1.2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8.7 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.101__multipart_key1.2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8.8 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.101__multipart_key1.2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8.9 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.101__multipart_key1.2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8.10 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.101__multipart_key1.2~USI_S7Rk1tn-4q8yhz1SiCEP39SaXC8.11 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6235006141847270849', time=2024-09-05T03:29:22.012067+0000, chain.objs.size()=1 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.113__shadow_.wjQPVWfuqCyC9iufsA-jjWOEN-tOsNr_0 2024-09-05T01:30:10.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18215806608071048271', time=2024-09-05T03:29:28.097431+0000, chain.objs.size()=1 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.117__shadow_.RpWc-Y6M5imqNogcOo3BmOxAO_o0E_f_0 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3124109858215185318', time=2024-09-05T03:29:36.973058+0000, chain.objs.size()=1 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.123__shadow_.-FStqX1jFeqzuLgm1tY_s_x1S85d9fX_0 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13347005400573719112', time=2024-09-05T03:30:09.566547+0000, chain.objs.size()=5 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__multipart_key1/data/file.mpg.2~tDGyiOpXBOXGO8NN6WMFPOdkoFYjAYv.1 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__multipart_key1/data/file.mpg.2~tDGyiOpXBOXGO8NN6WMFPOdkoFYjAYv.2 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__multipart_key1/data/file.mpg.2~tDGyiOpXBOXGO8NN6WMFPOdkoFYjAYv.3 2024-09-05T01:30:10.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.694+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__multipart_key1/data/file.mpg.2~tDGyiOpXBOXGO8NN6WMFPOdkoFYjAYv.4 2024-09-05T01:30:10.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.702+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__multipart_key1/data/file.mpg.2~tDGyiOpXBOXGO8NN6WMFPOdkoFYjAYv.5 2024-09-05T01:30:10.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.710+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.714+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:30:10.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6936971074024787805', time=2024-09-05T03:29:29.611334+0000, chain.objs.size()=1 2024-09-05T01:30:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.118__shadow_.nim-ZCet7R_a5QP6XtR3M9280tAMJJv_0 2024-09-05T01:30:10.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4679849972045342720', time=2024-09-05T03:29:35.666822+0000, chain.objs.size()=1 2024-09-05T01:30:10.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.122__shadow_.Gt9VSB1DkZ7uhCQjXYFGNozQoMQP4bI_0 2024-09-05T01:30:10.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15224844709288132208', time=2024-09-05T03:29:42.909851+0000, chain.objs.size()=1 2024-09-05T01:30:10.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.718+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.127__shadow_.1G2rE8i3Txw5Y4Trum9YuAnrv5kBGzG_0 2024-09-05T01:30:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.722+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.726+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:30:10.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1475227920936739983', time=2024-09-05T03:26:23.548740+0000, chain.objs.size()=1 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.85__shadow_.qobI3AgO75n4GU5eyXaanXOooukVbov_0 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12194749156710345981', time=2024-09-05T03:29:23.570096+0000, chain.objs.size()=1 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.114__shadow_.twLicPNEcNlxcNHx1R4WQUXHlQLkjwA_0 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14807402618956119982', time=2024-09-05T03:29:26.554222+0000, chain.objs.size()=1 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116__shadow_.dC04sms9Ssq-rEMlnyhoIz_atYhg3ux_0 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3211933349546306278', time=2024-09-05T03:29:29.555389+0000, chain.objs.size()=1 2024-09-05T01:30:10.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.118__shadow_.C-O5CqIjlYoWNWg9oqPnkh_HOJwhBEf_0 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13797485709479442911', time=2024-09-05T03:29:39.884496+0000, chain.objs.size()=1 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.730+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.125__shadow_._CsCfEm_84Ayb7JPf9eFdE-eMStbrmX_0 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6529515930258451', time=2024-09-05T03:29:45.896758+0000, chain.objs.size()=1 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.129__shadow_.DDHlJ7zUuQ6R7c1XVJ2HdGW3cLFHaar_0 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9651840917091134705', time=2024-09-05T03:29:47.297433+0000, chain.objs.size()=1 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.130__shadow_.NvY5-J0VRPK28i-aLjSlCPkP8U5tOZZ_0 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7806389666893219302', time=2024-09-05T03:29:48.612191+0000, chain.objs.size()=1 2024-09-05T01:30:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.734+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.131__shadow_.3T8T5D5EWxKxGuvnAHsYA-NkexfXYXx_0 2024-09-05T01:30:10.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.738+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.742+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:30:10.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.742+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.742+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-05T01:30:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4965026792203833152', time=2024-09-05T03:29:26.421062+0000, chain.objs.size()=1 2024-09-05T01:30:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116__shadow_.OAPsV5LcDZzyeEgzS-ODTys8OIRtK1n_0 2024-09-05T01:30:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12562668342540327420', time=2024-09-05T03:29:26.491494+0000, chain.objs.size()=1 2024-09-05T01:30:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116__shadow_.p0TD3awLyedLuHwwgqMrpW_WelmHlEJ_0 2024-09-05T01:30:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3254430968310982681', time=2024-09-05T03:29:34.172404+0000, chain.objs.size()=1 2024-09-05T01:30:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121__shadow_.ngYcJLpZCjG51PyVAZ3fRrmeOyHfHHF_0 2024-09-05T01:30:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.888368763937012193', time=2024-09-05T03:29:54.239502+0000, chain.objs.size()=1 2024-09-05T01:30:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.136__shadow_.LY2WAz1w7EL_h4-YdTWpcQJOtfC5RkG_0 2024-09-05T01:30:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.746+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.750+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:30:10.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.754+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.754+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3553147832513989738', time=2024-09-05T03:29:23.336165+0000, chain.objs.size()=1 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.114__shadow_.0T0smdKad3KUoOXILecGtmrCvER1Dup_0 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6675591589010121872', time=2024-09-05T03:29:23.405410+0000, chain.objs.size()=1 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.114__shadow_.4xiQqkd9DoLY6j7egLpVoOtvUz9IVtt_0 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10734239198849180324', time=2024-09-05T03:29:24.828537+0000, chain.objs.size()=1 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.115__shadow_.wYmoWe0wv-jE2uter71YuwwjmTUGJVv_0 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10976436956411403577', time=2024-09-05T03:29:32.444893+0000, chain.objs.size()=1 2024-09-05T01:30:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.120__shadow_.JKdJ1Rj5KQvgiN3pLCFkUhMm4YMjksf_0 2024-09-05T01:30:10.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4637010131903460337', time=2024-09-05T03:29:42.792016+0000, chain.objs.size()=1 2024-09-05T01:30:10.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.127__shadow_.ea_Ng-CDpu6GnWeSTLBaKeonw31XeL9_0 2024-09-05T01:30:10.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.758+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.766+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:30:10.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.766+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-05T01:30:10.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7311291277947905181', time=2024-09-05T03:27:58.178597+0000, chain.objs.size()=1 2024-09-05T01:30:10.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__shadow_.8_3YKpSerTs61K2HmIDoyLovn8EJjD3_0 2024-09-05T01:30:10.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8070128277793177374', time=2024-09-05T03:28:39.253342+0000, chain.objs.size()=5 2024-09-05T01:30:10.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~gFEsp0PNDBBGghpihhggnn25YqmWj5O.1 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~gFEsp0PNDBBGghpihhggnn25YqmWj5O.1_1 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~gFEsp0PNDBBGghpihhggnn25YqmWj5O.2 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~gFEsp0PNDBBGghpihhggnn25YqmWj5O.2_1 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~gFEsp0PNDBBGghpihhggnn25YqmWj5O.3 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6977246695545615190', time=2024-09-05T03:29:44.541862+0000, chain.objs.size()=1 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.128__shadow_.oe22NTOGbh5U2aRmhDBy_NskwLLlsbo_0 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14347231166643029958', time=2024-09-05T03:29:56.241093+0000, chain.objs.size()=1 2024-09-05T01:30:10.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.770+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.138__shadow_.KfqsMQVTJF-u9Jz5VDSQEUn8R4IQxaE_0 2024-09-05T01:30:10.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.778+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.782+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:30:10.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:30:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18070580440365227122', time=2024-09-05T03:29:25.044124+0000, chain.objs.size()=1 2024-09-05T01:30:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.115__shadow_.G3-rUCpZIP-qEUzvm_0verQR74dPvY0_0 2024-09-05T01:30:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6437415923701565757', time=2024-09-05T03:29:48.685063+0000, chain.objs.size()=1 2024-09-05T01:30:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.786+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.131__shadow_.c2D0Uwaj9d1NV4JIzngykISWyjOWsYi_0 2024-09-05T01:30:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.790+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.798+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:30:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.798+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12598842442208215750', time=2024-09-05T03:27:25.459411+0000, chain.objs.size()=5 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~XYt7nhNtGD-SWEwA2Cfspq6psyTLYj5.1 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~XYt7nhNtGD-SWEwA2Cfspq6psyTLYj5.1_1 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~XYt7nhNtGD-SWEwA2Cfspq6psyTLYj5.2 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~XYt7nhNtGD-SWEwA2Cfspq6psyTLYj5.2_1 2024-09-05T01:30:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.802+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~XYt7nhNtGD-SWEwA2Cfspq6psyTLYj5.3 2024-09-05T01:30:10.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.810+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.814+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:30:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.814+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17930314423176000271', time=2024-09-05T03:27:26.231794+0000, chain.objs.size()=4 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.93__shadow_.EOzLzsFTasmxYwNRQrf1J1WYwAQuvb0_0 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.93__shadow_.EOzLzsFTasmxYwNRQrf1J1WYwAQuvb0_1 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.93__shadow_.EOzLzsFTasmxYwNRQrf1J1WYwAQuvb0_2 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.93__shadow_.EOzLzsFTasmxYwNRQrf1J1WYwAQuvb0_3 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10059168125668879299', time=2024-09-05T03:27:33.199675+0000, chain.objs.size()=5 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.98__multipart_key1.2~hLk_GbgPaCDiqJb6aw6AiIbbnckG7V1.1 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.98__multipart_key1.2~hLk_GbgPaCDiqJb6aw6AiIbbnckG7V1.2 2024-09-05T01:30:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.98__multipart_key1.2~hLk_GbgPaCDiqJb6aw6AiIbbnckG7V1.3 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.98__multipart_key1.2~hLk_GbgPaCDiqJb6aw6AiIbbnckG7V1.4 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.98__multipart_key1.2~hLk_GbgPaCDiqJb6aw6AiIbbnckG7V1.5 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11041396613865665932', time=2024-09-05T03:28:24.459669+0000, chain.objs.size()=5 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~HRv9-OiVv7g7lgoDoBLEA2FXs39HBEf.1 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~HRv9-OiVv7g7lgoDoBLEA2FXs39HBEf.2 2024-09-05T01:30:10.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.818+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~HRv9-OiVv7g7lgoDoBLEA2FXs39HBEf.3 2024-09-05T01:30:10.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.826+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~HRv9-OiVv7g7lgoDoBLEA2FXs39HBEf.4 2024-09-05T01:30:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~HRv9-OiVv7g7lgoDoBLEA2FXs39HBEf.5 2024-09-05T01:30:10.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10196163100232884414', time=2024-09-05T03:29:30.999971+0000, chain.objs.size()=1 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.119__shadow_.sNws3lpkwekD-vnYHCCMDZ3MDvkkLHh_0 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15523920800924432552', time=2024-09-05T03:29:47.369120+0000, chain.objs.size()=1 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.130__shadow_.gGZIz5hSn0EBgirhglPFQDmIUlMDzkG_0 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8021644802165457159', time=2024-09-05T03:30:05.049948+0000, chain.objs.size()=5 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143__multipart_key1.2~TKnpqyWg6MY51gaDSEyg47O_DjuJ-ae.1 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143__multipart_key1.2~TKnpqyWg6MY51gaDSEyg47O_DjuJ-ae.2 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143__multipart_key1.2~TKnpqyWg6MY51gaDSEyg47O_DjuJ-ae.3 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143__multipart_key1.2~TKnpqyWg6MY51gaDSEyg47O_DjuJ-ae.4 2024-09-05T01:30:10.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.830+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143__multipart_key1.2~TKnpqyWg6MY51gaDSEyg47O_DjuJ-ae.5 2024-09-05T01:30:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.838+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.842+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:30:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.846+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.846+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.850+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:30:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.850+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11215577326168524482', time=2024-09-05T03:29:51.474498+0000, chain.objs.size()=1 2024-09-05T01:30:10.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.850+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.133__shadow_.l4M_RkCu078iyoNLjlfHfvoJwrcPz6R_0 2024-09-05T01:30:10.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.850+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.854+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:30:10.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.858+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5322191613594602201', time=2024-09-05T03:26:09.882368+0000, chain.objs.size()=1 2024-09-05T01:30:10.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.77__shadow_.dPp7KKb-gzxC3qe-7_uSSh3ODZj0Udp_0 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7254176476156446901', time=2024-09-05T03:29:27.854408+0000, chain.objs.size()=1 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.117__shadow_.jlm4UJTReA_GJtc6baAoWEmwpqyiC8y_0 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7452791330502510270', time=2024-09-05T03:29:34.101238+0000, chain.objs.size()=1 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121__shadow_.1xrJYVgSWjagz4Pwp5umkcNy-xWCUFB_0 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10607474557811313380', time=2024-09-05T03:29:44.467792+0000, chain.objs.size()=1 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.128__shadow_.WyLcAS2r2GvMxibsC1pf5B7NKOpa83a_0 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17590541877240084044', time=2024-09-05T03:29:55.208784+0000, chain.objs.size()=1 2024-09-05T01:30:10.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.137__shadow_.2ynXFnm8QPFX2OxfeqFx7MZu31ZY7gG_0 2024-09-05T01:30:10.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.862+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.870+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:30:10.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.870+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.870+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:10.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1319003198662679461', time=2024-09-05T03:27:57.987605+0000, chain.objs.size()=1 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__shadow_.Td2tH66B2o3OEFk6FBfdSW6sXsejL2k_0 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16952132115745462077', time=2024-09-05T03:28:43.449159+0000, chain.objs.size()=1 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__shadow_.qwaORagtPdhxVQYwb0FcEYVxGAUSuJt_0 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4775049270580291695', time=2024-09-05T03:28:49.798907+0000, chain.objs.size()=5 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.104__multipart_key1.2~Ol5hqaArhmJKtlJSMjvUuQPfUtSMIa4.1 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.104__multipart_key1.2~Ol5hqaArhmJKtlJSMjvUuQPfUtSMIa4.2 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.104__multipart_key1.2~Ol5hqaArhmJKtlJSMjvUuQPfUtSMIa4.3 2024-09-05T01:30:10.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.104__multipart_key1.2~Ol5hqaArhmJKtlJSMjvUuQPfUtSMIa4.4 2024-09-05T01:30:10.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.104__multipart_key1.2~Ol5hqaArhmJKtlJSMjvUuQPfUtSMIa4.5 2024-09-05T01:30:10.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6671965775015063630', time=2024-09-05T03:29:56.078181+0000, chain.objs.size()=1 2024-09-05T01:30:10.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.138__shadow_.rgIBJN7vVxUTzB7qepbWF-2pIu_zWsA_0 2024-09-05T01:30:10.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14581752816980579035', time=2024-09-05T03:29:57.785300+0000, chain.objs.size()=1 2024-09-05T01:30:10.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.874+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.139__shadow_.CUbzyMbNBPlXOFDVon4xT6heGMf2VFt_0 2024-09-05T01:30:10.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.882+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.886+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:30:10.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.886+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ', time=2024-09-05T03:26:15.317913+0000, chain.objs.size()=5 2024-09-05T01:30:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.79__multipart_key1.2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ.1 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.79__multipart_key1.2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ.2 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.79__multipart_key1.2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ.3 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.79__multipart_key1.2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ.4 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.79__multipart_key1.2~RwP7J7FLtYXpp6JjMLcVJDlezLwjtYQ.5 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2307961669809528448', time=2024-09-05T03:28:36.377449+0000, chain.objs.size()=5 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~o3NKD7RZWkJ5Rd6WTFoen9I_C3Psrso.1 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~o3NKD7RZWkJ5Rd6WTFoen9I_C3Psrso.1_1 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~o3NKD7RZWkJ5Rd6WTFoen9I_C3Psrso.2 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~o3NKD7RZWkJ5Rd6WTFoen9I_C3Psrso.2_1 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~o3NKD7RZWkJ5Rd6WTFoen9I_C3Psrso.3 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7448186537623376147', time=2024-09-05T03:29:49.983418+0000, chain.objs.size()=1 2024-09-05T01:30:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.890+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.132__shadow_.Giv5eM0w_ufda3gI25hyv6WlZhOh7z9_0 2024-09-05T01:30:10.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.902+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.906+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:30:10.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.746810363795099094', time=2024-09-05T03:26:22.572248+0000, chain.objs.size()=1 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.84__shadow_.i_DxgTYBTdqD4aP4d7EfdPCO1L_x83t_0 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10021436658672374533', time=2024-09-05T03:26:57.137022+0000, chain.objs.size()=5 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~pqiBhdbrRJAotHJDBp1FvSzAYxklJhK.1 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~pqiBhdbrRJAotHJDBp1FvSzAYxklJhK.2 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~pqiBhdbrRJAotHJDBp1FvSzAYxklJhK.3 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~pqiBhdbrRJAotHJDBp1FvSzAYxklJhK.4 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~pqiBhdbrRJAotHJDBp1FvSzAYxklJhK.5 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2248316706606682491', time=2024-09-05T03:29:27.927282+0000, chain.objs.size()=1 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.117__shadow_.wsg_3eBHothptUxrSsOkywl0yw1dL4h_0 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6560205702463228392', time=2024-09-05T03:29:34.027898+0000, chain.objs.size()=1 2024-09-05T01:30:10.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121__shadow_._gP32ki1aX0yPL6TLXB4Y81J2bth0pj_0 2024-09-05T01:30:10.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16085374282380966999', time=2024-09-05T03:29:58.860794+0000, chain.objs.size()=1 2024-09-05T01:30:10.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.910+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.140__shadow_.hplLuUeAYP1eRdybQ_Vj3WVr0EyA3kZ_0 2024-09-05T01:30:10.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.918+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.926+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:30:10.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.926+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17699517008926787685', time=2024-09-05T03:27:15.896987+0000, chain.objs.size()=5 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~7xY1t4ET9z-rUrhQsKVe8iCjUztSyiM.1 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~7xY1t4ET9z-rUrhQsKVe8iCjUztSyiM.2 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~7xY1t4ET9z-rUrhQsKVe8iCjUztSyiM.3 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~7xY1t4ET9z-rUrhQsKVe8iCjUztSyiM.4 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~7xY1t4ET9z-rUrhQsKVe8iCjUztSyiM.5 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14385026304880465721', time=2024-09-05T03:29:20.492300+0000, chain.objs.size()=1 2024-09-05T01:30:10.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.930+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.112__shadow_.Hr8l_I5UJXmf6cf3FSSggBx0cEXWBo0_0 2024-09-05T01:30:10.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.934+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.942+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:30:10.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T01:30:10.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16657064022317372638', time=2024-09-05T03:29:45.970569+0000, chain.objs.size()=1 2024-09-05T01:30:10.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.129__shadow_.uYHuHltbpn9FXgID9VCGXM63AiF5tqf_0 2024-09-05T01:30:10.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18280994798228517980', time=2024-09-05T03:29:46.044681+0000, chain.objs.size()=1 2024-09-05T01:30:10.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.946+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.129__shadow_.y5dttp3oGM3ahV26E9OopuymdRdlWZP_0 2024-09-05T01:30:10.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.950+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.954+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:30:10.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13034707178712497422', time=2024-09-05T03:27:58.120252+0000, chain.objs.size()=1 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__shadow_.0931il2ZQUY4s0H8D2U7eR2QPFlgC4T_0 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2578336121534656648', time=2024-09-05T03:28:44.932271+0000, chain.objs.size()=5 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__multipart_key1.2~_SSppVQihJpyLF6trgBkyWHI-tfwo0O.1 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__multipart_key1.2~_SSppVQihJpyLF6trgBkyWHI-tfwo0O.2 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__multipart_key1.2~_SSppVQihJpyLF6trgBkyWHI-tfwo0O.3 2024-09-05T01:30:10.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__multipart_key1.2~_SSppVQihJpyLF6trgBkyWHI-tfwo0O.4 2024-09-05T01:30:10.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.103__multipart_key1.2~_SSppVQihJpyLF6trgBkyWHI-tfwo0O.5 2024-09-05T01:30:10.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18216188830939192282', time=2024-09-05T03:29:41.380579+0000, chain.objs.size()=1 2024-09-05T01:30:10.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.958+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.126__shadow_.veVDiaYbkLyyHnZ514NUzNFMwDt_BYy_0 2024-09-05T01:30:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.970+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.974+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:30:10.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:10.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-05T01:30:10.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2356948083600856710', time=2024-09-05T03:28:21.556393+0000, chain.objs.size()=5 2024-09-05T01:30:10.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~8dlQaEEEbB_BfsrDVtKCeuQ9VJ88mqL.1 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~8dlQaEEEbB_BfsrDVtKCeuQ9VJ88mqL.2 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~8dlQaEEEbB_BfsrDVtKCeuQ9VJ88mqL.3 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~8dlQaEEEbB_BfsrDVtKCeuQ9VJ88mqL.4 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~8dlQaEEEbB_BfsrDVtKCeuQ9VJ88mqL.5 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.952827119622994881', time=2024-09-05T03:29:42.981299+0000, chain.objs.size()=1 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.127__shadow_.oApotO0V29v88uMTYy-hQzgNUmjpsSg_0 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17127102672272483086', time=2024-09-05T03:29:44.322590+0000, chain.objs.size()=1 2024-09-05T01:30:10.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.978+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.128__shadow_.LK-9B5Cr9Pmcjnsrh1F-GuNoGZ-MklL_0 2024-09-05T01:30:10.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.986+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:10.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.994+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:30:10.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.998+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:10.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.998+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.998+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-05T01:30:11.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.998+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6127232562434093368', time=2024-09-05T03:29:48.758625+0000, chain.objs.size()=1 2024-09-05T01:30:11.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:10.998+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.131__shadow_.A11HTUTz-OHpH_rSHMWveZim0x7ae-l_0 2024-09-05T01:30:11.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.002+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.010+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:30:11.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:11.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12504948156076133922', time=2024-09-05T03:29:26.349710+0000, chain.objs.size()=1 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116__shadow_.jQxi--MMpOeTZ5O4GE-Z_QLOT6blHkt_0 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13593376327046511665', time=2024-09-05T03:29:27.999567+0000, chain.objs.size()=1 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.117__shadow_.ptGv-WFqYzeyBlr-WTMe2U5DAa9JjDL_0 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2874420279032144825', time=2024-09-05T03:29:32.518295+0000, chain.objs.size()=1 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.120__shadow_.RC3dleIPFM7U6WiSJwiHMWBH1qC4Ve7_0 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18334421841374351233', time=2024-09-05T03:29:39.953103+0000, chain.objs.size()=1 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.125__shadow_.R0TXpQngG2yecKqzxnlp6_efbWQVJZg_0 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11472026291877829805', time=2024-09-05T03:30:09.657364+0000, chain.objs.size()=1 2024-09-05T01:30:11.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.014+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.144__shadow_.loOQFBHkNcWBSzEYu0JV_WdunC5HGSZ_0 2024-09-05T01:30:11.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.018+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.026+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:30:11.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.026+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4742410527893380341', time=2024-09-05T03:27:57.920386+0000, chain.objs.size()=5 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file.mpg.2~okLEmqBfH1g94QlKQVghNEY3b4CE7gQ.1 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file.mpg.2~okLEmqBfH1g94QlKQVghNEY3b4CE7gQ.2 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file.mpg.2~okLEmqBfH1g94QlKQVghNEY3b4CE7gQ.3 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file.mpg.2~okLEmqBfH1g94QlKQVghNEY3b4CE7gQ.4 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file.mpg.2~okLEmqBfH1g94QlKQVghNEY3b4CE7gQ.5 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7295019003436892650', time=2024-09-05T03:29:20.427952+0000, chain.objs.size()=1 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.112__shadow_.sDiebWf1EfRZk0QlwpBb6q_2GZaDdR0_0 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6857497403760506599', time=2024-09-05T03:29:21.805195+0000, chain.objs.size()=1 2024-09-05T01:30:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.113__shadow_.Cu1KhwBkIthbFsvcyYDY792upSmig8a_0 2024-09-05T01:30:11.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9975036052324155278', time=2024-09-05T03:29:21.942237+0000, chain.objs.size()=1 2024-09-05T01:30:11.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.113__shadow_.V8v9v4jGFt88OB5DyE3ajNcw7nPyz7Q_0 2024-09-05T01:30:11.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5377553378553668950', time=2024-09-05T03:29:41.327059+0000, chain.objs.size()=1 2024-09-05T01:30:11.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.030+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.126__shadow_.qYwJcESLE10FbMgkV7s1LdTrc6eMWgU_0 2024-09-05T01:30:11.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.038+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.042+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:30:11.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17998195211679139383', time=2024-09-05T03:26:28.105462+0000, chain.objs.size()=1 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.90__shadow_.xKhjnIa_n1s5EDumDO8YbI0lw1CFbv7_0 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2933622736881613802', time=2024-09-05T03:28:18.522769+0000, chain.objs.size()=5 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~SgBRp1o58uWXmw35ryeuJG92nBYuBhv.1 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~SgBRp1o58uWXmw35ryeuJG92nBYuBhv.2 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~SgBRp1o58uWXmw35ryeuJG92nBYuBhv.3 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~SgBRp1o58uWXmw35ryeuJG92nBYuBhv.4 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~SgBRp1o58uWXmw35ryeuJG92nBYuBhv.5 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1886750280239673979', time=2024-09-05T03:29:29.480948+0000, chain.objs.size()=1 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.118__shadow_.4qZ1foAVazjyRJRXxIhJRUQ3bvcCGUW_0 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5979267702432896430', time=2024-09-05T03:29:32.660540+0000, chain.objs.size()=1 2024-09-05T01:30:11.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.046+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.120__shadow_.4wHW0nvLVzf9D519HmtKk5G8Mb_tS1G_0 2024-09-05T01:30:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.054+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.058+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:30:11.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.062+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.062+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH', time=2024-09-05T03:29:08.627158+0000, chain.objs.size()=63 2024-09-05T01:30:11.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.1 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.2 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.3 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.4 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.5 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.6 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.7 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.8 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.9 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.10 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.11 2024-09-05T01:30:11.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.066+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.12 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.13 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.14 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.15 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.16 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.17 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.18 2024-09-05T01:30:11.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.070+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.19 2024-09-05T01:30:11.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.20 2024-09-05T01:30:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.21 2024-09-05T01:30:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.22 2024-09-05T01:30:11.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.23 2024-09-05T01:30:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.24 2024-09-05T01:30:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.25 2024-09-05T01:30:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.26 2024-09-05T01:30:11.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.27 2024-09-05T01:30:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.28 2024-09-05T01:30:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.29 2024-09-05T01:30:11.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.074+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.30 2024-09-05T01:30:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.078+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.31 2024-09-05T01:30:11.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.078+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.32 2024-09-05T01:30:11.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.078+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.33 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.078+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.34 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.078+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.35 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.36 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.37 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.38 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.39 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.40 2024-09-05T01:30:11.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.41 2024-09-05T01:30:11.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.42 2024-09-05T01:30:11.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.082+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.43 2024-09-05T01:30:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.44 2024-09-05T01:30:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.45 2024-09-05T01:30:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.46 2024-09-05T01:30:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.47 2024-09-05T01:30:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.48 2024-09-05T01:30:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.49 2024-09-05T01:30:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.50 2024-09-05T01:30:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.51 2024-09-05T01:30:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.52 2024-09-05T01:30:11.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.53 2024-09-05T01:30:11.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.086+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.54 2024-09-05T01:30:11.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.090+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.55 2024-09-05T01:30:11.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.090+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.56 2024-09-05T01:30:11.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.090+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.57 2024-09-05T01:30:11.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.090+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.58 2024-09-05T01:30:11.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.090+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.59 2024-09-05T01:30:11.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.60 2024-09-05T01:30:11.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.61 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.62 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.105__multipart_key1.2~l4P0R1hRzrevvcQbj8ExdKVcBzvkFZH.63 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5635857769621963938', time=2024-09-05T03:29:14.488351+0000, chain.objs.size()=1 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.106__shadow_.PCaarMljEghPTWpRp9CbZNtaMGty1ga_0 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17164093833585275197', time=2024-09-05T03:29:35.594701+0000, chain.objs.size()=1 2024-09-05T01:30:11.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.094+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.122__shadow_.ELAGpI2pDlCX8XqgJpxESCRr66o-4Ll_0 2024-09-05T01:30:11.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.098+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2976998837951650239', time=2024-09-05T03:29:38.422131+0000, chain.objs.size()=1 2024-09-05T01:30:11.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.098+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.124__shadow_.qSUyIMerXz7tw9I46ETcEcG5G_hP1PS_0 2024-09-05T01:30:11.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.098+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10956252221692350011', time=2024-09-05T03:29:50.125650+0000, chain.objs.size()=1 2024-09-05T01:30:11.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.098+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.132__shadow_.8HGEdBdlYKf87p0MKCpb0yQFT5LMCdm_0 2024-09-05T01:30:11.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.098+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.102+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:30:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T01:30:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5786222573049563186', time=2024-09-05T03:27:25.732671+0000, chain.objs.size()=5 2024-09-05T01:30:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~2eYC5srCE2g0aGPHEWjVaUGAaoVsSAx.1 2024-09-05T01:30:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~2eYC5srCE2g0aGPHEWjVaUGAaoVsSAx.1_1 2024-09-05T01:30:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~2eYC5srCE2g0aGPHEWjVaUGAaoVsSAx.2 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__shadow_key1.2~2eYC5srCE2g0aGPHEWjVaUGAaoVsSAx.2_1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~2eYC5srCE2g0aGPHEWjVaUGAaoVsSAx.3 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5427409390440983185', time=2024-09-05T03:28:39.571740+0000, chain.objs.size()=5 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.106+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~UULVNZKTYRNskXSNhZxEmvzCYldPS19.1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~UULVNZKTYRNskXSNhZxEmvzCYldPS19.1_1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~UULVNZKTYRNskXSNhZxEmvzCYldPS19.2 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__shadow_key1.2~UULVNZKTYRNskXSNhZxEmvzCYldPS19.2_1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.102__multipart_key1.2~UULVNZKTYRNskXSNhZxEmvzCYldPS19.3 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17705482075837946004', time=2024-09-05T03:29:24.975228+0000, chain.objs.size()=1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.115__shadow_.f_7Uf21mgl5E2j2HO2xKdwaZcZtHSRB_0 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14672227803498682172', time=2024-09-05T03:29:32.590311+0000, chain.objs.size()=1 2024-09-05T01:30:11.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.110+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.120__shadow_.1Q1mAkcH7lqGxaYzyrJFrmUeQD1fZfF_0 2024-09-05T01:30:11.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.114+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.742515206121313935', time=2024-09-05T03:29:44.396778+0000, chain.objs.size()=1 2024-09-05T01:30:11.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.114+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.128__shadow_.DCLXECexktYVFI2AfRr53GRzB2t945K_0 2024-09-05T01:30:11.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.122+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.126+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:30:11.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.126+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-05T01:30:11.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8488812471649769759', time=2024-09-05T03:26:17.579276+0000, chain.objs.size()=1 2024-09-05T01:30:11.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.81__shadow_.RFtQtjn5OTg1c_m1TkqyqbfPJgJqWhO_0 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9343645481960618887', time=2024-09-05T03:27:11.555371+0000, chain.objs.size()=5 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~4g9bPeLt8RlLdK8avh-01kxUpcAkyYK.1 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~4g9bPeLt8RlLdK8avh-01kxUpcAkyYK.2 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~4g9bPeLt8RlLdK8avh-01kxUpcAkyYK.3 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~4g9bPeLt8RlLdK8avh-01kxUpcAkyYK.4 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.94__multipart_key1.2~4g9bPeLt8RlLdK8avh-01kxUpcAkyYK.5 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16582401440268258900', time=2024-09-05T03:27:58.057986+0000, chain.objs.size()=5 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file2.mpg.2~uIT5sQZbW227C9d-HJk3N38-l_Th2YH.1 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file2.mpg.2~uIT5sQZbW227C9d-HJk3N38-l_Th2YH.2 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file2.mpg.2~uIT5sQZbW227C9d-HJk3N38-l_Th2YH.3 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file2.mpg.2~uIT5sQZbW227C9d-HJk3N38-l_Th2YH.4 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.100__multipart_file2.mpg.2~uIT5sQZbW227C9d-HJk3N38-l_Th2YH.5 2024-09-05T01:30:11.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7833770074330602790', time=2024-09-05T03:29:20.561368+0000, chain.objs.size()=1 2024-09-05T01:30:11.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.130+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.112__shadow_.yBMcdLhzFoVbSm98o5f18S0w53vTej-_0 2024-09-05T01:30:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.134+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10255091869887104000', time=2024-09-05T03:29:23.496617+0000, chain.objs.size()=1 2024-09-05T01:30:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.134+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.114__shadow_.awa21ggxscAdHnX8Fem8pKGP9r3ld5S_0 2024-09-05T01:30:11.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.138+0000 7fc4f324f9c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18276052995955777308', time=2024-09-05T03:29:47.222867+0000, chain.objs.size()=1 2024-09-05T01:30:11.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.138+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.130__shadow_._oV11ebpyAZNg7C1NUROdqq9YguoGuh_0 2024-09-05T01:30:11.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.142+0000 7fc4f324f9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T01:30:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.150+0000 7fc3a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.154+0000 7fc4f324f9c0 20 remove_watcher() i=0 2024-09-05T01:30:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.154+0000 7fc4f324f9c0 2 removed watcher, disabling cache 2024-09-05T01:30:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.154+0000 7fc4f324f9c0 20 remove_watcher() i=1 2024-09-05T01:30:11.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.158+0000 7fc4f324f9c0 20 remove_watcher() i=2 2024-09-05T01:30:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.158+0000 7fc4f324f9c0 20 remove_watcher() i=3 2024-09-05T01:30:11.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.158+0000 7fc4f324f9c0 20 remove_watcher() i=4 2024-09-05T01:30:11.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.162+0000 7fc4f324f9c0 20 remove_watcher() i=5 2024-09-05T01:30:11.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.162+0000 7fc4f324f9c0 20 remove_watcher() i=6 2024-09-05T01:30:11.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.166+0000 7fc4f324f9c0 20 remove_watcher() i=7 2024-09-05T01:30:11.184 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-09-05T01:30:11.256 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:11.257 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:11.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.298+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 realm 2024-09-05T01:30:11.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:11.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:11.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.302+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.306+0000 7f4b341c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:11.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.306+0000 7f4b341c19c0 20 searching for the correct realm 2024-09-05T01:30:11.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.310+0000 7f4b324c8640 0 -- 172.21.15.99:0/1757875973 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4b1c0c3060 msgr2=0x7f4b1c0ac740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:30:11.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.526+0000 7f4b324c8640 0 -- 172.21.15.99:0/1757875973 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4b1c0c3060 msgr2=0x7f4b1c0ac740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:11.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.538+0000 7f4b341c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:11.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 zone default found 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 4 Realm: () 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 zonegroup default 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:11.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:11.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 started sync module instance, tier type = 2024-09-05T01:30:11.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.542+0000 7f4b341c19c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:11.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=0 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=1 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=2 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=3 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=4 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=5 2024-09-05T01:30:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=6 2024-09-05T01:30:11.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 20 add_watcher() i=7 2024-09-05T01:30:11.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.566+0000 7f4b341c19c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:11.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.570+0000 7f49e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:11.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.570+0000 7f4b341c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:11.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.570+0000 7f4b341c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:11.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.654+0000 7f49e2ffd640 20 reqs_thread_entry: start 2024-09-05T01:30:11.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.654+0000 7f4b341c19c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:11.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.654+0000 7f4b341c19c0 20 Filter name: none 2024-09-05T01:30:11.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.654+0000 7f49e0ff9640 20 reqs_thread_entry: start 2024-09-05T01:30:11.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.654+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T01:30:11.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.658+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.658+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.658+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.662+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T01:30:11.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.662+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.666+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.666+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.670+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T01:30:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.670+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.674+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.674+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.674+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T01:30:11.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.678+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.678+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.678+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.682+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T01:30:11.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.686+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.686+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.686+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.686+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T01:30:11.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.690+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.690+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.690+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.690+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T01:30:11.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.694+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.694+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.698+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.698+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T01:30:11.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.698+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.702+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.702+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.702+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T01:30:11.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.706+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.706+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.706+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.710+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T01:30:11.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.714+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.714+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.714+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.718+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T01:30:11.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.722+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.722+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.722+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.726+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T01:30:11.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.726+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.730+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.730+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.730+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T01:30:11.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.734+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.734+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.734+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.738+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T01:30:11.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.742+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.742+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.742+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.746+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T01:30:11.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.750+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.750+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.750+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.754+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T01:30:11.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.754+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.758+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.758+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.758+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T01:30:11.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.762+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.766+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.766+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.770+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T01:30:11.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.770+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.770+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.774+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.774+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T01:30:11.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.778+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.778+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.778+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.782+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T01:30:11.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.782+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.782+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.782+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.786+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T01:30:11.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.790+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.790+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.790+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.794+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T01:30:11.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.798+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.802+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.802+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.806+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T01:30:11.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.810+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.810+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.810+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.814+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T01:30:11.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.818+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.818+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.818+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.822+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T01:30:11.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.826+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.826+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.826+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.830+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T01:30:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.834+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.834+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.834+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.838+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T01:30:11.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.842+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.842+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.846+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.846+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T01:30:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.850+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.854+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.854+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.858+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T01:30:11.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.862+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.862+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.862+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.866+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T01:30:11.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.866+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.870+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.870+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.874+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T01:30:11.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.874+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.878+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.878+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.878+0000 7f4b341c19c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T01:30:11.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.882+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.882+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T01:30:11.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.882+0000 7f4b341c19c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T01:30:11.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.886+0000 7f49e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.894+0000 7f4b341c19c0 20 remove_watcher() i=0 2024-09-05T01:30:11.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.894+0000 7f4b341c19c0 2 removed watcher, disabling cache 2024-09-05T01:30:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.894+0000 7f4b341c19c0 20 remove_watcher() i=1 2024-09-05T01:30:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.898+0000 7f4b341c19c0 20 remove_watcher() i=2 2024-09-05T01:30:11.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.902+0000 7f4b341c19c0 20 remove_watcher() i=3 2024-09-05T01:30:11.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.902+0000 7f4b341c19c0 20 remove_watcher() i=4 2024-09-05T01:30:11.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.906+0000 7f4b341c19c0 20 remove_watcher() i=5 2024-09-05T01:30:11.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.906+0000 7f4b341c19c0 20 remove_watcher() i=6 2024-09-05T01:30:11.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:11.906+0000 7f4b341c19c0 20 remove_watcher() i=7 2024-09-05T01:30:11.927 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-05T01:30:11.946 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-05T01:30:11.946 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-05T01:30:11.947 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-05T01:30:11.947 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-05T01:30:11.975 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-05T01:30:12.844 INFO:tasks.s3tests:Creating rgw users... 2024-09-05T01:30:12.845 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-05T01:30:12.845 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key MXIGPZPVVPKZPZGBUVKZ --secret H+/6LMl5wkERqM9zZ8TOjsreekF9ML2hAqeYsLJZ/fe02E5Kfbtbzw== --cluster ceph 2024-09-05T01:30:12.930 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:12.931 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:13.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.178+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 realm 2024-09-05T01:30:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:13.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.182+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.186+0000 7fcd079159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:13.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.186+0000 7fcd079159c0 20 searching for the correct realm 2024-09-05T01:30:13.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.186+0000 7fcd04c1a640 0 -- 172.21.15.99:0/1964732583 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7fccf8034070 msgr2=0x7fccf8043430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.398+0000 7fcd0541b640 0 -- 172.21.15.99:0/1964732583 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fcd00004040 msgr2=0x7fcd000f8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:13.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.414+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 zone default found 2024-09-05T01:30:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 4 Realm: () 2024-09-05T01:30:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 zonegroup default 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.418+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.422+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.422+0000 7fcd079159c0 20 started sync module instance, tier type = 2024-09-05T01:30:13.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.422+0000 7fcd079159c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:13.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=0 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=1 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=2 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=3 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=4 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=5 2024-09-05T01:30:13.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.442+0000 7fcd079159c0 20 add_watcher() i=6 2024-09-05T01:30:13.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.446+0000 7fcd079159c0 20 add_watcher() i=7 2024-09-05T01:30:13.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.446+0000 7fcd079159c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:13.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcbbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:13.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:13.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:13.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 5 note: GC not initialized 2024-09-05T01:30:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcbba7e4640 20 reqs_thread_entry: start 2024-09-05T01:30:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:13.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 Filter name: none 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcb2bfff640 20 reqs_thread_entry: start 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-05T01:30:13.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 10 cache get: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ : miss 2024-09-05T01:30:13.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.450+0000 7fcd079159c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ info.flags=0x0 2024-09-05T01:30:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 adding default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ to cache LRU end 2024-09-05T01:30:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 cache get: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ : hit (negative entry) 2024-09-05T01:30:13.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 cache get: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ : hit (negative entry) 2024-09-05T01:30:13.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-05T01:30:13.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:13.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcd079159c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-05T01:30:13.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcbe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464488 cookie 93962813367584 notifier 9045 bl.length()=645 2024-09-05T01:30:13.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcbe8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-05T01:30:13.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.454+0000 7fcbe8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:13.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.458+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-05T01:30:13.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.458+0000 7fcd079159c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-05T01:30:13.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.458+0000 7fcd079159c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-05T01:30:13.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.462+0000 7fcbe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464489 cookie 93962813375728 notifier 9045 bl.length()=185 2024-09-05T01:30:13.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.462+0000 7fcbe8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-05T01:30:13.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.462+0000 7fcbe8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-05T01:30:13.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcd079159c0 10 cache put: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ info.flags=0x7 2024-09-05T01:30:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcd079159c0 10 moving default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ to cache LRU end 2024-09-05T01:30:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcd079159c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MXIGPZPVVPKZPZGBUVKZ, ofs0, ns] 2024-09-05T01:30:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcbe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 93962813365104 notifier 9045 bl.length()=186 2024-09-05T01:30:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcbe8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ info.flags=0x7 2024-09-05T01:30:13.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.466+0000 7fcbe8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MXIGPZPVVPKZPZGBUVKZ to cache LRU end 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foo.client.0", 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foo.client.0", 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foo+test@test.test", 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:13.471 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foo.client.0", 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "MXIGPZPVVPKZPZGBUVKZ", 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "H+/6LMl5wkERqM9zZ8TOjsreekF9ML2hAqeYsLJZ/fe02E5Kfbtbzw==", 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:13.458018Z" 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:13.472 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:13.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:13.457985Z", 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:13.474 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:13.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.470+0000 7fcbbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:13.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.474+0000 7fcd079159c0 20 remove_watcher() i=0 2024-09-05T01:30:13.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.474+0000 7fcd079159c0 2 removed watcher, disabling cache 2024-09-05T01:30:13.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.478+0000 7fcd079159c0 20 remove_watcher() i=1 2024-09-05T01:30:13.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.482+0000 7fcd079159c0 20 remove_watcher() i=2 2024-09-05T01:30:13.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.482+0000 7fcd079159c0 20 remove_watcher() i=3 2024-09-05T01:30:13.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.486+0000 7fcd079159c0 20 remove_watcher() i=4 2024-09-05T01:30:13.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.486+0000 7fcd079159c0 20 remove_watcher() i=5 2024-09-05T01:30:13.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.486+0000 7fcd079159c0 20 remove_watcher() i=6 2024-09-05T01:30:13.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.490+0000 7fcd079159c0 20 remove_watcher() i=7 2024-09-05T01:30:13.508 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 7137285340 --totp-seed AL44XFSQF47ZACZNBUUVSIVLWFEP2XCPCE7GHM4ELANOQFPRRESIRW4VPBAGHAVY --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:13.553 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:13.553 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:13.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.590+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.590+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.590+0000 7f3479c1e9c0 20 realm 2024-09-05T01:30:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.590+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:13.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:13.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.594+0000 7f3479c1e9c0 20 searching for the correct realm 2024-09-05T01:30:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.598+0000 7f3477f25640 0 -- 172.21.15.99:0/1779721757 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f346c0d2440 msgr2=0x7f346c0d2840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:13.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.606+0000 7f3477f25640 0 -- 172.21.15.99:0/1779721757 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3340080900 msgr2=0x7f3340082d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:13.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:13.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:13.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:13.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.614+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:13.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 zone default found 2024-09-05T01:30:13.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 4 Realm: () 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 zonegroup default 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 started sync module instance, tier type = 2024-09-05T01:30:13.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.618+0000 7f3479c1e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=0 2024-09-05T01:30:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=1 2024-09-05T01:30:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=2 2024-09-05T01:30:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=3 2024-09-05T01:30:13.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=4 2024-09-05T01:30:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=5 2024-09-05T01:30:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=6 2024-09-05T01:30:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 20 add_watcher() i=7 2024-09-05T01:30:13.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.634+0000 7f3479c1e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f332e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 5 note: GC not initialized 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f332d7e2640 20 reqs_thread_entry: start 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 Filter name: none 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f33267fc640 20 reqs_thread_entry: start 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-05T01:30:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-05T01:30:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:13.638+0000 7f3479c1e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:15.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.666+0000 7f3479c1e9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-05T01:30:15.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.666+0000 7f3479c1e9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:15.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.666+0000 7f3479c1e9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-05T01:30:15.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.670+0000 7f335a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399082 cookie 94016979690032 notifier 9063 bl.length()=659 2024-09-05T01:30:15.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.670+0000 7f335a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-05T01:30:15.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.670+0000 7f335a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-05T01:30:15.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.674+0000 7f332e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:15.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.678+0000 7f3479c1e9c0 20 remove_watcher() i=0 2024-09-05T01:30:15.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.678+0000 7f3479c1e9c0 2 removed watcher, disabling cache 2024-09-05T01:30:15.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.682+0000 7f3479c1e9c0 20 remove_watcher() i=1 2024-09-05T01:30:15.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.682+0000 7f3479c1e9c0 20 remove_watcher() i=2 2024-09-05T01:30:15.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.686+0000 7f3479c1e9c0 20 remove_watcher() i=3 2024-09-05T01:30:15.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.686+0000 7f3479c1e9c0 20 remove_watcher() i=4 2024-09-05T01:30:15.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.690+0000 7f3479c1e9c0 20 remove_watcher() i=5 2024-09-05T01:30:15.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.690+0000 7f3479c1e9c0 20 remove_watcher() i=6 2024-09-05T01:30:15.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.694+0000 7f3479c1e9c0 20 remove_watcher() i=7 2024-09-05T01:30:15.718 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-05T01:30:15.718 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key PZXPSXGFRGPOOMJHYFVV --secret GRHiMrjBn2WnriU/n1oVCb1s5DQGLEOV7YTajw+535Iwb53/CocnWg== --cluster ceph 2024-09-05T01:30:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:15.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 realm 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.846+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.850+0000 7f28d4eda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:15.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.850+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.850+0000 7f28d4eda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:15.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.850+0000 7f28d4eda9c0 20 searching for the correct realm 2024-09-05T01:30:15.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.854+0000 7f28d31e1640 0 -- 172.21.15.99:0/3893553030 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x558264068a70 msgr2=0x55826406af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:15.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.862+0000 7f28d29e0640 0 -- 172.21.15.99:0/3893553030 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f28cc0039d0 msgr2=0x7f28cc017410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:15.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:15.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:15.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.866+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:15.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 zone default found 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 4 Realm: () 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:15.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 zonegroup default 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 started sync module instance, tier type = 2024-09-05T01:30:15.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.870+0000 7f28d4eda9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=0 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=1 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=2 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=3 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=4 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=5 2024-09-05T01:30:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.886+0000 7f28d4eda9c0 20 add_watcher() i=6 2024-09-05T01:30:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 add_watcher() i=7 2024-09-05T01:30:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f27897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 5 note: GC not initialized 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f2703fff640 20 reqs_thread_entry: start 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 Filter name: none 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f2701ffb640 20 reqs_thread_entry: start 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-05T01:30:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.890+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache get: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV : miss 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV info.flags=0x0 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 adding default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV to cache LRU end 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache get: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV : hit (negative entry) 2024-09-05T01:30:15.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.894+0000 7f28d4eda9c0 10 cache get: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV : hit (negative entry) 2024-09-05T01:30:15.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-05T01:30:15.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f28d4eda9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:15.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f28d4eda9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-05T01:30:15.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f27b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399023 cookie 94018512274080 notifier 9078 bl.length()=645 2024-09-05T01:30:15.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f27b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-05T01:30:15.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.898+0000 7f27b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:15.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-05T01:30:15.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f28d4eda9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-05T01:30:15.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f28d4eda9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-05T01:30:15.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f27b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399028 cookie 94018512285648 notifier 9078 bl.length()=185 2024-09-05T01:30:15.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f27b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-05T01:30:15.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.902+0000 7f27b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-05T01:30:15.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f28d4eda9c0 10 cache put: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV info.flags=0x7 2024-09-05T01:30:15.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f28d4eda9c0 10 moving default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV to cache LRU end 2024-09-05T01:30:15.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f28d4eda9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:PZXPSXGFRGPOOMJHYFVV, ofs0, ns] 2024-09-05T01:30:15.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f27b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399083 cookie 94018512268032 notifier 9078 bl.length()=186 2024-09-05T01:30:15.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f27b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV info.flags=0x7 2024-09-05T01:30:15.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.906+0000 7f27b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PZXPSXGFRGPOOMJHYFVV to cache LRU end 2024-09-05T01:30:15.910 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:15.910 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "bar.client.0", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.bar.client.0", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "bar+test@test.test", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "bar.client.0", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "PZXPSXGFRGPOOMJHYFVV", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "GRHiMrjBn2WnriU/n1oVCb1s5DQGLEOV7YTajw+535Iwb53/CocnWg==", 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:15.898842Z" 2024-09-05T01:30:15.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:15.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:15.913 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:15.898823Z", 2024-09-05T01:30:15.914 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:15.914 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:15.914 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:15.914 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:15.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.910+0000 7f27897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:15.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.914+0000 7f28d4eda9c0 20 remove_watcher() i=0 2024-09-05T01:30:15.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.914+0000 7f28d4eda9c0 2 removed watcher, disabling cache 2024-09-05T01:30:15.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.918+0000 7f28d4eda9c0 20 remove_watcher() i=1 2024-09-05T01:30:15.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.918+0000 7f28d4eda9c0 20 remove_watcher() i=2 2024-09-05T01:30:15.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.922+0000 7f28d4eda9c0 20 remove_watcher() i=3 2024-09-05T01:30:15.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.922+0000 7f28d4eda9c0 20 remove_watcher() i=4 2024-09-05T01:30:15.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.926+0000 7f28d4eda9c0 20 remove_watcher() i=5 2024-09-05T01:30:15.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.926+0000 7f28d4eda9c0 20 remove_watcher() i=6 2024-09-05T01:30:15.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:15.926+0000 7f28d4eda9c0 20 remove_watcher() i=7 2024-09-05T01:30:15.943 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4459117994 --totp-seed I34PDRUJMUMQPCNZ7SIFLT4VU7ZDMVRW4LIV6AG3SKKUIJY64G642TY2HLJHFG2E --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:15.984 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:15.984 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:16.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 realm 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.022+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.026+0000 7fa33089d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.026+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.026+0000 7fa33089d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:16.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.026+0000 7fa33089d9c0 20 searching for the correct realm 2024-09-05T01:30:16.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.030+0000 7fa32eba4640 0 -- 172.21.15.99:0/1521660181 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa324112c20 msgr2=0x7fa3240fc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.038+0000 7fa32eba4640 0 -- 172.21.15.99:0/1521660181 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fa1f80815e0 msgr2=0x7fa1f8083a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.046+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 zone default found 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 4 Realm: () 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 zonegroup default 2024-09-05T01:30:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 started sync module instance, tier type = 2024-09-05T01:30:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.050+0000 7fa33089d9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=0 2024-09-05T01:30:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=1 2024-09-05T01:30:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=2 2024-09-05T01:30:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=3 2024-09-05T01:30:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=4 2024-09-05T01:30:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=5 2024-09-05T01:30:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=6 2024-09-05T01:30:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 20 add_watcher() i=7 2024-09-05T01:30:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.066+0000 7fa33089d9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 5 note: GC not initialized 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa15f7fe640 20 reqs_thread_entry: start 2024-09-05T01:30:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 Filter name: none 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa15d7fa640 20 reqs_thread_entry: start 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-05T01:30:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.070+0000 7fa33089d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa33089d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-05T01:30:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa33089d9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa33089d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-05T01:30:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa211ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399024 cookie 94222046912912 notifier 9099 bl.length()=659 2024-09-05T01:30:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa211ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-05T01:30:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.078+0000 7fa211ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-05T01:30:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.082+0000 7fa1e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.086+0000 7fa33089d9c0 20 remove_watcher() i=0 2024-09-05T01:30:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.086+0000 7fa33089d9c0 2 removed watcher, disabling cache 2024-09-05T01:30:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.086+0000 7fa33089d9c0 20 remove_watcher() i=1 2024-09-05T01:30:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.090+0000 7fa33089d9c0 20 remove_watcher() i=2 2024-09-05T01:30:16.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.090+0000 7fa33089d9c0 20 remove_watcher() i=3 2024-09-05T01:30:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.094+0000 7fa33089d9c0 20 remove_watcher() i=4 2024-09-05T01:30:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.094+0000 7fa33089d9c0 20 remove_watcher() i=5 2024-09-05T01:30:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.094+0000 7fa33089d9c0 20 remove_watcher() i=6 2024-09-05T01:30:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.098+0000 7fa33089d9c0 20 remove_watcher() i=7 2024-09-05T01:30:16.113 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-05T01:30:16.199 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:16.199 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:16.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.238+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 realm 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:16.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:16.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.242+0000 7f1f5362e9c0 20 searching for the correct realm 2024-09-05T01:30:16.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.246+0000 7f1f51935640 0 -- 172.21.15.99:0/613336290 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f1f4810c630 msgr2=0x7f1f48128980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.254+0000 7f1f50933640 0 -- 172.21.15.99:0/613336290 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x55b96baafa00 msgr2=0x55b96bab1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.262+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 zone default found 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 4 Realm: () 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:16.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 zonegroup default 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 started sync module instance, tier type = 2024-09-05T01:30:16.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.266+0000 7f1f5362e9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:16.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=0 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=1 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=2 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=3 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=4 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=5 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=6 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 20 add_watcher() i=7 2024-09-05T01:30:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.282+0000 7f1f5362e9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:16.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1e07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 5 note: GC not initialized 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1e06fe5640 20 reqs_thread_entry: start 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 Filter name: none 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1e04fe1640 20 reqs_thread_entry: start 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-05T01:30:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-05T01:30:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-05T01:30:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-05T01:30:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-05T01:30:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-05T01:30:16.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.286+0000 7f1f5362e9c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-05T01:30:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1f5362e9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-05T01:30:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1f5362e9c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1f5362e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-05T01:30:16.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1e34ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399025 cookie 94254863710912 notifier 8567 bl.length()=389 2024-09-05T01:30:16.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1e34ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-05T01:30:16.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.290+0000 7f1e34ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1f5362e9c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-05T01:30:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1f5362e9c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1f5362e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-05T01:30:16.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1e23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399084 cookie 94254863713184 notifier 8567 bl.length()=230 2024-09-05T01:30:16.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1e23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-05T01:30:16.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.298+0000 7f1e23fff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1f5362e9c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-05T01:30:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1f5362e9c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-05T01:30:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1f5362e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-05T01:30:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1e23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398920 cookie 94254863717328 notifier 8567 bl.length()=234 2024-09-05T01:30:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1e23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-05T01:30:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.302+0000 7f1e23fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-05T01:30:16.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.306+0000 7f1e07fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.310+0000 7f1f5362e9c0 20 remove_watcher() i=0 2024-09-05T01:30:16.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.310+0000 7f1f5362e9c0 2 removed watcher, disabling cache 2024-09-05T01:30:16.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.310+0000 7f1f5362e9c0 20 remove_watcher() i=1 2024-09-05T01:30:16.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.314+0000 7f1f5362e9c0 20 remove_watcher() i=2 2024-09-05T01:30:16.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.314+0000 7f1f5362e9c0 20 remove_watcher() i=3 2024-09-05T01:30:16.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.318+0000 7f1f5362e9c0 20 remove_watcher() i=4 2024-09-05T01:30:16.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.318+0000 7f1f5362e9c0 20 remove_watcher() i=5 2024-09-05T01:30:16.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.322+0000 7f1f5362e9c0 20 remove_watcher() i=6 2024-09-05T01:30:16.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.322+0000 7f1f5362e9c0 20 remove_watcher() i=7 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "RGW33333333333333333", 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "tenant": "testx", 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "Mr.RGW33333333333333333", 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:16.335 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_users": 1000, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_roles": 1000, 2024-09-05T01:30:16.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max_groups": 1000, 2024-09-05T01:30:16.337 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:16.337 INFO:teuthology.orchestra.run.smithi099.stdout: "max_access_keys": 4 2024-09-05T01:30:16.337 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:16.338 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-05T01:30:16.338 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key TZOVDDMYBRSZVFKZQTWX --secret bEFtguvVVK2NH7xRuTo2F4wtTIbo+EYcmWmBb/qTl2XLOhSMqZB3Dg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-05T01:30:16.425 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:16.425 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:16.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.462+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 realm 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:16.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:16.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.466+0000 7f4e4ee609c0 20 searching for the correct realm 2024-09-05T01:30:16.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.470+0000 7f4e4d167640 0 -- 172.21.15.99:0/2685548101 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4e40008040 msgr2=0x7f4e4005bdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.478+0000 7f4e4d167640 0 -- 172.21.15.99:0/2685548101 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f4d18081660 msgr2=0x7f4d18083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.486+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 zone default found 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 4 Realm: () 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 zonegroup default 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 started sync module instance, tier type = 2024-09-05T01:30:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.490+0000 7f4e4ee609c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=0 2024-09-05T01:30:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=1 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=2 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=3 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=4 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=5 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=6 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 20 add_watcher() i=7 2024-09-05T01:30:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.506+0000 7f4e4ee609c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4d02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 5 note: GC not initialized 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4d01fe3640 20 reqs_thread_entry: start 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 Filter name: none 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4c737fe640 20 reqs_thread_entry: start 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-05T01:30:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX : miss 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX info.flags=0x0 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 adding default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX to cache LRU end 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-05T01:30:16.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.510+0000 7f4e4ee609c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX : hit (negative entry) 2024-09-05T01:30:16.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 cache get: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX : hit (negative entry) 2024-09-05T01:30:16.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-05T01:30:16.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4e4ee609c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-05T01:30:16.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4d23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399029 cookie 94107447090144 notifier 8585 bl.length()=732 2024-09-05T01:30:16.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4d23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-05T01:30:16.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.514+0000 7f4d23fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-05T01:30:16.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-05T01:30:16.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-05T01:30:16.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4d237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398962 cookie 94107447094064 notifier 8585 bl.length()=215 2024-09-05T01:30:16.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4d237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-05T01:30:16.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4d237fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-05T01:30:16.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 cache put: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX info.flags=0x7 2024-09-05T01:30:16.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 moving default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX to cache LRU end 2024-09-05T01:30:16.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.522+0000 7f4e4ee609c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:TZOVDDMYBRSZVFKZQTWX, ofs0, ns] 2024-09-05T01:30:16.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.526+0000 7f4d23fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 94107447075312 notifier 8585 bl.length()=201 2024-09-05T01:30:16.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.526+0000 7f4d23fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX info.flags=0x7 2024-09-05T01:30:16.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.526+0000 7f4d23fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TZOVDDMYBRSZVFKZQTWX to cache LRU end 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.526+0000 7f4e4ee609c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:16.529 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "testx$tenanteduser.client.0", 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "TZOVDDMYBRSZVFKZQTWX", 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "bEFtguvVVK2NH7xRuTo2F4wtTIbo+EYcmWmBb/qTl2XLOhSMqZB3Dg==", 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.518087Z" 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:16.530 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:16.531 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:16.531 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:16.531 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:16.531 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:16.532 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "root", 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "RGW33333333333333333", 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.518073Z", 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:16.533 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:16.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.530+0000 7f4d02fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.534+0000 7f4e4ee609c0 20 remove_watcher() i=0 2024-09-05T01:30:16.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.534+0000 7f4e4ee609c0 2 removed watcher, disabling cache 2024-09-05T01:30:16.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.534+0000 7f4e4ee609c0 20 remove_watcher() i=1 2024-09-05T01:30:16.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.538+0000 7f4e4ee609c0 20 remove_watcher() i=2 2024-09-05T01:30:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.538+0000 7f4e4ee609c0 20 remove_watcher() i=3 2024-09-05T01:30:16.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.542+0000 7f4e4ee609c0 20 remove_watcher() i=4 2024-09-05T01:30:16.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.542+0000 7f4e4ee609c0 20 remove_watcher() i=5 2024-09-05T01:30:16.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.546+0000 7f4e4ee609c0 20 remove_watcher() i=6 2024-09-05T01:30:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.546+0000 7f4e4ee609c0 20 remove_watcher() i=7 2024-09-05T01:30:16.561 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 8698219770 --totp-seed EYET7OC46KK4G52HRZ5QJAVQTCFVNORFMFDCS3IIRWMZFRFW2ENPSCGWKLELM4HD --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:16.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 realm 2024-09-05T01:30:16.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:16.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.706+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.710+0000 7fae553499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.710+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.710+0000 7fae553499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:16.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.710+0000 7fae553499c0 20 searching for the correct realm 2024-09-05T01:30:16.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.726+0000 7fae52e4f640 0 -- 172.21.15.99:0/1953164270 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fae4c07ab60 msgr2=0x7fae4c05fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.738+0000 7fae52e4f640 0 -- 172.21.15.99:0/1953164270 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fae4c068b60 msgr2=0x7fae4c04e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:16.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.746+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 zone default found 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 4 Realm: () 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 zonegroup default 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 started sync module instance, tier type = 2024-09-05T01:30:16.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.750+0000 7fae553499c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=0 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=1 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=2 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=3 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=4 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=5 2024-09-05T01:30:16.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=6 2024-09-05T01:30:16.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 20 add_watcher() i=7 2024-09-05T01:30:16.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.766+0000 7fae553499c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:16.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fad097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:16.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:16.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 5 note: GC not initialized 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fac83fff640 20 reqs_thread_entry: start 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 Filter name: none 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fac81ffb640 20 reqs_thread_entry: start 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-05T01:30:16.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-05T01:30:16.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-05T01:30:16.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.770+0000 7fae553499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:16.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fae553499c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-05T01:30:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fae553499c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fae553499c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-05T01:30:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fad367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366326 cookie 94424566356080 notifier 8603 bl.length()=746 2024-09-05T01:30:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fad367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-05T01:30:16.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.774+0000 7fad367fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-05T01:30:16.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.778+0000 7fad097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.782+0000 7fae553499c0 20 remove_watcher() i=0 2024-09-05T01:30:16.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.782+0000 7fae553499c0 2 removed watcher, disabling cache 2024-09-05T01:30:16.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.786+0000 7fae553499c0 20 remove_watcher() i=1 2024-09-05T01:30:16.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.786+0000 7fae553499c0 20 remove_watcher() i=2 2024-09-05T01:30:16.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.790+0000 7fae553499c0 20 remove_watcher() i=3 2024-09-05T01:30:16.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.790+0000 7fae553499c0 20 remove_watcher() i=4 2024-09-05T01:30:16.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.794+0000 7fae553499c0 20 remove_watcher() i=5 2024-09-05T01:30:16.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.794+0000 7fae553499c0 20 remove_watcher() i=6 2024-09-05T01:30:16.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.794+0000 7fae553499c0 20 remove_watcher() i=7 2024-09-05T01:30:16.811 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-05T01:30:16.811 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key RNDUVZLXINXRIYFLGSLI --secret MpdKuBLIdIrObg1DKF69fchJb4xUVcBWf8T/hjLO84LhXQ22FbO8JQ== --cluster ceph 2024-09-05T01:30:16.896 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:16.897 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:16.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 realm 2024-09-05T01:30:16.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:16.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.934+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:16.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.938+0000 7f847b6bb9c0 20 searching for the correct realm 2024-09-05T01:30:16.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.942+0000 7f84799c2640 0 -- 172.21.15.99:0/2467000750 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f847003d040 msgr2=0x7f847001a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.950+0000 7f84791c1640 0 -- 172.21.15.99:0/2467000750 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f846c101360 msgr2=0x7f846c1249e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:16.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:16.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:16.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 zone default found 2024-09-05T01:30:16.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 4 Realm: () 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 zonegroup default 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 started sync module instance, tier type = 2024-09-05T01:30:16.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.958+0000 7f847b6bb9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=0 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=1 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=2 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=3 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=4 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=5 2024-09-05T01:30:16.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.974+0000 7f847b6bb9c0 20 add_watcher() i=6 2024-09-05T01:30:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 add_watcher() i=7 2024-09-05T01:30:16.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f832ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 5 note: GC not initialized 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f832efe5640 20 reqs_thread_entry: start 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 Filter name: none 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f832cfe1640 20 reqs_thread_entry: start 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-05T01:30:16.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-05T01:30:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.978+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache get: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI : miss 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI info.flags=0x0 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 adding default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI to cache LRU end 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache get: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI : hit (negative entry) 2024-09-05T01:30:16.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache get: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI : hit (negative entry) 2024-09-05T01:30:16.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:16.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:16.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f847b6bb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-05T01:30:16.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f835cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366259 cookie 94914031538752 notifier 9180 bl.length()=660 2024-09-05T01:30:16.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f835cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:16.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.982+0000 7f835cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.986+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-05T01:30:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.986+0000 7f847b6bb9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-05T01:30:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.986+0000 7f847b6bb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-05T01:30:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.990+0000 7f835cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366322 cookie 94914031522384 notifier 9180 bl.length()=191 2024-09-05T01:30:16.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.990+0000 7f835cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-05T01:30:16.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.990+0000 7f835cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-05T01:30:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f847b6bb9c0 10 cache put: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI info.flags=0x7 2024-09-05T01:30:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f847b6bb9c0 10 moving default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI to cache LRU end 2024-09-05T01:30:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f847b6bb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:RNDUVZLXINXRIYFLGSLI, ofs0, ns] 2024-09-05T01:30:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f835cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94914031524592 notifier 9180 bl.length()=189 2024-09-05T01:30:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f835cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI info.flags=0x7 2024-09-05T01:30:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.994+0000 7f835cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RNDUVZLXINXRIYFLGSLI to cache LRU end 2024-09-05T01:30:16.998 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:16.998 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foobar.client.0", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foobar.client.0", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foobar+test@test.test", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foobar.client.0", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "RNDUVZLXINXRIYFLGSLI", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "MpdKuBLIdIrObg1DKF69fchJb4xUVcBWf8T/hjLO84LhXQ22FbO8JQ==", 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.986230Z" 2024-09-05T01:30:16.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:17.000 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:30:17.001 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.986218Z", 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:17.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:16.998+0000 7f832ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:17.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.002+0000 7f847b6bb9c0 20 remove_watcher() i=0 2024-09-05T01:30:17.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.002+0000 7f847b6bb9c0 2 removed watcher, disabling cache 2024-09-05T01:30:17.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.006+0000 7f847b6bb9c0 20 remove_watcher() i=1 2024-09-05T01:30:17.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.006+0000 7f847b6bb9c0 20 remove_watcher() i=2 2024-09-05T01:30:17.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.010+0000 7f847b6bb9c0 20 remove_watcher() i=3 2024-09-05T01:30:17.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.014+0000 7f847b6bb9c0 20 remove_watcher() i=4 2024-09-05T01:30:17.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.014+0000 7f847b6bb9c0 20 remove_watcher() i=5 2024-09-05T01:30:17.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.014+0000 7f847b6bb9c0 20 remove_watcher() i=6 2024-09-05T01:30:17.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.014+0000 7f847b6bb9c0 20 remove_watcher() i=7 2024-09-05T01:30:17.032 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 9864021587 --totp-seed ZIFRYQVISDZLSETZ3VOZOJXZBDE7G6JMTKLRWJQUAHET6RF5U67O5FHDO46ZIQ4I --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:17.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 realm 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.166+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.170+0000 7f3798cd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:17.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.170+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.170+0000 7f3798cd99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:17.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.170+0000 7f3798cd99c0 20 searching for the correct realm 2024-09-05T01:30:17.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.174+0000 7f3796fe0640 0 -- 172.21.15.99:0/575720247 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f378c035060 msgr2=0x7f378c062860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:17.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.390+0000 7f3796fe0640 0 -- 172.21.15.99:0/575720247 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f378c035060 msgr2=0x7f378c062860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.402+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 zone default found 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 4 Realm: () 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:17.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 zonegroup default 2024-09-05T01:30:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 started sync module instance, tier type = 2024-09-05T01:30:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.406+0000 7f3798cd99c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:17.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=0 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=1 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=2 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=3 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=4 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=5 2024-09-05T01:30:17.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.430+0000 7f3798cd99c0 20 add_watcher() i=6 2024-09-05T01:30:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.434+0000 7f3798cd99c0 20 add_watcher() i=7 2024-09-05T01:30:17.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.434+0000 7f3798cd99c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:17.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f364cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:17.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:17.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:17.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 5 note: GC not initialized 2024-09-05T01:30:17.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f35c77fe640 20 reqs_thread_entry: start 2024-09-05T01:30:17.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:17.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 20 Filter name: none 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f35c57fa640 20 reqs_thread_entry: start 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.438+0000 7f3798cd99c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.442+0000 7f3798cd99c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.442+0000 7f3798cd99c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.442+0000 7f3798cd99c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-05T01:30:17.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.442+0000 7f3798cd99c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.442+0000 7f3798cd99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:17.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3798cd99c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:17.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3798cd99c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3798cd99c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-05T01:30:17.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3679ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366260 cookie 94306116213536 notifier 8636 bl.length()=674 2024-09-05T01:30:17.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3679ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:17.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.446+0000 7f3679ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.450+0000 7f364cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.458+0000 7f3798cd99c0 20 remove_watcher() i=0 2024-09-05T01:30:17.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.458+0000 7f3798cd99c0 2 removed watcher, disabling cache 2024-09-05T01:30:17.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.458+0000 7f3798cd99c0 20 remove_watcher() i=1 2024-09-05T01:30:17.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.462+0000 7f3798cd99c0 20 remove_watcher() i=2 2024-09-05T01:30:17.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.462+0000 7f3798cd99c0 20 remove_watcher() i=3 2024-09-05T01:30:17.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.466+0000 7f3798cd99c0 20 remove_watcher() i=4 2024-09-05T01:30:17.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.466+0000 7f3798cd99c0 20 remove_watcher() i=5 2024-09-05T01:30:17.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.470+0000 7f3798cd99c0 20 remove_watcher() i=6 2024-09-05T01:30:17.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.470+0000 7f3798cd99c0 20 remove_watcher() i=7 2024-09-05T01:30:17.488 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-05T01:30:17.519 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:17.519 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:17.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 realm 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.558+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.562+0000 7ff4e41ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.562+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.562+0000 7ff4e41ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:17.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.562+0000 7ff4e41ff9c0 20 searching for the correct realm 2024-09-05T01:30:17.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.566+0000 7ff4e2506640 0 -- 172.21.15.99:0/337436938 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff4d8080b20 msgr2=0x7ff4d808fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:17.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.782+0000 7ff4e2506640 0 -- 172.21.15.99:0/337436938 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff4d8080b20 msgr2=0x7ff4d808fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.794+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 zone default found 2024-09-05T01:30:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 4 Realm: () 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 zonegroup default 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.798+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.802+0000 7ff4e41ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.802+0000 7ff4e41ff9c0 20 started sync module instance, tier type = 2024-09-05T01:30:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.802+0000 7ff4e41ff9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=0 2024-09-05T01:30:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=1 2024-09-05T01:30:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=2 2024-09-05T01:30:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=3 2024-09-05T01:30:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=4 2024-09-05T01:30:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=5 2024-09-05T01:30:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=6 2024-09-05T01:30:17.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 20 add_watcher() i=7 2024-09-05T01:30:17.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.822+0000 7ff4e41ff9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff3937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 5 note: GC not initialized 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff3927fc640 20 reqs_thread_entry: start 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 20 Filter name: none 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff303fff640 20 reqs_thread_entry: start 2024-09-05T01:30:17.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-05T01:30:17.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.826+0000 7ff4e41ff9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-05T01:30:17.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-05T01:30:17.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:17.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:17.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff4e41ff9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-05T01:30:17.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff3c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366261 cookie 94508665171904 notifier 8651 bl.length()=727 2024-09-05T01:30:17.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff3c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-05T01:30:17.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.830+0000 7ff3c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-05T01:30:17.834 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foobar.client.0", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foobar.client.0", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foobar+test@test.test", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foobar.client.0", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "RNDUVZLXINXRIYFLGSLI", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "MpdKuBLIdIrObg1DKF69fchJb4xUVcBWf8T/hjLO84LhXQ22FbO8JQ==", 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:17.835 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.986230Z" 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [ 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "oidc-provider", 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "roles", 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "user-policy", 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:17.837 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [ 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "9864021587" 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:17.838 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:16.986218Z", 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:17.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.834+0000 7ff3937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:17.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.838+0000 7ff4e41ff9c0 20 remove_watcher() i=0 2024-09-05T01:30:17.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.838+0000 7ff4e41ff9c0 2 removed watcher, disabling cache 2024-09-05T01:30:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.842+0000 7ff4e41ff9c0 20 remove_watcher() i=1 2024-09-05T01:30:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.842+0000 7ff4e41ff9c0 20 remove_watcher() i=2 2024-09-05T01:30:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.846+0000 7ff4e41ff9c0 20 remove_watcher() i=3 2024-09-05T01:30:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.850+0000 7ff4e41ff9c0 20 remove_watcher() i=4 2024-09-05T01:30:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.850+0000 7ff4e41ff9c0 20 remove_watcher() i=5 2024-09-05T01:30:17.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.850+0000 7ff4e41ff9c0 20 remove_watcher() i=6 2024-09-05T01:30:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.854+0000 7ff4e41ff9c0 20 remove_watcher() i=7 2024-09-05T01:30:17.869 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-05T01:30:17.948 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:17.949 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.986+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 realm 2024-09-05T01:30:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:17.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:17.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:17.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.990+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:17.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.994+0000 7fe2d8f569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:17.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.994+0000 7fe2d8f569c0 20 searching for the correct realm 2024-09-05T01:30:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:17.998+0000 7fe2d725d640 0 -- 172.21.15.99:0/4280605591 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe2cc01b040 msgr2=0x7fe2cc02a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:18.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.214+0000 7fe2d725d640 0 -- 172.21.15.99:0/4280605591 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fe2cc01b040 msgr2=0x7fe2cc02a3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 zone default found 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 4 Realm: () 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 zonegroup default 2024-09-05T01:30:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.226+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 started sync module instance, tier type = 2024-09-05T01:30:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.230+0000 7fe2d8f569c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=0 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=1 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=2 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=3 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=4 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=5 2024-09-05T01:30:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.254+0000 7fe2d8f569c0 20 add_watcher() i=6 2024-09-05T01:30:18.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.258+0000 7fe2d8f569c0 20 add_watcher() i=7 2024-09-05T01:30:18.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.258+0000 7fe2d8f569c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe18d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 5 note: GC not initialized 2024-09-05T01:30:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe107fff640 20 reqs_thread_entry: start 2024-09-05T01:30:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 Filter name: none 2024-09-05T01:30:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe105ffb640 20 reqs_thread_entry: start 2024-09-05T01:30:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-05T01:30:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-05T01:30:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.262+0000 7fe2d8f569c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-05T01:30:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe2d8f569c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-05T01:30:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe2d8f569c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe2d8f569c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-05T01:30:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe1ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366323 cookie 94923072450512 notifier 8666 bl.length()=384 2024-09-05T01:30:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe1ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-05T01:30:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.266+0000 7fe1ba7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe2d8f569c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe2d8f569c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe2d8f569c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe1ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366381 cookie 94923072465056 notifier 8666 bl.length()=225 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe1ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-05T01:30:18.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.274+0000 7fe1ba7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe2d8f569c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-05T01:30:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe2d8f569c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-05T01:30:18.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe2d8f569c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-05T01:30:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe1ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94923072462736 notifier 8666 bl.length()=234 2024-09-05T01:30:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe1ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-05T01:30:18.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.278+0000 7fe1ba7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-05T01:30:18.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.282+0000 7fe18d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.286+0000 7fe2d8f569c0 20 remove_watcher() i=0 2024-09-05T01:30:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.286+0000 7fe2d8f569c0 2 removed watcher, disabling cache 2024-09-05T01:30:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.290+0000 7fe2d8f569c0 20 remove_watcher() i=1 2024-09-05T01:30:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.290+0000 7fe2d8f569c0 20 remove_watcher() i=2 2024-09-05T01:30:18.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.294+0000 7fe2d8f569c0 20 remove_watcher() i=3 2024-09-05T01:30:18.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.298+0000 7fe2d8f569c0 20 remove_watcher() i=4 2024-09-05T01:30:18.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.298+0000 7fe2d8f569c0 20 remove_watcher() i=5 2024-09-05T01:30:18.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.298+0000 7fe2d8f569c0 20 remove_watcher() i=6 2024-09-05T01:30:18.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.302+0000 7fe2d8f569c0 20 remove_watcher() i=7 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "RGW88888888888888888", 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tenant": "", 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "Mr.RGW88888888888888888", 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-09-05T01:30:18.318 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:18.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max_users": 1000, 2024-09-05T01:30:18.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max_roles": 1000, 2024-09-05T01:30:18.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max_groups": 1000, 2024-09-05T01:30:18.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:18.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max_access_keys": 4 2024-09-05T01:30:18.320 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:18.322 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-05T01:30:18.322 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key AGHVSQXGLXLSHHNDDZRE --secret Zux36NGS4RfYNCWh1vVfw3BMAismPlx8eoe4JDGgRQYaH0JgqKf6SQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-05T01:30:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:18.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 realm 2024-09-05T01:30:18.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:18.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.454+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.458+0000 7f4d6a28c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.458+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.458+0000 7f4d6a28c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:18.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.458+0000 7f4d6a28c9c0 20 searching for the correct realm 2024-09-05T01:30:18.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.462+0000 7f4d67d92640 0 -- 172.21.15.99:0/1302732770 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f4d600c3410 msgr2=0x7f4d600c3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:30:18.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.470+0000 7f4d67d92640 0 -- 172.21.15.99:0/1302732770 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f4d600d3040 msgr2=0x7f4d600d4940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 zone default found 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 4 Realm: () 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:18.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 zonegroup default 2024-09-05T01:30:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.478+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.482+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.482+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.482+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.482+0000 7f4d6a28c9c0 20 started sync module instance, tier type = 2024-09-05T01:30:18.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.482+0000 7f4d6a28c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=0 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=1 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=2 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=3 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=4 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=5 2024-09-05T01:30:18.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=6 2024-09-05T01:30:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 20 add_watcher() i=7 2024-09-05T01:30:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.498+0000 7f4d6a28c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4c1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 5 note: GC not initialized 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4c1d7e2640 20 reqs_thread_entry: start 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 Filter name: none 2024-09-05T01:30:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4c167fc640 20 reqs_thread_entry: start 2024-09-05T01:30:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-05T01:30:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE : miss 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE info.flags=0x0 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 adding default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE to cache LRU end 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.502+0000 7f4d6a28c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-05T01:30:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-05T01:30:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-05T01:30:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE : hit (negative entry) 2024-09-05T01:30:18.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 cache get: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE : hit (negative entry) 2024-09-05T01:30:18.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-05T01:30:18.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4d6a28c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-05T01:30:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4c46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366324 cookie 94626072141920 notifier 9264 bl.length()=681 2024-09-05T01:30:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4c46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-05T01:30:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.506+0000 7f4c46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-05T01:30:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4d6a28c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-05T01:30:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4d6a28c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-05T01:30:18.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4c46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366327 cookie 94626072145472 notifier 9264 bl.length()=189 2024-09-05T01:30:18.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4c46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-05T01:30:18.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.510+0000 7f4c46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-05T01:30:18.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4d6a28c9c0 10 cache put: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE info.flags=0x7 2024-09-05T01:30:18.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4d6a28c9c0 10 moving default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE to cache LRU end 2024-09-05T01:30:18.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4d6a28c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:AGHVSQXGLXLSHHNDDZRE, ofs0, ns] 2024-09-05T01:30:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4c46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366262 cookie 94626072157168 notifier 9264 bl.length()=188 2024-09-05T01:30:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4c46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE info.flags=0x7 2024-09-05T01:30:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.514+0000 7f4c46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AGHVSQXGLXLSHHNDDZRE to cache LRU end 2024-09-05T01:30:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.518+0000 7f4d6a28c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-05T01:30:18.521 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "root1.client.0", 2024-09-05T01:30:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-05T01:30:18.521 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "root1+test@test.test", 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "root1.client.0", 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "AGHVSQXGLXLSHHNDDZRE", 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "Zux36NGS4RfYNCWh1vVfw3BMAismPlx8eoe4JDGgRQYaH0JgqKf6SQ==", 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:18.509386Z" 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:18.522 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:18.523 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "root", 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "RGW88888888888888888", 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:18.509372Z", 2024-09-05T01:30:18.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:18.525 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:18.525 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.522+0000 7f4c1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.526+0000 7f4d6a28c9c0 20 remove_watcher() i=0 2024-09-05T01:30:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.526+0000 7f4d6a28c9c0 2 removed watcher, disabling cache 2024-09-05T01:30:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.526+0000 7f4d6a28c9c0 20 remove_watcher() i=1 2024-09-05T01:30:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.530+0000 7f4d6a28c9c0 20 remove_watcher() i=2 2024-09-05T01:30:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.530+0000 7f4d6a28c9c0 20 remove_watcher() i=3 2024-09-05T01:30:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.534+0000 7f4d6a28c9c0 20 remove_watcher() i=4 2024-09-05T01:30:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.534+0000 7f4d6a28c9c0 20 remove_watcher() i=5 2024-09-05T01:30:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.538+0000 7f4d6a28c9c0 20 remove_watcher() i=6 2024-09-05T01:30:18.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.538+0000 7f4d6a28c9c0 20 remove_watcher() i=7 2024-09-05T01:30:18.553 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7320224169 --totp-seed PU7UMA7JLA2CJ4LVP7XFBWL4XRJLZV7R4KFKJL5CZQHAEBRSVRLT4VPXQL4W55ER --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:18.595 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.630+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 realm 2024-09-05T01:30:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:18.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.634+0000 7f6ce2e1c9c0 20 searching for the correct realm 2024-09-05T01:30:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.642+0000 7f6ce0922640 0 -- 172.21.15.99:0/1422490344 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f6cd80c9420 msgr2=0x7f6cd80c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:18.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.650+0000 7f6ce0922640 0 -- 172.21.15.99:0/1422490344 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7f6cd80d9920 msgr2=0x7f6cd80aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:18.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:18.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:18.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:18.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:18.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:18.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:18.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.654+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 zone default found 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 4 Realm: () 2024-09-05T01:30:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 zonegroup default 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 started sync module instance, tier type = 2024-09-05T01:30:18.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.658+0000 7f6ce2e1c9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:18.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=0 2024-09-05T01:30:18.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=1 2024-09-05T01:30:18.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=2 2024-09-05T01:30:18.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=3 2024-09-05T01:30:18.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=4 2024-09-05T01:30:18.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=5 2024-09-05T01:30:18.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=6 2024-09-05T01:30:18.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 20 add_watcher() i=7 2024-09-05T01:30:18.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.674+0000 7f6ce2e1c9c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:18.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 5 note: GC not initialized 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6b967e4640 20 reqs_thread_entry: start 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:18.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 Filter name: none 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6b8f7fe640 20 reqs_thread_entry: start 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.678+0000 7f6ce2e1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:18.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6ce2e1c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-05T01:30:18.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6ce2e1c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6ce2e1c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-05T01:30:18.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6bb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366325 cookie 93924666115392 notifier 9279 bl.length()=695 2024-09-05T01:30:18.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6bb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-05T01:30:18.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.682+0000 7f6bb77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-05T01:30:18.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.686+0000 7f6b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.690+0000 7f6ce2e1c9c0 20 remove_watcher() i=0 2024-09-05T01:30:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.690+0000 7f6ce2e1c9c0 2 removed watcher, disabling cache 2024-09-05T01:30:18.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.690+0000 7f6ce2e1c9c0 20 remove_watcher() i=1 2024-09-05T01:30:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.694+0000 7f6ce2e1c9c0 20 remove_watcher() i=2 2024-09-05T01:30:18.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.694+0000 7f6ce2e1c9c0 20 remove_watcher() i=3 2024-09-05T01:30:18.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.698+0000 7f6ce2e1c9c0 20 remove_watcher() i=4 2024-09-05T01:30:18.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.698+0000 7f6ce2e1c9c0 20 remove_watcher() i=5 2024-09-05T01:30:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.698+0000 7f6ce2e1c9c0 20 remove_watcher() i=6 2024-09-05T01:30:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.702+0000 7f6ce2e1c9c0 20 remove_watcher() i=7 2024-09-05T01:30:18.716 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-05T01:30:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:18.794 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:18.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 realm 2024-09-05T01:30:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:18.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.834+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.838+0000 7fc04ad419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:18.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.838+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.838+0000 7fc04ad419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.838+0000 7fc04ad419c0 20 searching for the correct realm 2024-09-05T01:30:18.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:18.842+0000 7fc049048640 0 -- 172.21.15.99:0/277405748 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc030062450 msgr2=0x7fc030061ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T01:30:19.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.058+0000 7fc049048640 0 -- 172.21.15.99:0/277405748 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc030062450 msgr2=0x7fc030061ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:19.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.070+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:19.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:19.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 zone default found 2024-09-05T01:30:19.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 4 Realm: () 2024-09-05T01:30:19.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:19.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 zonegroup default 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 started sync module instance, tier type = 2024-09-05T01:30:19.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.074+0000 7fc04ad419c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=0 2024-09-05T01:30:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=1 2024-09-05T01:30:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=2 2024-09-05T01:30:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=3 2024-09-05T01:30:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=4 2024-09-05T01:30:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=5 2024-09-05T01:30:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.098+0000 7fc04ad419c0 20 add_watcher() i=6 2024-09-05T01:30:19.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.102+0000 7fc04ad419c0 20 add_watcher() i=7 2024-09-05T01:30:19.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.102+0000 7fc04ad419c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:19.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fbefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fc04ad419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:19.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fc04ad419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fc04ad419c0 5 note: GC not initialized 2024-09-05T01:30:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fbefcfe1640 20 reqs_thread_entry: start 2024-09-05T01:30:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fc04ad419c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.106+0000 7fc04ad419c0 20 Filter name: none 2024-09-05T01:30:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fbe767fc640 20 reqs_thread_entry: start 2024-09-05T01:30:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-05T01:30:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-05T01:30:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-05T01:30:19.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.110+0000 7fc04ad419c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-05T01:30:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fc04ad419c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-05T01:30:19.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fc04ad419c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fc04ad419c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-05T01:30:19.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fbf26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366326 cookie 93831800312432 notifier 9300 bl.length()=384 2024-09-05T01:30:19.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fbf26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-05T01:30:19.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.114+0000 7fbf26ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fc04ad419c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-05T01:30:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fc04ad419c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fc04ad419c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-05T01:30:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fbf26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366382 cookie 93831800318912 notifier 9300 bl.length()=225 2024-09-05T01:30:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fbf26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-05T01:30:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.118+0000 7fbf26ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fc04ad419c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-05T01:30:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fc04ad419c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-05T01:30:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fc04ad419c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-05T01:30:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fbf267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 93831800309632 notifier 9300 bl.length()=234 2024-09-05T01:30:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fbf267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-05T01:30:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.126+0000 7fbf267fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-05T01:30:19.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.130+0000 7fbefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.134+0000 7fc04ad419c0 20 remove_watcher() i=0 2024-09-05T01:30:19.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.134+0000 7fc04ad419c0 2 removed watcher, disabling cache 2024-09-05T01:30:19.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.138+0000 7fc04ad419c0 20 remove_watcher() i=1 2024-09-05T01:30:19.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.138+0000 7fc04ad419c0 20 remove_watcher() i=2 2024-09-05T01:30:19.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.142+0000 7fc04ad419c0 20 remove_watcher() i=3 2024-09-05T01:30:19.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.142+0000 7fc04ad419c0 20 remove_watcher() i=4 2024-09-05T01:30:19.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.146+0000 7fc04ad419c0 20 remove_watcher() i=5 2024-09-05T01:30:19.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.146+0000 7fc04ad419c0 20 remove_watcher() i=6 2024-09-05T01:30:19.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.146+0000 7fc04ad419c0 20 remove_watcher() i=7 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "RGW99999999999999999", 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "tenant": "", 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "Mr.RGW99999999999999999", 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-09-05T01:30:19.161 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_users": 1000, 2024-09-05T01:30:19.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max_roles": 1000, 2024-09-05T01:30:19.163 INFO:teuthology.orchestra.run.smithi099.stdout: "max_groups": 1000, 2024-09-05T01:30:19.163 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:19.163 INFO:teuthology.orchestra.run.smithi099.stdout: "max_access_keys": 4 2024-09-05T01:30:19.163 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:19.164 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-05T01:30:19.164 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key AXXUMAUUEBGNEYPISFOH --secret tHy9kykISOooGBeHNxrLpGjlHxCew+vAsGU4xL7lg3rylP/EG3Bleg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-05T01:30:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 realm 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.290+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.294+0000 7f3e18c169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:19.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.294+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.294+0000 7f3e18c169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:19.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.294+0000 7f3e18c169c0 20 searching for the correct realm 2024-09-05T01:30:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.298+0000 7f3e16f1d640 0 -- 172.21.15.99:0/1242762715 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3e000d9060 msgr2=0x7f3e000ab980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.514+0000 7f3e16f1d640 0 -- 172.21.15.99:0/1242762715 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f3e000d9060 msgr2=0x7f3e000ab980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.522+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:19.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:19.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 zone default found 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 4 Realm: () 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:19.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:19.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 zonegroup default 2024-09-05T01:30:19.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.526+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.530+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.530+0000 7f3e18c169c0 20 started sync module instance, tier type = 2024-09-05T01:30:19.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.530+0000 7f3e18c169c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=0 2024-09-05T01:30:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=1 2024-09-05T01:30:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=2 2024-09-05T01:30:19.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=3 2024-09-05T01:30:19.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=4 2024-09-05T01:30:19.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=5 2024-09-05T01:30:19.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.550+0000 7f3e18c169c0 20 add_watcher() i=6 2024-09-05T01:30:19.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.554+0000 7f3e18c169c0 20 add_watcher() i=7 2024-09-05T01:30:19.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.554+0000 7f3e18c169c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3cccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 5 note: GC not initialized 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3c477fe640 20 reqs_thread_entry: start 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 Filter name: none 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3c457fa640 20 reqs_thread_entry: start 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-05T01:30:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-05T01:30:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH : miss 2024-09-05T01:30:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH info.flags=0x0 2024-09-05T01:30:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 adding default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH to cache LRU end 2024-09-05T01:30:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-05T01:30:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.558+0000 7f3e18c169c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH : hit (negative entry) 2024-09-05T01:30:19.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 cache get: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH : hit (negative entry) 2024-09-05T01:30:19.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-05T01:30:19.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.562+0000 7f3e18c169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-05T01:30:19.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.566+0000 7f3cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366327 cookie 93990156858464 notifier 8732 bl.length()=681 2024-09-05T01:30:19.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.566+0000 7f3cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-05T01:30:19.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.566+0000 7f3cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3e18c169c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3e18c169c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 93990156876528 notifier 8732 bl.length()=189 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-05T01:30:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.570+0000 7f3cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-05T01:30:19.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3e18c169c0 10 cache put: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH info.flags=0x7 2024-09-05T01:30:19.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3e18c169c0 10 moving default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH to cache LRU end 2024-09-05T01:30:19.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3e18c169c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:AXXUMAUUEBGNEYPISFOH, ofs0, ns] 2024-09-05T01:30:19.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366329 cookie 93990156876528 notifier 8732 bl.length()=188 2024-09-05T01:30:19.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH info.flags=0x7 2024-09-05T01:30:19.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.574+0000 7f3cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AXXUMAUUEBGNEYPISFOH to cache LRU end 2024-09-05T01:30:19.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.578+0000 7f3e18c169c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-05T01:30:19.581 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T01:30:19.581 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "root2.client.0", 2024-09-05T01:30:19.581 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-05T01:30:19.581 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "root2+test@test.test", 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "root2.client.0", 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "AXXUMAUUEBGNEYPISFOH", 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "tHy9kykISOooGBeHNxrLpGjlHxCew+vAsGU4xL7lg3rylP/EG3Bleg==", 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:19.566222Z" 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-05T01:30:19.582 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:19.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "root", 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "RGW99999999999999999", 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-09-05T01:30:19.584 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-09-05T01:30:19.566190Z", 2024-09-05T01:30:19.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-09-05T01:30:19.585 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-09-05T01:30:19.585 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T01:30:19.585 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:30:19.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.582+0000 7f3cccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.586+0000 7f3e18c169c0 20 remove_watcher() i=0 2024-09-05T01:30:19.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.586+0000 7f3e18c169c0 2 removed watcher, disabling cache 2024-09-05T01:30:19.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.590+0000 7f3e18c169c0 20 remove_watcher() i=1 2024-09-05T01:30:19.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.590+0000 7f3e18c169c0 20 remove_watcher() i=2 2024-09-05T01:30:19.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.594+0000 7f3e18c169c0 20 remove_watcher() i=3 2024-09-05T01:30:19.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.598+0000 7f3e18c169c0 20 remove_watcher() i=4 2024-09-05T01:30:19.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.598+0000 7f3e18c169c0 20 remove_watcher() i=5 2024-09-05T01:30:19.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.598+0000 7f3e18c169c0 20 remove_watcher() i=6 2024-09-05T01:30:19.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.602+0000 7f3e18c169c0 20 remove_watcher() i=7 2024-09-05T01:30:19.619 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4117042977 --totp-seed NASOII3WEAQ7TDTE7Z7KTCSDPC72ZVIHDVKBNBTULXVQJSI634REJCCSU7LA2BYT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-05T01:30:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T01:30:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T01:30:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.702+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 realm 2024-09-05T01:30:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T01:30:19.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T01:30:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.706+0000 7fc4424129c0 20 searching for the correct realm 2024-09-05T01:30:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.710+0000 7fc440719640 0 -- 172.21.15.99:0/299492453 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc428020060 msgr2=0x7fc42806f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:19.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.926+0000 7fc440719640 0 -- 172.21.15.99:0/299492453 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7fc428020060 msgr2=0x7fc42806f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T01:30:19.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T01:30:19.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.938+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 zone default found 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 4 Realm: () 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 zonegroup default 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T01:30:19.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 started sync module instance, tier type = 2024-09-05T01:30:19.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.942+0000 7fc4424129c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=0 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=1 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=2 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=3 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=4 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=5 2024-09-05T01:30:19.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=6 2024-09-05T01:30:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 20 add_watcher() i=7 2024-09-05T01:30:19.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.966+0000 7fc4424129c0 2 all 8 watchers are set, enabling cache 2024-09-05T01:30:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T01:30:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T01:30:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 5 note: GC not initialized 2024-09-05T01:30:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc2f4fe1640 20 reqs_thread_entry: start 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 init_complete bucket index max shards: 11 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 Filter name: none 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc26e7fc640 20 reqs_thread_entry: start 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 rados->read ofs=0 len=0 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-05T01:30:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-05T01:30:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.970+0000 7fc4424129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T01:30:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc4424129c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-05T01:30:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc4424129c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc4424129c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-05T01:30:19.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc31effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366328 cookie 94223050882544 notifier 9336 bl.length()=695 2024-09-05T01:30:19.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc31effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-05T01:30:19.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.978+0000 7fc31effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-05T01:30:19.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.982+0000 7fc2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T01:30:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.986+0000 7fc4424129c0 20 remove_watcher() i=0 2024-09-05T01:30:19.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.986+0000 7fc4424129c0 2 removed watcher, disabling cache 2024-09-05T01:30:19.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.990+0000 7fc4424129c0 20 remove_watcher() i=1 2024-09-05T01:30:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.990+0000 7fc4424129c0 20 remove_watcher() i=2 2024-09-05T01:30:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.994+0000 7fc4424129c0 20 remove_watcher() i=3 2024-09-05T01:30:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.994+0000 7fc4424129c0 20 remove_watcher() i=4 2024-09-05T01:30:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.998+0000 7fc4424129c0 20 remove_watcher() i=5 2024-09-05T01:30:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.998+0000 7fc4424129c0 20 remove_watcher() i=6 2024-09-05T01:30:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T01:30:19.998+0000 7fc4424129c0 20 remove_watcher() i=7 2024-09-05T01:30:20.016 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-05T01:30:20.017 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:30:20.017 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-05T01:30:20.062 INFO:tasks.s3tests:Configuring boto... 2024-09-05T01:30:20.063 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T01:30:20.063 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-05T01:30:20.111 DEBUG:teuthology.orchestra.run.smithi099:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-05T01:30:20.286 INFO:teuthology.orchestra.run.smithi099.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-05T01:30:20.482 INFO:teuthology.orchestra.run.smithi099.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-05T01:30:20.769 INFO:teuthology.orchestra.run.smithi099.stdout:py installdeps: -rrequirements.txt 2024-09-05T01:32:17.066 INFO:teuthology.orchestra.run.smithi099.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-05T01:32:18.819 INFO:teuthology.orchestra.run.smithi099.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.15.4,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.2.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.2,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=69c60640b2a0350e6e55c72ded0dcd754630e4a65f28c0b7f80f8e02be019d62,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.0,urllib3==1.26.20,virtualenv==20.26.3,zope.event==5.0,zope.interface==7.0.3 2024-09-05T01:32:18.819 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test-pre: PYTHONHASHSEED='659055957' 2024-09-05T01:32:18.819 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-05T01:32:19.004 INFO:teuthology.orchestra.run.smithi099.stdout:============================= test session starts ============================== 2024-09-05T01:32:19.004 INFO:teuthology.orchestra.run.smithi099.stdout:platform linux -- Python 3.10.6, pytest-8.3.2, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-05T01:32:19.004 INFO:teuthology.orchestra.run.smithi099.stdout:cachedir: .tox/py/.pytest_cache 2024-09-05T01:32:19.004 INFO:teuthology.orchestra.run.smithi099.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-05T01:32:19.004 INFO:teuthology.orchestra.run.smithi099.stdout:configfile: pytest.ini 2024-09-05T01:32:20.813 INFO:teuthology.orchestra.run.smithi099.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-05T01:32:20.813 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T01:32:21.660 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-05T01:32:22.390 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-05T01:32:23.234 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-05T01:32:24.093 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-05T01:32:24.844 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-05T01:32:25.624 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-05T01:32:26.626 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-05T01:32:27.322 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-05T01:32:27.487 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-05T01:32:27.652 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-05T01:32:28.389 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-05T01:32:29.142 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-05T01:32:29.898 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-05T01:32:30.647 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-05T01:32:30.833 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-05T01:32:31.000 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-05T01:32:31.112 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.332 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.442 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.667 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-05T01:32:31.780 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-05T01:32:31.891 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.005 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.115 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.226 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.335 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.444 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-05T01:32:32.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-05T01:32:32.665 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-05T01:32:32.777 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-05T01:32:32.888 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-05T01:32:32.998 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-05T01:32:33.108 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-05T01:32:33.219 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-05T01:32:33.329 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-05T01:32:33.440 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-05T01:32:33.568 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-05T01:32:33.678 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-05T01:32:33.790 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-05T01:32:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-05T01:32:34.012 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-05T01:32:34.123 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-05T01:32:34.237 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.458 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.597 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.709 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.820 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-05T01:32:34.932 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-05T01:32:35.046 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-05T01:32:35.160 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-05T01:32:36.475 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-05T01:32:41.583 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-05T01:32:48.438 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-05T01:32:57.277 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-05T01:33:08.759 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-05T01:33:11.968 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-05T01:33:17.013 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-05T01:33:18.635 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-05T01:33:19.317 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-05T01:33:20.303 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-05T01:33:21.262 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-05T01:33:22.835 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-05T01:33:23.822 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-05T01:33:24.534 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-05T01:33:24.536 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-05T01:33:24.539 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-05T01:33:24.541 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-05T01:33:24.543 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-05T01:33:24.545 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-05T01:33:24.548 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-05T01:33:24.550 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-05T01:33:24.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.554 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.557 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.559 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.561 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-05T01:33:24.563 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.566 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.568 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-05T01:33:24.572 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-05T01:33:24.572 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-05T01:33:24.574 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-05T01:33:24.576 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-05T01:33:24.578 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-05T01:33:24.580 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-05T01:33:24.582 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-05T01:33:24.585 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-05T01:33:24.586 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-05T01:33:24.588 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-05T01:33:24.589 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-05T01:33:24.591 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-05T01:33:24.696 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-05T01:33:24.706 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-05T01:33:26.276 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-05T01:33:36.234 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-05T01:33:37.486 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-05T01:33:38.970 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-05T01:33:40.498 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-05T01:33:41.954 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-05T01:33:43.426 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-05T01:33:44.630 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-05T01:33:46.186 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-05T01:33:47.538 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-05T01:33:48.890 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-05T01:33:50.110 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-05T01:33:51.262 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-05T01:33:52.418 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-05T01:33:52.966 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-05T01:33:54.226 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-05T01:33:55.798 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-05T01:33:57.282 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-05T01:33:58.466 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-05T01:33:59.654 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-05T01:34:00.874 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-05T01:34:02.058 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-05T01:34:03.238 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-05T01:34:04.370 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-05T01:34:05.534 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-05T01:34:06.098 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-05T01:34:06.678 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-05T01:34:07.258 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-05T01:34:07.818 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-05T01:34:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-05T01:34:09.482 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-05T01:34:10.086 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-05T01:34:10.762 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-05T01:34:11.726 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-05T01:34:12.622 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-05T01:34:13.222 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-05T01:34:14.122 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-05T01:34:15.046 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-05T01:34:16.254 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-05T01:34:17.046 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-05T01:34:17.946 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-05T01:34:18.834 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-05T01:34:20.334 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-05T01:34:21.982 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-05T01:34:23.458 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-05T01:34:25.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:27.062 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:29.694 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:32.254 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:34.202 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:36.178 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-05T01:34:37.682 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-05T01:34:39.450 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-05T01:34:40.446 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-05T01:34:42.958 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-05T01:34:44.526 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-05T01:34:46.430 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-05T01:34:50.290 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-05T01:34:55.302 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-05T01:34:58.162 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-05T01:35:00.767 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-05T01:35:02.791 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-05T01:35:04.098 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-05T01:35:06.518 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-05T01:35:08.162 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-05T01:35:10.382 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-05T01:35:12.046 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-05T01:35:15.002 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-05T01:35:17.646 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-05T01:35:20.818 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-05T01:35:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-05T01:35:26.262 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-05T01:35:28.314 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-05T01:35:29.930 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-05T01:35:33.750 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-05T01:35:36.682 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-05T01:35:39.862 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-05T01:35:42.851 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-05T01:35:45.726 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-05T01:35:48.627 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-05T01:35:51.102 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-05T01:35:52.831 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-05T01:35:54.786 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-05T01:35:58.414 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-05T01:36:03.007 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-05T01:36:04.966 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-05T01:36:07.890 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-05T01:36:10.809 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-05T01:36:13.698 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-05T01:36:16.787 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-05T01:36:20.091 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-05T01:36:23.162 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-05T01:36:26.027 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-05T01:36:28.006 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-05T01:36:29.535 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-05T01:36:31.026 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-05T01:36:32.594 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-05T01:36:35.650 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-05T01:36:38.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-05T01:36:41.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-05T01:36:44.875 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-05T01:36:47.959 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-05T01:36:51.067 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-05T01:36:54.127 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-05T01:36:57.198 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-05T01:37:00.243 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-05T01:37:03.295 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-05T01:37:06.403 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-05T01:37:09.479 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-05T01:37:11.547 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-05T01:37:13.599 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-05T01:37:15.586 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-05T01:37:17.567 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-05T01:37:19.118 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-05T01:37:21.226 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-05T01:37:23.102 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-05T01:37:24.958 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-05T01:37:26.870 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-05T01:37:28.754 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-05T01:37:30.614 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-05T01:37:32.562 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-05T01:37:34.374 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-05T01:37:37.042 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-05T01:37:39.786 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-05T01:37:41.286 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-05T01:37:42.834 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-05T01:37:44.666 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-05T01:37:46.534 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-05T01:37:49.218 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-05T01:37:51.909 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-05T01:37:53.790 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-05T01:37:55.701 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-05T01:37:57.542 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-05T01:37:59.438 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-05T01:38:01.297 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-05T01:38:03.170 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-05T01:38:04.998 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-05T01:38:06.898 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-05T01:38:08.758 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-05T01:38:10.602 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-05T01:38:12.618 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-05T01:38:14.466 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-05T01:38:16.222 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-05T01:38:17.963 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-05T01:38:19.742 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-05T01:38:21.597 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-05T01:38:23.473 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-05T01:40:37.402 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-05T01:40:39.122 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-05T01:40:40.882 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-05T01:40:42.574 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-05T01:40:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-05T01:40:46.234 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-05T01:40:47.946 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-05T01:40:49.738 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-05T01:40:51.438 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-05T01:40:53.134 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-05T01:40:54.862 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-05T01:40:56.614 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-05T01:40:58.318 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-05T01:41:00.230 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-05T01:41:02.086 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-05T01:41:03.930 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-05T01:41:05.818 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-05T01:41:07.630 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-05T01:41:09.474 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-05T01:41:11.374 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-05T01:41:13.354 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-05T01:41:15.202 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-05T01:41:17.050 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-05T01:41:19.018 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-05T01:41:21.046 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-05T01:41:22.894 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-05T01:41:24.825 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-05T01:41:26.694 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-05T01:41:28.530 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-05T01:41:29.178 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-05T01:41:30.682 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-05T01:41:35.910 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-05T01:41:41.195 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-05T01:41:42.994 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-05T01:41:44.874 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-05T01:41:46.754 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-05T01:41:48.622 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-05T01:41:50.618 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-05T01:41:52.638 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-05T01:41:54.474 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-05T01:41:56.390 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-05T01:41:58.238 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-05T01:42:00.017 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-05T01:42:01.870 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-05T01:42:03.694 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-05T01:42:06.051 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-05T01:42:08.962 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-05T01:42:10.314 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-05T01:42:11.654 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-05T01:42:12.838 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-05T01:42:14.022 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-05T01:42:14.594 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-05T01:42:15.174 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-05T01:42:15.762 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-05T01:42:21.786 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-05T01:42:22.374 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-05T01:42:23.764 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-05T01:42:24.914 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-05T01:42:26.202 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-05T01:42:27.449 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-05T01:42:32.594 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-05T01:42:34.726 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-05T01:42:36.802 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-05T01:44:51.119 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-05T01:47:05.437 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-05T01:47:06.827 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-05T01:47:08.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-05T01:47:09.727 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-05T01:47:11.183 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-05T01:47:12.887 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-05T01:47:14.419 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-05T01:47:15.879 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-05T01:47:17.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-05T01:47:19.128 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-05T01:47:20.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-05T01:47:22.191 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-05T01:47:23.823 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-05T01:47:25.271 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-05T01:47:26.479 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-05T01:47:27.807 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-05T01:47:29.155 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-05T01:47:30.983 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-05T01:47:32.419 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-05T01:47:33.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-05T01:47:35.183 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-05T01:47:36.655 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-05T01:47:38.215 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-05T01:47:39.451 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-05T01:47:40.643 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-05T01:47:41.843 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-05T01:47:43.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-05T01:47:44.251 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-05T01:47:45.511 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-05T01:47:46.967 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-05T01:47:48.175 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-05T01:47:49.423 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-05T01:47:50.571 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-05T01:47:51.771 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-05T01:47:53.615 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-05T01:47:54.895 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-05T01:47:56.087 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-05T01:47:57.307 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-05T01:47:58.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-05T01:47:59.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-05T01:48:01.035 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-05T01:48:02.279 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-05T01:48:04.287 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-05T01:48:05.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-05T01:48:07.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-05T01:48:08.531 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-05T01:48:10.027 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-05T01:48:11.491 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-05T01:48:12.983 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-05T01:48:15.591 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-05T01:48:17.083 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-05T01:48:18.595 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-05T01:48:20.331 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-05T01:48:22.063 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-05T01:48:23.771 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-05T01:48:25.219 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-05T01:48:26.927 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-05T01:48:28.719 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-05T01:48:30.291 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-05T01:48:32.028 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-05T01:48:33.415 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-05T01:48:34.703 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-05T01:48:36.007 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-05T01:48:37.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-05T01:48:38.615 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-05T01:48:39.199 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-05T01:48:41.271 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-05T01:48:42.687 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-05T01:48:44.107 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-05T01:48:48.511 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-05T01:48:49.943 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-05T01:48:51.391 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-05T01:48:52.807 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-05T01:48:54.239 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-05T01:48:55.619 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-05T01:48:57.055 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-05T01:48:58.544 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-05T01:49:00.011 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-05T01:49:01.427 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-05T01:49:02.795 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-05T01:49:04.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-05T01:49:05.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-05T01:49:07.087 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-05T01:49:08.431 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-05T01:49:09.919 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-05T01:49:11.551 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-05T01:49:12.939 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-05T01:49:13.519 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-05T01:49:14.115 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-05T01:49:14.703 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-05T01:49:15.883 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-05T01:49:17.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-05T01:49:18.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-05T01:49:19.339 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-05T01:49:20.671 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-05T01:49:21.327 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-05T01:49:21.907 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-05T01:49:23.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-05T01:49:23.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-05T01:49:24.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-05T01:49:24.775 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-05T01:49:25.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-05T01:49:26.735 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-05T01:49:28.000 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-05T01:49:29.223 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-05T01:49:30.492 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-05T01:49:31.767 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-05T01:49:32.979 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-05T01:49:34.251 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-05T01:49:35.703 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-05T01:49:36.936 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-05T01:49:38.203 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-05T01:49:39.707 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-05T01:49:41.243 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-05T01:49:42.899 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-05T01:49:44.455 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-05T01:49:45.991 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-05T01:49:47.635 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-05T01:49:49.320 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-05T01:49:51.100 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-05T01:49:52.799 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-05T01:49:54.255 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-05T01:49:55.963 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-05T01:49:57.699 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-05T01:49:59.395 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-05T01:50:01.131 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-05T01:50:02.892 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-05T01:50:04.903 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-05T01:50:06.684 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-05T01:50:08.731 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-05T01:50:10.863 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-05T01:50:12.632 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-05T01:50:14.324 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-05T01:50:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-05T01:50:17.447 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-05T01:50:18.879 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-05T01:50:20.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-05T01:50:21.883 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-05T01:50:24.111 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-05T01:50:26.275 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-05T01:50:28.508 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-05T01:50:30.767 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-05T01:50:32.992 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-05T01:50:35.191 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-05T01:50:37.383 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-05T01:50:39.659 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-05T01:50:41.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-05T01:50:44.331 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-05T01:50:46.664 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-05T01:50:49.121 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-05T01:50:52.887 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-05T01:50:56.564 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-05T01:50:57.111 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-05T01:50:57.683 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-05T01:50:58.327 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-05T01:50:59.620 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-05T01:51:00.883 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-05T01:51:02.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-05T01:51:03.251 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-05T01:51:05.171 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-05T01:51:10.519 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-05T01:51:12.615 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-05T01:51:14.455 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-05T01:51:19.371 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-05T01:51:21.075 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-05T01:51:22.855 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-05T01:51:24.463 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-05T01:51:26.083 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-05T01:51:28.584 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-05T01:51:30.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-05T01:51:32.667 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-05T01:51:34.599 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-05T01:51:37.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-05T01:51:40.759 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-05T01:51:41.929 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-05T01:51:43.312 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-05T01:51:48.424 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-05T01:51:50.516 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-05T01:52:06.872 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-05T01:52:08.208 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-05T01:52:10.055 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-05T01:52:14.320 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-05T01:52:16.011 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-05T01:52:18.936 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-05T01:52:30.183 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-05T01:52:49.352 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-05T01:53:10.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-05T01:54:27.372 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-05T01:54:39.371 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-05T01:55:00.000 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-05T01:55:02.679 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-05T01:55:07.943 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-05T01:55:12.836 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-05T01:55:16.699 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-05T01:55:18.175 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-05T01:55:23.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-05T01:55:25.188 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-05T01:55:26.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-05T01:55:28.331 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-05T01:55:48.936 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-05T01:55:52.923 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-05T01:55:54.507 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-05T01:55:55.847 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-05T01:55:57.460 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-05T01:56:03.227 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-05T01:56:07.703 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-05T01:56:12.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-05T01:56:13.647 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-05T01:56:15.224 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-05T01:56:16.835 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-05T01:56:18.403 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-05T01:56:19.908 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-05T01:56:21.467 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-05T01:56:23.039 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-05T01:56:25.411 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-05T01:56:28.628 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-05T01:56:32.884 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-05T01:56:35.563 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-05T01:56:39.495 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-05T01:56:45.496 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-05T01:56:48.275 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-05T01:56:52.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-05T01:56:59.951 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-05T01:57:02.423 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-05T01:57:04.180 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-05T01:57:06.623 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-05T01:57:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-05T01:57:15.252 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-05T01:57:16.724 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-05T01:57:18.279 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-05T01:57:19.771 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-05T01:57:21.203 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-05T01:57:23.171 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-05T01:57:46.928 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-05T01:57:50.060 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-05T01:57:51.903 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-05T01:57:54.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-05T01:57:56.759 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-05T01:58:06.911 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-05T01:58:09.535 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-05T01:58:21.179 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-05T01:59:03.571 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-05T01:59:20.788 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-05T01:59:26.180 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-05T01:59:31.388 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-05T01:59:33.631 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-05T01:59:36.103 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-05T01:59:37.835 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-05T01:59:40.695 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-05T01:59:43.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-05T01:59:47.499 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-05T01:59:48.912 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-05T01:59:50.367 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-05T01:59:51.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-05T01:59:52.944 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-05T01:59:54.195 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-05T01:59:55.663 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-05T01:59:56.948 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-05T01:59:58.179 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-05T01:59:59.868 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-05T02:00:01.116 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-05T02:00:02.400 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-05T02:00:03.671 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-05T02:00:05.091 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-05T02:00:06.299 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-05T02:00:08.207 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-05T02:00:10.132 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-05T02:00:12.227 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-05T02:00:13.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-05T02:00:15.427 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-05T02:00:16.915 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-05T02:00:18.411 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-05T02:00:19.707 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-05T02:00:21.012 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-05T02:00:22.271 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-05T02:00:23.539 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-05T02:01:01.988 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-05T02:01:39.600 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-05T02:01:50.219 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-05T02:01:51.635 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-05T02:02:53.736 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-05T02:03:55.900 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-05T02:03:57.587 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-05T02:03:59.128 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-05T02:04:00.379 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-05T02:04:01.579 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-05T02:04:29.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-05T02:04:38.096 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-05T02:04:47.035 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-05T02:04:48.576 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-05T02:04:50.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-05T02:04:51.603 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-05T02:04:53.471 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-05T02:04:54.955 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-05T02:04:56.491 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-05T02:04:58.079 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-05T02:04:59.640 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-05T02:05:01.475 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-05T02:05:03.259 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-05T02:05:04.851 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-05T02:05:06.488 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-05T02:05:09.191 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-05T02:05:11.935 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-05T02:05:14.583 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-05T02:05:17.108 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-05T02:05:19.808 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-05T02:05:22.628 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-05T02:05:25.408 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-05T02:05:27.961 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-05T02:05:30.964 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-05T02:05:33.831 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-05T02:05:36.699 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-05T02:05:38.271 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-05T02:05:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-05T02:05:41.300 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-05T02:05:44.148 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-05T02:05:46.959 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-05T02:05:49.663 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-05T02:05:53.419 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-05T02:06:13.660 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-05T02:06:15.947 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-05T02:06:18.460 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-05T02:06:20.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-05T02:06:24.180 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-05T02:06:27.007 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-05T02:06:28.652 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-05T02:06:31.323 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-05T02:06:32.519 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-05T02:06:33.787 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-05T02:06:34.999 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-05T02:06:36.195 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-05T02:06:37.800 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-05T02:06:39.155 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-05T02:06:41.655 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-05T02:06:43.087 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-05T02:06:44.392 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-05T02:06:45.648 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-05T02:06:46.903 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-05T02:06:48.147 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-05T02:06:49.547 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-05T02:06:50.851 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-05T02:06:52.092 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-05T02:06:53.488 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-05T02:06:54.732 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-05T02:06:56.464 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-05T02:06:57.932 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-05T02:06:59.691 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-05T02:07:01.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-05T02:07:02.987 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-05T02:07:04.527 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-05T02:07:06.560 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-05T02:07:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-05T02:07:10.140 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-05T02:07:11.799 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-05T02:07:13.575 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-05T02:07:15.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-05T02:07:17.239 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-05T02:07:19.263 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-05T02:07:21.171 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-05T02:07:22.899 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-05T02:07:24.431 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-05T02:07:26.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-05T02:07:27.916 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-05T02:07:29.444 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-05T02:07:31.215 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-05T02:07:33.223 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-05T02:07:34.823 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-05T02:07:36.672 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-05T02:07:38.331 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-05T02:07:49.687 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-05T02:07:51.303 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-05T02:08:02.051 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-05T02:08:03.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-05T02:08:05.472 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-05T02:08:06.711 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-05T02:08:08.067 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-05T02:08:09.399 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-05T02:08:10.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-05T02:08:12.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-05T02:08:13.703 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-05T02:08:14.976 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-05T02:08:16.299 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-05T02:08:17.843 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-05T02:08:19.396 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-05T02:08:21.099 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-05T02:08:22.592 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-05T02:08:23.935 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-05T02:08:25.359 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-05T02:08:27.303 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-05T02:08:38.787 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-05T02:08:40.099 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-05T02:08:41.507 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-05T02:08:43.027 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-05T02:08:44.559 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-05T02:08:47.099 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-05T02:08:48.711 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-05T02:08:51.507 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-05T02:08:56.647 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-05T02:08:58.691 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-05T02:09:11.747 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-05T02:09:23.080 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-05T02:09:24.163 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-05T02:09:25.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-05T02:09:41.035 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-05T02:10:05.459 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-05T02:10:10.318 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-05T02:10:13.377 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-05T02:10:20.971 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-05T02:10:23.488 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-05T02:10:24.571 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-05T02:10:29.655 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-05T02:10:35.908 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-05T02:12:28.459 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-05T02:12:42.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-05T02:12:44.912 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-05T02:12:47.487 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-05T02:12:48.827 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-05T02:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-05T02:13:03.695 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-05T02:13:05.287 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-05T02:13:07.187 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-05T02:13:14.139 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-05T02:13:18.535 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-05T02:13:24.763 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-05T02:13:27.243 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-05T02:13:27.768 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-05T02:13:32.599 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-05T02:13:37.627 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-05T02:13:40.567 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-05T02:13:45.639 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-05T02:13:47.399 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-05T02:14:22.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-05T02:14:23.327 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-05T02:14:25.162 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-05T02:14:26.651 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-05T02:14:28.339 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-05T02:14:30.382 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-05T02:14:30.427 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout:=============================== warnings summary =============================== 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: import imp 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:120 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: if boto_type is 'S3Connection': 2024-09-05T02:14:30.428 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:124 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: elif boto_type is 'HTTPRequest': 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py:359 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:176 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: if k is 'BucketName': 2024-09-05T02:14:30.429 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:253 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.timeout(10) 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.s3website_routing_rules 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.431 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.432 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-05T02:14:30.433 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-05T02:14:30.434 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-05T02:14:30.434 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:14:30.434 INFO:teuthology.orchestra.run.smithi099.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-05T02:14:30.434 INFO:teuthology.orchestra.run.smithi099.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 2531.42s (0:42:11) = 2024-09-05T02:14:30.598 INFO:teuthology.orchestra.run.smithi099.stdout:___________________________________ summary ____________________________________ 2024-09-05T02:14:30.598 INFO:teuthology.orchestra.run.smithi099.stdout: py: commands succeeded 2024-09-05T02:14:30.599 INFO:teuthology.orchestra.run.smithi099.stdout: congratulations :) 2024-09-05T02:14:30.636 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-05T02:14:30.637 DEBUG:teuthology.orchestra.run.smithi099:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-05T02:14:30.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:14:30.740 INFO:tasks.s3tests:Cleaning up boto... 2024-09-05T02:14:30.740 DEBUG:teuthology.orchestra.run.smithi099:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-05T02:14:30.745 INFO:tasks.s3tests:Removing s3-tests... 2024-09-05T02:14:30.745 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-05T02:14:30.922 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T02:14:30.934 INFO:tasks.workunit:Pulling workunits from ref ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T02:14:30.934 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T02:14:30.934 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T02:14:30.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:14:30.941 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-05T02:14:30.941 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T02:14:30.988 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-05T02:14:30.988 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-05T02:14:31.036 INFO:tasks.workunit:timeout=3h 2024-09-05T02:14:31.036 INFO:tasks.workunit:cleanup=True 2024-09-05T02:14:31.037 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ede1507024117d16395cd6d958c594ff4aaf4da5 2024-09-05T02:14:31.086 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T02:15:27.858 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 96% (12309/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'ede1507024117d16395cd6d958c594ff4aaf4da5'. 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-05T02:15:28.693 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:28.694 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at ede15070241 cls/rgw: add a helper function for calls to cls_cxx_map_remove_key() 2024-09-05T02:15:28.700 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T02:15:28.749 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T02:15:28.752 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T02:15:28.752 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T02:15:28.805 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T02:15:28.859 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T02:15:28.900 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T02:15:28.901 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T02:15:28.902 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T02:15:28.943 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T02:15:28.947 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-05T02:15:28.947 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T02:15:28.997 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-05T02:15:28.999 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-05T02:15:28.999 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ede1507024117d16395cd6d958c594ff4aaf4da5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-05T02:15:29.049 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-05T02:15:29.049 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T02:15:29.049 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-05T02:15:31.884 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-05T02:15:31.885 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-05T02:15:31.886 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T02:15:31.886 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-09-05T02:15:31.886 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-09-05T02:15:32.253 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-05T02:15:32.442 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-09-05T02:15:32.448 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-05T02:15:32.482 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-09-05T02:15:32.483 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-09-05T02:15:32.483 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-09-05T02:15:32.754 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-09-05T02:15:32.760 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-09-05T02:15:33.799 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.2 2024-09-05T02:15:33.873 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install boto3 2024-09-05T02:15:34.822 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-09-05T02:15:34.823 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached boto3-1.35.12-py3-none-any.whl.metadata (6.6 kB) 2024-09-05T02:15:35.376 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.36.0,>=1.35.12 (from boto3) 2024-09-05T02:15:35.377 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached botocore-1.35.12-py3-none-any.whl.metadata (5.7 kB) 2024-09-05T02:15:35.435 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-05T02:15:35.435 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-05T02:15:35.480 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-05T02:15:35.481 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-05T02:15:35.535 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T02:15:35.537 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-05T02:15:35.644 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T02:15:35.668 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-05T02:15:35.896 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.12->boto3) 2024-09-05T02:15:35.896 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-05T02:15:35.900 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached boto3-1.35.12-py3-none-any.whl (139 kB) 2024-09-05T02:15:35.901 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached botocore-1.35.12-py3-none-any.whl (12.5 MB) 2024-09-05T02:15:35.911 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-05T02:15:35.912 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-05T02:15:35.913 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-05T02:15:35.914 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-05T02:15:35.916 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-05T02:15:35.986 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-05T02:15:37.042 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.35.12 botocore-1.35.12 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-05T02:15:37.250 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-05T02:15:37.384 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-05T02:15:37.422 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:37.423 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:37.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 realm 2024-09-05T02:15:37.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.461+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.465+0000 7ff55dda59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:37.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.465+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.465+0000 7ff55dda59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:15:37.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.465+0000 7ff55dda59c0 20 searching for the correct realm 2024-09-05T02:15:37.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.469+0000 7ff55b8ab640 0 -- 172.21.15.99:0/3983976405 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7ff5540f7ec0 msgr2=0x7ff5540f6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:37.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.477+0000 7ff55b8ab640 0 -- 172.21.15.99:0/3983976405 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7ff554100a60 msgr2=0x7ff5541110d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:37.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:15:37.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:15:37.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.481+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 zone default found 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 4 Realm: () 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 zonegroup default 2024-09-05T02:15:37.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 started sync module instance, tier type = 2024-09-05T02:15:37.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.485+0000 7ff55dda59c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:15:37.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=0 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=1 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=2 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=3 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=4 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=5 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=6 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 20 add_watcher() i=7 2024-09-05T02:15:37.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.505+0000 7ff55dda59c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:15:37.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:37.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:15:37.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 5 note: GC not initialized 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff410fe1640 20 reqs_thread_entry: start 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 init_complete bucket index max shards: 11 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 Filter name: none 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff38a7fc640 20 reqs_thread_entry: start 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-05T02:15:37.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:37.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-05T02:15:37.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-05T02:15:37.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-05T02:15:37.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.509+0000 7ff55dda59c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-05T02:15:37.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff55dda59c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-05T02:15:37.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff55dda59c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-05T02:15:37.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff55dda59c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-05T02:15:37.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff43affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366433 cookie 93992786663872 notifier 9357 bl.length()=613 2024-09-05T02:15:37.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff43affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-05T02:15:37.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.513+0000 7ff43affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff55dda59c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff55dda59c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff55dda59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff43affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367453 cookie 93992786666368 notifier 9357 bl.length()=191 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff43affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-05T02:15:37.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.517+0000 7ff43affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-05T02:15:37.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.521+0000 7ff411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:37.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.525+0000 7ff55dda59c0 20 remove_watcher() i=0 2024-09-05T02:15:37.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.525+0000 7ff55dda59c0 2 removed watcher, disabling cache 2024-09-05T02:15:37.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.525+0000 7ff55dda59c0 20 remove_watcher() i=1 2024-09-05T02:15:37.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.529+0000 7ff55dda59c0 20 remove_watcher() i=2 2024-09-05T02:15:37.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.529+0000 7ff55dda59c0 20 remove_watcher() i=3 2024-09-05T02:15:37.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.533+0000 7ff55dda59c0 20 remove_watcher() i=4 2024-09-05T02:15:37.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.533+0000 7ff55dda59c0 20 remove_watcher() i=5 2024-09-05T02:15:37.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.537+0000 7ff55dda59c0 20 remove_watcher() i=6 2024-09-05T02:15:37.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:37.537+0000 7ff55dda59c0 20 remove_watcher() i=7 2024-09-05T02:15:37.979 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-05T02:15:37.979 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:38.307 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-05T02:15:38.410 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:38.410 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:38.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.373+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 realm 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.377+0000 7fa2e12729c0 20 searching for the correct realm 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.381+0000 7fa2ded78640 0 -- 172.21.15.99:0/3397600950 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7fa2d00f9d50 msgr2=0x7fa2d00f97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.393+0000 7fa2ded78640 0 -- 172.21.15.99:0/3397600950 >> [v2:172.21.15.204:6824/2123851170,v1:172.21.15.204:6825/2123851170] conn(0x7fa2d011fb90 msgr2=0x7fa2d0103050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:38.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.397+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 zone default found 2024-09-05T02:15:38.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 4 Realm: () 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 zonegroup default 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:38.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 started sync module instance, tier type = 2024-09-05T02:15:38.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.401+0000 7fa2e12729c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:15:38.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=0 2024-09-05T02:15:38.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=1 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=2 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=3 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=4 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=5 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=6 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 20 add_watcher() i=7 2024-09-05T02:15:38.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.417+0000 7fa2e12729c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:15:38.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 5 note: GC not initialized 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa10ffff640 20 reqs_thread_entry: start 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 init_complete bucket index max shards: 11 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 Filter name: none 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa10dffb640 20 reqs_thread_entry: start 2024-09-05T02:15:38.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-05T02:15:38.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:38.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-05T02:15:38.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T02:15:38.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T02:15:38.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 INFO: main: starting shard=0 2024-09-05T02:15:38.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.421+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.0 2024-09-05T02:15:38.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=1 2024-09-05T02:15:38.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.1 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=2 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.2 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=3 2024-09-05T02:15:38.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.3 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=4 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.4 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=5 2024-09-05T02:15:38.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.5 2024-09-05T02:15:38.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 INFO: main: starting shard=6 2024-09-05T02:15:38.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.425+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.6 2024-09-05T02:15:38.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: starting shard=7 2024-09-05T02:15:38.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.7 2024-09-05T02:15:38.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: starting shard=8 2024-09-05T02:15:38.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.8 2024-09-05T02:15:38.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: starting shard=9 2024-09-05T02:15:38.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.9 2024-09-05T02:15:38.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 INFO: main: starting shard=10 2024-09-05T02:15:38.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.429+0000 7fa2e12729c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.10 2024-09-05T02:15:38.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.433+0000 7fa2e12729c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:38.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.433+0000 7fa2e12729c0 20 INFO: main: done 2024-09-05T02:15:38.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.433+0000 7fa1957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:38.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.437+0000 7fa2e12729c0 20 remove_watcher() i=0 2024-09-05T02:15:38.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.437+0000 7fa2e12729c0 2 removed watcher, disabling cache 2024-09-05T02:15:38.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.437+0000 7fa2e12729c0 20 remove_watcher() i=1 2024-09-05T02:15:38.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.441+0000 7fa2e12729c0 20 remove_watcher() i=2 2024-09-05T02:15:38.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.441+0000 7fa2e12729c0 20 remove_watcher() i=3 2024-09-05T02:15:38.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.445+0000 7fa2e12729c0 20 remove_watcher() i=4 2024-09-05T02:15:38.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.445+0000 7fa2e12729c0 20 remove_watcher() i=5 2024-09-05T02:15:38.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.449+0000 7fa2e12729c0 20 remove_watcher() i=6 2024-09-05T02:15:38.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.449+0000 7fa2e12729c0 20 remove_watcher() i=7 2024-09-05T02:15:38.467 INFO:tasks.workunit.client.0.smithi099.stderr:rados -p default.rgw.buckets.data ls | grep f1e71501-bde2-4c69-820b-32f469b9c7b3 2024-09-05T02:15:38.489 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:38.489 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:38.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:38.633+0000 7f6303899640 0 -- 172.21.15.99:0/2316734090 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x7f62ec027070 msgr2=0x7f62ec05f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:38.662 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-05T02:15:38.662 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:38.663 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-05T02:15:40.232 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-05T02:15:40.667 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-05T02:15:40.690 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:40.690 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:40.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 realm 2024-09-05T02:15:40.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:15:40.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.725+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.729+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:40.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.729+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.729+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:15:40.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.729+0000 7ff867ce69c0 20 searching for the correct realm 2024-09-05T02:15:40.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.733+0000 7ff865fed640 0 -- 172.21.15.99:0/1817099225 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7ff85c08d030 msgr2=0x7ff85c07d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:40.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.741+0000 7ff864feb640 0 -- 172.21.15.99:0/1817099225 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x560005e0cac0 msgr2=0x560005e0eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.745+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:40.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 zone default found 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 4 Realm: () 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 zonegroup default 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 started sync module instance, tier type = 2024-09-05T02:15:40.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.749+0000 7ff867ce69c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=0 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=1 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=2 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=3 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=4 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=5 2024-09-05T02:15:40.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=6 2024-09-05T02:15:40.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 20 add_watcher() i=7 2024-09-05T02:15:40.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.765+0000 7ff867ce69c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:15:40.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff71b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:40.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:15:40.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:15:40.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 5 note: GC not initialized 2024-09-05T02:15:40.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff71a7e4640 20 reqs_thread_entry: start 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 init_complete bucket index max shards: 11 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 Filter name: none 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff68bfff640 20 reqs_thread_entry: start 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-05T02:15:40.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-05T02:15:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-05T02:15:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-05T02:15:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 INFO: main: starting shard=0 2024-09-05T02:15:40.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.769+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.0 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=1 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.1 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=2 2024-09-05T02:15:40.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.2 2024-09-05T02:15:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=3 2024-09-05T02:15:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.3 2024-09-05T02:15:40.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=4 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.4 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=5 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.5 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 INFO: main: starting shard=6 2024-09-05T02:15:40.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.773+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.6 2024-09-05T02:15:40.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: starting shard=7 2024-09-05T02:15:40.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.7 2024-09-05T02:15:40.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: starting shard=8 2024-09-05T02:15:40.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.8 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: starting shard=9 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.9 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: starting shard=10 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.10 2024-09-05T02:15:40.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-05T02:15:40.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff867ce69c0 20 INFO: main: done 2024-09-05T02:15:40.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.777+0000 7ff71b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:40.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.781+0000 7ff867ce69c0 20 remove_watcher() i=0 2024-09-05T02:15:40.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.781+0000 7ff867ce69c0 2 removed watcher, disabling cache 2024-09-05T02:15:40.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.785+0000 7ff867ce69c0 20 remove_watcher() i=1 2024-09-05T02:15:40.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.785+0000 7ff867ce69c0 20 remove_watcher() i=2 2024-09-05T02:15:40.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.789+0000 7ff867ce69c0 20 remove_watcher() i=3 2024-09-05T02:15:40.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.789+0000 7ff867ce69c0 20 remove_watcher() i=4 2024-09-05T02:15:40.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.793+0000 7ff867ce69c0 20 remove_watcher() i=5 2024-09-05T02:15:40.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.793+0000 7ff867ce69c0 20 remove_watcher() i=6 2024-09-05T02:15:40.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.793+0000 7ff867ce69c0 20 remove_watcher() i=7 2024-09-05T02:15:40.809 INFO:tasks.workunit.client.0.smithi099.stderr:rados -p default.rgw.buckets.data ls | grep 96c4c979-19f5-4e68-9add-2207a88a264b 2024-09-05T02:15:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:40.829 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:40.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:40.973+0000 7fdaa4fd2640 0 -- 172.21.15.99:0/1525219415 >> [v2:172.21.15.99:6800/4087752053,v1:172.21.15.99:6801/4087752053] conn(0x7fda8c0b68d0 msgr2=0x7fda8c0b5350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:40.997 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-05T02:15:40.997 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:41.234 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-05T02:15:42.856 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-05T02:15:42.857 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-05T02:15:43.437 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-05T02:15:43.437 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-05T02:15:43.823 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-05T02:15:47.485 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-05T02:15:47.924 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-05T02:15:47.951 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:47.951 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:47.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:47.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:47.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 realm 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:47.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.989+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:47.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.993+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:47.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.993+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:47.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.993+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:15:47.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.993+0000 7f53b10ee9c0 20 searching for the correct realm 2024-09-05T02:15:48.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:47.997+0000 7f53ae3f3640 0 -- 172.21.15.99:0/2400423572 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f53a0008040 msgr2=0x7f53a00999c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:48.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.213+0000 7f53aebf4640 0 -- 172.21.15.99:0/2400423572 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f53a80be040 msgr2=0x7f53a8007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:48.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:15:48.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.225+0000 7f53b10ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:48.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:15:48.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 zone default found 2024-09-05T02:15:48.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 4 Realm: () 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 zonegroup default 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:48.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:48.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.229+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.233+0000 7f53b10ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:48.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.233+0000 7f53b10ee9c0 20 started sync module instance, tier type = 2024-09-05T02:15:48.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.233+0000 7f53b10ee9c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=0 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=1 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=2 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=3 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=4 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=5 2024-09-05T02:15:48.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.253+0000 7f53b10ee9c0 20 add_watcher() i=6 2024-09-05T02:15:48.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.257+0000 7f53b10ee9c0 20 add_watcher() i=7 2024-09-05T02:15:48.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.257+0000 7f53b10ee9c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:15:48.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f5265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:48.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f53b10ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:15:48.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f53b10ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:15:48.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f53b10ee9c0 5 note: GC not initialized 2024-09-05T02:15:48.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f5264fe1640 20 reqs_thread_entry: start 2024-09-05T02:15:48.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.261+0000 7f53b10ee9c0 20 init_complete bucket index max shards: 11 2024-09-05T02:15:48.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 Filter name: none 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f525dffb640 20 reqs_thread_entry: start 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-05T02:15:48.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782 : miss 2024-09-05T02:15:48.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782 info.flags=0x17 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782 to cache LRU end 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782 2024-09-05T02:15:48.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.265+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.0 2024-09-05T02:15:48.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-05T02:15:48.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.1 2024-09-05T02:15:48.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-05T02:15:48.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.2 2024-09-05T02:15:48.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-05T02:15:48.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.3 2024-09-05T02:15:48.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-05T02:15:48.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.4 2024-09-05T02:15:48.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-05T02:15:48.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.5 2024-09-05T02:15:48.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-05T02:15:48.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.269+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.6 2024-09-05T02:15:48.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-05T02:15:48.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.7 2024-09-05T02:15:48.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-05T02:15:48.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.8 2024-09-05T02:15:48.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-05T02:15:48.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.273+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.9 2024-09-05T02:15:48.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.277+0000 7f53b10ee9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-05T02:15:48.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.277+0000 7f53b10ee9c0 20 bucket index object: :.dir.029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782.10 2024-09-05T02:15:48.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.277+0000 7f53b10ee9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-05T02:15:48.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.277+0000 7f53b10ee9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-05T02:15:48.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.277+0000 7f5265fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:48.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.281+0000 7f53b10ee9c0 20 remove_watcher() i=0 2024-09-05T02:15:48.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.281+0000 7f53b10ee9c0 2 removed watcher, disabling cache 2024-09-05T02:15:48.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.285+0000 7f53b10ee9c0 20 remove_watcher() i=1 2024-09-05T02:15:48.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.285+0000 7f53b10ee9c0 20 remove_watcher() i=2 2024-09-05T02:15:48.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.289+0000 7f53b10ee9c0 20 remove_watcher() i=3 2024-09-05T02:15:48.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.293+0000 7f53b10ee9c0 20 remove_watcher() i=4 2024-09-05T02:15:48.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.293+0000 7f53b10ee9c0 20 remove_watcher() i=5 2024-09-05T02:15:48.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.297+0000 7f53b10ee9c0 20 remove_watcher() i=6 2024-09-05T02:15:48.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-09-05T02:15:48.297+0000 7f53b10ee9c0 20 remove_watcher() i=7 2024-09-05T02:15:48.316 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket versioning-bucket 2024-09-05T02:15:48.728 INFO:tasks.workunit.client.0.smithi099.stderr:Completed bucket versioning tests 2024-09-05T02:15:48.729 INFO:tasks.workunit.client.0.smithi099.stdout:connected to http://localhost:80 2024-09-05T02:15:48.825 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-05T02:15:48.826 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-09-05T02:15:48.827 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-09-05T02:15:48.828 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-09-05T02:15:48.828 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T02:15:48.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T02:15:48.883 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-05T02:15:48.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T02:15:49.274 DEBUG:teuthology.parallel:result is None 2024-09-05T02:15:49.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T02:15:49.287 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T02:15:49.287 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-05T02:15:49.335 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T02:15:49.336 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-05T02:15:49.345 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-05T02:15:49.409 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-05T02:15:49.410 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-05T02:15:49.410 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-05T02:15:49.461 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-05T02:15:49.462 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-05T02:15:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:15:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:15:49.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.533+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.533+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.533+0000 7f3cc7f489c0 20 realm 2024-09-05T02:15:49.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.533+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:15:49.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:15:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.537+0000 7f3cc7f489c0 20 searching for the correct realm 2024-09-05T02:15:49.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.541+0000 7f3cc524d640 0 -- 172.21.15.99:0/1179492105 >> [v2:172.21.15.99:6816/3137608818,v1:172.21.15.99:6817/3137608818] conn(0x7f3cb80d9040 msgr2=0x7f3cb8102050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-05T02:15:49.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.549+0000 7f3cc5a4e640 0 -- 172.21.15.99:0/1179492105 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f3cc0062c20 msgr2=0x7f3cc00605c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:15:49.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 zone default found 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 4 Realm: () 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:15:49.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 zonegroup default 2024-09-05T02:15:49.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.557+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.561+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.561+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.561+0000 7f3cc7f489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:15:49.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.561+0000 7f3cc7f489c0 20 started sync module instance, tier type = 2024-09-05T02:15:49.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.561+0000 7f3cc7f489c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=0 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=1 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=2 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=3 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=4 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=5 2024-09-05T02:15:49.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.577+0000 7f3cc7f489c0 20 add_watcher() i=6 2024-09-05T02:15:49.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.581+0000 7f3cc7f489c0 20 add_watcher() i=7 2024-09-05T02:15:49.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.581+0000 7f3cc7f489c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:15:49.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.585+0000 7f3b77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:49.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.585+0000 7f3cc7f489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:15:49.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.585+0000 7f3cc7f489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:15:49.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3b76fe5640 20 reqs_thread_entry: start 2024-09-05T02:15:49.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 20 init_complete bucket index max shards: 11 2024-09-05T02:15:49.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 20 Filter name: none 2024-09-05T02:15:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3b74fe1640 20 reqs_thread_entry: start 2024-09-05T02:15:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-05T02:15:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 20 rados->read ofs=0 len=0 2024-09-05T02:15:49.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-05T02:15:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-05T02:15:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-05T02:15:49.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.661+0000 7f3cc7f489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-05T02:15:49.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.665+0000 7f3cc7f489c0 10 removing key index: TWFNPDHPMMHJLRYHPMNM 2024-09-05T02:15:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.665+0000 7f3cc7f489c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:TWFNPDHPMMHJLRYHPMNM, ofs0, ns] 2024-09-05T02:15:49.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.669+0000 7f3ba17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367449 cookie 94059172770960 notifier 9492 bl.length()=170 2024-09-05T02:15:49.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.669+0000 7f3cc7f489c0 10 removing email index: tester.client.0_test@test.test 2024-09-05T02:15:49.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.673+0000 7f3cc7f489c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-05T02:15:49.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.673+0000 7f3ba0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366396 cookie 94059172774656 notifier 9492 bl.length()=181 2024-09-05T02:15:49.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.673+0000 7f3cc7f489c0 10 removing user buckets index 2024-09-05T02:15:49.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.677+0000 7f3cc7f489c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-05T02:15:49.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.677+0000 7f3ba17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366434 cookie 94059172779984 notifier 9492 bl.length()=172 2024-09-05T02:15:49.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.677+0000 7f3cc7f489c0 10 removing user index: tester.client.0 2024-09-05T02:15:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.681+0000 7f3cc7f489c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-05T02:15:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.681+0000 7f3cc7f489c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-05T02:15:49.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.681+0000 7f3ba17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367456 cookie 94059172773456 notifier 9492 bl.length()=164 2024-09-05T02:15:49.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.685+0000 7f3b77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:15:49.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.689+0000 7f3cc7f489c0 20 remove_watcher() i=0 2024-09-05T02:15:49.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.689+0000 7f3cc7f489c0 2 removed watcher, disabling cache 2024-09-05T02:15:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.693+0000 7f3cc7f489c0 20 remove_watcher() i=1 2024-09-05T02:15:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.697+0000 7f3cc7f489c0 20 remove_watcher() i=2 2024-09-05T02:15:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.697+0000 7f3cc7f489c0 20 remove_watcher() i=3 2024-09-05T02:15:49.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.701+0000 7f3cc7f489c0 20 remove_watcher() i=4 2024-09-05T02:15:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.701+0000 7f3cc7f489c0 20 remove_watcher() i=5 2024-09-05T02:15:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.701+0000 7f3cc7f489c0 20 remove_watcher() i=6 2024-09-05T02:15:49.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:15:49.705+0000 7f3cc7f489c0 20 remove_watcher() i=7 2024-09-05T02:15:49.733 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-05T02:15:49.744 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-05T02:15:49.778 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-05T02:15:49.824 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-05T02:15:49.835 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-05T02:15:49.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:15:49.888 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-05T02:15:49.873+0000 e571640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38673) UID: 0 2024-09-05T02:15:49.892 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-05T02:15:49.885+0000 8ed9f80 -1 shutting down 2024-09-05T02:16:14.312 INFO:tasks.rgw.client.0.smithi099.stderr:==00:01:26:33.508 38676== could not unlink /tmp/vgdb-pipe-from-vgdb-to-38676-by-root-on-??? 2024-09-05T02:16:14.312 INFO:tasks.rgw.client.0.smithi099.stderr:==00:01:26:33.508 38676== could not unlink /tmp/vgdb-pipe-to-vgdb-from-38676-by-root-on-??? 2024-09-05T02:16:14.312 INFO:tasks.rgw.client.0.smithi099.stderr:==00:01:26:33.508 38676== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-38676-by-root-on-??? 2024-09-05T02:16:19.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-05T02:16:20.343 INFO:tasks.rgw.client.0:Stopped 2024-09-05T02:16:20.344 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-05T02:16:20.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/vault-root-token 2024-09-05T02:16:20.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-05T02:16:20.463 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-05T02:16:20.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-05T02:16:20.463 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-05T02:16:20.543 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-05T02:16:20.543 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-05T02:16:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.580+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 realm 2024-09-05T02:16:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-05T02:16:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:16:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.584+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.588+0000 7f57676149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-05T02:16:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.588+0000 7f57676149c0 20 searching for the correct realm 2024-09-05T02:16:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.592+0000 7f576591b640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5750018040 msgr2=0x7f5750037430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:20.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.808+0000 7f576591b640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.204:6808/2199271947,v1:172.21.15.204:6809/2199271947] conn(0x7f5750018040 msgr2=0x7f5750037430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got zone_info.029be2ba-89f5-4a66-997f-b36b11292c2c 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got zonegroup_info.8edd3c29-2e40-4b23-aa11-68b5f97c46c3 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-05T02:16:20.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.820+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-05T02:16:20.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 zone default found 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 4 Realm: () 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 4 ZoneGroup: default (8edd3c29-2e40-4b23-aa11-68b5f97c46c3) 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 4 Zone: default (029be2ba-89f5-4a66-997f-b36b11292c2c) 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 zonegroup default 2024-09-05T02:16:20.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados->read ofs=0 len=0 2024-09-05T02:16:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-05T02:16:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 started sync module instance, tier type = 2024-09-05T02:16:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.824+0000 7f57676149c0 20 started zone id=029be2ba-89f5-4a66-997f-b36b11292c2c (name=default) with tier type = 2024-09-05T02:16:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=0 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=1 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=2 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=3 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=4 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=5 2024-09-05T02:16:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=6 2024-09-05T02:16:20.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 20 add_watcher() i=7 2024-09-05T02:16:20.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.848+0000 7f57676149c0 2 all 8 watchers are set, enabling cache 2024-09-05T02:16:20.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.852+0000 7f561b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:16:20.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.852+0000 7f57676149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-05T02:16:20.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.852+0000 7f57676149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-05T02:16:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.944+0000 7f561a7e4640 20 reqs_thread_entry: start 2024-09-05T02:16:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.944+0000 7f57676149c0 20 init_complete bucket index max shards: 11 2024-09-05T02:16:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.944+0000 7f57676149c0 20 Filter name: none 2024-09-05T02:16:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.944+0000 7f558bfff640 20 reqs_thread_entry: start 2024-09-05T02:16:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.944+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-05T02:16:20.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.948+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:20.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44494' 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.818526240212727', time=2024-09-05T03:37:52.962567+0000, chain.objs.size()=1 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.245__shadow_.2C4sqft6gP7MeCojjsorYQ40RgCtwgx_0 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7458035165828979480', time=2024-09-05T03:37:54.862333+0000, chain.objs.size()=1 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.246__shadow_.EcjFQwmBXFlqzDcE4On41jPSEVSkl5B_0 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11301385656761943925', time=2024-09-05T03:37:56.729921+0000, chain.objs.size()=1 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.247__shadow_.FlJ4gRrCTthHnof9wChjh252Mubqzro_0 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3784864041947066074', time=2024-09-05T03:38:07.929902+0000, chain.objs.size()=1 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.253__shadow_.XZ0nR8pwri_SjrPDZmsZm3Dlg-7qTj4_0 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18239782653907587330', time=2024-09-05T03:40:05.106739+0000, chain.objs.size()=1 2024-09-05T02:16:20.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.d93VmvtK5wVPSjLPD4NaWv7TMEEZbzW_0 2024-09-05T02:16:20.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13115483694551671892', time=2024-09-05T03:40:07.760432+0000, chain.objs.size()=1 2024-09-05T02:16:20.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XHjp8v8FIxfQ9vITWZ473KIaYH7Hht9_0 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1709483487378143742', time=2024-09-05T03:40:09.343739+0000, chain.objs.size()=1 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7cwfbJn2arfCTOHO3ksEhJhy9M408M0_0 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17959284103356230416', time=2024-09-05T03:40:09.675843+0000, chain.objs.size()=1 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yN9Ka-8KPMfmrMZl-XrxUzZow0gsMjg_0 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16279746985806909802', time=2024-09-05T03:40:10.784142+0000, chain.objs.size()=1 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vF8Qbgzuta0MwpsMN9oN1X72DIdoF-o_0 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11521942023605241517', time=2024-09-05T03:40:11.030653+0000, chain.objs.size()=1 2024-09-05T02:16:20.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.uAiNPmnXgmOp2QRBzM_DE_C6448pHbl_0 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2430507518289702107', time=2024-09-05T03:40:11.593646+0000, chain.objs.size()=1 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VTDl0e72Cc8VfFUzJejXoeGzrPrdj-n_0 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3398901643209904365', time=2024-09-05T03:40:12.040546+0000, chain.objs.size()=1 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-N32vX6rfVahyiKpGTx1Ru0i6k0T-I4_0 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.943338191300784495', time=2024-09-05T03:40:13.217019+0000, chain.objs.size()=1 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dOHzaA7OlWJY6lG3xu7XovQ0nB7Ukbv_0 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12795165692378247012', time=2024-09-05T03:40:13.863567+0000, chain.objs.size()=1 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5aywk265zm3YiFkG9vlBI1hbcqfvpBX_0 2024-09-05T02:16:20.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16847052631485769740', time=2024-09-05T03:40:14.023220+0000, chain.objs.size()=1 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ha7XdaeKugnsvCc7PYG-6M-FY7ue2_S_0 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2367801168635910316', time=2024-09-05T03:40:14.420015+0000, chain.objs.size()=1 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1Uz5eXYd_1DRTglZ1pGNAGHKYQxuqzL_0 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1050346521812487726', time=2024-09-05T03:40:15.165902+0000, chain.objs.size()=1 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oh86gktsiqtx-UlWJt0-kQI99Gw-PV7_0 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11372293868996364676', time=2024-09-05T03:40:17.878745+0000, chain.objs.size()=1 2024-09-05T02:16:20.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9V3pmGBT6NCqmsv8cICWQGii-16Wg3o_0 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5577783793195607343', time=2024-09-05T03:40:18.131829+0000, chain.objs.size()=1 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tAwrL3E0-xZoS1XaBU2RNz73x3X2HhN_0 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9126993391201102334', time=2024-09-05T03:40:18.742689+0000, chain.objs.size()=1 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._FVsyot60Os369tHkYTbnDOe5AX27TH_0 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.314086157723491730', time=2024-09-05T03:40:20.724271+0000, chain.objs.size()=1 2024-09-05T02:16:20.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zgbWBTIVXxhFR0hMYZaT5mzpjhzWLfz_0 2024-09-05T02:16:20.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13038318505669499726', time=2024-09-05T03:40:21.769192+0000, chain.objs.size()=1 2024-09-05T02:16:20.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XcHAh4Fr0Re_yMNV5WFuCtvVC2z5uFV_0 2024-09-05T02:16:20.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12227316293142152503', time=2024-09-05T03:40:22.653682+0000, chain.objs.size()=1 2024-09-05T02:16:20.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i9pFs8QDK31EPb3WtKvhcrNPqbS-2VG_0 2024-09-05T02:16:20.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5035897002270254421', time=2024-09-05T03:40:23.413674+0000, chain.objs.size()=1 2024-09-05T02:16:20.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gtBNiLiFWjSdzXiCsswMr9hHx99x1Gb_0 2024-09-05T02:16:20.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10329559600630098430', time=2024-09-05T03:40:24.144485+0000, chain.objs.size()=1 2024-09-05T02:16:20.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Do9R-1kHdBVgtqn37hvc5E_r_izGwWW_0 2024-09-05T02:16:20.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17613597676182453125', time=2024-09-05T03:40:24.966597+0000, chain.objs.size()=1 2024-09-05T02:16:20.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jftaGTEaxWbSHt1Hzt-2pc3tQFVyECC_0 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13774642074991828418', time=2024-09-05T03:40:25.858052+0000, chain.objs.size()=1 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o7U8TPnrTxE5QGrinr1KZz-ORDxM4Ls_0 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6155901079298261634', time=2024-09-05T03:40:26.381540+0000, chain.objs.size()=1 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bA5nocu3TC9N58T_0UkqSblIO6WC8kc_0 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8620352301137731370', time=2024-09-05T03:40:28.522105+0000, chain.objs.size()=1 2024-09-05T02:16:20.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-0s1XcmStyUcrz5HMVgH-6MCox1JHRG_0 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6902682842682327674', time=2024-09-05T03:40:29.948072+0000, chain.objs.size()=1 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BdvcGg3BhJ4u3d_rEuAg2h5ok4b9jI0_0 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3968466622575472373', time=2024-09-05T03:40:30.011465+0000, chain.objs.size()=1 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4wRlzPVRFVl-1rK4F4KmMUv5E_QZjuz_0 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14858601641119333552', time=2024-09-05T03:40:31.285981+0000, chain.objs.size()=1 2024-09-05T02:16:20.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TJjt5cNUXWIINhjD8vZr-iHtONLWR88_0 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10779830678566669633', time=2024-09-05T03:40:31.625474+0000, chain.objs.size()=1 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-OlxwijOycxQBwZYJPoJjKZQk9aFCgK_0 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7657526589057499260', time=2024-09-05T03:40:32.140869+0000, chain.objs.size()=1 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cMBIf4f48LLBSNAP_0Ejcx0OCfnTAGB_0 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16518335422177570659', time=2024-09-05T03:40:34.638232+0000, chain.objs.size()=1 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.O8hBhS0kqxz4tDV9u9OOor1PqPO96pj_0 2024-09-05T02:16:20.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4334033526604122190', time=2024-09-05T03:40:34.879562+0000, chain.objs.size()=1 2024-09-05T02:16:20.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wUIHzJ2H4Yl1YU6ZU0ouDCcy6q7ryv7_0 2024-09-05T02:16:20.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5513884762592660735', time=2024-09-05T03:40:35.041790+0000, chain.objs.size()=1 2024-09-05T02:16:20.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rqHkagSSodl-pjVjTofNPb_FOghonK4_0 2024-09-05T02:16:20.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4364944182118888161', time=2024-09-05T03:40:36.166743+0000, chain.objs.size()=1 2024-09-05T02:16:20.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EWcsnICQy40jt6ILuD48_3kKmW3CA51_0 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6427849204322945899', time=2024-09-05T03:40:48.902272+0000, chain.objs.size()=1 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.269__shadow_.dypZB4y-QssyJmpU-OxcGOXk2RRoEJV_0 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14350074802990542951', time=2024-09-05T03:41:12.557459+0000, chain.objs.size()=1 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.282__shadow_.qOaXQl685qFe0hotmuLSE5_ajtZpKtN_0 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1041308622272952277', time=2024-09-05T03:41:12.559407+0000, chain.objs.size()=1 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.282__shadow_.1qdl1JYNZK0oiZXS8aYpBreRJNAsY98_0 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5352095417816929610', time=2024-09-05T03:41:42.193075+0000, chain.objs.size()=1 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.294__shadow_.4Icn8nmq4YY6ZoKPsKR-JHHCbznkfUM_0 2024-09-05T02:16:20.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12679094358046712762', time=2024-09-05T03:42:01.062667+0000, chain.objs.size()=1 2024-09-05T02:16:20.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.304__shadow_.zm_iOxlTthtI6FrpHTqgfWeL5cEo4kg_0 2024-09-05T02:16:20.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15369884770309695471', time=2024-09-05T03:44:19.299512+0000, chain.objs.size()=1 2024-09-05T02:16:20.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1MR_vWjHnYSkbUgjmBa_MDgA6LCebfu_0 2024-09-05T02:16:20.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13508265004232671491', time=2024-09-05T03:44:21.104479+0000, chain.objs.size()=1 2024-09-05T02:16:20.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HLGSP5EJ8bzmIzUG4Id-gZYtTLmB_Q0_0 2024-09-05T02:16:20.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9884952804248720201', time=2024-09-05T03:44:22.288848+0000, chain.objs.size()=1 2024-09-05T02:16:20.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7mKUNmVyZcXh2Yj_0WFT4RN6NtKX43u_0 2024-09-05T02:16:20.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15923014802004936198', time=2024-09-05T03:44:25.506478+0000, chain.objs.size()=1 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KJY7qrqeb15TcWvuQf9VfWD9ruz7ABN_0 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13621801220721772540', time=2024-09-05T03:44:26.564629+0000, chain.objs.size()=1 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d-doQQevSmCEDBSl7_fWd3ZFWIkD7rH_0 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6469131114491109966', time=2024-09-05T03:44:28.664582+0000, chain.objs.size()=1 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.L9bMwot4cVO6Oj2XkRg_l0Oe0y_0gf7_0 2024-09-05T02:16:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3207710027910174422', time=2024-09-05T03:44:28.935958+0000, chain.objs.size()=1 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-BZaeVr_BCVU58ssDmtJGMRIF5rAbgQ_0 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3909786269331171274', time=2024-09-05T03:44:29.314906+0000, chain.objs.size()=1 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cl7SxfYnowWsjBguLPdkba7jBzZIsuS_0 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8035703156181824405', time=2024-09-05T03:44:29.640423+0000, chain.objs.size()=1 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bkUkQyZ9TxmOflyV7WLFin_M3vJuwyR_0 2024-09-05T02:16:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11386656860984509949', time=2024-09-05T03:44:29.642449+0000, chain.objs.size()=1 2024-09-05T02:16:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7mDbrD610j8MfiomCgC-Jzgdk9WQ2dI_0 2024-09-05T02:16:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10484658147896533092', time=2024-09-05T03:44:31.727928+0000, chain.objs.size()=1 2024-09-05T02:16:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9KFNgCe_cRv1QsG_y3h3KQEw8gozxrY_0 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8051419483628030231', time=2024-09-05T03:44:33.803152+0000, chain.objs.size()=1 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sZxOmjYMQx07hlvDGe81zQABIJLZJcn_0 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11415606917305600580', time=2024-09-05T03:44:36.194598+0000, chain.objs.size()=1 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9OsYwp3NY1usv1R0cKO4_opBcWTTKef_0 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11300759812852376170', time=2024-09-05T03:44:36.633794+0000, chain.objs.size()=1 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Rk8Gx2FG_IAOmC_eFiNt2yp3Bx4aBy4_0 2024-09-05T02:16:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1948846505687230781', time=2024-09-05T03:44:41.051406+0000, chain.objs.size()=1 2024-09-05T02:16:20.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.976+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.P6pZnNq3jE2ITSN-eyN0_fDUrO_EUFp_0 2024-09-05T02:16:20.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2236648733197200346', time=2024-09-05T03:44:41.146358+0000, chain.objs.size()=1 2024-09-05T02:16:20.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.v63AHjhR2k6iSQVgNp3cBE9Srr1GG2P_0 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11178945291356504367', time=2024-09-05T03:44:42.322272+0000, chain.objs.size()=1 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.eD5Vk2ug92oRHXt9DcRrGtmpcny8uEG_0 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3376494911246984975', time=2024-09-05T03:44:43.045560+0000, chain.objs.size()=1 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.McGy861D1XzAm-sENVL0ILjxzsYWYRa_0 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11827743135318057332', time=2024-09-05T03:44:43.864101+0000, chain.objs.size()=1 2024-09-05T02:16:20.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QvCa5rV5dJwz4kExEBFzXDxgIjtC76a_0 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10812536689557770759', time=2024-09-05T03:44:44.714936+0000, chain.objs.size()=1 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CqvgRKJDrElDKCCdXTxHHKKQgvldV5f_0 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5493023275318283790', time=2024-09-05T03:44:45.440791+0000, chain.objs.size()=1 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.E_tyqPMjc3aPunlNtupyZ7Sik8_R02E_0 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14510401349915123207', time=2024-09-05T03:44:47.768047+0000, chain.objs.size()=1 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IjlruoDjq9G5AE5mwJ0Woc5NNoJ9UWE_0 2024-09-05T02:16:20.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14468231345229571478', time=2024-09-05T03:44:49.203470+0000, chain.objs.size()=1 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ljUOH9gswxx2zwbbBslFE3cTOI3Y6OK_0 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10605542797401204571', time=2024-09-05T03:46:33.396587+0000, chain.objs.size()=1 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XnmJtdyKXHaGXp5aE8yCwGGJ31crNSS_0 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3695648399087196586', time=2024-09-05T03:46:33.764644+0000, chain.objs.size()=1 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.m0dkJDamXNGJTA2HxgjPFbG-s2YIy3w_0 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1205191376260407686', time=2024-09-05T03:46:34.701249+0000, chain.objs.size()=1 2024-09-05T02:16:20.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mhAkMS6JvVxBFYzI3vXR5oYtHchhy-B_0 2024-09-05T02:16:20.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2930200252524446506', time=2024-09-05T03:46:35.111096+0000, chain.objs.size()=1 2024-09-05T02:16:20.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TVmMlO5zQrDEGi8GKnCYC8yGrAtCnd8_0 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13469132071997953536', time=2024-09-05T03:46:35.538012+0000, chain.objs.size()=1 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2bsyjcjniHLw0_FZRn_ahuSZYton1-K_0 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17802513514384489571', time=2024-09-05T03:46:36.033545+0000, chain.objs.size()=1 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LanNGfqDO1WCX_dZzQXSWwJ7-BaoEx__0 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13146950157543731929', time=2024-09-05T03:46:38.299300+0000, chain.objs.size()=1 2024-09-05T02:16:20.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.D6V9Ii9QKL1TERoJboLoaoiZTClGBJe_0 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.97361653248716824', time=2024-09-05T03:46:39.076660+0000, chain.objs.size()=1 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JK4KpQPLoGhxRnWAz45D5h6D2U_yqf6_0 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15429805307213171747', time=2024-09-05T03:46:39.263069+0000, chain.objs.size()=1 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lFGcZPteZvIA5iQf8W_wkBW26-JkNm0_0 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6001678514646659714', time=2024-09-05T03:46:42.475903+0000, chain.objs.size()=1 2024-09-05T02:16:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AhSe1mt87u7m_iaZv9WImfJZqkqNE70_0 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11194955794152298010', time=2024-09-05T03:46:43.387227+0000, chain.objs.size()=1 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.N5TIaIM0IGelQMo_XgUnSEg3vkW8nFV_0 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16014182703166738380', time=2024-09-05T03:46:43.500370+0000, chain.objs.size()=1 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Tbs4p9iKpJNlacqCKaLnnwDxE74cKNv_0 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17733228342190021643', time=2024-09-05T03:46:47.132078+0000, chain.objs.size()=1 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o2ImBEi30LmEy7BDrEA-GW2NYjRjJWs_0 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10614446744452466886', time=2024-09-05T03:46:47.825291+0000, chain.objs.size()=1 2024-09-05T02:16:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QN0wUlGcPAd6MDBps1nQYl7yp-XskRS_0 2024-09-05T02:16:20.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9080401736770066034', time=2024-09-05T03:46:49.181504+0000, chain.objs.size()=1 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.04inBQVjSJ4Clor1nvsRFdpXdyIOdfx_0 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1996500870045005432', time=2024-09-05T03:46:49.233665+0000, chain.objs.size()=1 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gEAsbzvvoCPH9_p0mtUkmDAsp4PhVm5_0 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3181604211384240883', time=2024-09-05T03:46:50.173741+0000, chain.objs.size()=1 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.j9l5u6d_VuvB23F-3atBEm1icatcR1E_0 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11580894997737066866', time=2024-09-05T03:46:50.628849+0000, chain.objs.size()=1 2024-09-05T02:16:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.pR1TeKpLvejHBvObXSiCU7c_w1O12Ub_0 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9364572824483870724', time=2024-09-05T03:46:51.019905+0000, chain.objs.size()=1 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3u3P45hTxQ2_mb8Ut1jNQ_HPuiXsevQ_0 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16980385052616949883', time=2024-09-05T03:46:52.040159+0000, chain.objs.size()=1 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rma_ZvYkTwaZRhJtqdtu3Xg_p9aAJWa_0 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323298842324913655', time=2024-09-05T03:46:52.850982+0000, chain.objs.size()=1 2024-09-05T02:16:20.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qQ-1cNOTKrqzNjOkwfdnE5TxMvEKHNc_0 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17216696240852106938', time=2024-09-05T03:46:52.962619+0000, chain.objs.size()=1 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fgXI8OkJ-yz5qDPScp5KQY9MkFPgkOc_0 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9217368501768137347', time=2024-09-05T03:46:53.219904+0000, chain.objs.size()=1 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Er-efoxF3WTZwdDnBmkiWvtwi2ALlZJ_0 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7431705979190910793', time=2024-09-05T03:46:56.422792+0000, chain.objs.size()=1 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RJuvPzqXLwT2nkRMmZLouhGP48amCcj_0 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9499947956636080727', time=2024-09-05T03:46:56.425925+0000, chain.objs.size()=1 2024-09-05T02:16:20.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fBVGKahYIroNGnkJsryzq9VR4HT_nL1_0 2024-09-05T02:16:20.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5387285333059643987', time=2024-09-05T03:46:58.218879+0000, chain.objs.size()=1 2024-09-05T02:16:20.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hIfr7Wb4yDLmv9ysb-UBk0h_t3Ke2ty_0 2024-09-05T02:16:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13462961394803406379', time=2024-09-05T03:46:59.594351+0000, chain.objs.size()=1 2024-09-05T02:16:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.a0wXFFCUhpVurNkY4BqO47hkhiHV9n__0 2024-09-05T02:16:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14650759353138737054', time=2024-09-05T03:52:28.716031+0000, chain.objs.size()=2 2024-09-05T02:16:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.9GVFOqxp4KVN3xrRoVUutW9tx1tvOon_0 2024-09-05T02:16:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:20.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.9GVFOqxp4KVN3xrRoVUutW9tx1tvOon_1 2024-09-05T02:16:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2441527384652437052', time=2024-09-05T03:54:54.331065+0000, chain.objs.size()=3 2024-09-05T02:16:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~kCkL6V6QRwahhTsyf3yvrTlT17c9F9X.1 2024-09-05T02:16:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~kCkL6V6QRwahhTsyf3yvrTlT17c9F9X.2 2024-09-05T02:16:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~kCkL6V6QRwahhTsyf3yvrTlT17c9F9X.3 2024-09-05T02:16:21.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2375749067812950690', time=2024-09-05T03:55:07.125286+0000, chain.objs.size()=4 2024-09-05T02:16:21.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.527__multipart_mymultipart.2~jTMx-Touz-bXGUTJ6qNajCrLgQ64IE6.1 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.527__multipart_mymultipart.2~jTMx-Touz-bXGUTJ6qNajCrLgQ64IE6.2 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.527__multipart_mymultipart.2~jTMx-Touz-bXGUTJ6qNajCrLgQ64IE6.3 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.527__multipart_mymultipart.2~jTMx-Touz-bXGUTJ6qNajCrLgQ64IE6.4 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~WVBbf9T2zrYfJC8waIAFkuKulcTQdkj', time=2024-09-05T03:55:22.214883+0000, chain.objs.size()=2 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.531__multipart_mymultipart.2~WVBbf9T2zrYfJC8waIAFkuKulcTQdkj.1 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.531__multipart_mymultipart.2~WVBbf9T2zrYfJC8waIAFkuKulcTQdkj.2 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7833703218346499994', time=2024-09-05T03:56:44.060165+0000, chain.objs.size()=1 2024-09-05T02:16:21.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.555__shadow_.WrzqwGAnlykYO8dKAAj2bMexyHu_WNy_0 2024-09-05T02:16:21.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4297056515171814896', time=2024-09-05T03:57:05.814550+0000, chain.objs.size()=1 2024-09-05T02:16:21.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.561__multipart_mymultipart.qWErS2uD8C-tn-iRwarmiFmGnrdkCedO.1 2024-09-05T02:16:21.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15554574903150080425', time=2024-09-05T03:57:40.901164+0000, chain.objs.size()=1 2024-09-05T02:16:21.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.004+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:uTI4451tDyN8pII0xIfm-kaFMsw-2.m_.i-Qxq9tu0dpkcXYFzsG5bkhRpID9erY_0 2024-09-05T02:16:21.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44494 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10202942437038340808', time=2024-09-05T03:57:55.148647+0000, chain.objs.size()=1 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.573__shadow_.iaE6rnFX-s_XcKzQ2K-E0UYXI2dGUQK_0 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5894895740402552785', time=2024-09-05T03:58:39.382847+0000, chain.objs.size()=1 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:osYHzi-aat1YIalfDiSvJ4zesB.eLqY_.UjGFooahK_03r1Bk1YaE8NyNRTvof1O_0 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.651570670776629189', time=2024-09-05T03:59:19.764343+0000, chain.objs.size()=4 2024-09-05T02:16:21.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~tzeO0Ox2UavHFUOfc9F0VVjR9Zrzf2b.1 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~tzeO0Ox2UavHFUOfc9F0VVjR9Zrzf2b.2 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~tzeO0Ox2UavHFUOfc9F0VVjR9Zrzf2b.3 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~tzeO0Ox2UavHFUOfc9F0VVjR9Zrzf2b.4 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17134593385783049772', time=2024-09-05T04:00:12.920167+0000, chain.objs.size()=1 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.605__shadow_.dNVMCTwiKRZnwwPJBt7VXQsvpO-EmQc_0 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15762682506221660067', time=2024-09-05T04:07:20.126792+0000, chain.objs.size()=1 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.704__shadow:ip3zm.5VLqXPXoJH-32z5Itzz9vT.aR_.jzwv6UlwLsEMAX66OCm5VZjoiiMerGz_0 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3677153465902195513', time=2024-09-05T04:07:22.081969+0000, chain.objs.size()=1 2024-09-05T02:16:21.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.705__shadow:jo0Pmo8BJIw40FJnuMzjublVX0JNfMP_.LfPkl70umqr8PhSpD1N-FQrVX16tz8-_0 2024-09-05T02:16:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.032+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-05T02:16:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.032+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48575' 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_s6BA-pfL8gFMUYgLnTYbIE9B15s6BX6', time=2024-09-05T03:33:03.730799+0000, chain.objs.size()=2 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.2pRzqYCj61Ui4luTpemqKUxSOanDNOr_0 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.2pRzqYCj61Ui4luTpemqKUxSOanDNOr_1 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5418349534856816264', time=2024-09-05T03:37:36.225205+0000, chain.objs.size()=1 2024-09-05T02:16:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.237__shadow_.yoQyX5ltDqE5nYRowMr3FpH1aaEbovj_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8625835569879724168', time=2024-09-05T03:38:22.645812+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.261__shadow_.xtsTlLQupMs7r7woEpVrZDU7pViJG7V_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13468703491037513808', time=2024-09-05T03:40:05.183973+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.IGMqyivc0kAFA3BwFuUizoDKaKRlxzD_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17240264899410193732', time=2024-09-05T03:40:05.849529+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Aqy5ZKS4M_dFRBg_Difm--7C77T4uDi_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14297831202246932515', time=2024-09-05T03:40:06.387295+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C5Y2g_CYPC5HLNYVMPaEjs7bfEYGsrz_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9799948070472364229', time=2024-09-05T03:40:10.005795+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GSj5wUjQ_EmbpWixaWddmf0QCOR3xxf_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10351266365557814317', time=2024-09-05T03:40:10.186262+0000, chain.objs.size()=1 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.DZeu5LzwWEZV7-LjqPYpA7YV6us7wPA_0 2024-09-05T02:16:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17921871409179502129', time=2024-09-05T03:40:11.297783+0000, chain.objs.size()=1 2024-09-05T02:16:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kUyIZbzhyc2y9Ro2lhWVRNH3Ydg9KIz_0 2024-09-05T02:16:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10397304055066962031', time=2024-09-05T03:40:13.746043+0000, chain.objs.size()=1 2024-09-05T02:16:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0dLjZC10yXKj4KcV5JK2ohecm_czv_K_0 2024-09-05T02:16:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15756454044084923586', time=2024-09-05T03:40:14.061543+0000, chain.objs.size()=1 2024-09-05T02:16:21.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oVrud4gsAOuRPW-8ZawUro7mY0qEiVZ_0 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15333914934442411948', time=2024-09-05T03:40:14.898368+0000, chain.objs.size()=1 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VEypcBzhlCRCk2O5M5dlU3cQjzo_zk9_0 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7905197848529655067', time=2024-09-05T03:40:15.974500+0000, chain.objs.size()=1 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6lnQAFwODeeO15twyCE5KOi9nUcM3LB_0 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5632210804894944099', time=2024-09-05T03:40:17.519472+0000, chain.objs.size()=1 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cNICgQiVkp_abTgwSwueUKDAcqeRIAe_0 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17254807587793761492', time=2024-09-05T03:40:18.297670+0000, chain.objs.size()=1 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.G0cTmCbUB_ANm1Kb9zdcFDILzijqCuy_0 2024-09-05T02:16:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2749543563625140054', time=2024-09-05T03:40:18.594583+0000, chain.objs.size()=1 2024-09-05T02:16:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5BtJAUf6qUI_uHntAlLT69-U3jbzXdE_0 2024-09-05T02:16:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4809860815570674743', time=2024-09-05T03:40:19.517564+0000, chain.objs.size()=1 2024-09-05T02:16:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.omSG51mO0nh9RGNZj04UCnb4W9cn3Ry_0 2024-09-05T02:16:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10858096708393623618', time=2024-09-05T03:40:19.658600+0000, chain.objs.size()=1 2024-09-05T02:16:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ilVZiOJRopsdTmsGMmtYDS5BFgO4AiV_0 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10153015372951038615', time=2024-09-05T03:40:20.003116+0000, chain.objs.size()=1 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eLCf6OzGXicJyaRbd2v-EhIp1GlpjfB_0 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14252578832178492789', time=2024-09-05T03:40:20.525347+0000, chain.objs.size()=1 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BaWO1JqofZ8snSo0T_-8gDxj43dUzQG_0 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14546658456918021346', time=2024-09-05T03:40:22.288835+0000, chain.objs.size()=1 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wv3GSUJ-orpuWsFyI7yHRhDCdYuvIrO_0 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1668062691913182806', time=2024-09-05T03:40:23.248671+0000, chain.objs.size()=1 2024-09-05T02:16:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.044+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.REyLmheKmekDdB6K98cfyVkRSu9NanJ_0 2024-09-05T02:16:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11367250494247198010', time=2024-09-05T03:40:23.789854+0000, chain.objs.size()=1 2024-09-05T02:16:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.76hxhEMlDaSHnr0SM9kj4hCjunpr9je_0 2024-09-05T02:16:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14162251943734146697', time=2024-09-05T03:40:24.751508+0000, chain.objs.size()=1 2024-09-05T02:16:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ktI_UjwqDjr7SGirNr7L8au-7QdW7a3_0 2024-09-05T02:16:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13023599088736135525', time=2024-09-05T03:40:24.808822+0000, chain.objs.size()=1 2024-09-05T02:16:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7Yh6gH5WD6aUukbBWEYV4Wb2RwtfsIv_0 2024-09-05T02:16:21.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5013038182806936765', time=2024-09-05T03:40:28.074374+0000, chain.objs.size()=1 2024-09-05T02:16:21.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gLb6-svbtBnbTS9I6mlUPQDaqIgrEje_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16265410193324291129', time=2024-09-05T03:40:30.136624+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ob02SzoVZ70mOLJR7NVy9T9eYCmIklp_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11499025614622292566', time=2024-09-05T03:40:30.433130+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eL1tSYnPV4wKEWgHZ_9pVm6LJHnRQD6_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5449392074816919130', time=2024-09-05T03:40:30.797910+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.342f8udApz4rmRUB8eAQbcbKvM-Scuk_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5514679316285299817', time=2024-09-05T03:40:32.378590+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6uFFZ9HIcbOIyktKacXwALwOjvNB9dp_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15115318836077719934', time=2024-09-05T03:40:33.097596+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.O8D1haRb9D25CzEkErjWxPnY_W5Rs8q_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15083250802373729207', time=2024-09-05T03:40:34.257497+0000, chain.objs.size()=1 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6MNHO5RmF8bNZHz_al5sBe0GSrPCOeL_0 2024-09-05T02:16:21.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10450594869374041970', time=2024-09-05T03:40:34.538234+0000, chain.objs.size()=1 2024-09-05T02:16:21.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.00tJPghE8W0ZCP4jzIhQDcCEsmDAQvM_0 2024-09-05T02:16:21.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9205507133057826222', time=2024-09-05T03:40:35.205124+0000, chain.objs.size()=1 2024-09-05T02:16:21.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.048+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nSe7au5IdJ5ntWJ3olwSitVg7_j0wTs_0 2024-09-05T02:16:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9070680098856267209', time=2024-09-05T03:40:35.352681+0000, chain.objs.size()=1 2024-09-05T02:16:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.skw7T-fk61sAdgy7F7JkmesNfATxeJ-_0 2024-09-05T02:16:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15544577189020528473', time=2024-09-05T03:40:35.744125+0000, chain.objs.size()=1 2024-09-05T02:16:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZFurztuYKQRL7XTlhd9MbXHScrEexZ__0 2024-09-05T02:16:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10841969074480621996', time=2024-09-05T03:40:35.826086+0000, chain.objs.size()=1 2024-09-05T02:16:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4rksv_tx92XWIvZLKDLpGVowBPGHKnt_0 2024-09-05T02:16:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7039063148929139252', time=2024-09-05T03:40:52.324905+0000, chain.objs.size()=1 2024-09-05T02:16:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.271__shadow_.Os4Cd_eME3uoiYNrNn_OqQwgOD8ZBV3_0 2024-09-05T02:16:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13235078673396712456', time=2024-09-05T03:40:59.339989+0000, chain.objs.size()=1 2024-09-05T02:16:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.275__shadow_.FLQNU_du8HzNceMIwDBp9skW20QzJQd_0 2024-09-05T02:16:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7464733191824783935', time=2024-09-05T03:41:27.702316+0000, chain.objs.size()=1 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.290__shadow_.7yv3BvO6_l2_IqImuWKZWv6Ppt01idz_0 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17278247041987076735', time=2024-09-05T03:41:34.695180+0000, chain.objs.size()=1 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.pNvjuiIwrNj5cm3Qdaqh6K6HZXPUqH0_0 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11060896409757702895', time=2024-09-05T03:41:42.161673+0000, chain.objs.size()=1 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.294__shadow_.z09s_WO7uFIvkXNSsmfCjEnY67QXU2T_0 2024-09-05T02:16:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4261254689002471828', time=2024-09-05T03:41:42.179727+0000, chain.objs.size()=1 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.294__shadow_.9nuvvsXASpvhYergt1lkDCavfbtnanP_0 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12856434097203630503', time=2024-09-05T03:41:47.802669+0000, chain.objs.size()=1 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.297__shadow_.xCgpd7eFSdvgbF1zH3gSMVNrr0wBw0V_0 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16711787112051681763', time=2024-09-05T03:42:01.042610+0000, chain.objs.size()=1 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.304__shadow_.dXtKQ_QvYWMH-iCJ4ETe-HuUt74S01Y_0 2024-09-05T02:16:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18214180134177854295', time=2024-09-05T03:42:01.062660+0000, chain.objs.size()=1 2024-09-05T02:16:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.304__shadow_.NxiL5xy8MK8aGVpm45RmrVhGFbZFoi__0 2024-09-05T02:16:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7693881284923483078', time=2024-09-05T03:44:19.276299+0000, chain.objs.size()=1 2024-09-05T02:16:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G8A313N84gD10fkCe4A-pxIS56w8vrn_0 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16792128875014114583', time=2024-09-05T03:44:21.308065+0000, chain.objs.size()=1 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6N-HOHrv7osB7IFZPLDZJ-VyxTY1mW9_0 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17075209870022887912', time=2024-09-05T03:44:23.447812+0000, chain.objs.size()=1 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YaemgYwm1_dpJTd47BJXo4W620GYwUV_0 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15688902327813733541', time=2024-09-05T03:44:24.211305+0000, chain.objs.size()=1 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LKq8G0-upAZ6tqfERbo1Ndu1J1rUxWU_0 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.27970907784478963', time=2024-09-05T03:44:26.009017+0000, chain.objs.size()=1 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9LST0MZhR3uiwSkLJ70ZlFtfNk1JQEL_0 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11782343955676149167', time=2024-09-05T03:44:26.564433+0000, chain.objs.size()=1 2024-09-05T02:16:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OZENxGLUIjrRHVYiI47WKzIbaCqsEkX_0 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4825290402313877844', time=2024-09-05T03:44:29.314852+0000, chain.objs.size()=1 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._CV7f8-nGGaPlClijeEA9VyBYaIlkPc_0 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16652113660107826308', time=2024-09-05T03:44:30.423950+0000, chain.objs.size()=1 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2yrkYKVJMDjayqWG3vzthBXuWiKSbv__0 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12677282421719379994', time=2024-09-05T03:44:30.722990+0000, chain.objs.size()=1 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uTLloXqSdrtwa8_1AhZl_K2EdQBLfFl_0 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12541103660537599725', time=2024-09-05T03:44:32.103383+0000, chain.objs.size()=1 2024-09-05T02:16:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.htxMbzET2LyDd0e3LXGjoRkcBQHt56t_0 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18287476875873769661', time=2024-09-05T03:44:32.869362+0000, chain.objs.size()=1 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xbBuMIrV2Jy6NeRSdNQN-uNergz8XuW_0 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1743346799248436510', time=2024-09-05T03:44:34.118387+0000, chain.objs.size()=1 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NMQEWfa_O1ZgZpR0mO3PrvBt-3tZapw_0 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2720505693863025800', time=2024-09-05T03:44:35.805399+0000, chain.objs.size()=1 2024-09-05T02:16:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jDKcQX1K3qWkJ71HhYfobFFwPGBvIB1_0 2024-09-05T02:16:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15960557877376684280', time=2024-09-05T03:44:36.617749+0000, chain.objs.size()=1 2024-09-05T02:16:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zII4PiD4fOZpgLxRT394C_EXO6X3LgF_0 2024-09-05T02:16:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7514225318350339132', time=2024-09-05T03:44:37.352515+0000, chain.objs.size()=1 2024-09-05T02:16:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sv8bPZbJe3F87lhPDTGrL_B3SdJrgFG_0 2024-09-05T02:16:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18381562615966254151', time=2024-09-05T03:44:37.441151+0000, chain.objs.size()=1 2024-09-05T02:16:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WGo5w6eKM_v8kCfJjxNBYzFmUh3PVHC_0 2024-09-05T02:16:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12434993453370399666', time=2024-09-05T03:44:37.701147+0000, chain.objs.size()=1 2024-09-05T02:16:21.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TDMlAaC9saCE_TDwukZbGooVKNMTM82_0 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2475630482128344506', time=2024-09-05T03:44:38.990959+0000, chain.objs.size()=1 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.O3p1HTkNOBQXrJjBCRxZ7Uj2houi_nq_0 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17375956856599252537', time=2024-09-05T03:44:39.044687+0000, chain.objs.size()=1 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zFEU-4IGcL1zCmgX3Whs1zKHt6WxlUU_0 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12958568273854363015', time=2024-09-05T03:44:40.765321+0000, chain.objs.size()=1 2024-09-05T02:16:21.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Y5dO6u-sMobjZPNxvEVNXvQNfn81SKD_0 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10934160699845938767', time=2024-09-05T03:44:41.310004+0000, chain.objs.size()=1 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GcRHMFz1iCaoyJx3BR9opmY2imgHj-R_0 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15866799878065851191', time=2024-09-05T03:44:41.574282+0000, chain.objs.size()=1 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XfAbUcXKRFSJ-8oXxId0bwjGtOJc1aH_0 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3911815947171951877', time=2024-09-05T03:44:44.145952+0000, chain.objs.size()=1 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pYxlx092Mr42zCMXpSv4dL-TAVmtd5-_0 2024-09-05T02:16:21.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6189229753750759622', time=2024-09-05T03:44:44.270479+0000, chain.objs.size()=1 2024-09-05T02:16:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AdQAlPyut71YfJsRsOCUFDCdYIWtQvG_0 2024-09-05T02:16:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2755410906380667349', time=2024-09-05T03:44:45.205986+0000, chain.objs.size()=1 2024-09-05T02:16:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bcQSnM-n1rznG8qjfrrhtCwalvTvAr2_0 2024-09-05T02:16:21.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7501661248836764641', time=2024-09-05T03:44:46.367442+0000, chain.objs.size()=1 2024-09-05T02:16:21.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7s37TMc1J1KAkSTlBcCa3KjbntnXQeu_0 2024-09-05T02:16:21.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10588977507190848843', time=2024-09-05T03:44:46.912154+0000, chain.objs.size()=1 2024-09-05T02:16:21.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DTLlYYhqEqVYZcDzGKDOwc16C6P-wHQ_0 2024-09-05T02:16:21.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11140540222187874385', time=2024-09-05T03:44:48.226694+0000, chain.objs.size()=1 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VdoYV_r8uhGVpU3IF1Ups0M7KbRXnNo_0 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8868349566211189360', time=2024-09-05T03:44:48.678827+0000, chain.objs.size()=1 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Oj3h01Hyn7dTGXv-Qbs153SKKy2z9b5_0 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3930091077243070235', time=2024-09-05T03:44:50.122110+0000, chain.objs.size()=1 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SgmlGSGGAQZbagooHaEej8GS-tX6usn_0 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2534896729331269395', time=2024-09-05T03:44:50.234847+0000, chain.objs.size()=1 2024-09-05T02:16:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RDSXCyANPLnW1L_D_gelD4j_CA0-JuJ_0 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17632385912831858097', time=2024-09-05T03:46:37.726811+0000, chain.objs.size()=1 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SlyAQ68181m0ahtr-gDZLpKAhui-TAZ_0 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8497326005266160321', time=2024-09-05T03:46:38.306098+0000, chain.objs.size()=1 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hdwb6WWOiwfCcJbxKyDJas6MpQlpiMD_0 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9229747909865258822', time=2024-09-05T03:46:39.781523+0000, chain.objs.size()=1 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._HyrksSjRMHKiP_TSLO6I5bv49Nxb2L_0 2024-09-05T02:16:21.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1025228168944919871', time=2024-09-05T03:46:40.518916+0000, chain.objs.size()=1 2024-09-05T02:16:21.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Un0Q7Cu2fItfU3b8G26Cuysm7a3g6es_0 2024-09-05T02:16:21.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15601767149032840847', time=2024-09-05T03:46:40.886685+0000, chain.objs.size()=1 2024-09-05T02:16:21.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Wdn5cgoZfIRLIV-TmVeKNP-2kPZkbLv_0 2024-09-05T02:16:21.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10041214566610594067', time=2024-09-05T03:46:40.888407+0000, chain.objs.size()=1 2024-09-05T02:16:21.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.072+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dsiMG6oFjT_e80cogYiQp1yBcWTg6Lt_0 2024-09-05T02:16:21.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10069004906114466625', time=2024-09-05T03:46:46.074686+0000, chain.objs.size()=1 2024-09-05T02:16:21.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Cxm3_tlWsC91MCeaA532F8uq6BImWN2_0 2024-09-05T02:16:21.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3813214385144117860', time=2024-09-05T03:46:46.076776+0000, chain.objs.size()=1 2024-09-05T02:16:21.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sPeav_lVnohcGdpN_NC2SUd2bTCCqjO_0 2024-09-05T02:16:21.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14265328121458654883', time=2024-09-05T03:46:46.874773+0000, chain.objs.size()=1 2024-09-05T02:16:21.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hQJDRWlhZrXuovmeCsBkkPpEROAZMC2_0 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6486857721406487640', time=2024-09-05T03:46:48.187170+0000, chain.objs.size()=1 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UaBLTwETe6l5oSvwcWgU9rRoy8ifmKr_0 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12270544077093402495', time=2024-09-05T03:46:48.628767+0000, chain.objs.size()=1 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6NJk9AYKp82PDkK0oTvClUtn_04T80E_0 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17018603828268782568', time=2024-09-05T03:46:50.607978+0000, chain.objs.size()=1 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8HI6u2zP2DqDUSVkzXVI5Nkv3xSZqom_0 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17647130191377949873', time=2024-09-05T03:46:50.993756+0000, chain.objs.size()=1 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.U786rBYYO-DW12z6RDhXUslA4fSgrnt_0 2024-09-05T02:16:21.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14332752074337877340', time=2024-09-05T03:46:51.140641+0000, chain.objs.size()=1 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.I_cYFtdyTj6ZhI-XUPbSvJUC9cyQhRP_0 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11455142531645278277', time=2024-09-05T03:46:51.426746+0000, chain.objs.size()=1 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._YAd-U2Bsl5Cko34Z-PCyTy0ASjOu3C_0 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16390901888436055122', time=2024-09-05T03:46:53.149773+0000, chain.objs.size()=1 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GQ-RFTQxuA-ivcz-kKgbpPZEJgKZiod_0 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8203568870669692386', time=2024-09-05T03:46:54.821938+0000, chain.objs.size()=1 2024-09-05T02:16:21.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZFHDDAFuzso3KFW5DxDsOL959BNG5fz_0 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8208050774982887231', time=2024-09-05T03:46:55.547359+0000, chain.objs.size()=1 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4KOxK-yS_M7OU5_dC8IMgCIZr0pyoo5_0 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9000480714243902233', time=2024-09-05T03:46:56.500810+0000, chain.objs.size()=1 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.P9UZEYjmFFqTPv_Y8smUT5wRUHPaRVN_0 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16999842675895090832', time=2024-09-05T03:47:00.273066+0000, chain.objs.size()=1 2024-09-05T02:16:21.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DI8304mVqAubI6jhBQBMadk9JEW_35a_0 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4381649480768777677', time=2024-09-05T03:47:00.340129+0000, chain.objs.size()=1 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7jpTJ4PqdAIDw3n90-8h8OUkqvkRCF4_0 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9036270696948247006', time=2024-09-05T03:47:00.590139+0000, chain.objs.size()=1 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.n28doyndtyJjBeHVku_oqBcgELvI58B_0 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10308202837473729742', time=2024-09-05T03:47:00.611775+0000, chain.objs.size()=1 2024-09-05T02:16:21.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ikFYhhZ-ZQYZ-X-SI90tM0Z4NKJ8MxY_0 2024-09-05T02:16:21.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48575 2024-09-05T02:16:21.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-05T02:16:21.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17759571281420991342', time=2024-09-05T03:47:01.236767+0000, chain.objs.size()=1 2024-09-05T02:16:21.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RrqAepzjIPT6RfTqVcxS0wkkGS8swB-_0 2024-09-05T02:16:21.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13215365682249686659', time=2024-09-05T03:47:02.438680+0000, chain.objs.size()=1 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aO6gc1doR0HRcC8ZT_pzPa9emVq4Y_j_0 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7482890323188511302', time=2024-09-05T03:47:02.714707+0000, chain.objs.size()=1 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W954l15oTNfG2xHExWOaCtOhJNGuSQT_0 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6474453350764117300', time=2024-09-05T03:47:02.791536+0000, chain.objs.size()=1 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gGnED2Kp0ngR8ZvaVhL9epmZpbNxzVx_0 2024-09-05T02:16:21.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4896619939104707636', time=2024-09-05T03:47:13.563666+0000, chain.objs.size()=1 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.330__shadow_.f888qrFoVb8VWf31V5pkYvNE2t6LO6h_0 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1562642592606589721', time=2024-09-05T03:48:19.489760+0000, chain.objs.size()=1 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.377__shadow_.AO_udJiVNC1U-vmGWLT1TVPO_Ze5Xhq_0 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.63838456057685643', time=2024-09-05T03:50:32.135204+0000, chain.objs.size()=1 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.459__shadow_.aeijdUiljSAwdxVjxmi0-l9llpPxSIO_0 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4207062665392737756', time=2024-09-05T03:51:46.295566+0000, chain.objs.size()=1 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.554868822009643862', time=2024-09-05T03:53:08.572906+0000, chain.objs.size()=3 2024-09-05T02:16:21.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.520__shadow:CYn7MSBSK14MkUGqsvL8Mx4NbVVuDWw_._tUl2hpEFdbjYyyhO6nXpZbhlGmhat__0 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.520__shadow:CYn7MSBSK14MkUGqsvL8Mx4NbVVuDWw_._tUl2hpEFdbjYyyhO6nXpZbhlGmhat__1 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.520__shadow:CYn7MSBSK14MkUGqsvL8Mx4NbVVuDWw_._tUl2hpEFdbjYyyhO6nXpZbhlGmhat__2 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mAUOYkYnP00Vumo8hQmC1KkTWXbxFLM', time=2024-09-05T03:55:22.306925+0000, chain.objs.size()=1 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.531__multipart_mymultipart2.2~mAUOYkYnP00Vumo8hQmC1KkTWXbxFLM.1 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13193475318918225184', time=2024-09-05T03:58:03.898388+0000, chain.objs.size()=1 2024-09-05T02:16:21.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:d3lVYBFXpbv89JWZBrf6y8IeJ3PnrF8_.D-LdmVj_fEe9Inf7-rFEgl6tAcJZM3i_0 2024-09-05T02:16:21.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17643808441972048707', time=2024-09-05T03:58:38.420736+0000, chain.objs.size()=1 2024-09-05T02:16:21.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:FcFH4xaGfnKSc8ClFfq1du2.EGhOVy8_.6G4WoEftj3QadB5zRTmKH4fpFN8X5Ir_0 2024-09-05T02:16:21.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17473912345263268345', time=2024-09-05T03:58:43.700752+0000, chain.objs.size()=1 2024-09-05T02:16:21.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:-lO.KAGRLJsIspKG86AgyhdKi8EPu8L_.kPjqb3nhYr_Pd_5vBhjT6wEE1QS8DEq_0 2024-09-05T02:16:21.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13035657647380542469', time=2024-09-05T03:59:29.667938+0000, chain.objs.size()=1 2024-09-05T02:16:21.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:D8pYjN2GLiUO1hdJkbUFT6CEAb4Ix77_.EMmWIVAluYaqzyGPVaEA3kMGpVM7f4Y_0 2024-09-05T02:16:21.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1257183562683467247', time=2024-09-05T04:04:49.260884+0000, chain.objs.size()=1 2024-09-05T02:16:21.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.627__shadow_.KAUUNOATD4oq746i4Xj-a_K1xMQ2tE0_0 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13653471436409329570', time=2024-09-05T04:04:58.836664+0000, chain.objs.size()=1 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.633__shadow_.UAsrfcn5l0unEJrn0WBnhRm_IxANAHt_0 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7085410606788647210', time=2024-09-05T04:05:24.616400+0000, chain.objs.size()=2 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.646__shadow_.LgBjluOr_WZTs4P8maoUxFlPovxApdV_0 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.646__shadow_.LgBjluOr_WZTs4P8maoUxFlPovxApdV_1 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14460532049294989002', time=2024-09-05T04:06:40.824487+0000, chain.objs.size()=1 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.679__shadow_.ZYFTRNBuFp8HLUNeafmHnshynFNTKxX_0 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11345683327586429388', time=2024-09-05T04:07:50.479428+0000, chain.objs.size()=1 2024-09-05T02:16:21.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.716__shadow:r9nmJcnRM8KAkNXWXpGl-S6eMJh5B01_.56euO9j6lUTbCljqun_Ke_TSu-yuogA_0 2024-09-05T02:16:21.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.096+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.100+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-05T02:16:21.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49685' 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5242142179131334006', time=2024-09-05T03:32:22.819111+0000, chain.objs.size()=1 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.147__shadow_.phSIz5IEaLbuDKqzwlKftWvSQFm60uR_0 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2324447882610686551', time=2024-09-05T03:33:23.407661+0000, chain.objs.size()=1 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.171__shadow_.73o_jkr2pwhDhsylkfCMz3crP6h9FpY_0 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15106730822850618426', time=2024-09-05T03:37:22.293753+0000, chain.objs.size()=1 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.230__shadow_.-J6fcwh_DZhDTguSoFZIJPkN08J7eBH_0 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14587727738771316171', time=2024-09-05T03:37:31.692406+0000, chain.objs.size()=1 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.235__shadow_.6ItBgkZ5RAP0q0Xx74UszrEesq9vu0e_0 2024-09-05T02:16:21.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13315959338712873326', time=2024-09-05T03:37:33.540741+0000, chain.objs.size()=1 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.236__shadow_.M7S5mm4nLdXfTL2QkQ6S-InTDinDt4q_0 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13409290764976190242', time=2024-09-05T03:37:38.961767+0000, chain.objs.size()=1 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.238__shadow_.pHCLibxEKU9tBOyRclB5fquEJB0o5A7_0 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9857253252473998671', time=2024-09-05T03:37:43.827696+0000, chain.objs.size()=1 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.241__shadow_.k6Kv0ksSE_S7WchlzpHxoMV5r5pDzs9_0 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11719110991666221392', time=2024-09-05T03:37:54.856489+0000, chain.objs.size()=1 2024-09-05T02:16:21.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.246__shadow_.ROPGv601sawWNcHthmGJXj4D72iZCgI_0 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.268370470874801807', time=2024-09-05T03:38:09.781310+0000, chain.objs.size()=1 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.254__shadow_.l3C4-bSbciIAD352JL-gK6xLrrJb5yf_0 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6493613313299452019', time=2024-09-05T03:38:13.669224+0000, chain.objs.size()=1 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.256__shadow_.cMZEHkR8L9NuAIEaTdDkmuvzLDACHfF_0 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.413693621848580889', time=2024-09-05T03:40:05.614224+0000, chain.objs.size()=1 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cq8C1FYN4RXlGpZ0bLOoEeFYVgNWA4O_0 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10910205686628836390', time=2024-09-05T03:40:09.021912+0000, chain.objs.size()=1 2024-09-05T02:16:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.P7Xbr-orbdduiJlG-KMBfKcax096V7C_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15762927222488281229', time=2024-09-05T03:40:09.708173+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oEbRGuaL0eZd_rV1GLCVRonocRbO1_U_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.793487194536602733', time=2024-09-05T03:40:10.905757+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.at2UjddvdFrEtHqP6cdy4VozRICx82u_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5606786736010354005', time=2024-09-05T03:40:11.760256+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.S1IeIB-wsSMMIUZfWHO5kg0h4AlWKQs_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17268324400178360757', time=2024-09-05T03:40:13.238233+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YmZytcka_AxhNi9IoIZ1vDbY5khEBis_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6136062236034688225', time=2024-09-05T03:40:14.267121+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.487Kqj795io02KKpAlCDzLvMf7WK1m6_0 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2878775757846171107', time=2024-09-05T03:40:14.540833+0000, chain.objs.size()=1 2024-09-05T02:16:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iFPMD8EmOBdPCRDbrJEQmHd_KwqCkzD_0 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7525813220057930719', time=2024-09-05T03:40:14.708137+0000, chain.objs.size()=1 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.X2_SckrevoaC2EGPGUWENxEb5xBKSOT_0 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.974228048273679967', time=2024-09-05T03:40:14.710100+0000, chain.objs.size()=1 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gORl4HO1lIdT7zXHac9VZmCxi4nWSlO_0 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6243483041253416878', time=2024-09-05T03:40:17.534300+0000, chain.objs.size()=1 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iQkTm8hk8nEHNWJj0Z75DVOj0sukh_h_0 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12457251801642001762', time=2024-09-05T03:40:20.014988+0000, chain.objs.size()=1 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GsrkWBoZhSMZg_GnNUWJ2ojex8NOBZG_0 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2205243628588083425', time=2024-09-05T03:40:20.361510+0000, chain.objs.size()=1 2024-09-05T02:16:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0kpx8So8VeAGI6hz1ux3hOsskg7Ry4J_0 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2040711818358697396', time=2024-09-05T03:40:22.768481+0000, chain.objs.size()=1 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6gvrT36iilYm-regay3o8jJV6kgQBT4_0 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15414002263698673781', time=2024-09-05T03:40:23.421636+0000, chain.objs.size()=1 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yGoNjI5AFID7jitfp7FoDC4OBzwzchc_0 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14813099065773097990', time=2024-09-05T03:40:23.672774+0000, chain.objs.size()=1 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QLe_1mvQZ9_nc_CjPaoIn7NiBuayzCA_0 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2665564375132682815', time=2024-09-05T03:40:24.128199+0000, chain.objs.size()=1 2024-09-05T02:16:21.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2lSwtj3ARm5w4lzROksb0qEl91Jxp60_0 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17374708089380766719', time=2024-09-05T03:40:24.563710+0000, chain.objs.size()=1 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yWLYQNAlAlhm-c2eM08r9057JZT14Jq_0 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15636260505323587438', time=2024-09-05T03:40:25.004417+0000, chain.objs.size()=1 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Y2qfyYsCIfRbDZaKJ2V6laXY1Y7E0Jc_0 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16689250271626300109', time=2024-09-05T03:40:26.177802+0000, chain.objs.size()=1 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i2aVlNhOWGZHF8GnAsP7WDudQ9uy4UQ_0 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9188485028698591981', time=2024-09-05T03:40:26.943120+0000, chain.objs.size()=1 2024-09-05T02:16:21.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bqhCBeHi-DgciQWL2KtNgojOvLHvmdg_0 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1701168722108681954', time=2024-09-05T03:40:27.300865+0000, chain.objs.size()=1 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tnnkZ9omy0_WGXUGuaRTMFSu6O-F_nu_0 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5165926960697101791', time=2024-09-05T03:40:27.625734+0000, chain.objs.size()=1 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KgdEWne9ZVjZ_fKfyKryQD1FfuhFK28_0 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6305666779491950689', time=2024-09-05T03:40:27.695914+0000, chain.objs.size()=1 2024-09-05T02:16:21.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ph-6a3yTouuw3oRtFOwLxapWVv9Z08g_0 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9608492673396974584', time=2024-09-05T03:40:28.262336+0000, chain.objs.size()=1 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Rono06nXbwlIM5_O-g4EJgsCHjNKMk8_0 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12721053634955296154', time=2024-09-05T03:40:30.917872+0000, chain.objs.size()=1 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6E_c37esoT33nQ_IrASKTk1yyg0GEEB_0 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14812194676022272964', time=2024-09-05T03:40:33.868243+0000, chain.objs.size()=1 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Y_CTH-efLcPAWlSgOQTPmA80hsPSDWJ_0 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15184986055045294727', time=2024-09-05T03:40:35.361386+0000, chain.objs.size()=1 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yVcI_L4NS9aRzlIcDY6GqGSLL8jlKZM_0 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1965172987404677938', time=2024-09-05T03:40:59.321106+0000, chain.objs.size()=1 2024-09-05T02:16:21.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.275__shadow_.3ACroCSL3mscZUiAZkwwEmMT2K0Exs2_0 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16378508296098458389', time=2024-09-05T03:41:25.855672+0000, chain.objs.size()=1 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.289__shadow_.wLiWFBiCBQW826Z4MZGEbeYZGxP9dqq_0 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7753929005393804632', time=2024-09-05T03:41:34.698798+0000, chain.objs.size()=1 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.D6UxlWj2_16OgUqA285BYPx7rnPQ-m0_0 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15680986357673428371', time=2024-09-05T03:41:45.910861+0000, chain.objs.size()=1 2024-09-05T02:16:21.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.296__shadow_.tFnQCuYZ226HW3qwiMdHRqSb_Bd-5Bg_0 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3091283376743654992', time=2024-09-05T03:41:57.391753+0000, chain.objs.size()=1 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.302__shadow_.sQyv9-Cahg-dTf5Li9y5EOQQlySMvV__0 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.149697733951852058', time=2024-09-05T03:42:05.207247+0000, chain.objs.size()=1 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.306__shadow_.UHZHfZ2x1euG5qdNxkC4R4JEayjEZBZ_0 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4317698929482446340', time=2024-09-05T03:42:16.496597+0000, chain.objs.size()=1 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.313__shadow_.hdc4Sz1dJx1g9CQSdi_fXQZONukwFBV_0 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7247372468865769637', time=2024-09-05T03:44:19.370413+0000, chain.objs.size()=1 2024-09-05T02:16:21.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hm5su8u1EjnzKIQPgUgX8OghAk-Msxv_0 2024-09-05T02:16:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16678579524412242986', time=2024-09-05T03:44:19.731811+0000, chain.objs.size()=1 2024-09-05T02:16:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hv0VQila_sRRFUJBriACm5FjTLLb-oN_0 2024-09-05T02:16:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6173245667358055138', time=2024-09-05T03:44:20.200538+0000, chain.objs.size()=1 2024-09-05T02:16:21.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5j_IEag4yf4jqnDrw9oKrL0FlakdmBl_0 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3605423063791772411', time=2024-09-05T03:44:20.332277+0000, chain.objs.size()=1 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uO9kb3itahPlDhZc3msJeFtBKAc5TAm_0 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10195538373023552219', time=2024-09-05T03:44:20.765903+0000, chain.objs.size()=1 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.F_KRBC4gV4r5uXJTkixmzI7ICWsF4oY_0 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17119401892415087587', time=2024-09-05T03:44:24.213188+0000, chain.objs.size()=1 2024-09-05T02:16:21.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.15qFlygPg63m5ySWAGq-Bt1c9Aq_VBE_0 2024-09-05T02:16:21.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.509915847864376390', time=2024-09-05T03:44:25.806637+0000, chain.objs.size()=1 2024-09-05T02:16:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TKsdCjuF_KG_CtJ4RGmcpkpPS69D0pM_0 2024-09-05T02:16:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14895410550511164106', time=2024-09-05T03:44:27.665074+0000, chain.objs.size()=1 2024-09-05T02:16:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IaXAsJWQMhq4AaWTtm7lEn05_j-V0-A_0 2024-09-05T02:16:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6222772211873353760', time=2024-09-05T03:44:27.667106+0000, chain.objs.size()=1 2024-09-05T02:16:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wDntq6XmZsykN8zUbN61SHHqH8Z-0rG_0 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6574679634324792451', time=2024-09-05T03:44:27.691737+0000, chain.objs.size()=1 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wPERYrovs5PEl9L5mJMfWGa7wYdY3v7_0 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5856122810848808456', time=2024-09-05T03:44:28.059618+0000, chain.objs.size()=1 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gBJrcSfDsrq6SZBXNJkHgAEtDn4CjIt_0 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12357037516166374328', time=2024-09-05T03:44:28.759010+0000, chain.objs.size()=1 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mcZYw2KV-Nt0la-epAZjqS9OIRKKSQ4_0 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3699334362422442905', time=2024-09-05T03:44:30.026147+0000, chain.objs.size()=1 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mleZF4LwC0cmJBArQakpxaP-U_8V3bF_0 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18404490174771571884', time=2024-09-05T03:44:30.741181+0000, chain.objs.size()=1 2024-09-05T02:16:21.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RXSPGEefYIdJnOE2XMMEDWxvcK4CPZL_0 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1628660278436602887', time=2024-09-05T03:44:31.707038+0000, chain.objs.size()=1 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Uju8Q7wJ0TF57SwL08DG-QPMQJbAKa3_0 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12099044370928751248', time=2024-09-05T03:44:33.928808+0000, chain.objs.size()=1 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HmRzpx6VdGaMwDn1u2YWbPxg9StiGio_0 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8818022680489497209', time=2024-09-05T03:44:34.368774+0000, chain.objs.size()=1 2024-09-05T02:16:21.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6GEUol45GA9HCjIGHD2SVSbhRTY5ACm_0 2024-09-05T02:16:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12984791406182560297', time=2024-09-05T03:44:35.793161+0000, chain.objs.size()=1 2024-09-05T02:16:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6hkBI1Cz-uK2eC4-XuOiZeTM8L_u8vz_0 2024-09-05T02:16:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16411040774020453944', time=2024-09-05T03:44:38.148855+0000, chain.objs.size()=1 2024-09-05T02:16:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SX0hs2_eKUxbN9VSirx1d2_aXF_9w5p_0 2024-09-05T02:16:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3670605797150607853', time=2024-09-05T03:44:39.904372+0000, chain.objs.size()=1 2024-09-05T02:16:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.m5QTuv7402g5fuEtPVDlAGacpefqE7m_0 2024-09-05T02:16:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10181805215000799569', time=2024-09-05T03:44:43.872214+0000, chain.objs.size()=1 2024-09-05T02:16:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cg6qMe0fb5qxQf90BEMQpnlmUH447P6_0 2024-09-05T02:16:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3280791143380588158', time=2024-09-05T03:44:46.223669+0000, chain.objs.size()=1 2024-09-05T02:16:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gN4E6UJUNc-AM3bFv8EgpcHtBbNQV3w_0 2024-09-05T02:16:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11145524729654640221', time=2024-09-05T03:44:49.555536+0000, chain.objs.size()=1 2024-09-05T02:16:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wRyApagb-Bf1hO1l8Xhfwqn7YvUXIMW_0 2024-09-05T02:16:21.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6420431488647777589', time=2024-09-05T03:44:49.795553+0000, chain.objs.size()=1 2024-09-05T02:16:21.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OWNryDMBJLG5b6eGnoRT41AqjD3NHZh_0 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13951028461387609540', time=2024-09-05T03:44:49.993218+0000, chain.objs.size()=1 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8S3AwUWLJxcc8amPsIqEqJ7pQlbQpVV_0 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10000782854019340377', time=2024-09-05T03:46:33.381238+0000, chain.objs.size()=1 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-qZWgiljGFc-7ckPysEwyxyeCJ6_MkU_0 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1563194699940586462', time=2024-09-05T03:46:33.590051+0000, chain.objs.size()=1 2024-09-05T02:16:21.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oCaxzLzSyFVvh-ghewIL39IArrdnjbO_0 2024-09-05T02:16:21.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13070507037771408736', time=2024-09-05T03:46:33.764613+0000, chain.objs.size()=1 2024-09-05T02:16:21.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.m0twLhCzV-7q5Rh1LVogwy0gdbWIHNb_0 2024-09-05T02:16:21.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11945264339548015391', time=2024-09-05T03:46:33.880283+0000, chain.objs.size()=1 2024-09-05T02:16:21.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ryaW1uq7RN2JRVmPuJs4AZvG3SGVrED_0 2024-09-05T02:16:21.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8776400541824564352', time=2024-09-05T03:46:35.524248+0000, chain.objs.size()=1 2024-09-05T02:16:21.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BFg0s6VI8yPP5mn0EXWCk7FpQXNOI7u_0 2024-09-05T02:16:21.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4205763769071160753', time=2024-09-05T03:46:35.529719+0000, chain.objs.size()=1 2024-09-05T02:16:21.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.B4LyHnUp8viAlqOgiBABzBBVczrP8h5_0 2024-09-05T02:16:21.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2290136423903326772', time=2024-09-05T03:46:35.639913+0000, chain.objs.size()=1 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.H2Ao1ng-h4Um7-3pmsY9X3h0EVyEgD7_0 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5864077854759855961', time=2024-09-05T03:46:40.268285+0000, chain.objs.size()=1 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.VkVrQimHjgqkOorFh81wWUIHHvk0vTo_0 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8805763800855333972', time=2024-09-05T03:46:41.928696+0000, chain.objs.size()=1 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mvNrJDU7UBB8WK-hNokDFLtcBuqCnFt_0 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10187887548321711212', time=2024-09-05T03:46:42.043612+0000, chain.objs.size()=1 2024-09-05T02:16:21.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DQpSrKMZOtKLZ8Hn_sQFt_uuTr5ohun_0 2024-09-05T02:16:21.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12872986491673749160', time=2024-09-05T03:46:42.499384+0000, chain.objs.size()=1 2024-09-05T02:16:21.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ObmVTbz5uqnGmbn93RPVMLJri32dNFX_0 2024-09-05T02:16:21.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11091477926468039368', time=2024-09-05T03:46:42.860577+0000, chain.objs.size()=1 2024-09-05T02:16:21.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jyygE9wMP_dTrYo5OZ21SMIzxjKL-PG_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16313465768749215217', time=2024-09-05T03:46:43.511514+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8LbJ4QnBMPvmdYTBDTJUzyeYHfZCtWK_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13310162498397218021', time=2024-09-05T03:46:47.095410+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._zytABMJTeg42o4nD_7Bav6Uyv-jvX9_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4200856350428173064', time=2024-09-05T03:46:47.453876+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZcglFCmAbii_ELk_YIwhMsTDib6dueG_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18089042048638198541', time=2024-09-05T03:46:47.455392+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DWnxYqkK-kSqSP-XfZJuDSWR4lHFxHx_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4301296037551364184', time=2024-09-05T03:46:47.826477+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fCG4EWukaueIpbr6v0SVg_Vykb3k8Ma_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14406450748661111157', time=2024-09-05T03:46:56.022758+0000, chain.objs.size()=1 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ko-1FhuyYN4st5Yq8ZlSbBMLKNOve06_0 2024-09-05T02:16:21.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.755218248979203868', time=2024-09-05T03:46:56.024823+0000, chain.objs.size()=1 2024-09-05T02:16:21.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.q5IIbnzUMg60mc5cRm3PFlP7AVqDeAD_0 2024-09-05T02:16:21.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5009668241343369826', time=2024-09-05T03:46:56.026782+0000, chain.objs.size()=1 2024-09-05T02:16:21.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._-mf3AO9Qfrjs6798fNdCwHdnRGjw7-_0 2024-09-05T02:16:21.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11215138329830887704', time=2024-09-05T03:46:57.273814+0000, chain.objs.size()=1 2024-09-05T02:16:21.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MgkzBS5poaBZbAoi5Mcwg3-YOnNoCd5_0 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.498343779677624772', time=2024-09-05T03:46:57.968458+0000, chain.objs.size()=1 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ebQvrWPMTI8mTD8Q2ZDmsUdINA_ipba_0 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8468311665666526394', time=2024-09-05T03:46:58.041023+0000, chain.objs.size()=1 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.omqmddew84P813PhexfgXY6mjQA1yHX_0 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16534780057222441423', time=2024-09-05T03:46:58.081439+0000, chain.objs.size()=1 2024-09-05T02:16:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6rRDp20RU4MZKCG1XgvTEDx9T3OkQiZ_0 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3971013012647783371', time=2024-09-05T03:46:59.269092+0000, chain.objs.size()=1 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8Ua4WNxVwTfqU68TTaybsuVDCKBhcuk_0 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12264777190114065634', time=2024-09-05T03:46:59.452335+0000, chain.objs.size()=1 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BeNnS1Zr39voMKg8h36x4c4N1Njtvak_0 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13516264849298169482', time=2024-09-05T03:46:59.455008+0000, chain.objs.size()=1 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Vohy8g3bUpDStNF1Q7zAVtbAO1bN6t-_0 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.674971613844320783', time=2024-09-05T03:46:59.852536+0000, chain.objs.size()=1 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.slSK2IvFZpNXW52Q3z3T4PupHmc-4wZ_0 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9251040275925526593', time=2024-09-05T03:47:01.000197+0000, chain.objs.size()=1 2024-09-05T02:16:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.v24OXUhd5GC3AwuSOgkjjVc-QalDLN7_0 2024-09-05T02:16:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13072660802483364585', time=2024-09-05T03:47:02.623021+0000, chain.objs.size()=1 2024-09-05T02:16:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rKNT-qDqYA8xf8wuHAVOCTpw6m7-SPk_0 2024-09-05T02:16:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49685 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4488726475459965130', time=2024-09-05T03:47:02.839454+0000, chain.objs.size()=1 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ezQEZ2gtyZhjBplo8YcdxIYLGf6_3a-_0 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10261766344245440404', time=2024-09-05T03:47:03.085226+0000, chain.objs.size()=1 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.g9ZavNTMZH69pTKBzEPPnYNDvY2jnHZ_0 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15576958551630630518', time=2024-09-05T03:47:03.287079+0000, chain.objs.size()=1 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gJGTdU36Z6pqOhmHNejcGHiKl1ypDnW_0 2024-09-05T02:16:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14396628562628585613', time=2024-09-05T03:47:28.337200+0000, chain.objs.size()=1 2024-09-05T02:16:21.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.340__shadow_.1BI3r0HFOcwx-j4hJFItk8WkG6-su7X_0 2024-09-05T02:16:21.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9052842223499901440', time=2024-09-05T03:50:09.851672+0000, chain.objs.size()=1 2024-09-05T02:16:21.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.447__shadow_.ALn4Rt9DAYiQ94heM8fekLFCt-J5hbY_0 2024-09-05T02:16:21.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16329933029858875595', time=2024-09-05T03:50:27.696492+0000, chain.objs.size()=1 2024-09-05T02:16:21.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.457__shadow_.2zot9RE5NUrQ5ei7rZLOa6gdiE3AKQB_0 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5347028712622824746', time=2024-09-05T03:50:41.055357+0000, chain.objs.size()=1 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.463__shadow_.5K9bE9dIEwmx6DmREKPtsrGBuf2z3Qt_0 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5825908946216059195', time=2024-09-05T03:51:09.620937+0000, chain.objs.size()=1 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.v6UEn5EMegnoRqF_tNcRhf71jDKVGQR_0 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5325165152244533970', time=2024-09-05T03:51:09.669638+0000, chain.objs.size()=1 2024-09-05T02:16:21.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.8zvG4H3q9SUr0urjL54N8EI7qkD7NMf_0 2024-09-05T02:16:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15575208452578841885', time=2024-09-05T03:51:18.542682+0000, chain.objs.size()=3 2024-09-05T02:16:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_0 2024-09-05T02:16:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_1 2024-09-05T02:16:21.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_2 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14475389973565070344', time=2024-09-05T03:52:04.742798+0000, chain.objs.size()=6 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:21.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG', time=2024-09-05T03:55:02.046571+0000, chain.objs.size()=10 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.152+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.1 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.2 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.3 2024-09-05T02:16:21.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.4 2024-09-05T02:16:21.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.5 2024-09-05T02:16:21.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.6 2024-09-05T02:16:21.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.7 2024-09-05T02:16:21.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.8 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.9 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.526__multipart_mymultipart.2~lfor64bgHD5zFo8lGtqb1C4o1jMzoyG.10 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12067789533368848902', time=2024-09-05T03:56:32.067760+0000, chain.objs.size()=1 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.552__shadow_.QFMGEzSUZgRCqypBxYJvH265lVpcvpp_0 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8585964168074197679', time=2024-09-05T03:57:17.460104+0000, chain.objs.size()=1 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.565__shadow_.XSR8I6WSxlDqzprEpHXpEWmPT3uRW9T_0 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3590864148894781783', time=2024-09-05T03:57:58.678256+0000, chain.objs.size()=1 2024-09-05T02:16:21.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow_.uSHcJ0YXUkyxIqPIjTf6XA9soJlYsDn_0 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17752641638911312219', time=2024-09-05T04:01:38.864947+0000, chain.objs.size()=6 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.1 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.2 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.3 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.4 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.5 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.614__multipart_multipart_enc.2~vT6nXxUhHvKxz0j-0xz0FMUOf7JTIKD.6 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14343712740555624434', time=2024-09-05T04:06:40.830614+0000, chain.objs.size()=1 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.679__shadow_.ar5E0sW0n76fw-FPhKnBo7X-Ga_7OC2_0 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14238929306413381771', time=2024-09-05T04:07:18.182496+0000, chain.objs.size()=1 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.703__shadow:qUHpI0jVXFczPOBA71jsdIMNKaWL0eb_.8VbufFP52beOkxs8rDdxsZgdsEJAGXI_0 2024-09-05T02:16:21.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QJKTwjrp7-Cq0aC0WuPJNuq8dQKjKCr', time=2024-09-05T04:08:50.829430+0000, chain.objs.size()=1 2024-09-05T02:16:21.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.742__multipart_mymultipart.2~QJKTwjrp7-Cq0aC0WuPJNuq8dQKjKCr.1 2024-09-05T02:16:21.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2589737654562935083', time=2024-09-05T04:09:25.072527+0000, chain.objs.size()=1 2024-09-05T02:16:21.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.745__shadow_.y8ExlV3S2eCQzvO8zFeK1nitUwsQjby_0 2024-09-05T02:16:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.172+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-05T02:16:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.172+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49106' 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6767243530331562507', time=2024-09-05T03:37:38.931348+0000, chain.objs.size()=1 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.238__shadow_.9c6_skahVIeRRvyVAS0LQnK2gPwBIi3_0 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17536436539633635770', time=2024-09-05T03:37:48.411827+0000, chain.objs.size()=1 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.243__shadow_.rZeolRfslDms7cPu2I-2awYSBbI35-N_0 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6820268838420135791', time=2024-09-05T03:37:54.862446+0000, chain.objs.size()=1 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.246__shadow_.KSRqb4LUMHIHorqqZE-HZMs7WEtXi_p_0 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14258796659892986014', time=2024-09-05T03:37:58.613074+0000, chain.objs.size()=1 2024-09-05T02:16:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.248__shadow_.SbFWQCirDFI5CjuE279GUKDyGK2wU1L_0 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5018348236309891036', time=2024-09-05T03:38:20.783873+0000, chain.objs.size()=1 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.260__shadow_.RXKsgeVQQk11-Gl3O3YONGF4aupawXO_0 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8137067002945027675', time=2024-09-05T03:40:04.401425+0000, chain.objs.size()=1 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UJtDFEVS6Simv75K4P-l-e4yVlzlvCj_0 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2682390389078036367', time=2024-09-05T03:40:06.387257+0000, chain.objs.size()=1 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-FoyGgryhqWYJMbMjdMxZT_4-u1hZbC_0 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1736657107701890148', time=2024-09-05T03:40:06.499698+0000, chain.objs.size()=1 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iwVLLk0r0PytD9tV2qsS6DE0ChsDM88_0 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1686739097476480997', time=2024-09-05T03:40:07.562140+0000, chain.objs.size()=1 2024-09-05T02:16:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MbXeyYxW_hpLndiwx78aXRREMmTLrSe_0 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1593258014054078158', time=2024-09-05T03:40:09.251816+0000, chain.objs.size()=1 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Q0xiA2qkwWPe8Baymc3waABODeVb3cZ_0 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3846665746297478932', time=2024-09-05T03:40:09.339928+0000, chain.objs.size()=1 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CVac7SenxeZ78LiTtpbBNuSV-TpWUYy_0 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4061372085681418574', time=2024-09-05T03:40:09.431090+0000, chain.objs.size()=1 2024-09-05T02:16:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xKsuzU8nozXQ_EDDdkQEoW6Z78sF4LU_0 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6626076731192288476', time=2024-09-05T03:40:10.313637+0000, chain.objs.size()=1 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0AR9fp-RxuVyxk1HDHKaGrdFCoBHbP4_0 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3748802926573027786', time=2024-09-05T03:40:11.692215+0000, chain.objs.size()=1 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.U_t4JLc9_P-4zBeGhVt1u0s8QWjMmcR_0 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16581248123002407573', time=2024-09-05T03:40:11.983649+0000, chain.objs.size()=1 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ubocLDYiQhWIdLAK655Uok9jtZe3_Se_0 2024-09-05T02:16:21.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8215249971749443720', time=2024-09-05T03:40:12.117436+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.irXm1MUM1bi_uyuvYmn6GjjZCiC4e0Z_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8445696237462067205', time=2024-09-05T03:40:14.423100+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1aOzt5FdYsb7uUr7PsGfxetDFJKrXjF_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7685017725913240334', time=2024-09-05T03:40:14.559960+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RjFnjvO5f-mvhghazjLoRXgcjQTlZFR_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2660334447019147233', time=2024-09-05T03:40:18.597508+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5JQ--FAv4MrACU9kyekSsZyrbX5w0Qh_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16235748629300579379', time=2024-09-05T03:40:19.519105+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.k4sRdOPftT_zduRz30ucX3FF1dpg_2T_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15789146927405755523', time=2024-09-05T03:40:20.376033+0000, chain.objs.size()=1 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EFJWGHBeCwb5trIrEFO9KSXAE7Akrgy_0 2024-09-05T02:16:21.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11715941946722548956', time=2024-09-05T03:40:21.869051+0000, chain.objs.size()=1 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.69rf2h9NVRJwCGlMqDqWwZ6TFCHX5E8_0 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11967941680190534570', time=2024-09-05T03:40:24.477380+0000, chain.objs.size()=1 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HcBt4Rai6CkToN6Z-PHzTMp7PY6k-zW_0 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7889582485817263842', time=2024-09-05T03:40:30.432850+0000, chain.objs.size()=1 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XuuKw-d4LFPFcEjC_EV8P8uiYyGiIbG_0 2024-09-05T02:16:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1131632248664127068', time=2024-09-05T03:40:31.988203+0000, chain.objs.size()=1 2024-09-05T02:16:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nAzzB69YsnbhyML_bUShzwlqA46385D_0 2024-09-05T02:16:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15568827421272422019', time=2024-09-05T03:40:35.378964+0000, chain.objs.size()=1 2024-09-05T02:16:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YKORmryjR1TJYN38fRokKPIauqCVlv6_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17104836208596669103', time=2024-09-05T03:40:36.558826+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Lxk2jbi-NiOod3mbDwnxGP_TpTxPD3-_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12518534714980462527', time=2024-09-05T03:40:48.880227+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.269__shadow_.cdx_aKgwFhUUO9qcrKCsl_zFmSCTPmt_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10932000307947584960', time=2024-09-05T03:41:01.278575+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.276__shadow_.Wzgvb-0-5RB7zpODbQbxRTCQaN_UoxE_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8007949309153149676', time=2024-09-05T03:41:06.817213+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.279__shadow_.fkdcQ5AOBB2JoHU3bXQfCggw1R1ucm8_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14679195226983830924', time=2024-09-05T03:41:35.047246+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.DrkzrOU5jR4k5qusEHV7Mq0BQ0mZ6hG_0 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4599446494214857973', time=2024-09-05T03:41:35.083249+0000, chain.objs.size()=1 2024-09-05T02:16:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.sLcyheYTXpH6Y_MchIUuCM43T5voQAB_0 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2746369321730354552', time=2024-09-05T03:41:55.523462+0000, chain.objs.size()=1 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.301__shadow_.enNY2mXwNlZS2Z3ixCOuQYgXshVsLPl_0 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16837046355271894871', time=2024-09-05T03:42:35.442208+0000, chain.objs.size()=1 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.322__shadow_.JmcvHMWHZmn29qt2moJVocFXzjk0eBd_0 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17390550704886112116', time=2024-09-05T03:44:19.488161+0000, chain.objs.size()=1 2024-09-05T02:16:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Y9BVK3DNPgE0J3WKsQQGuZdf7vYCsO4_0 2024-09-05T02:16:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5386872871237621283', time=2024-09-05T03:44:19.687563+0000, chain.objs.size()=1 2024-09-05T02:16:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9O2ZFR7WMONFp--lixpWD2Gnp9X_Z_D_0 2024-09-05T02:16:21.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7897036706852632699', time=2024-09-05T03:44:22.333986+0000, chain.objs.size()=1 2024-09-05T02:16:21.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.v-DLDrz8T6XQ95Kh6ZNpSuB589WsRIM_0 2024-09-05T02:16:21.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7556608471045852923', time=2024-09-05T03:44:24.844428+0000, chain.objs.size()=1 2024-09-05T02:16:21.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TfeZ6hqsOAjuG2mRahF3Cx_HZHx-49V_0 2024-09-05T02:16:21.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11544219394435873093', time=2024-09-05T03:44:26.159051+0000, chain.objs.size()=1 2024-09-05T02:16:21.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iFvR80ff8U5Ae4vvYnr6lRFgj--Hh5T_0 2024-09-05T02:16:21.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15829708260976868646', time=2024-09-05T03:44:28.057972+0000, chain.objs.size()=1 2024-09-05T02:16:21.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VQaqyZ6dtcXoa5jQjwewlba8JV0FMTp_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6181948105851793845', time=2024-09-05T03:44:28.238441+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bSXM1unYgm_Jo7w2sCmQGXcuyw3PYL9_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1075857076982821489', time=2024-09-05T03:44:29.276602+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0_exAUFkYzMtEGAPuJthvMkq9uePnVR_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16765480026491098681', time=2024-09-05T03:44:30.339038+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7ZQ43CWVw1ULP0OUhR3cq7dTQcl2au2_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11437282775406796891', time=2024-09-05T03:44:30.679704+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TRqk-kcjgL8U503FLlqQlsqLqVr8d6g_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3040686840127581896', time=2024-09-05T03:44:32.376923+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dg140B-zBYZzoLwJoqo75OzXVyQoQHs_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10418028542549906229', time=2024-09-05T03:44:32.927015+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.y6_GVvhlsBobQ63yoaMcfRujJOAe5xV_0 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15001843522701465965', time=2024-09-05T03:44:33.650853+0000, chain.objs.size()=1 2024-09-05T02:16:21.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.i5EdVeSYM9IdesrB2rw2h2FoZOgT5N4_0 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7480520842056051603', time=2024-09-05T03:44:33.653493+0000, chain.objs.size()=1 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Xa7GS98nnDgYHYuD79mHRYx2TQ2MWki_0 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9575770455219954667', time=2024-09-05T03:44:33.809947+0000, chain.objs.size()=1 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OVsu-32R4-zlMYpuqAHjhaIZSbVzalY_0 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17272430889199847601', time=2024-09-05T03:44:34.072722+0000, chain.objs.size()=1 2024-09-05T02:16:21.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VvN_hTvLSiesTaqyvsYaYyqi42BVy5G_0 2024-09-05T02:16:21.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16281924338663841403', time=2024-09-05T03:44:34.449237+0000, chain.objs.size()=1 2024-09-05T02:16:21.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Vf2x2buJRvBDwdJ82NubcT-z7coqjko_0 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.89795618307261616', time=2024-09-05T03:44:34.913882+0000, chain.objs.size()=1 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0AM14y4uQO0okjuC0D3fX62Jcu2d8UH_0 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8519033977089147600', time=2024-09-05T03:44:36.308490+0000, chain.objs.size()=1 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PVdHThHzF0hik3peOO3fAeeCo-7mWvN_0 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12558893219281273447', time=2024-09-05T03:44:36.340169+0000, chain.objs.size()=1 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AMzR1MjgzjrrzyP9PqWFtqHOTkiCgT__0 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6721211136558548697', time=2024-09-05T03:44:38.141942+0000, chain.objs.size()=1 2024-09-05T02:16:21.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YCuH7lXFeQOlvDrDKKFnPX-pW0qbJOl_0 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14471799191744901891', time=2024-09-05T03:44:38.474702+0000, chain.objs.size()=1 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nscKaf65aFdIhrwf85NHCQLFRY8PAPN_0 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5091784258442686623', time=2024-09-05T03:44:40.690855+0000, chain.objs.size()=1 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QAEyL0PNu0FqIXvoEGAE3GiCHV3HXyX_0 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7597371631004556698', time=2024-09-05T03:44:40.737604+0000, chain.objs.size()=1 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LpRvdYY7RlqQVcPa23NbzVD6pf_AQKE_0 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2335224089277006404', time=2024-09-05T03:44:44.776675+0000, chain.objs.size()=1 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Pe_nqFEX5rcNMrLdMazTjfwU4qQqtbI_0 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.204+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3310200687488621287', time=2024-09-05T03:44:44.912256+0000, chain.objs.size()=1 2024-09-05T02:16:21.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.204+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EyEapcaXeEpG1CPxstpQfepWSDOZs0i_0 2024-09-05T02:16:21.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.204+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16309087324565344553', time=2024-09-05T03:44:47.901605+0000, chain.objs.size()=1 2024-09-05T02:16:21.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.204+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d4BlY-fvve7zuG0nehf7HMqxrSAC6As_0 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6944451277668137509', time=2024-09-05T03:44:48.190203+0000, chain.objs.size()=1 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UED__JT833XpYoWfNIQMUL9ulcxEdeT_0 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7502500240756294458', time=2024-09-05T03:44:48.193487+0000, chain.objs.size()=1 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7ntsbnDsWVodsg-aqpHQ8TZ4reM7NwL_0 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625517534584308193', time=2024-09-05T03:44:48.197409+0000, chain.objs.size()=1 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Dv_DCY_kQ9PU6MR1Mi6oMnQVc9MJCve_0 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8432019732648765148', time=2024-09-05T03:44:48.678735+0000, chain.objs.size()=1 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RqiOlRHT4SysMgPb78NIv9Zf_dSLo7b_0 2024-09-05T02:16:21.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8295438171249500222', time=2024-09-05T03:44:48.819552+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FHAB_j2qmS2U9oHbwM5SdNguxbpNaME_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8091380298762434634', time=2024-09-05T03:44:49.319098+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4l7pjpgbMunGoaSqPUViyRnOFMX4rrr_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7387300505991168377', time=2024-09-05T03:44:50.269912+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RXLfcEnFxjvgu2dLxbRfWlaKXP5Rl1s_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16137452742487225382', time=2024-09-05T03:46:33.761554+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wcYo6lAs6zwDVz0NnplwHxbPajgCxnv_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1648106388964815303', time=2024-09-05T03:46:33.877488+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Knu_SWSMK9YY-_j_z3RGh9DFXCusUIU_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10492209307102367175', time=2024-09-05T03:46:33.880531+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eY_bsMu11dY8dRJCEDSVWleQuelq32R_0 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1742993026466293843', time=2024-09-05T03:46:34.174807+0000, chain.objs.size()=1 2024-09-05T02:16:21.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.A1PUQOcSC8EwvBjhnwXK0zyM2UqyupR_0 2024-09-05T02:16:21.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9648425113607893498', time=2024-09-05T03:46:34.593593+0000, chain.objs.size()=1 2024-09-05T02:16:21.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ILJNWcRvf-TDwd-EPemkVoVFPMVCdMh_0 2024-09-05T02:16:21.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8283190933215275892', time=2024-09-05T03:46:34.795044+0000, chain.objs.size()=1 2024-09-05T02:16:21.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0KDXRkLf4ws94Is3cdcYchHcwQ3VEja_0 2024-09-05T02:16:21.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.699683202208567743', time=2024-09-05T03:46:37.690844+0000, chain.objs.size()=1 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RJmaN01-NQT4eDpb70dawqxj5t5BJDH_0 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13501880876230581593', time=2024-09-05T03:46:37.856273+0000, chain.objs.size()=1 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DfAId3s_GXp7g8NmKH-lPb2Kc4OC7E4_0 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17540615096622824841', time=2024-09-05T03:46:39.394400+0000, chain.objs.size()=1 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.KPuPr4f6pXfYslJso0imOGTc-rpXdH8_0 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9630034987035000637', time=2024-09-05T03:46:39.521674+0000, chain.objs.size()=1 2024-09-05T02:16:21.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W6cIwBySSZnZP5v38kjeCW9fS5y-m5B_0 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13475532907553550968', time=2024-09-05T03:46:39.907425+0000, chain.objs.size()=1 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0zVV9YFhJ4il5vkSfPcki_cS0qcMxtA_0 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1606438665307749809', time=2024-09-05T03:46:39.985257+0000, chain.objs.size()=1 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tNFedq1z-6nSmB0vel7c9L4-O8Y5a04_0 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1972747721870485055', time=2024-09-05T03:46:40.887717+0000, chain.objs.size()=1 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dY-_O4TFVz1KrtkXpAAtvf5gfDyRVyu_0 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12477632472154903401', time=2024-09-05T03:46:40.889539+0000, chain.objs.size()=1 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4T51xm0E5HD5P_30VxFHtkukS8oM145_0 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15994903266591201459', time=2024-09-05T03:46:41.991541+0000, chain.objs.size()=1 2024-09-05T02:16:21.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IM-twV9zHF-EStko_786qELl0zwAy1U_0 2024-09-05T02:16:21.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1058269711849315882', time=2024-09-05T03:46:44.259911+0000, chain.objs.size()=1 2024-09-05T02:16:21.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tbbj7FpFP2zgSXZJZQ4V1mmE-vx231O_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8787384066037133178', time=2024-09-05T03:46:44.418950+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nYmMVuqoLRsU-DRhJP8Spv3J_vUdULa_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11526618165039442918', time=2024-09-05T03:46:44.785974+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RXdxHfPyn-77uQPZ_R7z4v3DixAhTqR_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8628405599637004984', time=2024-09-05T03:46:44.872077+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1a48fIQbkvqsH6SndcCz0q4U6Cpvh53_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14233823963391143337', time=2024-09-05T03:46:46.481372+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9qJVv8u740zcuAtbsUCI7PoANcLxMpB_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18259634124473841185', time=2024-09-05T03:46:51.426647+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.A_Nqey3A9Zonvmtgef7Jpc0OIxHUPtb_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4634394648151574517', time=2024-09-05T03:46:51.643277+0000, chain.objs.size()=1 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yPX3BJ-fRU_Nk-DFdlU2Te2-5QM1e_K_0 2024-09-05T02:16:21.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5623916183179748257', time=2024-09-05T03:46:52.041371+0000, chain.objs.size()=1 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.U0xVMrHyoanT-6OF1DcmaP2OAd5qZZi_0 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3671594976661818678', time=2024-09-05T03:46:54.104671+0000, chain.objs.size()=1 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.O1DySSW9JtO1NcqqgmjPJiMyDOQ5Xv__0 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3522715186977573390', time=2024-09-05T03:46:54.203436+0000, chain.objs.size()=1 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JBREL1Jd6PM6_-NB0TEdLfjMyKOUkPW_0 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7880347647601168769', time=2024-09-05T03:46:54.206770+0000, chain.objs.size()=1 2024-09-05T02:16:21.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ERJzgAuN2T_irTrC8FQ0Uj1wUHA4YaC_0 2024-09-05T02:16:21.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3733626308940686726', time=2024-09-05T03:46:55.405839+0000, chain.objs.size()=1 2024-09-05T02:16:21.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XzViDfP3ksFxoqvMj_EYf0tdH-W7XOh_0 2024-09-05T02:16:21.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8593572180207007678', time=2024-09-05T03:46:55.547313+0000, chain.objs.size()=1 2024-09-05T02:16:21.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Iw6fc-v1mKf-ivihOUw7HXKs3IBBwSi_0 2024-09-05T02:16:21.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17980647936084090380', time=2024-09-05T03:46:56.500787+0000, chain.objs.size()=1 2024-09-05T02:16:21.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JsTfx6Vz9Su7r1jUj1dSA44WZcSaXsu_0 2024-09-05T02:16:21.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.448776630223744020', time=2024-09-05T03:46:57.144120+0000, chain.objs.size()=1 2024-09-05T02:16:21.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.u72VJkBLYKtg6gJ7xINTfybJF9fSkLt_0 2024-09-05T02:16:21.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.224+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5009672834846838793', time=2024-09-05T03:46:58.350126+0000, chain.objs.size()=1 2024-09-05T02:16:21.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.224+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5-7si6rI5dYT-lrhx83rdg3VLjiuh3e_0 2024-09-05T02:16:21.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.224+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7381855411217228107', time=2024-09-05T03:46:58.450615+0000, chain.objs.size()=1 2024-09-05T02:16:21.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.224+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W1bUvG29BPixA6MVXiAsdaOCiSI4e9b_0 2024-09-05T02:16:21.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.228+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49106 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14992801053280966532', time=2024-09-05T03:46:59.276152+0000, chain.objs.size()=1 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2_Tqr34uK1rYspnPOGj4Z7Xy4gxzpEe_0 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11154087653633949330', time=2024-09-05T03:47:00.076982+0000, chain.objs.size()=1 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ta8z4D74KtdADCLCpkGTqFpPgr4B4LO_0 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15491927910408809554', time=2024-09-05T03:47:01.084159+0000, chain.objs.size()=1 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wY9Ie5Lh6fSZbrTmsordXs53seM5HSM_0 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14878593175960132973', time=2024-09-05T03:47:02.351413+0000, chain.objs.size()=1 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.U1Rkw3lFRlD7oT6uoL66kP3wB_9v-oO_0 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14326840235372963885', time=2024-09-05T03:47:02.789532+0000, chain.objs.size()=1 2024-09-05T02:16:21.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-DSeB6KFGGFRsx6Zg3_1p1xnLrSXaiE_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1558101118778329109', time=2024-09-05T03:47:03.019760+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ObMPsy0aRtnB_V7bQhVgOJsT0bk1P-3_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3451971344427825259', time=2024-09-05T03:47:03.154602+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Bir6y3caNRmCbJ3YLyvDnLv7_zJSDGp_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11002523454023278734', time=2024-09-05T03:47:03.748221+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2NjQBX4Gw3t0Dhqx-qZ-pUFz7BYJWCB_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.227721300240143272', time=2024-09-05T03:47:03.823772+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GEQhsukTBulwb4Bc-TNUtraD9hFdhk8_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8943415073032814029', time=2024-09-05T03:47:04.056861+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gm93taC0c3aOW2rIVtd0Grfb_RNfaNF_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10044190866946108394', time=2024-09-05T03:47:04.518235+0000, chain.objs.size()=1 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.diutgNNwk-bPhe9xQymT-XD7TtQ4nd9_0 2024-09-05T02:16:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7611694234951682400', time=2024-09-05T03:48:29.395539+0000, chain.objs.size()=1 2024-09-05T02:16:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.383__shadow_.FN-d7ocL1NaPFDr_Of0NIObisuVvLTD_0 2024-09-05T02:16:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17375181935355737975', time=2024-09-05T03:49:07.632159+0000, chain.objs.size()=1 2024-09-05T02:16:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.408__shadow_.fj7h9v2cvvddFqewxL0UH8FFd6Gs_x-_0 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1160983975617464078', time=2024-09-05T03:50:23.288337+0000, chain.objs.size()=1 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.455__shadow_.woXOVpk-sulfRZ2vibRJJD9hFnTzHfj_0 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18147755844907054209', time=2024-09-05T03:50:43.437393+0000, chain.objs.size()=1 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464__shadow_.C4QbzvayFH0XH1pJso1mDdhfQKWqg9t_0 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3084898679653961855', time=2024-09-05T03:51:46.323472+0000, chain.objs.size()=1 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10602889818291409371', time=2024-09-05T03:54:33.461654+0000, chain.objs.size()=2 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~X67ZwLtsuuQe6vD-l1SO7TBG0gJz2UQ.1 2024-09-05T02:16:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~X67ZwLtsuuQe6vD-l1SO7TBG0gJz2UQ.2 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10644237830671017231', time=2024-09-05T03:54:57.125082+0000, chain.objs.size()=3 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~_mJ-mRoEidaGIn1CRN6Pd0Ojdc_LcWw.1 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~_mJ-mRoEidaGIn1CRN6Pd0Ojdc_LcWw.2 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~_mJ-mRoEidaGIn1CRN6Pd0Ojdc_LcWw.3 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SOD1cNDTa29bkj3-x8yTc6-aNbmVy91', time=2024-09-05T03:55:26.185884+0000, chain.objs.size()=1 2024-09-05T02:16:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.533__multipart_mymultipart.2~SOD1cNDTa29bkj3-x8yTc6-aNbmVy91.1 2024-09-05T02:16:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8995371948105941717', time=2024-09-05T03:57:36.415436+0000, chain.objs.size()=1 2024-09-05T02:16:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:8s7KcxUxluoFyj9rI0Hf6GBU2dTtqQB_.V5YYn8tvWWhbkSj1x7o7fhu7eysvnX4_0 2024-09-05T02:16:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14507154548275031741', time=2024-09-05T03:58:18.280957+0000, chain.objs.size()=1 2024-09-05T02:16:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:-XgufBh8qGvjGCmHCvZoI6.U-JA934S_.nxSuktDBa4wmErNTcPtk2YQ18g6e3ph_0 2024-09-05T02:16:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1077112492862726601', time=2024-09-05T03:59:39.767565+0000, chain.objs.size()=1 2024-09-05T02:16:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.585__shadow:mF7OZ00txOqK4dkIjqDHDvUl4xwo8Zm_.xVkR60SmtmM7B-UGelizRjkIvqif5eV_0 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8827756559155894940', time=2024-09-05T03:59:46.251810+0000, chain.objs.size()=1 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:9qyKFKHvTSEjaWWhRo245TMoD2pTDz1_.KaCUdZB3LWBT4r5xSFo5Cf9Aa4T-yin_0 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13424359728410805606', time=2024-09-05T04:05:16.305432+0000, chain.objs.size()=1 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.643__shadow_.5G347W7j1mpqGANXa0g8tHbJT93_6dl_0 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13309382957880229056', time=2024-09-05T04:05:40.500447+0000, chain.objs.size()=1 2024-09-05T02:16:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.653__shadow_.3XCzvsrdBxUwNVlFtbY4XqY7VPuizRP_0 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9302425383298010325', time=2024-09-05T04:06:11.566412+0000, chain.objs.size()=6 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.1 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.2 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.3 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.4 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.5 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.660__multipart_bar.2~k7diQIIvIux5Xk2_rLScmUG3ob2wp83.6 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9302862779747792812', time=2024-09-05T04:06:25.595770+0000, chain.objs.size()=1 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.668__shadow_.9Usfe7JWs6i9ta2BD9g3sx8tMXNhH1f_0 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11519643375627723570', time=2024-09-05T04:07:05.719600+0000, chain.objs.size()=1 2024-09-05T02:16:21.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.696__shadow:ZqC3Qjx.BwSh8XuD3w2HEGrcjkqFZsc_.VMS6hpwB63v1Vy479qzDBnTip5O5je4_0 2024-09-05T02:16:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10301130895141516674', time=2024-09-05T04:07:48.693855+0000, chain.objs.size()=1 2024-09-05T02:16:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.715__shadow:bsfJvPRpAQ6lvJQ0hPtDTsed15cfHoJ_.YM5sWJWTj_C62Xp7hhFJoux8QgxIsKY_0 2024-09-05T02:16:21.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.252+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.256+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-05T02:16:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.256+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.256+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/62201' 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16873953916539552145', time=2024-09-05T03:37:31.666616+0000, chain.objs.size()=1 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.235__shadow_.ZVzT-rJ_le_GJs8JukflwOOsNXNelD-_0 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3727183214871175160', time=2024-09-05T03:38:00.459462+0000, chain.objs.size()=1 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.249__shadow_.i58OQBZFhewpnNL1BjUMb1nTe4-SziZ_0 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.290253111794617488', time=2024-09-05T03:38:04.174258+0000, chain.objs.size()=1 2024-09-05T02:16:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.251__shadow_.7iJQ33v_7GT4_YyeGpagHq0IoiXRn4f_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12493681312128784000', time=2024-09-05T03:40:04.349635+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6xwcW21ShNQzME6gAw3PxfR0ATq_fxF_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13047839998688579404', time=2024-09-05T03:40:04.351667+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.enYI3FrAchXD5uOiSGwSicsqc2G634e_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5469301530042904438', time=2024-09-05T03:40:04.894998+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-9W8sZyIkiguf1bsAOWvK8F7mNVy3eA_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6616229967017078347', time=2024-09-05T03:40:05.489665+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.v8CXJaHSQNZlB29KqjSyNe7Xg0Vuoui_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5996404201993761528', time=2024-09-05T03:40:06.374076+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-zstwM8DzbgEHuc8Y537KbBbhX0kBZf_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7619050991678991852', time=2024-09-05T03:40:07.693168+0000, chain.objs.size()=1 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JQCARX7sspNK4EX2Y8qxqWHy5k64eBT_0 2024-09-05T02:16:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8483660948777790013', time=2024-09-05T03:40:09.906892+0000, chain.objs.size()=1 2024-09-05T02:16:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QDPs2HWVEXbCGLsNpJRDLZJPXDbOC-J_0 2024-09-05T02:16:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14035525521761841794', time=2024-09-05T03:40:14.894593+0000, chain.objs.size()=1 2024-09-05T02:16:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZyAIJd7_hNveUvnAvSHQOiVeyUNC3Qp_0 2024-09-05T02:16:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10778409720466844563', time=2024-09-05T03:40:15.539883+0000, chain.objs.size()=1 2024-09-05T02:16:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kDU30UVsoOgO2YtUyH13vEoVq_WJpR8_0 2024-09-05T02:16:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9420331441084167320', time=2024-09-05T03:40:15.768070+0000, chain.objs.size()=1 2024-09-05T02:16:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5urPZTvKrXCdPXhPkz5yaquLG3_l0KK_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8982977902645732595', time=2024-09-05T03:40:18.168402+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FtdabrJVYQMxpFykNozgqZeERrLyMxd_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12606654765386657328', time=2024-09-05T03:40:19.522702+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.K9mpWUuRO75noTLlzN8zpf8Hwv1dxTN_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17390468906593857346', time=2024-09-05T03:40:22.276152+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MEriaKn8-sKrGlk8CSNVozmhHQdKz72_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3787132264138165917', time=2024-09-05T03:40:23.399745+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FM5PE0qK33ViVdSSwztH30RdRECAFoH_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15875020928563027706', time=2024-09-05T03:40:26.217246+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Y6Gy3T36LC5kykVYsPkQGSH3irV_EZc_0 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6725793473025428993', time=2024-09-05T03:40:29.994037+0000, chain.objs.size()=1 2024-09-05T02:16:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZL8tGn-j1vHEZ6ghfiuOz8Czq7TC_Xr_0 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7302765183601365022', time=2024-09-05T03:40:31.039263+0000, chain.objs.size()=1 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OhDDp6iGXKLvrT2LzGxtpHCYBprYyiH_0 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2583957103038215783', time=2024-09-05T03:40:32.030838+0000, chain.objs.size()=1 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bG5hejA9kX7rQK2jJwDtWCnaduVaDSQ_0 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13003854823540012689', time=2024-09-05T03:40:32.132143+0000, chain.objs.size()=1 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bdtP_wJITOc6G-uvPSviRcLG9Lp4YnC_0 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14471732709425877917', time=2024-09-05T03:40:34.272080+0000, chain.objs.size()=1 2024-09-05T02:16:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CHjTe--woyS5YYPHPfFRPnKk0uyUXJJ_0 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12837995359810483534', time=2024-09-05T03:40:34.833478+0000, chain.objs.size()=1 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.g9PgCi7At-8fQMQXt_YiWvAlRBOnxR__0 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9322725982109021406', time=2024-09-05T03:40:45.401959+0000, chain.objs.size()=1 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.267__shadow_.twyJx_mQ8b8r5dUD_mGvCsOxaY8R2T9_0 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3867114374462232562', time=2024-09-05T03:41:04.968774+0000, chain.objs.size()=1 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.278__shadow_.KJk207Jxpf50XgEii8fruInSGzJincq_0 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12351153111519747948', time=2024-09-05T03:41:04.986545+0000, chain.objs.size()=1 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.278__shadow_.HoFOkqSIsQWOWKi3fQT_CPVSCPHLY_6_0 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4508508867379130528', time=2024-09-05T03:41:39.960084+0000, chain.objs.size()=1 2024-09-05T02:16:21.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.NIyMRcXEtRbZswe4EE9XewkZ58EsiCv_0 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14668312401215003721', time=2024-09-05T03:41:49.796049+0000, chain.objs.size()=1 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.298__shadow_.uNVTcI7RYY8qnGzuBr6Atn8Hf8u5ePb_0 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3379045098100080071', time=2024-09-05T03:41:57.417087+0000, chain.objs.size()=1 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.302__shadow_.AfjKq8IZO_YKCHHge8EGx6-MS6XI8qm_0 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17553449699653483266', time=2024-09-05T03:42:02.884113+0000, chain.objs.size()=1 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.305__shadow_.NV7EndqUxngFcAbAuX6N7pWkWbiWYMq_0 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10411518130783694472', time=2024-09-05T03:42:33.364220+0000, chain.objs.size()=1 2024-09-05T02:16:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.321__shadow_.EaGssovl2-yIMwrNIEwONMKv7q-mcID_0 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1965810344064174226', time=2024-09-05T03:44:19.252459+0000, chain.objs.size()=1 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-ST66f5AkjB8BwBNefRQgy5g2qa2x_i_0 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7915223991270220639', time=2024-09-05T03:44:20.230270+0000, chain.objs.size()=1 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uAN23DZM9JI_ErF2xnVLFfHxHq_8p4r_0 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5810398342870749410', time=2024-09-05T03:44:21.055602+0000, chain.objs.size()=1 2024-09-05T02:16:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dIAs4WiZY208NBlZplXWREWvlN7BB67_0 2024-09-05T02:16:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121631687602304289', time=2024-09-05T03:44:21.984491+0000, chain.objs.size()=1 2024-09-05T02:16:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rYNRllITJEQitX6RSpwjtGMLatdJSBp_0 2024-09-05T02:16:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11177353817425710191', time=2024-09-05T03:44:24.445039+0000, chain.objs.size()=1 2024-09-05T02:16:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7BYRudTFUX4sfD-gTtWknbCxpN88V2Q_0 2024-09-05T02:16:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15663699011238226388', time=2024-09-05T03:44:24.571055+0000, chain.objs.size()=1 2024-09-05T02:16:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.K73Ut0fJdObBc5CmHAG1LpgGcEeSeV2_0 2024-09-05T02:16:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10671149743704541533', time=2024-09-05T03:44:26.562400+0000, chain.objs.size()=1 2024-09-05T02:16:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sQgAQedxDODRQdGaBVIiKViXG2ZM-H__0 2024-09-05T02:16:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13839988508015211951', time=2024-09-05T03:44:28.052904+0000, chain.objs.size()=1 2024-09-05T02:16:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G7cxnUMCH03fs8Ga2onbRtpcq1mksrw_0 2024-09-05T02:16:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3209432207308556796', time=2024-09-05T03:44:30.731683+0000, chain.objs.size()=1 2024-09-05T02:16:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qfyzscL2BtYTgVLP_MP2FCBkphmkkWJ_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16961701820149711605', time=2024-09-05T03:44:31.844665+0000, chain.objs.size()=1 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.C9oPrxoPpaJJDEXoCJjeM-QrgG1BIya_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13117449497138961657', time=2024-09-05T03:44:32.979683+0000, chain.objs.size()=1 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fyWOU0vfsgZxstEI4bzlMT1Ca_WYp1z_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7882798738045860180', time=2024-09-05T03:44:33.565070+0000, chain.objs.size()=1 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h5I50OU0gWZdlfTbngeGmNZe_QK9iYZ_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3067163364624247266', time=2024-09-05T03:44:34.503957+0000, chain.objs.size()=1 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.y9yGNAyR1R0vWMOBfoU1yxGWqB_JPhD_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1103193630313454264', time=2024-09-05T03:44:36.677305+0000, chain.objs.size()=1 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cXaOd9t3tyfNOXU5hrQOUK0m-dswZeh_0 2024-09-05T02:16:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8189859837667028738', time=2024-09-05T03:44:36.901510+0000, chain.objs.size()=1 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MKVK50-9H9N3AW-i5RVaLNJY4VywR7O_0 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6385217179947417585', time=2024-09-05T03:44:37.975954+0000, chain.objs.size()=1 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oh-Y_VAY1Ds9MGCkiQas0FpwrjgT3DY_0 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16921616273893996056', time=2024-09-05T03:44:38.929900+0000, chain.objs.size()=1 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IYAbKOdp9kTneflnRMLJGBoMyScltrE_0 2024-09-05T02:16:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3348532928474388680', time=2024-09-05T03:44:39.797496+0000, chain.objs.size()=1 2024-09-05T02:16:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yPEgupILAJcu66KHO1ZZmawbssKhMOd_0 2024-09-05T02:16:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3005511680360480082', time=2024-09-05T03:44:40.276084+0000, chain.objs.size()=1 2024-09-05T02:16:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RC-q2cz1BEpBwZXDnBgwWVipFLSUHeP_0 2024-09-05T02:16:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14933727125481126864', time=2024-09-05T03:44:40.368385+0000, chain.objs.size()=1 2024-09-05T02:16:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ocJgBW-iTWSNkl2h0RfTyPBigNq1A5R_0 2024-09-05T02:16:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5114436589294930164', time=2024-09-05T03:44:40.856999+0000, chain.objs.size()=1 2024-09-05T02:16:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Wg3ata859U7S2vtVa93r9bCK40n_GHd_0 2024-09-05T02:16:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5819437191605485085', time=2024-09-05T03:44:42.463505+0000, chain.objs.size()=1 2024-09-05T02:16:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Wb8ZLPTj69AwIfmIwLjxAw_V3JZkqOd_0 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16292523060860222165', time=2024-09-05T03:44:42.465422+0000, chain.objs.size()=1 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.V1l7QB1EqGGC1XictbXXdIZD4bXZvKx_0 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6633696741410146192', time=2024-09-05T03:44:42.751448+0000, chain.objs.size()=1 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sl7fqhz6fe8gmLbY8mEQJ1Bm4r0QHx-_0 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15710729719989394891', time=2024-09-05T03:44:42.902022+0000, chain.objs.size()=1 2024-09-05T02:16:21.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G0SWMC0fFFygMQTA9jCH24etQGtvKTI_0 2024-09-05T02:16:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10094940488131990401', time=2024-09-05T03:44:44.426386+0000, chain.objs.size()=1 2024-09-05T02:16:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.D-BIfXUh0nwAOcHRHB7Fp5AejCQvLG5_0 2024-09-05T02:16:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16199620851217462259', time=2024-09-05T03:44:46.586041+0000, chain.objs.size()=1 2024-09-05T02:16:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-lAkq0TWXy9Ij4RcVLndmGkmDGjUT13_0 2024-09-05T02:16:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9912431324539299900', time=2024-09-05T03:44:46.768963+0000, chain.objs.size()=1 2024-09-05T02:16:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jLXq6oZTTw8Ji9tEp01LHZkLJGUpknh_0 2024-09-05T02:16:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9016189205460955062', time=2024-09-05T03:44:48.492263+0000, chain.objs.size()=1 2024-09-05T02:16:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bPFL4eequ5W3pYTl-gAEKnoS0Fop_qt_0 2024-09-05T02:16:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9571025628131281320', time=2024-09-05T03:44:49.056006+0000, chain.objs.size()=1 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jIkDMmTjnZLw-qFOS4Mv7Ytja1683_y_0 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1032734303656239550', time=2024-09-05T03:44:49.058198+0000, chain.objs.size()=1 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EKvVXVuLD-yKvAmzdEioXTAvA7_f9kE_0 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10202864946631994756', time=2024-09-05T03:44:49.428005+0000, chain.objs.size()=1 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lSz8SnTFu8jnEHMClEDV98PVPgLDnQC_0 2024-09-05T02:16:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4141686543175608305', time=2024-09-05T03:44:49.998550+0000, chain.objs.size()=1 2024-09-05T02:16:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UtIfN_6Bj1vdvL9Kg_ypH6DDLC1jFQ7_0 2024-09-05T02:16:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11511274654409396963', time=2024-09-05T03:46:33.674462+0000, chain.objs.size()=1 2024-09-05T02:16:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GuLRXFoC3cIWMQE-AiAseAD-lAjCZoH_0 2024-09-05T02:16:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12322886413465340512', time=2024-09-05T03:46:35.176826+0000, chain.objs.size()=1 2024-09-05T02:16:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.z7972nKWn-aBrToWZdUA4PGeeGKZCjE_0 2024-09-05T02:16:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9130298029323393996', time=2024-09-05T03:46:35.871150+0000, chain.objs.size()=1 2024-09-05T02:16:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3wb-1-IdxuwOXCu1KVLyCd8b1pfVbrC_0 2024-09-05T02:16:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10919611191000932279', time=2024-09-05T03:46:36.162982+0000, chain.objs.size()=1 2024-09-05T02:16:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PEVtEwKKzxdTRtaB_Q4UlAIVjXFef7W_0 2024-09-05T02:16:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12834609842526114180', time=2024-09-05T03:46:36.291617+0000, chain.objs.size()=1 2024-09-05T02:16:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hmW0wnesmClBkL3CVA5XuAhZ9SYm8rC_0 2024-09-05T02:16:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5181532584494955467', time=2024-09-05T03:46:36.422360+0000, chain.objs.size()=1 2024-09-05T02:16:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WjVc1kc9yNDvNAFlzZKjbHv2cahxlYI_0 2024-09-05T02:16:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5289597124449525818', time=2024-09-05T03:46:38.162689+0000, chain.objs.size()=1 2024-09-05T02:16:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wNQqX_Jsy9tAo9hPRKisafpTvKetLqj_0 2024-09-05T02:16:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10544423259454723493', time=2024-09-05T03:46:40.516266+0000, chain.objs.size()=1 2024-09-05T02:16:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QOvHqA6Ns3MoyULbr0A6ImJmpM2tFHR_0 2024-09-05T02:16:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6146587251720504315', time=2024-09-05T03:46:41.876389+0000, chain.objs.size()=1 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-gtaEG9OraZpQQhAha7Ab83WSxRpsF4_0 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16916486576069120149', time=2024-09-05T03:46:42.459543+0000, chain.objs.size()=1 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jbYtDN-czILUYdqZjJi4e5bTxsz1D7E_0 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9300831068224100024', time=2024-09-05T03:46:42.771950+0000, chain.objs.size()=1 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZJa5fsrbGOj_T26Hev49MVdX4o269zQ_0 2024-09-05T02:16:21.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15157870234696240816', time=2024-09-05T03:46:44.019608+0000, chain.objs.size()=1 2024-09-05T02:16:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hRFZej-69eFhNBdxFVtycwq8v9saCxi_0 2024-09-05T02:16:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.338415499597089696', time=2024-09-05T03:46:44.197635+0000, chain.objs.size()=1 2024-09-05T02:16:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9mZQBrGhifFN6TqK0vXUdImdhn2BbKX_0 2024-09-05T02:16:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15625293748794555636', time=2024-09-05T03:46:44.503658+0000, chain.objs.size()=1 2024-09-05T02:16:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dBeFxxCDUaZkgDUotIQWYqERZoZ3wzy_0 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3374603407880368104', time=2024-09-05T03:46:46.404500+0000, chain.objs.size()=1 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qCngaMpqFTkOpHbAD1SsozewJT2UB_8_0 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16348237967236298399', time=2024-09-05T03:46:46.447949+0000, chain.objs.size()=1 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xYc2okPJ1H_xQPbeh93vuB6WirLwyVu_0 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14997302207788222069', time=2024-09-05T03:46:47.462192+0000, chain.objs.size()=1 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yRj1rBoZa-18Pegu_peuytbpzSI-ZJ6_0 2024-09-05T02:16:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6466040414658963876', time=2024-09-05T03:46:47.791324+0000, chain.objs.size()=1 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fe3kwV5P9rRRMyQBMsd7KYWHdd9JsSn_0 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15893560967847560397', time=2024-09-05T03:46:48.093297+0000, chain.objs.size()=1 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.G7hQ0lRtfZPAY5vQUtsZYacxESIHmsx_0 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7525637818663414232', time=2024-09-05T03:46:49.016872+0000, chain.objs.size()=1 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.w1j9wk7i4NraGzuY4LgdybRDh4jh7No_0 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5161972409480181956', time=2024-09-05T03:46:50.982520+0000, chain.objs.size()=1 2024-09-05T02:16:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.K-NBEpoeCwoeUmIdOKZPMNKNU9-FuJK_0 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13066139047619743276', time=2024-09-05T03:46:52.741043+0000, chain.objs.size()=1 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.it84mGEGAgcXFTx-OqDIYlHAqRaZXjr_0 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3261781467221972091', time=2024-09-05T03:46:52.832366+0000, chain.objs.size()=1 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wPu5OEuuSeR5vHo1potMhBrRDO3hFRe_0 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9489300423901920534', time=2024-09-05T03:46:54.139888+0000, chain.objs.size()=1 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Bk-xCRhrf-eTjXdy8G27l0Hb8xQcbt0_0 2024-09-05T02:16:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6254746223712511241', time=2024-09-05T03:46:55.825332+0000, chain.objs.size()=1 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Tzq82QQIxOBU884YrqJuopzrNg1UbAT_0 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15027266758355863489', time=2024-09-05T03:46:56.148295+0000, chain.objs.size()=1 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nBy9g3KaiKWp5g3kIw9TxI02UPHHBuU_0 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3784275568840398231', time=2024-09-05T03:46:56.153517+0000, chain.objs.size()=1 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GMaxoyFK-nC_vzlxt3eqdaBeaTlhpQz_0 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14952076187550340653', time=2024-09-05T03:46:58.690399+0000, chain.objs.size()=1 2024-09-05T02:16:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MHxIsM58PrNXyAWefgAoyYkt8lfMdDt_0 2024-09-05T02:16:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1602674135668413679', time=2024-09-05T03:46:59.004518+0000, chain.objs.size()=1 2024-09-05T02:16:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HPVJ1uQJ77MK4g4Mu9wA16mEY86npT4_0 2024-09-05T02:16:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11709756745982438160', time=2024-09-05T03:46:59.645837+0000, chain.objs.size()=1 2024-09-05T02:16:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vmLXU-5b5hOMQF7XPlf8OBKFKYiRIKl_0 2024-09-05T02:16:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5677324046999018961', time=2024-09-05T03:46:59.868294+0000, chain.objs.size()=1 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.B-54pQ6XXAPWncj351gOAKB86qBKREr_0 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10508109862169951318', time=2024-09-05T03:48:40.451043+0000, chain.objs.size()=1 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.390__shadow_.kOZx-1pElQ76XcchPVg2aD9gFqvamNX_0 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11268955827214118123', time=2024-09-05T03:49:09.109800+0000, chain.objs.size()=1 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.409__shadow_.9WqhYKSGh15SzgKWWZvPMFvuFoWt_rW_0 2024-09-05T02:16:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18060970584145007853', time=2024-09-05T03:50:21.086991+0000, chain.objs.size()=1 2024-09-05T02:16:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.454__shadow_.XU7lnUFyqq7IyEbFpDQQkDxANi0j_4x_0 2024-09-05T02:16:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10073117180502173851', time=2024-09-05T03:51:31.842407+0000, chain.objs.size()=1 2024-09-05T02:16:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.495__shadow_.pI-ph1R00a_zImpikCX7-nDYQbljhkW_0 2024-09-05T02:16:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/62201 2024-09-05T02:16:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2341897915090206002', time=2024-09-05T03:51:36.234353+0000, chain.objs.size()=1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.497__shadow_.Tt2i3BGWWY6nj-yC5FKP_0dI47XMBzK_0 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14143472241251541947', time=2024-09-05T03:52:13.446606+0000, chain.objs.size()=1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.513__multipart_mymultipart.2~HTYcfu4_4oOkBJgkuF2aA07J3WkieUz.1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l8uneaJogZ3Ky5okDqKIOEgUkdBwzLi', time=2024-09-05T03:55:15.535788+0000, chain.objs.size()=2 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.529__multipart_mymultipart.2~l8uneaJogZ3Ky5okDqKIOEgUkdBwzLi.1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.529__multipart_mymultipart.2~l8uneaJogZ3Ky5okDqKIOEgUkdBwzLi.2 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17629173333758985639', time=2024-09-05T03:58:24.659243+0000, chain.objs.size()=1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:1p8Fwo8rYuDh4k32jRWsfgVrYmbvC6Q_.tCoMg_qTczb83lgZcBDOQ220M6-zqtN_0 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2994471054110865986', time=2024-09-05T03:58:25.952221+0000, chain.objs.size()=1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:6Obq-U.fpmKB-obVl1ZBReQ7WGDJqoU_.bbZjfQsoCsKYUPnCNn1gRtaSGiSDpce_0 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9320105954246177038', time=2024-09-05T03:58:29.981624+0000, chain.objs.size()=1 2024-09-05T02:16:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:7ddpqgAqjg3qNrfQ7RHBCT3TWDmt09H_.fu8ZhV_lsX2H6eS23Y3Hr96NrjRyiBj_0 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6068888022425646497', time=2024-09-05T03:58:37.358353+0000, chain.objs.size()=1 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:yKPDr-AnAe2xKvR91Vrp8Ds2uv11Xji_.YbHYo497pKlqMbRHjIgSwBaKTBQWbQY_0 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7082333090461782087', time=2024-09-05T03:58:40.215280+0000, chain.objs.size()=1 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:s3qcvtH9JJrDcUKpr1tvwzhCcvO8Gwq_.-tWkkXgXyr9EBmT3Hfmpa9frJr_xFTs_0 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12311008491821554469', time=2024-09-05T04:07:28.582468+0000, chain.objs.size()=1 2024-09-05T02:16:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.709__shadow_.mxMPoY-sDrw94GXnc2kb0Lj0JM4PgZN_0 2024-09-05T02:16:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.304+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-05T02:16:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.304+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46303' 2024-09-05T02:16:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9139104275841547076', time=2024-09-05T03:32:47.862870+0000, chain.objs.size()=3 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-FROZEN.2~VL5NBprM0afka0IlLW1JEp6ee6pwZkf.1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-FROZEN.2~VL5NBprM0afka0IlLW1JEp6ee6pwZkf.2 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-FROZEN.2~VL5NBprM0afka0IlLW1JEp6ee6pwZkf.3 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_SRq4oiZxtgyTMlfsHmCX3Wu5MTCqAt3', time=2024-09-05T03:33:08.319646+0000, chain.objs.size()=1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.Two8kr_BfTvRe67gDfP2bfnDjRWkqK9_0 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12243814349408308901', time=2024-09-05T03:33:22.403961+0000, chain.objs.size()=1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.170__shadow_.3tVUateFEFdctC1kw3_Rp41TqINQS8p_0 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1410539894372293045', time=2024-09-05T03:37:22.274306+0000, chain.objs.size()=1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.230__shadow_.AYB3bYbpzLP3AxOGZLJ-uO7ztcbAXB9_0 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.128681033934734085', time=2024-09-05T03:37:51.082288+0000, chain.objs.size()=1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244__shadow_.dAf6wQHZl_fByc92pGoeqdISOYWl3ZJ_0 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4417579963690259975', time=2024-09-05T03:38:07.915391+0000, chain.objs.size()=1 2024-09-05T02:16:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.253__shadow_.FvQtWMOrLDL3FPAN-GlQdCgL3IY-BcK_0 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1048343865969924028', time=2024-09-05T03:40:06.283456+0000, chain.objs.size()=1 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Gl9rM5Z02tA75AFHaqb4v5l2KZKF674_0 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16690892841035389320', time=2024-09-05T03:40:06.929365+0000, chain.objs.size()=1 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0pfvg67T3q8RRh107z9XvFE48HTcbtA_0 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1631229554421224700', time=2024-09-05T03:40:07.427358+0000, chain.objs.size()=1 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RbzvhmTrU6r9sdhjlUXm4klPueskBV4_0 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3031383442959524798', time=2024-09-05T03:40:09.310473+0000, chain.objs.size()=1 2024-09-05T02:16:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Z6Iid2asTMWF5YHzeFkELNE5aSEhQtp_0 2024-09-05T02:16:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10142925964847127663', time=2024-09-05T03:40:09.390715+0000, chain.objs.size()=1 2024-09-05T02:16:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pUAwEuB5w1hu8s5NLgBC_sBZavTHyc4_0 2024-09-05T02:16:21.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3136253887377621662', time=2024-09-05T03:40:10.275148+0000, chain.objs.size()=1 2024-09-05T02:16:21.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dMQJfaCSvGdiKRxzoVV1OEXLYNeVesu_0 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8296017395071716994', time=2024-09-05T03:40:10.574327+0000, chain.objs.size()=1 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UaCGJc9kFavsTTiHtWYya05AN5_zC27_0 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5879711460488612227', time=2024-09-05T03:40:10.986492+0000, chain.objs.size()=1 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6wVa_MQ2BQ8bK3XWCB1-wJAEIeyeR2L_0 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8506534482914194819', time=2024-09-05T03:40:11.493148+0000, chain.objs.size()=1 2024-09-05T02:16:21.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vceKc_nq1ZgUIko5bwjicZs50fkerDv_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17680537810094600594', time=2024-09-05T03:40:13.210345+0000, chain.objs.size()=1 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.llCIdCJlZQF9ZSjFsAYgN87NCbXHqvF_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16445118241078438037', time=2024-09-05T03:40:15.014212+0000, chain.objs.size()=1 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bJpGPrD9rbBF_4CyqGvLszcTeybS7Jy_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12837141651070349308', time=2024-09-05T03:40:16.107237+0000, chain.objs.size()=1 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ideru4YQsCwt8dJPglyY5yw8DDvgQfi_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6159959655437141595', time=2024-09-05T03:40:16.246720+0000, chain.objs.size()=1 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EdbXSjrr9Dl8qId77FSSx53udd6CIaw_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8050953218329658065', time=2024-09-05T03:40:19.098073+0000, chain.objs.size()=1 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TKV_SpU-TMIvONznL4p2JfpGhDBkryz_0 2024-09-05T02:16:21.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3019172308702933110', time=2024-09-05T03:40:19.513216+0000, chain.objs.size()=1 2024-09-05T02:16:21.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.06RE2sZ3thyVAG62HQbnyjudFqROKw8_0 2024-09-05T02:16:21.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7673237330855026833', time=2024-09-05T03:40:19.621328+0000, chain.objs.size()=1 2024-09-05T02:16:21.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UTj4DmZG1ayntrJF0-ipxlSs-K-5CJ2_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11777905009961999328', time=2024-09-05T03:40:21.799482+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RRuny_kJwqkMi6nUCwafHYZZe2ldYgy_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11329400792318252423', time=2024-09-05T03:40:22.992513+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5VKh5KqOHQr2sUjVa7ZSb9-EowGANJ3_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16743846813453898044', time=2024-09-05T03:40:23.423164+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.faNwPmfVZ6JaamACp2Cf9xOM8o4glnR_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11299018383259933104', time=2024-09-05T03:40:23.828920+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jM4q45dzb6ifoDq4bXpo7ana40gVqQm_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17399577491110803290', time=2024-09-05T03:40:24.677999+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.W1zC4YeHR0YJu_Q1kdxZNWpF-XUSAeG_0 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12745417663256194170', time=2024-09-05T03:40:26.154960+0000, chain.objs.size()=1 2024-09-05T02:16:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YwMI-xxmZYbieS_-qlMANB4vOqgjvIl_0 2024-09-05T02:16:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9917102026354837046', time=2024-09-05T03:40:27.209549+0000, chain.objs.size()=1 2024-09-05T02:16:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TgriGmzzezAdKG9tIeVCd-xCs5mlGUh_0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.108440133488832757', time=2024-09-05T03:40:28.683923+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OOINRX6dj08jMgZeTTOL9rzWQxxfFZ__0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18190391971008447753', time=2024-09-05T03:40:30.008788+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cosmS3ueMdcd8bhunXTpMtkVjspvpS5_0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3704306833149169676', time=2024-09-05T03:40:30.010717+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XvJEqIOaVjf-eyf-L8ducJFqGdNYO9d_0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11188432293370808412', time=2024-09-05T03:40:31.051304+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GtlI9EXkHUgFD89q3r94dbg42CwY8Kc_0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6432823981465159192', time=2024-09-05T03:40:32.383872+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Yx51EBGCm-gl4XsuhiranA-L1FF8i9X_0 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10841111624794698644', time=2024-09-05T03:40:32.868099+0000, chain.objs.size()=1 2024-09-05T02:16:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sLgfWmbaLG8h32Vz6MFQ2XhLOIUDcl6_0 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15777915777063434914', time=2024-09-05T03:40:33.094273+0000, chain.objs.size()=1 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i2UW5swVi581oZtq7Jz1xlgVUTNMiET_0 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7659247703295656946', time=2024-09-05T03:40:34.256062+0000, chain.objs.size()=1 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zu8e19lCf4uCdw7NgzMI1psgL_jAqHp_0 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15295038671461853359', time=2024-09-05T03:40:35.308731+0000, chain.objs.size()=1 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H5xSIqeHrzA8bRgA_EkRVDV380jSZ7a_0 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3077148367698617911', time=2024-09-05T03:41:14.332971+0000, chain.objs.size()=1 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.283__shadow_.GiIzFe9q0BKCjCOWXUsUtURviPEswZh_0 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16546085635635478912', time=2024-09-05T03:41:39.970052+0000, chain.objs.size()=1 2024-09-05T02:16:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.Aw5cUKD4dcJvyWIwBfbj-uDcZ6j7JCN_0 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13600288072287415486', time=2024-09-05T03:41:40.127423+0000, chain.objs.size()=1 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.hfi3GcOzfoR5I7YWS3scbKk1C-oyV3l_0 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18339795291238178517', time=2024-09-05T03:41:53.648449+0000, chain.objs.size()=1 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.300__shadow_.EkukfFoh8bFsbtBE1oxak6ENZZQqJBp_0 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4601443396903708084', time=2024-09-05T03:41:53.674277+0000, chain.objs.size()=1 2024-09-05T02:16:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.300__shadow_.n8LHIEnJYnDkHHf7DHHclWDhaFf4tDz_0 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.68697817935536098', time=2024-09-05T03:44:19.264624+0000, chain.objs.size()=1 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UhnCXijFB0DGjebeUa2KcIJIF9C3-4S_0 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14624403099404958755', time=2024-09-05T03:44:20.639905+0000, chain.objs.size()=1 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AOQUl1-PPW7wUSHdBj9fATSsbSKRO8h_0 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16389554855891824124', time=2024-09-05T03:44:24.130524+0000, chain.objs.size()=1 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rH2-2P_ZQA49DlViB09bsyeX3pHkLZO_0 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5909987948382071421', time=2024-09-05T03:44:24.548790+0000, chain.objs.size()=1 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.x0MhtUleqEQyD0T9zc3q22cpupNKsDm_0 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.41731996198140137', time=2024-09-05T03:44:24.847602+0000, chain.objs.size()=1 2024-09-05T02:16:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pRopfpCGsSukiVyj_0OVR7sIhH0tmlw_0 2024-09-05T02:16:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6674251537989863577', time=2024-09-05T03:44:24.868850+0000, chain.objs.size()=1 2024-09-05T02:16:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BDM2RzgdgNKzJB76Mq_oGzY3OHnr8Tr_0 2024-09-05T02:16:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9054702987545034069', time=2024-09-05T03:44:25.025797+0000, chain.objs.size()=1 2024-09-05T02:16:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.r1nT4fmYqZHWmdqyZUdCJq3mVvUxHXt_0 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12098344073178477983', time=2024-09-05T03:44:25.265925+0000, chain.objs.size()=1 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Ap0nz4APgCrfSxI5FDktKcLiXBW1CgM_0 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11215356599629446977', time=2024-09-05T03:44:27.789149+0000, chain.objs.size()=1 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FKV7mdlz57LGtTOy6o9MaJfgNduJDVr_0 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.586851183330545801', time=2024-09-05T03:44:28.237969+0000, chain.objs.size()=1 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PtndjDxsIvoLr4RWWEKQBfbxHEF5ILr_0 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17365531684651997776', time=2024-09-05T03:44:28.440285+0000, chain.objs.size()=1 2024-09-05T02:16:21.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AXKAorJezI67QESYX3fCMr-3qG8zsyE_0 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13052931460267889646', time=2024-09-05T03:44:30.130675+0000, chain.objs.size()=1 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WAzPcObgc9_KvzePK0TJOUm64RZjw_7_0 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1941423764861002451', time=2024-09-05T03:44:31.830247+0000, chain.objs.size()=1 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fTPX_xmyvL7h86PIKwH-BGv1BzDTF3c_0 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13706043568214758111', time=2024-09-05T03:44:32.144492+0000, chain.objs.size()=1 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WgA6mnjz7_QK0WyzADRH1Y_8fk3EvwL_0 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7550002929304557366', time=2024-09-05T03:44:32.614429+0000, chain.objs.size()=1 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zHtPAwdkVkVI-A9eAvhzoeB1GI3iKmW_0 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4964614704046889270', time=2024-09-05T03:44:33.026814+0000, chain.objs.size()=1 2024-09-05T02:16:21.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6kPRET9gwbfdFjVy7hk3JE6dLY2_pX8_0 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16845060144057834191', time=2024-09-05T03:44:36.318527+0000, chain.objs.size()=1 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ddZqV78n00KiXSInQFT8OfDLhCpwaT9_0 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7148307985197751969', time=2024-09-05T03:44:36.320772+0000, chain.objs.size()=1 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LKpQiaT_UJCv56COZK0iRLssavm0V41_0 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7429499652257867316', time=2024-09-05T03:44:37.137756+0000, chain.objs.size()=1 2024-09-05T02:16:21.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BtH78CR7PTfGd37xedPpjIXMS_Hql8e_0 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2581545290376809742', time=2024-09-05T03:44:37.947162+0000, chain.objs.size()=1 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.z-CETIVfxnM3S_2FIXnbxJj14icOYly_0 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9596717084444774897', time=2024-09-05T03:44:37.998950+0000, chain.objs.size()=1 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.f_r_dqeF_ZwGKfUMuIuGX-xF3tCtv94_0 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6781336298042705884', time=2024-09-05T03:44:38.387163+0000, chain.objs.size()=1 2024-09-05T02:16:21.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dbrJgwOQtXzM3SQx4F7XgFz-8eTliNs_0 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4198584501108808104', time=2024-09-05T03:44:38.598165+0000, chain.objs.size()=1 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jkZg7nhR4mh_9TRcEJJzfU1JYn4DQdP_0 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2842950742966936545', time=2024-09-05T03:44:40.928745+0000, chain.objs.size()=1 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZT_y4Tq31cykUfypLM1dQ1O0g4b25TY_0 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7877229032410634132', time=2024-09-05T03:44:41.275872+0000, chain.objs.size()=1 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GjpZ6_yi-d-tepfl0faKqL1U5T3ETha_0 2024-09-05T02:16:21.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10228508281755354315', time=2024-09-05T03:44:41.380691+0000, chain.objs.size()=1 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yge3Gh67xWE390EVibzwCtfNNS9vlJI_0 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17066755774924035484', time=2024-09-05T03:44:43.013387+0000, chain.objs.size()=1 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zfyYSMOo1p8gmE18ets7nPmQRM9fp9f_0 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13299698244089202307', time=2024-09-05T03:44:43.855237+0000, chain.objs.size()=1 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AO8i3iyJfHxMl-TJm2AQUe_1DkyCUbq_0 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17518215462148919422', time=2024-09-05T03:44:45.059880+0000, chain.objs.size()=1 2024-09-05T02:16:21.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.06rO4ylZ3k8rOK6CN-Y54jO7yJu5I7O_0 2024-09-05T02:16:21.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1673802174639238934', time=2024-09-05T03:44:45.419095+0000, chain.objs.size()=1 2024-09-05T02:16:21.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.t_HlwK4CZl-4SyslwO4jK7dH0TY5fKM_0 2024-09-05T02:16:21.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13223891652041200544', time=2024-09-05T03:44:46.371015+0000, chain.objs.size()=1 2024-09-05T02:16:21.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jhPgnNpbzh608Cw5sUnbYD6tTycqanN_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7605428313964544240', time=2024-09-05T03:44:46.826910+0000, chain.objs.size()=1 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AOSDYgtVmRRyEeKM1TR9Z9pzUyCab9q_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12324677579168291864', time=2024-09-05T03:44:47.789567+0000, chain.objs.size()=1 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.32QAZXtbhOrmTtnHbe29rqCv-2OTpmn_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3635492693704096380', time=2024-09-05T03:46:33.971266+0000, chain.objs.size()=1 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UNs-IFkgTGAVObcNgQkFP0zFVMYDpU7_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.846779857841589511', time=2024-09-05T03:46:34.423982+0000, chain.objs.size()=1 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hngbsmESg1Z7ckgxVeGdT3AJVjzSRaQ_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2465332659105453098', time=2024-09-05T03:46:34.992053+0000, chain.objs.size()=1 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rICWFd-o7RU_l2H39XP5BGfpk-a_YzZ_0 2024-09-05T02:16:21.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16406380238472061300', time=2024-09-05T03:46:35.565900+0000, chain.objs.size()=1 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Y4njhNeAnuceeclaN2NeL2H7GAIqOmW_0 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8665731863363001380', time=2024-09-05T03:46:38.026594+0000, chain.objs.size()=1 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZiieiZEPzIm36jChvoW16QGcmo2fhTM_0 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16329450615357080063', time=2024-09-05T03:46:39.094796+0000, chain.objs.size()=1 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5WuFbC1MA-9jz8WL_tfVxrHO-M62BQk_0 2024-09-05T02:16:21.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11128694491575878812', time=2024-09-05T03:46:40.164655+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.j-d9utlBgIRp4Yn314VW7aPY2sNYB-F_0 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8420022167312241116', time=2024-09-05T03:46:41.871550+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zbMygUHwXe863tc43iMo4edOFso5BnH_0 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2454420970930537575', time=2024-09-05T03:46:43.361212+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zOJ9RyBHd3vU67SdTozj63s0ywRpR7i_0 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11733401866294154019', time=2024-09-05T03:46:43.438680+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.l-5hfJVliuvpISnOdM0gfZ7tZ9A2Gtt_0 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4906738471609762174', time=2024-09-05T03:46:44.775352+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Y1g9JG0M3b4qP3ZjfsyChaxwLbbzK-1_0 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7333157460424265876', time=2024-09-05T03:46:44.777425+0000, chain.objs.size()=1 2024-09-05T02:16:21.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4CaMI6SH9V-daneuzUKPsPs8SGTOXDa_0 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1884866144947111351', time=2024-09-05T03:46:45.000614+0000, chain.objs.size()=1 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wTu6BTo0ijrYabhPpXLSYDciZA83aeT_0 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13702325265670190065', time=2024-09-05T03:46:46.193874+0000, chain.objs.size()=1 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-llmzblgVo8xYdWlYifL1HrUrtzrkis_0 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3232642879688612137', time=2024-09-05T03:46:47.934974+0000, chain.objs.size()=1 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6PYECxH3HwTTmUuJHtlqsDFFcINPpAq_0 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13656652593255556926', time=2024-09-05T03:46:48.347865+0000, chain.objs.size()=1 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o0oGFDOtvwHbYJyZhVKOetsy6T7OlLA_0 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2576841879981872953', time=2024-09-05T03:46:50.188306+0000, chain.objs.size()=1 2024-09-05T02:16:21.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Mashq9f8UICCFHFRWQCC-wKHEtT4uJS_0 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16581879571888140852', time=2024-09-05T03:46:54.559526+0000, chain.objs.size()=1 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GjJ9RIMIq9iWKHR0NtfDkTnbdAKKJl4_0 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10819219790425426864', time=2024-09-05T03:46:54.561312+0000, chain.objs.size()=1 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zGmcFw5D6NRkMY_RxenbVY9oWyaJsa6_0 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5629714825248283629', time=2024-09-05T03:46:56.229766+0000, chain.objs.size()=1 2024-09-05T02:16:21.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8cnkYZBWAq5dZpOScd9Wfaw7WpHxc8C_0 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464501702291794462', time=2024-09-05T03:46:59.848144+0000, chain.objs.size()=1 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9irXeTs66LIQs8t19mAddwzxpoVr_a7_0 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4699916123936882079', time=2024-09-05T03:47:00.980854+0000, chain.objs.size()=1 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.KgZ_kJvoBVAidb1b4q7WC8owb9QUVaX_0 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7967288722406099799', time=2024-09-05T03:47:01.166067+0000, chain.objs.size()=1 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nMQZftzg-xMCXmcz7HralIe6InFoeg3_0 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15101451929579253991', time=2024-09-05T03:47:02.519064+0000, chain.objs.size()=1 2024-09-05T02:16:21.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W4LIvcGfDWdWdSlRAFJX-ziDN2CUyL4_0 2024-09-05T02:16:21.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46303 2024-09-05T02:16:21.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-05T02:16:21.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3072574698543549117', time=2024-09-05T03:47:03.469220+0000, chain.objs.size()=1 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Gu-xbRn7iId-endsZOSA3HJSG351OTh_0 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9608256549279649069', time=2024-09-05T03:49:40.364802+0000, chain.objs.size()=1 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.430__shadow_.RZy3OSW2UuxmMaU-0cQattPjbvsfmK6_0 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5257607077224502592', time=2024-09-05T03:50:15.025143+0000, chain.objs.size()=1 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.450__shadow_.QpyW9iqny59gIc3yCjTlnFhl4e8VGkd_0 2024-09-05T02:16:21.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16320122863386385492', time=2024-09-05T03:50:41.067130+0000, chain.objs.size()=1 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.463__shadow_.GLI2wsSJPwE3QsOnxS1aXjrHBUCCMCL_0 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3437786622894784875', time=2024-09-05T03:56:46.748851+0000, chain.objs.size()=1 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.556__shadow_.XpvksffRWgo0utM3tO-z219Mr2l27mt_0 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1433219983815392064', time=2024-09-05T03:57:26.978729+0000, chain.objs.size()=1 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:cg2W42wCWQvnLL2l.1UUwS6KLaFtD3K_.MUfwjkfHBj4EoOYJOPcQ09QMpKdd_rt_0 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13259844432459886341', time=2024-09-05T03:58:40.922265+0000, chain.objs.size()=1 2024-09-05T02:16:21.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:kWDbm1Mq9Ogd14g1IQUfrFBtnXLkQ8Y_.IOvBSpSU6LOvSPZGDzIj8vKJswWHjPg_0 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16855802022929412839', time=2024-09-05T03:59:24.673245+0000, chain.objs.size()=1 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:CySEi299ZdQrPZtB7E9d.QXq-rKPO.u_.RQ64olZi6Lr8tY_tfUm8KY5pDDh_tcL_0 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6412249395956335753', time=2024-09-05T03:59:29.763336+0000, chain.objs.size()=1 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:wFaiSQf83oY.r4gERgNWcH.cOFcLQXS_.yakIQvLeUHVGHB6aX6MM9h25fywvEdx_0 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12108266420779631900', time=2024-09-05T04:00:16.119625+0000, chain.objs.size()=1 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.607__shadow_.3TcL1cpIJeS6LnEcIRJBiDZvT9umHz6_0 2024-09-05T02:16:21.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5030407973932046677', time=2024-09-05T04:05:19.009001+0000, chain.objs.size()=1 2024-09-05T02:16:21.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.644__shadow_.a8a3H_LcTKzeisknj71eRL9vshQ2dB4_0 2024-09-05T02:16:21.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.348+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.348+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-05T02:16:21.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/64104' 2024-09-05T02:16:21.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15640924481167705788', time=2024-09-05T03:32:52.363625+0000, chain.objs.size()=2 2024-09-05T02:16:21.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.yHVPmBl3d6XlabvspWaCGwsenmJmKIw_0 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.yHVPmBl3d6XlabvspWaCGwsenmJmKIw_1 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5554939078515281797', time=2024-09-05T03:32:59.588671+0000, chain.objs.size()=3 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-STANDARD.2~T67ay__k7HVNL3AWBdbn7bYDIYP-AoC.1 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-STANDARD.2~T67ay__k7HVNL3AWBdbn7bYDIYP-AoC.2 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-STANDARD.2~T67ay__k7HVNL3AWBdbn7bYDIYP-AoC.3 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17773226953332398846', time=2024-09-05T03:33:17.622222+0000, chain.objs.size()=1 2024-09-05T02:16:21.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.166__shadow_.FBftNEr666k14Ecc5hLRdzC_hr9YZ23_0 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13544212892645325354', time=2024-09-05T03:33:38.166734+0000, chain.objs.size()=1 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.176__shadow_.EdRLSlnf718WuJKYzO27kmbVJYk8xLB_0 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16109961697974003787', time=2024-09-05T03:37:29.756076+0000, chain.objs.size()=1 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.234__shadow_.OfwbC1xE4IYS9Rsmg1R_hpafK40k9uf_0 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9317589970632796873', time=2024-09-05T03:38:04.188563+0000, chain.objs.size()=1 2024-09-05T02:16:21.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.251__shadow_.Re7-y2Ad8fBJGyBkD_S9tytVJnfHm8O_0 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16742746427779212261', time=2024-09-05T03:40:04.800716+0000, chain.objs.size()=1 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bt5r0D3biS7032UIMsDCDYehd9YmF5l_0 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3379020101194807151', time=2024-09-05T03:40:05.325218+0000, chain.objs.size()=1 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SCJ8MmqVe6aRG5Y7XZB9PZJ_FWSf7g1_0 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16249734548126666935', time=2024-09-05T03:40:05.707134+0000, chain.objs.size()=1 2024-09-05T02:16:21.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.E_oi0zbJhvSh8MnppAh0VXbx5lfDAGX_0 2024-09-05T02:16:21.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14722623299712330414', time=2024-09-05T03:40:05.827950+0000, chain.objs.size()=1 2024-09-05T02:16:21.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MW6k8Qj9a_O7gwRi0HYSHS1_Tfk0tCB_0 2024-09-05T02:16:21.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10828402160910454241', time=2024-09-05T03:40:07.321012+0000, chain.objs.size()=1 2024-09-05T02:16:21.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4kwNhIQVRRyN_1IIgywOoyCJo0TKw8L_0 2024-09-05T02:16:21.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3973163693549071906', time=2024-09-05T03:40:08.846784+0000, chain.objs.size()=1 2024-09-05T02:16:21.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C2JirP1JhMlMJaXqc-_QEwsJ-DD6w3l_0 2024-09-05T02:16:21.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6620486456797706788', time=2024-09-05T03:40:09.295122+0000, chain.objs.size()=1 2024-09-05T02:16:21.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9aoaJ9tzkG87Y_Kzy0EAv8l58dd_iro_0 2024-09-05T02:16:21.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11929023620408659242', time=2024-09-05T03:40:09.422845+0000, chain.objs.size()=1 2024-09-05T02:16:21.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1dEaa86_UbEr0JCKuu7cIBNpTMH8L6T_0 2024-09-05T02:16:21.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10593825710656345510', time=2024-09-05T03:40:10.257476+0000, chain.objs.size()=1 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.u7KwZF1_FFa_RS48mC8dHlx03KOlHl4_0 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3792974109620831549', time=2024-09-05T03:40:11.212430+0000, chain.objs.size()=1 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FU87c5HUJ8AJok-zKFlRBzfjNXrnkbJ_0 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11555543849377875646', time=2024-09-05T03:40:11.297732+0000, chain.objs.size()=1 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0mby8ZesrfI-2KJ4_N3ZIW_d3YPKt0d_0 2024-09-05T02:16:21.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16663553723589232469', time=2024-09-05T03:40:11.870117+0000, chain.objs.size()=1 2024-09-05T02:16:21.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._bPHevKrDwq4oroHz4INynTaSZ90LBn_0 2024-09-05T02:16:21.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17451303791207776015', time=2024-09-05T03:40:13.677125+0000, chain.objs.size()=1 2024-09-05T02:16:21.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gjSvc0RlDQc968NvBkP6td0Ix8pquS6_0 2024-09-05T02:16:21.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5728781477891758827', time=2024-09-05T03:40:13.691051+0000, chain.objs.size()=1 2024-09-05T02:16:21.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SH0fJmUQ5UkpZwwqKQJUN9kkFRb3SJy_0 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.242973101863343862', time=2024-09-05T03:40:14.727577+0000, chain.objs.size()=1 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cBbpzpSFNlkDxJwog2UknlTtR1wFBHA_0 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12812151729467373118', time=2024-09-05T03:40:15.490114+0000, chain.objs.size()=1 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.M1kEttcFVcMZ6tF_UlVwoXiPQ42QhRQ_0 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13675430680817821020', time=2024-09-05T03:40:15.495407+0000, chain.objs.size()=1 2024-09-05T02:16:21.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SvhwssHQBAj7Ebapi8gCEoEFNMI8Ttl_0 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17599790038548989529', time=2024-09-05T03:40:15.851086+0000, chain.objs.size()=1 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rxAUQdMmQhAYLn9WxuYsYu87h2cWadS_0 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9611837555677755466', time=2024-09-05T03:40:17.645072+0000, chain.objs.size()=1 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vUN1m8-Tui57ZzdxriiJdYIUUOFc0-y_0 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.195012671445989939', time=2024-09-05T03:40:17.971562+0000, chain.objs.size()=1 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pAbtdpPBXiBAcTG4hBijworVwCyxLPX_0 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10081889322565632838', time=2024-09-05T03:40:18.477817+0000, chain.objs.size()=1 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2G-8fFabwJL9etzIAX_PIURyVM0MlSm_0 2024-09-05T02:16:21.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9561608381226691621', time=2024-09-05T03:40:19.232917+0000, chain.objs.size()=1 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6ASjwQNTKaHK1F0mDEwIX50OkM7FaDQ_0 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2366604785395957721', time=2024-09-05T03:40:20.003472+0000, chain.objs.size()=1 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5F3wljQThKM7Mns9KX9Zwy2upuFozV2_0 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5848444747251204791', time=2024-09-05T03:40:20.235518+0000, chain.objs.size()=1 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6d6oWrdpgHSpGl2wNQcQC-PsYIn3yOY_0 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18259655212928289645', time=2024-09-05T03:40:20.451808+0000, chain.objs.size()=1 2024-09-05T02:16:21.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tQ78r1ZGN9mFZHRw3sq07OBrTX50KHy_0 2024-09-05T02:16:21.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8857399154308105341', time=2024-09-05T03:40:21.689151+0000, chain.objs.size()=1 2024-09-05T02:16:21.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bebsdQoAHaA8INVrFfhFG4bt09uUoI6_0 2024-09-05T02:16:21.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16400564132929825326', time=2024-09-05T03:40:22.895502+0000, chain.objs.size()=1 2024-09-05T02:16:21.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jjgmSRyuOGH6Rds7jSPjmQoD8kXN1Z3_0 2024-09-05T02:16:21.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4722945996106282091', time=2024-09-05T03:40:24.068388+0000, chain.objs.size()=1 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NusL1Ys4GKtcr8zM9_NuLDa7ynZOGmf_0 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3387120648999064477', time=2024-09-05T03:40:24.264188+0000, chain.objs.size()=1 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.apm3Rfdj98dM0ma0mrM58XveWw6mT92_0 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12042316735551479785', time=2024-09-05T03:40:25.984645+0000, chain.objs.size()=1 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bpoUe1JFwsiGZttu2A-kSWdQGEaq2lG_0 2024-09-05T02:16:21.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5349160602895166337', time=2024-09-05T03:40:26.909349+0000, chain.objs.size()=1 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GCZu5TVFwwzrdA_AfLAQ70778bsqM1Y_0 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6860521945546197118', time=2024-09-05T03:40:27.917520+0000, chain.objs.size()=1 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vXlEI_p8FwI9CVKhZH4W0wCSCK60Nkj_0 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7402962450135902431', time=2024-09-05T03:40:28.472476+0000, chain.objs.size()=1 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nYmgXTIpbeO9bRTZmfG7PWPRATDCiEa_0 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3223241784134929451', time=2024-09-05T03:40:28.628685+0000, chain.objs.size()=1 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VQXKQlM763qeIuWiDCCpTQZUYfw-NAa_0 2024-09-05T02:16:21.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13242222726646636811', time=2024-09-05T03:40:30.467615+0000, chain.objs.size()=1 2024-09-05T02:16:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YJqv-UkUO0k_6DULoa2VGu6tJs3P8sy_0 2024-09-05T02:16:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5199412213702628915', time=2024-09-05T03:40:30.525032+0000, chain.objs.size()=1 2024-09-05T02:16:21.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wg7f1UYwcTOrmX44ep2opngnGFb0Rk5_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18293097539547261752', time=2024-09-05T03:40:31.041971+0000, chain.objs.size()=1 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.k93t0Mr3fXnqBq3tTSOjnqS5kZhhQZy_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15621913471411308408', time=2024-09-05T03:40:31.223457+0000, chain.objs.size()=1 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.emFyGsgIhbXmp_axNXMg_ixM1AbTX-H_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17983888473465360445', time=2024-09-05T03:40:32.168534+0000, chain.objs.size()=1 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UnD21ct762Lz4Je1T-MIaEGK38KDjEZ_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2708117674289104602', time=2024-09-05T03:40:32.671749+0000, chain.objs.size()=1 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xnM7sY-Cmxahj6qnqEnJHg1tPJn_AIT_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7885476383345858538', time=2024-09-05T03:40:34.053025+0000, chain.objs.size()=1 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fID3eg1Uekvdv_fjK8JHE_E4G0qeNIt_0 2024-09-05T02:16:21.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6196188462679070100', time=2024-09-05T03:40:34.252778+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cOe1y9Zxx8wV-bldmzwPCd-m0cQXlF6_0 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18165970514250418805', time=2024-09-05T03:40:35.388331+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mj7W3MFuHmzupBI0t0pLLVrqcHVP_Ei_0 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6566919811089925364', time=2024-09-05T03:40:36.497178+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fxtgUgBaIjNP-gtwEQUgP_QlLsQ-fyx_0 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2425426497857594351', time=2024-09-05T03:40:41.778075+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.265__shadow_.PZ67eRDjm8nnmFOtEKaJHGrpAwdcHtA_0 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.137622935909019528', time=2024-09-05T03:40:45.397576+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.267__shadow_.VGmN0KYlKMda57dGylx6gwKqSjC0dl0_0 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4282308802772481967', time=2024-09-05T03:40:47.139019+0000, chain.objs.size()=1 2024-09-05T02:16:21.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.268__shadow_.iwu6Si6tW0GkCCvcfr1i0IxfdU7DQfN_0 2024-09-05T02:16:21.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4735537113388062117', time=2024-09-05T03:41:01.249719+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.276__shadow_.56IKwTOVrTN-Nop0OAi_UTwpsDz4qQx_0 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.844301464076138658', time=2024-09-05T03:41:03.113306+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.277__shadow_.brdGlgNOZgOXTTxzMr6TIbNxenRRWqk_0 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17250191597847265427', time=2024-09-05T03:41:08.642369+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.280__shadow_.Q1ej-9dZfkYHmtqqt2kgctucy_c9JZU_0 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9324451535230615443', time=2024-09-05T03:41:23.911995+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.288__shadow_.tmX0ztGf7HZJpkqJthSoI9qvx89-GqI_0 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5300877020904629074', time=2024-09-05T03:41:40.297054+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.HrJouaniy0sJJVlUIrStLc0ojFMnnVq_0 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8956351671597487689', time=2024-09-05T03:41:40.299285+0000, chain.objs.size()=1 2024-09-05T02:16:21.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.2NltN01EgdIvblS3rapLxP3Ad3aSJWy_0 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1900668365968935818', time=2024-09-05T03:41:47.771982+0000, chain.objs.size()=1 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.297__shadow_.t3ilPXasFDheW74D7X4MzdGCEUiaide_0 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9391630634403187746', time=2024-09-05T03:42:01.063811+0000, chain.objs.size()=1 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.304__shadow_._fv1ONt7V8WpqJwC4xcgeg_wmRlgge1_0 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14277183228057628254', time=2024-09-05T03:44:19.689035+0000, chain.objs.size()=1 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.I41Mgv-SXPFHyTBfdcsaAtT4wDXp2GV_0 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13370172313337026866', time=2024-09-05T03:44:20.604223+0000, chain.objs.size()=1 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GVm54kN6D_fKnquI09dCvAT1Q-WsF6e_0 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13894136799925737937', time=2024-09-05T03:44:20.992020+0000, chain.objs.size()=1 2024-09-05T02:16:21.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zQW87DyPmrBsKQa1RZ_xGA63yEC8AN1_0 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17539827900266720931', time=2024-09-05T03:44:23.464560+0000, chain.objs.size()=1 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.R-20SAKVAmF7jnw0MzGuWvSc64Vj4Af_0 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15626019449327687438', time=2024-09-05T03:44:23.467574+0000, chain.objs.size()=1 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zhApFc1-0cDkQqKEOD8Lpzl2mTSH93c_0 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.830211494558085540', time=2024-09-05T03:44:23.563439+0000, chain.objs.size()=1 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.z_oCIVDKZshaK7l39hWsGNlP4ewI6NG_0 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5484473049509153270', time=2024-09-05T03:44:24.203960+0000, chain.objs.size()=1 2024-09-05T02:16:21.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wWkE9ApxP5UEe2nKpbMIIw6ErEXvv7y_0 2024-09-05T02:16:21.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9397047946963750749', time=2024-09-05T03:44:26.127354+0000, chain.objs.size()=1 2024-09-05T02:16:21.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QlqB-N2IOmHk_NAFndu81Hoxo35wn_L_0 2024-09-05T02:16:21.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17800946047361242676', time=2024-09-05T03:44:26.214649+0000, chain.objs.size()=1 2024-09-05T02:16:21.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.214uVEoWwwft1Sl2jQiB8aRyKoPV2ZH_0 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10893740207944552002', time=2024-09-05T03:44:26.546204+0000, chain.objs.size()=1 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h2yJlMLO2id-02RRMm_alV5v_hQ9HlT_0 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9897370004058796763', time=2024-09-05T03:44:28.683139+0000, chain.objs.size()=1 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.b0J-t9WZ6WI6Oc2dOioJLr35qALd2jn_0 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4623731906819189372', time=2024-09-05T03:44:30.727693+0000, chain.objs.size()=1 2024-09-05T02:16:21.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vkJWYGVcV0XK3Ozr3Tw8UoJP4Q0Cshi_0 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1783147286294004033', time=2024-09-05T03:44:30.757368+0000, chain.objs.size()=1 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IkJTDX57foZMM7pFdOSawh1QPDJRcWa_0 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4217305864594089850', time=2024-09-05T03:44:34.814451+0000, chain.objs.size()=1 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TQn6lmuIgXhfV8eByJSXfP0Uc21jvtn_0 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.125921072794871784', time=2024-09-05T03:44:34.868079+0000, chain.objs.size()=1 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KXBHwmZl0XBzllaT5ISFeT4wFxNRwas_0 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1013554176091651161', time=2024-09-05T03:44:36.327068+0000, chain.objs.size()=1 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MZQkdHZ-jbG2X5dDDG6CL46PkJGj70t_0 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3678800343197193442', time=2024-09-05T03:44:37.148139+0000, chain.objs.size()=1 2024-09-05T02:16:21.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WiMuo5DwtbNgtxlNhmiS4brRtQoqXde_0 2024-09-05T02:16:21.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5253341007444336512', time=2024-09-05T03:44:37.158221+0000, chain.objs.size()=1 2024-09-05T02:16:21.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vZfPBHiKQffNWHzkavXCIWpuS7mx6Gv_0 2024-09-05T02:16:21.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8514946270106622694', time=2024-09-05T03:44:38.143937+0000, chain.objs.size()=1 2024-09-05T02:16:21.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NRSawaFFttlhn5ilVu0Xg7La55QDFaG_0 2024-09-05T02:16:21.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10803344292393145131', time=2024-09-05T03:44:38.778687+0000, chain.objs.size()=1 2024-09-05T02:16:21.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kpT5MF2JhlmBIniGtfW_JRE7tJSEvIg_0 2024-09-05T02:16:21.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15326232107688803529', time=2024-09-05T03:44:38.891789+0000, chain.objs.size()=1 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ybnOQeu2L7RwplgNmL-NToAlWy1_DE9_0 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18433029802953551996', time=2024-09-05T03:44:41.295945+0000, chain.objs.size()=1 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RltQUuw5QKgVPibPIAgZrGWymEGJRvC_0 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11860213352906902705', time=2024-09-05T03:44:41.835936+0000, chain.objs.size()=1 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.517Wzwhvfe1HAlw5b_SB2NzXb_42kuH_0 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16899149798468474206', time=2024-09-05T03:44:41.927918+0000, chain.objs.size()=1 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.v43JG1F9_l3xn_47VRZ5CVHsGCJRyuU_0 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7405460025375399480', time=2024-09-05T03:44:42.455545+0000, chain.objs.size()=1 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yR3UOQ2AIm5ldRoekYXlJUltu8K7XmF_0 2024-09-05T02:16:21.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16191408210332059692', time=2024-09-05T03:44:42.931688+0000, chain.objs.size()=1 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IRA4VDKbwqrrSC3STiB-oLAd7j3G8Br_0 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13476249451144751178', time=2024-09-05T03:44:43.082167+0000, chain.objs.size()=1 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.79NHEGvHTyVeYyLvTbKzwR4ONYdIECv_0 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16170126154421466774', time=2024-09-05T03:44:44.921865+0000, chain.objs.size()=1 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xK-c3Wg4c1wwMX4ZmgSZvbzAJModqEB_0 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14330299781292932249', time=2024-09-05T03:44:45.726952+0000, chain.objs.size()=1 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6vUPG55Q37APsvhqkrdQe03Al0tKkvF_0 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587660090916229541', time=2024-09-05T03:44:46.202212+0000, chain.objs.size()=1 2024-09-05T02:16:21.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.omeTAI1NEkT_Q7D5PdIOOJwgqFja4wQ_0 2024-09-05T02:16:21.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16536471130076778898', time=2024-09-05T03:44:46.576520+0000, chain.objs.size()=1 2024-09-05T02:16:21.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FCQzlMw70XyfqDz_xTIqtL5qe3y-Iyn_0 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11918980123716932977', time=2024-09-05T03:44:46.965435+0000, chain.objs.size()=1 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cJ4XZ8dFiBujXoy9f24nZoH3vXo5PIp_0 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6230891056381470646', time=2024-09-05T03:44:48.588909+0000, chain.objs.size()=1 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.37jTganWmugl2_8cSi0v8sNxyHKCz5Q_0 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13649582755473804604', time=2024-09-05T03:44:49.056906+0000, chain.objs.size()=1 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZbemssZ2mJynl_C0J9mHfEZSNUJf97F_0 2024-09-05T02:16:21.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6692680740481016032', time=2024-09-05T03:44:50.198375+0000, chain.objs.size()=1 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wBPrYY4XqvConBS46bDTO78CCJ-5OwS_0 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8407427422902195973', time=2024-09-05T03:46:34.198432+0000, chain.objs.size()=1 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tmcq-hAKYO3qJYuob2DUempWOuZIoiN_0 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7819554360071024710', time=2024-09-05T03:46:34.392066+0000, chain.objs.size()=1 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8nvmpGvqfjINlKSyqYwyg3SdR7AyHQ7_0 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3452934165518492768', time=2024-09-05T03:46:34.495820+0000, chain.objs.size()=1 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uWG-DSvPN4Jy9pK0GHfyRrFeBZfEF_Q_0 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10062864006161217572', time=2024-09-05T03:46:34.550800+0000, chain.objs.size()=1 2024-09-05T02:16:21.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nw7wnc-5YALpRVp9E7hnZhq8pan0iih_0 2024-09-05T02:16:21.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.388+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/64104 2024-09-05T02:16:21.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=47, truncated=0, next_marker='' 2024-09-05T02:16:21.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10197760537772453377', time=2024-09-05T03:46:36.046828+0000, chain.objs.size()=1 2024-09-05T02:16:21.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2KPjTIr6sEnf7phHQZDAfSKujEUvNSu_0 2024-09-05T02:16:21.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13367271901372537459', time=2024-09-05T03:46:36.468348+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V_vqlK-16TxIOzyITBR-nvBNg_7BYLd_0 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9705321263345711871', time=2024-09-05T03:46:37.692248+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JAC6V-3acw3szS-048jtYWVZ-8ApeHC_0 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11008314764525267564', time=2024-09-05T03:46:38.224694+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ipWt6oUsl8YMT-q2Y8VQCMYOMa-9_eu_0 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12214322981238015566', time=2024-09-05T03:46:38.687164+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OIhkak0qfHt-rYgVspZpet0QBZqNreh_0 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16106348775424164904', time=2024-09-05T03:46:39.381752+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ADSVjPAhnOpDXvWp5iDIPSgMoT4BuaN_0 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1301266775522714318', time=2024-09-05T03:46:40.747658+0000, chain.objs.size()=1 2024-09-05T02:16:21.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AvZFFCg37W4fBAO7W2uci-hpkMU2T4R_0 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14180057024611094703', time=2024-09-05T03:46:44.120693+0000, chain.objs.size()=1 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EP8nGW8WIREbHORaVvO0Jf6lDXiFbth_0 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8913445903191698206', time=2024-09-05T03:46:44.754452+0000, chain.objs.size()=1 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gK-36RaMGmrRCB7CFPm01dNqGYnQqGZ_0 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13290170177571252802', time=2024-09-05T03:46:48.764897+0000, chain.objs.size()=1 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0BaCTa19Mn_Llj74q61BLhpizHdnJp5_0 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14209197967952451598', time=2024-09-05T03:46:49.095747+0000, chain.objs.size()=1 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kuQNjE3PrgS4ISQQLMjQHjTkmCOTOhq_0 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12117059900407591895', time=2024-09-05T03:46:50.185113+0000, chain.objs.size()=1 2024-09-05T02:16:21.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HK8AAmziFn3xAEKoxBlHEHQE43wt1uv_0 2024-09-05T02:16:21.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11038974360057057405', time=2024-09-05T03:46:51.539772+0000, chain.objs.size()=1 2024-09-05T02:16:21.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.n7ZBtuLKeZMjYuFB5u7vrC1zkhbJzm0_0 2024-09-05T02:16:21.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6253423427858392801', time=2024-09-05T03:46:54.193745+0000, chain.objs.size()=1 2024-09-05T02:16:21.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EHukNWSBSZbjUG1zax2qOUUA8M11Nbc_0 2024-09-05T02:16:21.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8311562684844326829', time=2024-09-05T03:46:54.750662+0000, chain.objs.size()=1 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9FnRouBGD06jh0-Suu7WxNht6nHF8zo_0 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16225620166753430169', time=2024-09-05T03:46:55.750102+0000, chain.objs.size()=1 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LcQmVb_Zf0SSEIVjI-6b4-sRHH4LeyI_0 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2078120571872094428', time=2024-09-05T03:46:55.819356+0000, chain.objs.size()=1 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wRGZYOwc_s6DHC0i993mBEINomTlX23_0 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1901313034867474571', time=2024-09-05T03:46:56.007094+0000, chain.objs.size()=1 2024-09-05T02:16:21.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ze0wrYUPuUiSvntsaYZBxiTzrn8q6_V_0 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13784596044537169566', time=2024-09-05T03:46:56.651062+0000, chain.objs.size()=1 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yuwIZbUNPcWpuF_VM5hzs3XFL5VK-5y_0 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7210864662659971472', time=2024-09-05T03:46:58.189361+0000, chain.objs.size()=1 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6x9uri2wbpC19Oe_S0OpoBLPkXR0gEL_0 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.289251047280688663', time=2024-09-05T03:46:58.473181+0000, chain.objs.size()=1 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LCmHJUfVeNJzZiDXfhjwSe6FWJ9d9hd_0 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13300152507007559462', time=2024-09-05T03:46:58.477206+0000, chain.objs.size()=1 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rFb8smfhD8VLzxGuQPpwDq8byVFsPG7_0 2024-09-05T02:16:21.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17341743222980028267', time=2024-09-05T03:46:59.431078+0000, chain.objs.size()=1 2024-09-05T02:16:21.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.t88AMdNIRQdp2QmQN5QIQBb9DeLA8Rb_0 2024-09-05T02:16:21.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10097620197179924092', time=2024-09-05T03:47:00.073494+0000, chain.objs.size()=1 2024-09-05T02:16:21.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yv7WhioRkhllmS0DO4-RfPshrjxAGKj_0 2024-09-05T02:16:21.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1104667756229494708', time=2024-09-05T03:47:01.210601+0000, chain.objs.size()=1 2024-09-05T02:16:21.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gFdbnyiY2Sm0ZEA05YimT8k8058ndtW_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11116544565377198530', time=2024-09-05T03:47:02.839515+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-Cci0tkiBvmm1SaHr7cXcjkaTcfvH3Z_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16529346930468542528', time=2024-09-05T03:47:03.570763+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fdU2PZ2xBP8MQKjs0AGwWcodgLR3Bz2_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6075581338952974329', time=2024-09-05T03:47:03.775508+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hFM-6_zyNfmOePsapjl_-dn8uksSM8o_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1199255846070479929', time=2024-09-05T03:47:04.055725+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.t6yUHF6fMLBRJl7nRwjJZoGz_TV8g7Z_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5167459537280488795', time=2024-09-05T03:47:04.412102+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hCYM3YEayBl7insbuM1HI27m6i9-cr0_0 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2135010276961053348', time=2024-09-05T03:47:04.414175+0000, chain.objs.size()=1 2024-09-05T02:16:21.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qElcYqA37sUWegSSqPZesjPQbWalTzI_0 2024-09-05T02:16:21.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14992989021848133975', time=2024-09-05T03:49:38.887310+0000, chain.objs.size()=1 2024-09-05T02:16:21.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.429__shadow_.UCPWlpR2gUsUygcpdcsCWfjyL1FqsU5_0 2024-09-05T02:16:21.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1565208692438058353', time=2024-09-05T03:50:29.893763+0000, chain.objs.size()=1 2024-09-05T02:16:21.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.458__shadow_.q2rUb0r_PkgC0Ux5fWUb-GFmws_PeyJ_0 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13561553230801705565', time=2024-09-05T03:50:48.281389+0000, chain.objs.size()=1 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.466__shadow_.rdlerRr0X2BBZyC600oeMkhLuzGXRhx_0 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17986892880286803636', time=2024-09-05T03:51:09.621448+0000, chain.objs.size()=1 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.rp91oC0DOJ2gBOzwEU9hMgmUKgOyi3V_0 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6049663772316750770', time=2024-09-05T03:53:08.520138+0000, chain.objs.size()=1 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.520__shadow:nTgCJSEFq-AQoxawwAfEINdRdgW42N._.Wh7mr_a0Zs8ZFwSt4HCrakoP9R_NtIS_0 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9248757884526437856', time=2024-09-05T03:55:11.391662+0000, chain.objs.size()=1 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.528__shadow_.6b4dfbG9MD_KsZMookMdJ3HW9FCa2Mg_0 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9370218783565198702', time=2024-09-05T03:55:52.107874+0000, chain.objs.size()=1 2024-09-05T02:16:21.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.536__multipart_mymultipart.2~6Wn9LNpeR5947TGpkWjDrYf4-kaxo3X.1 2024-09-05T02:16:21.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2953508979775185827', time=2024-09-05T03:56:51.929023+0000, chain.objs.size()=1 2024-09-05T02:16:21.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.557__shadow_.LEqVEUv3j5FwkayL9dmTB7NgFYjVefC_0 2024-09-05T02:16:21.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6592960760217175585', time=2024-09-05T03:56:58.500022+0000, chain.objs.size()=1 2024-09-05T02:16:21.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.558__shadow_.-rvAdrFq3tHSw1CGYxjFJpBETAiTI8z_0 2024-09-05T02:16:21.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16549711430303033077', time=2024-09-05T03:57:01.129839+0000, chain.objs.size()=1 2024-09-05T02:16:21.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.559__shadow_.8i24XW_TF_bWC3AQh4BHiMAwEFKz2bQ_0 2024-09-05T02:16:21.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8985635563306515335', time=2024-09-05T03:57:37.785814+0000, chain.objs.size()=1 2024-09-05T02:16:21.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:4YkRZbLekr7YtG1HlOvcHJYnglb013H_.mrEmE1_YAard4MA22zFdK18ef3bffnb_0 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.564750863174795422', time=2024-09-05T03:58:18.997292+0000, chain.objs.size()=1 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:0ZgkfYfwMHhT0zsFjBTcARmvA.F8EsE_.G-uQNbXCQRrid_lmuWs0Jhx1eXPoaes_0 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16617648081735439272', time=2024-09-05T04:04:28.418566+0000, chain.objs.size()=6 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.1 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.2 2024-09-05T02:16:21.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.3 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.4 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.5 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623__multipart_multipart_enc.2~4R30Vud5Vy4HU7449vGze5SiKIdOCng.6 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6495134787305497013', time=2024-09-05T04:05:02.455356+0000, chain.objs.size()=1 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.635__shadow_.DL8CwkIh6kZjgUW42st5KssYq9Kf5HG_0 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6781333106857032726', time=2024-09-05T04:06:20.033818+0000, chain.objs.size()=1 2024-09-05T02:16:21.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.665__shadow_.L2ZCMn2rkseZJHmSCBFXmZD381herxb_0 2024-09-05T02:16:21.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.412+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11461880911322111861', time=2024-09-05T04:07:01.953102+0000, chain.objs.size()=1 2024-09-05T02:16:21.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.412+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.694__shadow:Mnt5DpU7C15.QVEuoansQukro3RziFl_.1QdiTZbohq9SiqX5cDiPJ9OdaQrEMp4_0 2024-09-05T02:16:21.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.416+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.420+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-05T02:16:21.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48723' 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4149644591439789557', time=2024-09-05T03:33:06.849838+0000, chain.objs.size()=3 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-FROZEN.2~7l2NqOTMMk-_mzJmxOJBCTW_4of_AfR.1 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-FROZEN.2~7l2NqOTMMk-_mzJmxOJBCTW_4of_AfR.2 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-FROZEN.2~7l2NqOTMMk-_mzJmxOJBCTW_4of_AfR.3 2024-09-05T02:16:21.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3978843782855099413', time=2024-09-05T03:37:29.777703+0000, chain.objs.size()=1 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.234__shadow_.99KE_0hw__wI0F7fgNMFN-fbfwaTxSv_0 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12247403939365725939', time=2024-09-05T03:38:11.670703+0000, chain.objs.size()=1 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.255__shadow_.6FMPlk7qeaUmzwVcLpxQxDmn2s2400c_0 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14373596390486200438', time=2024-09-05T03:38:22.643999+0000, chain.objs.size()=1 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.261__shadow_.ek8yax6_SpOtGsNwzfaN2f8jJEGGqLi_0 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6377475140163818597', time=2024-09-05T03:40:04.715408+0000, chain.objs.size()=1 2024-09-05T02:16:21.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aF_tuSmrMvoo2pgf-0dph-6aajzECfL_0 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.927263939954060353', time=2024-09-05T03:40:06.128628+0000, chain.objs.size()=1 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0NzcVw5hbxt-7LAr9LwHnHMhxfQV3AK_0 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17650242576669687163', time=2024-09-05T03:40:07.006981+0000, chain.objs.size()=1 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H3Lw3JQxW9gpBck4U07MR1TFLL57MWU_0 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14289804446853257981', time=2024-09-05T03:40:16.192518+0000, chain.objs.size()=1 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0zk0n-bW-9SnBtwsZjLuc2tVO35X1sF_0 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5435086232110829093', time=2024-09-05T03:40:16.467929+0000, chain.objs.size()=1 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.G-YQLoZPoT1BUzUrSFqRIB_XCbIgU2m_0 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7754669809297622383', time=2024-09-05T03:40:18.130791+0000, chain.objs.size()=1 2024-09-05T02:16:21.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SLBhQmEpRpuLb_WEp324JjXunnNih_5_0 2024-09-05T02:16:21.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9703442084484194767', time=2024-09-05T03:40:18.132722+0000, chain.objs.size()=1 2024-09-05T02:16:21.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.saDAfDtAZ_dj4UlIPzJprzCMmgUc4tu_0 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9948917249862982448', time=2024-09-05T03:40:18.743612+0000, chain.objs.size()=1 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iJLSh1ZDEmT0rWJpSqg7hYhMkzQhFxK_0 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8944041378654962373', time=2024-09-05T03:40:19.079943+0000, chain.objs.size()=1 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.41ss3Rt5B6YJrsHjVW1xx6JpuE6hIJK_0 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13067970365138664369', time=2024-09-05T03:40:19.742414+0000, chain.objs.size()=1 2024-09-05T02:16:21.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yPVtvyHm-LO4Rs9LNIO47o8SloI0fg2_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15714680311215496200', time=2024-09-05T03:40:20.632359+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vqNz5BXl6xAo9FPyY9d4z2yK6zdU8pt_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5961952157169229298', time=2024-09-05T03:40:21.869162+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kqa2euv4HBuUcA09keX3iiChfyU6aVs_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8852656380229848256', time=2024-09-05T03:40:22.281377+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1wMur6xQIlqwDEsepu4zlwXJfxmHwb6_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13753557870445470843', time=2024-09-05T03:40:22.284449+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0yMuJWSc7nnIZyTSiE5zZU4aZzCTlig_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18391179384990431627', time=2024-09-05T03:40:22.291070+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xWlF4ERpURZg7VQzpSPn607JPActUTV_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10282092438181829501', time=2024-09-05T03:40:23.663602+0000, chain.objs.size()=1 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zcfVVrpvwtVUmYt-VlESuLXzVG1EXEt_0 2024-09-05T02:16:21.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6574822578397445490', time=2024-09-05T03:40:26.770767+0000, chain.objs.size()=1 2024-09-05T02:16:21.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.V8j5uFeAZqA8XaDtN9Z51qR0y6A6wQx_0 2024-09-05T02:16:21.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6294435461644594746', time=2024-09-05T03:40:27.738578+0000, chain.objs.size()=1 2024-09-05T02:16:21.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.opeevdbCkTaxX8dpnWWe_NVNZrCit1-_0 2024-09-05T02:16:21.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5178574043988187450', time=2024-09-05T03:40:28.146614+0000, chain.objs.size()=1 2024-09-05T02:16:21.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hTHWRQk0Ka5pRGQq6arGlAlqJQQx_S__0 2024-09-05T02:16:21.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17012473539115254982', time=2024-09-05T03:40:28.627269+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Z5nQfAyjjIYwoh_SIO9CXj4UIOdA5tG_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1348075836457110979', time=2024-09-05T03:40:30.036053+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4T-DupBl98vCsX44xGe2phezgubYcV9_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.798462989594013942', time=2024-09-05T03:40:34.638101+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.83mOViW6vXMYYKB7sPR1GVJkeyBYtlt_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6933475226757145123', time=2024-09-05T03:40:34.741407+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ss0QLvIot3YeGk7sqjW-9EICq9gydl5_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15086324356562275351', time=2024-09-05T03:40:50.639456+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.270__shadow_._fHge5Gv20tYIQZV1tPI9ZOsnn-3wjf_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12206961031854610760', time=2024-09-05T03:41:16.250579+0000, chain.objs.size()=1 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.284__shadow_.Nqez7W2zUcaP2py0yz40_Cs-Oz2exyD_0 2024-09-05T02:16:21.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10234741260085526649', time=2024-09-05T03:41:40.313796+0000, chain.objs.size()=1 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.O3R-Y84aQ8BOM3DFTfY4CYLK0FWhRQ0_0 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15589327409058009597', time=2024-09-05T03:41:42.177842+0000, chain.objs.size()=1 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.294__shadow_.Z8ee0Wwe9CO8IeLflAoHv60LZ9fBuYC_0 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5383770153992923399', time=2024-09-05T03:41:55.545216+0000, chain.objs.size()=1 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.301__shadow_.x6bpZn5yxDzQJVPUz5xqXt-fP_jdguo_0 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3883343119139062783', time=2024-09-05T03:42:08.086588+0000, chain.objs.size()=1 2024-09-05T02:16:21.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.307__shadow:GMVZ.GJDYUoSOewC7rRLYDVP5iiwHQS_.gFrn3JCZ_Bh36toHkFLs2-gRuaXFDzB_0 2024-09-05T02:16:21.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10700266669400832076', time=2024-09-05T03:44:19.180435+0000, chain.objs.size()=1 2024-09-05T02:16:21.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YKm-2uUHXfTYlfwH5wfN_rRUvgHIgPc_0 2024-09-05T02:16:21.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9119857996673004475', time=2024-09-05T03:44:19.876079+0000, chain.objs.size()=1 2024-09-05T02:16:21.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0rLmXW8yhgJXsN_zFur-6ZuZGZGz0Uw_0 2024-09-05T02:16:21.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15278439717034413209', time=2024-09-05T03:44:20.258689+0000, chain.objs.size()=1 2024-09-05T02:16:21.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SapdGKrGerL6DZg5udGT9YSQVdUoqRK_0 2024-09-05T02:16:21.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8212303629045265549', time=2024-09-05T03:44:20.629366+0000, chain.objs.size()=1 2024-09-05T02:16:21.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OVehPqrbOImqQ0cosZhSxP12xRdTkmk_0 2024-09-05T02:16:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17927351997840929583', time=2024-09-05T03:44:21.152002+0000, chain.objs.size()=1 2024-09-05T02:16:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Mu6yvISo6t4bD9h7RjNv0fOQmIKQPYM_0 2024-09-05T02:16:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8232493900020486949', time=2024-09-05T03:44:21.755511+0000, chain.objs.size()=1 2024-09-05T02:16:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.e6asyefxVReH06sKXT5aYuahdx8iOjW_0 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17432527492513389270', time=2024-09-05T03:44:22.371077+0000, chain.objs.size()=1 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FshUHrbCYs5bEvhUVgmzfEbmDJZVwwB_0 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12768954236010012691', time=2024-09-05T03:44:23.373823+0000, chain.objs.size()=1 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GYgRSwCGBrgVWb1TDKn1956c4gjgrZf_0 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14022849284004606207', time=2024-09-05T03:44:23.558252+0000, chain.objs.size()=1 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xYDm5Ar6ArF9iSGtYfaeCXadEA1vwIe_0 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13453194264240011202', time=2024-09-05T03:44:24.314364+0000, chain.objs.size()=1 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.66R7aIc6rzShKr7utEiq9agRV8pD1Pb_0 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16681927243541122281', time=2024-09-05T03:44:24.721731+0000, chain.objs.size()=1 2024-09-05T02:16:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Xl2_au-w9v7BW2XNaO-W626oOf1SlOh_0 2024-09-05T02:16:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17748335331415158278', time=2024-09-05T03:44:25.340405+0000, chain.objs.size()=1 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tuFwEJZM-WWqchPne0OTWFtYFlMphdW_0 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2444584508315017293', time=2024-09-05T03:44:26.473964+0000, chain.objs.size()=1 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HX12XvWXRX03xcdNU0cr_KcbgM7MBCo_0 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.497742041460641942', time=2024-09-05T03:44:28.061085+0000, chain.objs.size()=1 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.R6vm5a8y_pqL_4Dc57Lp-nMnOE90Ipv_0 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9744243450623457865', time=2024-09-05T03:44:28.238489+0000, chain.objs.size()=1 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FVtdh_-Ga9TMEJKFaFeef7qCPSyogYG_0 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17044495987827129878', time=2024-09-05T03:44:28.990035+0000, chain.objs.size()=1 2024-09-05T02:16:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YNNzUWLbQnCw3VLT24pIz3afqb5g8o0_0 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7286169242117043625', time=2024-09-05T03:44:29.207800+0000, chain.objs.size()=1 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xjLkM_bOrVhN9jrT1BqcAIhWOkWfYyg_0 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16142085543067267531', time=2024-09-05T03:44:29.639837+0000, chain.objs.size()=1 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nGe7MzPwdbL0jKamHWnifX57-XhwCJ-_0 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16625988524667817581', time=2024-09-05T03:44:30.339078+0000, chain.objs.size()=1 2024-09-05T02:16:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6OokZi1EDMrprcBM2KWnmIKv7EUrmhs_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3748590321880663527', time=2024-09-05T03:44:32.261820+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fr-n3kKj7hAlZKtNPHXOJu-v5r6gpmu_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9626444026972277779', time=2024-09-05T03:44:33.195238+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hKynH1FNYxJd3HLUYobGC7AIWfa0aRf_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3264590412847167322', time=2024-09-05T03:44:33.357639+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JfxyM5gmqVtj9EJdCaRl6lxYT_PX6Yg_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7928707379957769412', time=2024-09-05T03:44:35.910393+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.g2dxXJS5XNjxmGmktlSHSRpwpagKtJs_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14144577089432185870', time=2024-09-05T03:44:35.915249+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OriCyfitVWQjZ8ZN9HpdOwzqPTgVNYf_0 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11073576948958345841', time=2024-09-05T03:44:37.574276+0000, chain.objs.size()=1 2024-09-05T02:16:21.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jMjm8HnTtO759PrI-99kYEbql814P4J_0 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3191976647162854517', time=2024-09-05T03:44:40.738009+0000, chain.objs.size()=1 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.M28z5fRokPHPPJ-zXuLai2AS_Yqe6p0_0 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1831154444173714783', time=2024-09-05T03:44:41.146430+0000, chain.objs.size()=1 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.edWXyfy_z6-EZ9n-krJ5bJ_-x5Kh0_b_0 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14962167865562230426', time=2024-09-05T03:44:43.864073+0000, chain.objs.size()=1 2024-09-05T02:16:21.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Bql4imHF0JtbQssxZVUVRA_2VA8Hnbx_0 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3736835490667842538', time=2024-09-05T03:44:44.714847+0000, chain.objs.size()=1 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UpuD5MSylBVqV0Y-TJ5ZbUuuIlxzfRn_0 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12126884062140534199', time=2024-09-05T03:44:45.622689+0000, chain.objs.size()=1 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.j2AruC0bwWYmmqHQsfgtl89KQ4Xm5QK_0 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15016808884271710444', time=2024-09-05T03:44:46.205315+0000, chain.objs.size()=1 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NhelgsQCZHavfRZzNtP9uCDEm9Yz61j_0 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2349921152878155328', time=2024-09-05T03:44:48.193607+0000, chain.objs.size()=1 2024-09-05T02:16:21.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yC9o39hkcBAeNnXEzTVXpVZwDJZRZKy_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9494538405142154866', time=2024-09-05T03:44:48.356993+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SKvNZjKI0NhdKhWOMIAXkLxFvLEnxsF_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10736649003597662810', time=2024-09-05T03:44:48.379853+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wT41JQ-gPRkGVT3M_ph5c0A1jV5B3un_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15708755189960264134', time=2024-09-05T03:44:49.564261+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ejfq8mmdwAIiTgA9BgYt-LKe7blMhBN_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3350452914139513690', time=2024-09-05T03:44:50.003534+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.j4TuQn41scJEUde-Ny5tEsb1Eyar0wG_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11133290651503191875', time=2024-09-05T03:46:33.352383+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LM1WAZDI1n430Vp0F2xx-Y6MZlNdE-G_0 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.218487525036789240', time=2024-09-05T03:46:34.086800+0000, chain.objs.size()=1 2024-09-05T02:16:21.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DMImyDIGzlRLnHeFxk3-3iB2g2-pIXm_0 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7523855421204829285', time=2024-09-05T03:46:34.374468+0000, chain.objs.size()=1 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.pDuajoMho371Qa1qIgtQ19cc9Ori0cM_0 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17074736202290437449', time=2024-09-05T03:46:35.537829+0000, chain.objs.size()=1 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jZNe_WwbIcfnZpJWuyRhwIfzkYUiGCy_0 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7793930863556866771', time=2024-09-05T03:46:35.919056+0000, chain.objs.size()=1 2024-09-05T02:16:21.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ahgip23Ijh02pAt3VFEolU6FNU_xUSF_0 2024-09-05T02:16:21.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10820876739497566169', time=2024-09-05T03:46:38.687787+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5B3YOVKfL3aSe0Rus1zYxmHz-0i4--w_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10504382284570909959', time=2024-09-05T03:46:38.763970+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Q4oOyMgpX55eYUI1WypNkmgtzdvs5be_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13545893593072458033', time=2024-09-05T03:46:42.869550+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9512F_ndIG925I7oz_rP2WH03fGGx4M_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12844801151674037241', time=2024-09-05T03:46:44.418863+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nN_5Hfp8Zr4af8geLY8VXTursxU3D0u_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8280155071954697610', time=2024-09-05T03:46:44.638066+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aGp-ZB9CWdwkrFAcOsAPmhN4ext32gM_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13959194931013272607', time=2024-09-05T03:46:46.175967+0000, chain.objs.size()=1 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FUV9_oC7scI6B3aL3WwTB0VCD3HmwR-_0 2024-09-05T02:16:21.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17479682137810718115', time=2024-09-05T03:46:47.746434+0000, chain.objs.size()=1 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Wa_RvggggUPKxi6G6yBX-R7eVJOWxtn_0 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.841368526069771307', time=2024-09-05T03:46:48.385288+0000, chain.objs.size()=1 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IoI_pgV4I41bzmOmCyqI9PreQzfb22Q_0 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13588335866455442914', time=2024-09-05T03:46:50.510034+0000, chain.objs.size()=1 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wcXPRp4DzKYqMccYs_RbrDa-bnUAz3-_0 2024-09-05T02:16:21.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15725868661873771713', time=2024-09-05T03:46:51.643513+0000, chain.objs.size()=1 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.f4BTYvrMhoOyIksu3sY5y9jdloc5Cgz_0 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2599190062492424945', time=2024-09-05T03:46:52.570372+0000, chain.objs.size()=1 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dM7qQL8PxPTQD3SYvAI-_bzV5xsq0v0_0 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15462575522025333020', time=2024-09-05T03:46:53.217042+0000, chain.objs.size()=1 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AiErqxDQ0yjlY6iByu4qbd6PH0vfQcw_0 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5870939112265109752', time=2024-09-05T03:46:54.104492+0000, chain.objs.size()=1 2024-09-05T02:16:21.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b0QVC5II6Us5QdwZimJIVL2EmZa99tc_0 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3946478129210811063', time=2024-09-05T03:46:54.209354+0000, chain.objs.size()=1 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.brxmDfpMgRvGE7_tQGjvP7K5nUZJB7L_0 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17744160246934201708', time=2024-09-05T03:46:54.548948+0000, chain.objs.size()=1 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EEilks4yAQSnlnVjFNZStLCc2pLvVjh_0 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4017768568608393537', time=2024-09-05T03:46:56.425638+0000, chain.objs.size()=1 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.93vfUdSYo81lpTVPnWRgVI5xzaKsKwZ_0 2024-09-05T02:16:21.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17695311591001932490', time=2024-09-05T03:46:57.243139+0000, chain.objs.size()=1 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4anJvzE-4rB17TPf2sbfFmDTdxaLLiO_0 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10677477059582130510', time=2024-09-05T03:46:58.702159+0000, chain.objs.size()=1 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LuZ-NsFQtnCuvmsk3BGd4CJkXZ1oLTt_0 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12833218294444992945', time=2024-09-05T03:46:59.200913+0000, chain.objs.size()=1 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9VdSYqSIPZam_VG9QV3guVYPjJfZ09p_0 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10721536089418759542', time=2024-09-05T03:47:00.445812+0000, chain.objs.size()=1 2024-09-05T02:16:21.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7rXSUGcDy3hsfB2FunphRk8w6gDFTY6_0 2024-09-05T02:16:21.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10470789027325100106', time=2024-09-05T03:47:03.153233+0000, chain.objs.size()=1 2024-09-05T02:16:21.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.itzxt09-eU0tKYOnEjL2FoKUDNlHoQX_0 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2352288596032685130', time=2024-09-05T03:47:03.191813+0000, chain.objs.size()=1 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SVSTAaxsFK8SOCDgXhSway7VDZCbRvv_0 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14386888735385949878', time=2024-09-05T03:47:16.335444+0000, chain.objs.size()=1 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.332__shadow_.lVKRGjHLDuzXnhTyIF0SSQY8V8N-xxH_0 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15679177842314317232', time=2024-09-05T03:50:45.850435+0000, chain.objs.size()=1 2024-09-05T02:16:21.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.465__shadow_.P43TjqS5h2Ok1APmWcuIDxkZVSNRMq-_0 2024-09-05T02:16:21.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6786817191649197664', time=2024-09-05T03:51:29.347228+0000, chain.objs.size()=1 2024-09-05T02:16:21.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.493__shadow_.sPlOFpR2zEkCkQaEtdpWpNQ1rVVKNdD_0 2024-09-05T02:16:21.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16623780838366987355', time=2024-09-05T03:52:28.719301+0000, chain.objs.size()=1 2024-09-05T02:16:21.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.bCpcLNGB3vRBJnt6oJoY5sbVqlfP26O_0 2024-09-05T02:16:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48723 2024-09-05T02:16:21.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7284349791685642616', time=2024-09-05T03:52:28.720855+0000, chain.objs.size()=1 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.YhuYCwUJi-A8VHbdl_YYuxERqjtoqae_0 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15367789621622604257', time=2024-09-05T03:52:28.738058+0000, chain.objs.size()=2 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.eoNysRTQNOojKogo_c6p4JUDECOUcTr_0 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.517__shadow_.eoNysRTQNOojKogo_c6p4JUDECOUcTr_1 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17321514634154223988', time=2024-09-05T03:54:31.297715+0000, chain.objs.size()=2 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~nLYC240Y7gzuObdcBfPEP113VfVp1W2.1 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~nLYC240Y7gzuObdcBfPEP113VfVp1W2.2 2024-09-05T02:16:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11454792768246481361', time=2024-09-05T03:56:27.818907+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.551__shadow_.-Ll0szu8zmQZFks8JeQeo3lzQyAz6d3_0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7334054656048573352', time=2024-09-05T03:57:37.191116+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:PumyCSUcoMWFJHCz2wuCWn2Nhj0I20Q_.4u0mGAb5_PagjOc_LIoBmIR344P3JqZ_0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15081093979621145092', time=2024-09-05T03:58:08.517140+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.575__shadow:a2ZZ6YCHEsNIAtgwe4rvP.vaRQSjGpz_.wmNraSjF2ivWa6ovTFvns1fT1jDaZ1__0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1705096521912475574', time=2024-09-05T03:58:27.126239+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:Y0TtjzzMLecILADqXcuwaoY28wkcx6J_.xAJzxXVS7xRCNs1jRTMdXRd2Kd1Cvs9_0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5746618880798024936', time=2024-09-05T03:59:25.186524+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:ymhQYfzhcyKuTkv7jMH2.ZylUl4JBNU_.wpr4m9O_fEjNgn2H2SRv-T4ppS0KrVl_0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7490313856442406789', time=2024-09-05T03:59:42.287936+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.586__shadow:79nRw7o1UvW2rJZIHJiSskXY25CPFVE_.M18Cbjih4RwC-uARYBojf2Qa41Wbff9_0 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.794014285637822477', time=2024-09-05T03:59:45.953983+0000, chain.objs.size()=1 2024-09-05T02:16:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:sWiYCDWqyxw2.CI1m2mAroJMXylFPHa_.VXNT2F0kpIXR-wV8UXada15OMHM0uhU_0 2024-09-05T02:16:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5968988317848894480', time=2024-09-05T04:00:11.328562+0000, chain.objs.size()=1 2024-09-05T02:16:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.604__shadow_.CCDoKNmz0GvRgD_22Q5XIxtNH9mC1x__0 2024-09-05T02:16:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7079994842575894014', time=2024-09-05T04:03:56.734766+0000, chain.objs.size()=1 2024-09-05T02:16:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.619__shadow_.g1Yv_0-90EcxC83R7NNU9TsLL9eeKR2_0 2024-09-05T02:16:21.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ', time=2024-09-05T04:04:37.484227+0000, chain.objs.size()=6 2024-09-05T02:16:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.1 2024-09-05T02:16:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.2 2024-09-05T02:16:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.3 2024-09-05T02:16:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.4 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.5 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.624__multipart_multipart_enc.2~pV0q6qoyYW90sTChNLypx1zPBP06UnZ.6 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9869523893968142989', time=2024-09-05T04:08:50.597033+0000, chain.objs.size()=1 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.742__multipart_mymultipart3.2~ZTFPm_kFy-Xpcg8sk3aqLDZSTx1Cd1w.1 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13230515576386373781', time=2024-09-05T04:08:57.876541+0000, chain.objs.size()=1 2024-09-05T02:16:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.744__shadow_.9N1JiLk8quoKsRMsbpM-GypfrzmQ3aF_0 2024-09-05T02:16:21.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.484+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.488+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-05T02:16:21.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.488+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.488+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43536' 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10404229252250703444', time=2024-09-05T03:32:55.509957+0000, chain.objs.size()=2 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.F2orLduGHnbqfN-UzJWHZtncMHPceUn_0 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.F2orLduGHnbqfN-UzJWHZtncMHPceUn_1 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10838115221707443784', time=2024-09-05T03:34:26.311182+0000, chain.objs.size()=1 2024-09-05T02:16:21.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.200__shadow_.biFERBtse5fOlgvszeZlyrz3QaYDAri_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14524271335929238752', time=2024-09-05T03:38:02.320646+0000, chain.objs.size()=1 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.250__shadow_.LPHHRsH9aMVYEeT8A7syNalYbPyIS3k_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8521948141646538019', time=2024-09-05T03:38:09.782261+0000, chain.objs.size()=1 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.254__shadow_.G5_e2-5PeyBEjm6BSTBITzDhg8-ZxR-_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17782208332807511788', time=2024-09-05T03:38:17.130705+0000, chain.objs.size()=1 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.258__shadow_.ABivTcJt4RS5h5le6B7BJD1JaHCaWlN_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14475091269137043956', time=2024-09-05T03:38:18.904667+0000, chain.objs.size()=1 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.259__shadow_.BgxjXiXiL1ngQajkcV5OzlwvpVTDG1X_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8122754206632454018', time=2024-09-05T03:40:05.709974+0000, chain.objs.size()=1 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fs8i2bEaul3lAz5yf2hbUSblry3gcng_0 2024-09-05T02:16:21.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6683456991957260251', time=2024-09-05T03:40:05.830583+0000, chain.objs.size()=1 2024-09-05T02:16:21.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.x8xUyKu3r2N8CVMQim-URH1AQ4rVI5V_0 2024-09-05T02:16:21.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6771079560998481272', time=2024-09-05T03:40:06.023419+0000, chain.objs.size()=1 2024-09-05T02:16:21.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Vg-pcHAAonpfrxnZHPsaTXK47DlOtMI_0 2024-09-05T02:16:21.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10076698448895335514', time=2024-09-05T03:40:06.676646+0000, chain.objs.size()=1 2024-09-05T02:16:21.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.T2jHm7DAuub4nEASpzHMdCaedIl6LRC_0 2024-09-05T02:16:21.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3901599383418718342', time=2024-09-05T03:40:08.812022+0000, chain.objs.size()=1 2024-09-05T02:16:21.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1sCyAE5n7jJFfkqc241EwtgtlTs_41E_0 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7594910958412844001', time=2024-09-05T03:40:10.117805+0000, chain.objs.size()=1 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tMEZonS6wNOU8Bzl73fOAQqq43UXezu_0 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.811999511737787647', time=2024-09-05T03:40:10.623715+0000, chain.objs.size()=1 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Jj6BansA9hKeDM--TbKPm5sdr-LPvRB_0 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11027330593272681476', time=2024-09-05T03:40:12.114975+0000, chain.objs.size()=1 2024-09-05T02:16:21.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eb8PZidKOnTtUN_-x2pDPYA-8bVWEhS_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5150916604697366056', time=2024-09-05T03:40:12.116781+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0R5Nc_JO18zcwB5ubch6Xa6CzK1jrLY_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.307996535786059411', time=2024-09-05T03:40:14.761748+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.z0wYFLfqPekaZK4z0UdUNm1V92xG5ay_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8382002905190011202', time=2024-09-05T03:40:15.005289+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cT1WbLp8gJJ22lzs-rXUS8ZWAVTGtWH_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13443851793301211769', time=2024-09-05T03:40:15.189319+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aI1vigVa3j5gsqGP3vGmKDhM5SAEwdB_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7618726283167963281', time=2024-09-05T03:40:16.110624+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hheeDhepf4Wa20ap0RJSHRF37cf6xYH_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16975751332906730656', time=2024-09-05T03:40:16.510224+0000, chain.objs.size()=1 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ugSMUOXEMAR8_V7hc1g8sX7cEW_Z_kq_0 2024-09-05T02:16:21.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9535468378641046775', time=2024-09-05T03:40:18.869568+0000, chain.objs.size()=1 2024-09-05T02:16:21.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7ULTgo8IGZuP2LyDozh1iboYB5npjM2_0 2024-09-05T02:16:21.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9362203525888932724', time=2024-09-05T03:40:19.094055+0000, chain.objs.size()=1 2024-09-05T02:16:21.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HiW9ZArF0U69F54Rieun9i0NFsFeU_v_0 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10973349230867384892', time=2024-09-05T03:40:21.770569+0000, chain.objs.size()=1 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qR8EG8gL2eckyD-ptXsbGj5mLq8KEui_0 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.97950581625480703', time=2024-09-05T03:40:22.106833+0000, chain.objs.size()=1 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mduE6fmtyEl2dgZPqFKT6WZl-bYcHoI_0 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6250545190983564266', time=2024-09-05T03:40:27.875923+0000, chain.objs.size()=1 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.z6fByOV__7za_WUTkDUZDy7kx5I43Ok_0 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4730928991883225844', time=2024-09-05T03:40:28.024940+0000, chain.objs.size()=1 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tkLExaW3fCEoh8HG1i7EsX-CFmQAlmN_0 2024-09-05T02:16:21.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5362117267704072829', time=2024-09-05T03:40:28.678047+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TUA2qQCcknt9Lfb6JGhjr4G2tyWjlHu_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13464027907953446993', time=2024-09-05T03:40:28.961169+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1-TdUzUlJhIjq2BbTGNba1JUJK_ACcl_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17412143978709887859', time=2024-09-05T03:40:31.545840+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HZJU0Ck4VajtFy0qFGyhxgVtvRxBBLw_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7744867335171754926', time=2024-09-05T03:40:31.735260+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OLt8z9TU3NlJTvGka4MXa3OSeAAAlGr_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13768993107262382593', time=2024-09-05T03:40:31.989748+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1gvERxsUxY8szmkscgRGsW_7erbto4k_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15979618389166023763', time=2024-09-05T03:40:34.030451+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8LyJMrmsIa8WojsBmDIxEGLt3D8_ztD_0 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16514443109818762864', time=2024-09-05T03:40:34.032710+0000, chain.objs.size()=1 2024-09-05T02:16:21.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mcMvXg4ZjOEjsO30GkOeQvy06mbFd0j_0 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13229770013621568988', time=2024-09-05T03:40:34.937763+0000, chain.objs.size()=1 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LEaZb2k0HNkLMxrSRUeWMqsXhrK8-3N_0 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12989901456525791707', time=2024-09-05T03:40:35.561077+0000, chain.objs.size()=1 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UVDWBv35MQ8p3rQX0XZGn9OEBolk2ds_0 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7541978735878923261', time=2024-09-05T03:41:14.341608+0000, chain.objs.size()=1 2024-09-05T02:16:21.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.283__shadow_.dd9dZqrFeXrk5De1DDar0ajd8yHoQgk_0 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11033608282562302076', time=2024-09-05T03:41:20.188613+0000, chain.objs.size()=1 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.286__shadow_.JDi-5RceJ8V8qQrAxVZyIv95gAOQ8I5_0 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4164156622106890289', time=2024-09-05T03:41:34.888160+0000, chain.objs.size()=1 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.89adHwy85U1rV_Biy1pW2A1DqVUsNr8_0 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1485795008303930796', time=2024-09-05T03:41:55.523267+0000, chain.objs.size()=1 2024-09-05T02:16:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.301__shadow_.vJpBhZuvA1OSOX_JePRgbYXMtY0Ze0u_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3308126038840871217', time=2024-09-05T03:44:21.762521+0000, chain.objs.size()=1 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.3QjVKVZ4ZdPXeTZW9_IBdAdpO_Myci5_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3263808323247140646', time=2024-09-05T03:44:21.835758+0000, chain.objs.size()=1 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q0ZpanhRZzBe_dmgjQV4AH8hlUeC4oW_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5258419017080809162', time=2024-09-05T03:44:21.984597+0000, chain.objs.size()=1 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OTh1N86TdJolMfGxU_URzMxhPjgI__3_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17668239910377189541', time=2024-09-05T03:44:22.205244+0000, chain.objs.size()=1 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.70VfU4cKrMhezJXq_sNgfD8CkYCtrem_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14277808255917007063', time=2024-09-05T03:44:24.021776+0000, chain.objs.size()=1 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7x5dHQI6Q6idRn8VwUfYc6-5Jv6x-vg_0 2024-09-05T02:16:21.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13542047900801001221', time=2024-09-05T03:44:25.144448+0000, chain.objs.size()=1 2024-09-05T02:16:21.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0pqnb5lMoJ2GArIR8pqGXY8e85WkCiM_0 2024-09-05T02:16:21.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15030076393328720939', time=2024-09-05T03:44:25.330275+0000, chain.objs.size()=1 2024-09-05T02:16:21.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WdUipPEH_ymgbqwhI-KpvP_CImSkt3P_0 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1134411260280507932', time=2024-09-05T03:44:29.069762+0000, chain.objs.size()=1 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gCRmDlfhm_gV-l4ZoWw2n97HWjjoJtS_0 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9092027855395736015', time=2024-09-05T03:44:30.099538+0000, chain.objs.size()=1 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._0HEfNoVSl4TP1HtKYMuHsjDgu9uUkz_0 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1366403507274329241', time=2024-09-05T03:44:30.559293+0000, chain.objs.size()=1 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iRtQBc2etznAnaewrbd0hLXGByBqX0U_0 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16654703678799340454', time=2024-09-05T03:44:32.280441+0000, chain.objs.size()=1 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.o6WSBbXUt8pbrkVJWVYDiYf8ay8xE_j_0 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17141794949095122273', time=2024-09-05T03:44:33.021601+0000, chain.objs.size()=1 2024-09-05T02:16:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-y1nTlEAG9XOdPmt69ZsArI7j1LjNRC_0 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13869236319569128744', time=2024-09-05T03:44:34.739746+0000, chain.objs.size()=1 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tgdKp1ETcNMJTI8Wl-JhtxCYdrxpBXk_0 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8331981690387831777', time=2024-09-05T03:44:34.851410+0000, chain.objs.size()=1 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HA8grmnp9mGpING4lm5A_GsZscL4XZN_0 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17334804717735979613', time=2024-09-05T03:44:36.194151+0000, chain.objs.size()=1 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BAlqG4QoInj_r9gVCCKG3SOL7HLA3Q1_0 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1471739304303122552', time=2024-09-05T03:44:36.677537+0000, chain.objs.size()=1 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CkFbl6cF5Y_vk-QxBoYvKnWGuUm1C-G_0 2024-09-05T02:16:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1115250294862461662', time=2024-09-05T03:44:38.986427+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sdXrS0YGQayXQ99oFxunrx7XxOnIZjB_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3753863835663393197', time=2024-09-05T03:44:39.888164+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.T9W9tyAdx3n2VKLDAhNgxNOv7n9i2OY_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.172341032417190281', time=2024-09-05T03:44:41.283076+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.E9f1q6_U0jjixyx9xgZ8RG7CPzt25tB_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16890048251310512743', time=2024-09-05T03:44:42.582271+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sJ8eFy-IDuqYnozhmVPuIoJmhzDxIru_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7657485758631386371', time=2024-09-05T03:44:45.141110+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Oq9sCf9M_9XPNLHj06SPH8eCz-71TbA_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10235287189060720109', time=2024-09-05T03:44:45.728580+0000, chain.objs.size()=1 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OG5RvOnWvAwwEBI6kYLC9yHTDVsx-Gr_0 2024-09-05T02:16:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13331062206884640654', time=2024-09-05T03:44:46.586016+0000, chain.objs.size()=1 2024-09-05T02:16:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.o8Zd9KRS5pvOKoZlufRwQ0XMBhPHUM0_0 2024-09-05T02:16:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15416565977657122324', time=2024-09-05T03:44:46.983940+0000, chain.objs.size()=1 2024-09-05T02:16:21.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7yi2nuwwSdCxQfoLkdCnhTMrT8zUNU3_0 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11992163842464006953', time=2024-09-05T03:44:48.955448+0000, chain.objs.size()=1 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rsYnpz4UjR7u4h07m_0SoOYWybJ-tk-_0 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1905635802954583951', time=2024-09-05T03:46:33.412731+0000, chain.objs.size()=1 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rI6jreSVMDVfrr8bXQCP8Q7SOTY94Mk_0 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16384330650866995787', time=2024-09-05T03:46:35.542446+0000, chain.objs.size()=1 2024-09-05T02:16:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MqeEpTrooQ1O13JsXULiU6hrAN2je2w_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7292062208847992922', time=2024-09-05T03:46:35.640916+0000, chain.objs.size()=1 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._C8GMsSQSlcR3NUWWQRWNpHD6XmmlXm_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18145108732768496605', time=2024-09-05T03:46:36.668783+0000, chain.objs.size()=1 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9DYrjZtMUTnCOPSlZPzzCf_nhWkoVYJ_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8380444470553686431', time=2024-09-05T03:46:38.162994+0000, chain.objs.size()=1 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.katzUfQCJp-B6qPBU8I8LJNegQutKqe_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9940401547271134356', time=2024-09-05T03:46:38.281297+0000, chain.objs.size()=1 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZwEbwZj3skUUbgXlEFT2NHbbabvNBfc_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12123986454811636410', time=2024-09-05T03:46:38.642105+0000, chain.objs.size()=1 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Rw_nHEPIrZyc9_ncrM3DOzU8pZ5C6DJ_0 2024-09-05T02:16:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15957604374905979001', time=2024-09-05T03:46:38.794230+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oCkpaluPbLCezg8MMgeRQmnDQhffWIX_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7211880638681851637', time=2024-09-05T03:46:39.649834+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wgmOHUd9mzgUPNxmamjaz2P4B7Dcw-t_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16779578455013436166', time=2024-09-05T03:46:39.976326+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qh39kZt22dfaA9N4C4LWt46oTETJN1Q_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5792109838166792962', time=2024-09-05T03:46:40.518725+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XstR6qCA4bWKYWsFwwVi-shjVy5a1f6_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7082685329928601312', time=2024-09-05T03:46:40.778235+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W8y3BndSDr1l-pS0y8wAhmciGE04Lcr_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10970719562875023813', time=2024-09-05T03:46:40.815652+0000, chain.objs.size()=1 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1fKmgurNyI1RrMpNvrMdWH3yQSw4eSQ_0 2024-09-05T02:16:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16006906956599034253', time=2024-09-05T03:46:42.456890+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SJ4ZGPhCZxoAeJeB8urf5KI2dH_Fa7n_0 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8734211866770074241', time=2024-09-05T03:46:42.458783+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lYMrWPF56WbkzNYWzzTwEgPDdmWEuTp_0 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8473170525029254041', time=2024-09-05T03:46:46.069557+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bH2wkTZ8XbYNFjklhmttjcud1WWXes__0 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14668380678844406403', time=2024-09-05T03:46:46.539911+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.VNqM1re4j0uzO54_M266OOoGgPGYuQJ_0 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9343616887992087192', time=2024-09-05T03:46:46.926440+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PkKdUex2Sirfho3TV7UUomn5vtbIDv0_0 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9565159135785916607', time=2024-09-05T03:46:47.095188+0000, chain.objs.size()=1 2024-09-05T02:16:21.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yJD11YudikJwNt6c2lJfGaALtwjL_AM_0 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17166795305402799590', time=2024-09-05T03:46:47.365114+0000, chain.objs.size()=1 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.apE3hBqcNADE7fyqXsT4uvOXIPFvvyQ_0 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10729257549705534237', time=2024-09-05T03:46:47.958922+0000, chain.objs.size()=1 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ey6rT2T4_1Vy7Qx7xK7S5BbDUY9IJWM_0 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1602073174846611641', time=2024-09-05T03:46:50.166033+0000, chain.objs.size()=1 2024-09-05T02:16:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IPL4yrpMlO8X4H3eCINx5Tg8nWiFpRV_0 2024-09-05T02:16:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16415525633294272117', time=2024-09-05T03:46:52.068437+0000, chain.objs.size()=1 2024-09-05T02:16:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tA_3LQCArxMfSZ9wl8kQo9fFhzu5Tn2_0 2024-09-05T02:16:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12539968702253121095', time=2024-09-05T03:46:53.015916+0000, chain.objs.size()=1 2024-09-05T02:16:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.woOk1T0AUUaCh3-eDQJeoUapbq1AT3I_0 2024-09-05T02:16:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8706857491333182019', time=2024-09-05T03:46:53.069008+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._uZcCgXuhStCsk_Yd1EAYq88Na9zeUg_0 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16233571761778750156', time=2024-09-05T03:46:54.141201+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lFdy3IC7Gs-tXWcNkKZSeZUHYYSytaS_0 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5040804803168305938', time=2024-09-05T03:46:55.464488+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Y1TZP3z8ewdIll7VwcPM3sK3ylhbKrI_0 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4337547984110673764', time=2024-09-05T03:46:56.567953+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3KG1dZlwlVTUv71MJiZOvULaRMhfkhB_0 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14469643470660033359', time=2024-09-05T03:46:57.014784+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gYG7zUhbS6w3X5cloBuPNI0Tj7FAmA5_0 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3826459006141283475', time=2024-09-05T03:46:57.095779+0000, chain.objs.size()=1 2024-09-05T02:16:21.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NidTtXTP54vSLTCN8158gpac73ps1y4_0 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12159878347149961492', time=2024-09-05T03:46:58.181620+0000, chain.objs.size()=1 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.a7HO-41xBZx0BWCvxUdlDJHuCxOjNst_0 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16613417361960246831', time=2024-09-05T03:46:58.574901+0000, chain.objs.size()=1 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EIqH1BmitEnIiFtHsDO11K0msSaaUA1_0 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13147231600363117103', time=2024-09-05T03:46:58.844914+0000, chain.objs.size()=1 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1_IyxogaX05337qRkXk76raX56DoDn2_0 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16406383186990183269', time=2024-09-05T03:47:00.795158+0000, chain.objs.size()=1 2024-09-05T02:16:21.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8Xwz0keoMeiUB9T61-GSBudr7QKr1NO_0 2024-09-05T02:16:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1667953691232673079', time=2024-09-05T03:47:03.165784+0000, chain.objs.size()=1 2024-09-05T02:16:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ckWK2em2GmOaKNmx9hd684gJOCWinoA_0 2024-09-05T02:16:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1289250393787204294', time=2024-09-05T03:48:19.063122+0000, chain.objs.size()=1 2024-09-05T02:16:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.377__shadow_.vwNpWxtdiKe_ekuMrJSjzwrdJIQstdw_0 2024-09-05T02:16:21.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.524+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43536 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4410018822902337154', time=2024-09-05T03:50:23.297025+0000, chain.objs.size()=1 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.455__shadow_.kTAbqxzhnTjve3LSOMQMB66JtlvkhGR_0 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8130244413332930602', time=2024-09-05T03:50:32.135956+0000, chain.objs.size()=1 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.459__shadow_.mcFIhK_34c5whxrYipgl2zuPgmWF4r5_0 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4192816024979136023', time=2024-09-05T03:50:45.271044+0000, chain.objs.size()=1 2024-09-05T02:16:21.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.465__shadow_.etkD41aTvekFMhd-0NMPfq49nZQyJxo_0 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7707344781314335712', time=2024-09-05T03:51:27.124724+0000, chain.objs.size()=1 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.491__shadow_.-yo8Jzf7d60Hn_xatZNFV320yQXKIv1_0 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7111413667565405152', time=2024-09-05T03:53:03.066680+0000, chain.objs.size()=3 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~uzviL-02WxQaXTyw4FF1M19GpFcTW-U.1 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~uzviL-02WxQaXTyw4FF1M19GpFcTW-U.2 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~uzviL-02WxQaXTyw4FF1M19GpFcTW-U.3 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16403351708778012754', time=2024-09-05T03:54:38.602074+0000, chain.objs.size()=2 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~Jlh15cWgmfAZm_n9nubbgD1Shg8iP38.1 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~Jlh15cWgmfAZm_n9nubbgD1Shg8iP38.2 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3003688703733318441', time=2024-09-05T03:55:53.707549+0000, chain.objs.size()=1 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.537__shadow_.pZBWAWd7pjUalouBnieXbbr5fzVezdo_0 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5541715919637643464', time=2024-09-05T03:56:46.987860+0000, chain.objs.size()=1 2024-09-05T02:16:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.556__shadow_.iFFEA9HK0NtR1SigV2l02B0tfCHB59z_0 2024-09-05T02:16:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9131361089292706186', time=2024-09-05T03:56:57.672121+0000, chain.objs.size()=1 2024-09-05T02:16:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.558__shadow_.UZujZ_GZVdHvhJwXlrajJjFWOW40r7X_0 2024-09-05T02:16:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10338967980505300886', time=2024-09-05T03:57:45.287593+0000, chain.objs.size()=1 2024-09-05T02:16:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:qcsENGip-u46enKlohpokNiBI-SeJnZ_.BpVfb9NUFn3rJ-3vB8r0k7YTNOJ3dYw_0 2024-09-05T02:16:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.498420496983807744', time=2024-09-05T03:58:16.449200+0000, chain.objs.size()=1 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:CUhbGhnLksZ4zP.Ons6rNiYkYOHP93M_.PgSRPRx_p2KsrYBGKhWUl-hGH40pYNL_0 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13488408596562876189', time=2024-09-05T03:58:30.703232+0000, chain.objs.size()=1 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:2r71VnB325VPKtpuNfNBRL3iX6KuBqP_.lBE101k21CGLyE7hQSG2VlzKk4SFagd_0 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5192094732611121186', time=2024-09-05T03:58:34.914892+0000, chain.objs.size()=1 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:nBnjfEcADvz.wTWIWQwVdEpkip-bAGQ_.hsKfARXeM1D-86EeHWcIqgJJyrxbcFI_0 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12869313009611135677', time=2024-09-05T03:59:29.682596+0000, chain.objs.size()=1 2024-09-05T02:16:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:wFaiSQf83oY.r4gERgNWcH.cOFcLQXS_.yakIQvLeUHVGHB6aX6MM9h25fywvEdx_0 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8375176407127089669', time=2024-09-05T03:59:32.205812+0000, chain.objs.size()=1 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.582__shadow:m3D-hcgQ91Ac.ecgnsKoNGnvwUxx66X_.16PawTPCeQbBsnyly24eEsxDrd1r46E_0 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.313376413118742524', time=2024-09-05T03:59:45.857110+0000, chain.objs.size()=1 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:uYuvrWtNVI8mSMeHlvr1pNJeT.hKInv_.d3OT6FQH7Oc22-TTOmgQekcpqa013JE_0 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10130387160676382717', time=2024-09-05T04:00:09.008122+0000, chain.objs.size()=1 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.603__shadow_.ayBS71rfnK92U7MBC32WA3LJX5P318Y_0 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9231304443963682688', time=2024-09-05T04:05:11.110945+0000, chain.objs.size()=1 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.641__shadow_.Ym-aE4HwtUjbMOA8QpF6uxB16X6479r_0 2024-09-05T02:16:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12857262123985847302', time=2024-09-05T04:06:23.355529+0000, chain.objs.size()=1 2024-09-05T02:16:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.666__shadow_.lI_cUGq5kPSRcI5TJghysCOgfxs-lXr_0 2024-09-05T02:16:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.249340363396859092', time=2024-09-05T04:08:43.760536+0000, chain.objs.size()=1 2024-09-05T02:16:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.739__shadow_.pTHWjxAIf6WsU98S9COTX8GD9XO_6es_0 2024-09-05T02:16:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lmyw3-0CGjxbJGU4_Old_oRxOFRK5-a', time=2024-09-05T04:08:50.870152+0000, chain.objs.size()=1 2024-09-05T02:16:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.742__multipart_mymultipart2.2~lmyw3-0CGjxbJGU4_Old_oRxOFRK5-a.1 2024-09-05T02:16:21.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.540+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-05T02:16:21.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49653' 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15147087518956047920', time=2024-09-05T03:37:38.965278+0000, chain.objs.size()=1 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.238__shadow_.GVW3GBCoT7YhFYy-kXWN5kMvDGyGCgS_0 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16473383221132466267', time=2024-09-05T03:37:48.397147+0000, chain.objs.size()=1 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.243__shadow_.xnP7Fa39fEg7NwALVO1lPnxRy9gxMfu_0 2024-09-05T02:16:21.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6268440149049471228', time=2024-09-05T03:38:07.941614+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.253__shadow_.vvEeW9Dl_CfQq86EmEFhUWvE_5Evkz9_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.914386773464423468', time=2024-09-05T03:40:05.152366+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OqYrJ1SaROA-D-3bUK_5vdC2uCDNH2v_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4817799632968299380', time=2024-09-05T03:40:11.018386+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VKcNoP-mqKd24YoVuRDyYxLo6s3LOuA_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4195845435148353493', time=2024-09-05T03:40:12.058934+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oIrXSk8CipxmgE0V7PQ2rD9cXAq9HUW_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9348981707051577063', time=2024-09-05T03:40:13.685248+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iFm8_mi4cAF3BsphaJdOp5c3XvoIrGt_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13470886566983152654', time=2024-09-05T03:40:15.003995+0000, chain.objs.size()=1 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.DHdEJWI33aD4dgxYcyMGiXcrs5Ghv8H_0 2024-09-05T02:16:21.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15631416053541382162', time=2024-09-05T03:40:17.512763+0000, chain.objs.size()=1 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.52HyKVyJxABtahm5T3i1dvBEdH3xzbx_0 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14249361934482209348', time=2024-09-05T03:40:17.645183+0000, chain.objs.size()=1 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GTKoItbOh3XfB352MrCsu6911zS4VQu_0 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7072981121128479035', time=2024-09-05T03:40:18.167354+0000, chain.objs.size()=1 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.c6Zm-gNZbTFzn2BM4gLEC1875OLiwsI_0 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.508049964178163809', time=2024-09-05T03:40:18.477877+0000, chain.objs.size()=1 2024-09-05T02:16:21.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.544+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bSnQhK3rBE2B5iJAXpCQqBoWRm6ofsS_0 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4342315860321725966', time=2024-09-05T03:40:19.036090+0000, chain.objs.size()=1 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ltA3_CbVs1_8r6EpB_MVjjwQf3HTUpU_0 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5654804715144847422', time=2024-09-05T03:40:19.421637+0000, chain.objs.size()=1 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.alF0s2gPCD5kFr6ntc1Fi4-5KqTEVHI_0 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4333278514837307391', time=2024-09-05T03:40:22.499444+0000, chain.objs.size()=1 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HhaGhs9aIytTCUR6NdQ5T0jjUQaq7H2_0 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4820052824803728676', time=2024-09-05T03:40:24.006966+0000, chain.objs.size()=1 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EIMUBoyBk45lMOvWZoDC36blyTM60SF_0 2024-09-05T02:16:21.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4542583345116500851', time=2024-09-05T03:40:25.856912+0000, chain.objs.size()=1 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AtDzNjLTzUxJZDtKfwWl7Nmwq_g85av_0 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14312064970542818966', time=2024-09-05T03:40:27.302196+0000, chain.objs.size()=1 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5PNnLBTr1JHsA-08yrx-r7H5VyLbuo4_0 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9624559279642102852', time=2024-09-05T03:40:27.554227+0000, chain.objs.size()=1 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XYn5xIlHRGRlHEyVEg62Z9T3YNblxt9_0 2024-09-05T02:16:21.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10667360653102524442', time=2024-09-05T03:40:27.714195+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CLQz8Uo_DpN9tPlTQwLwGtdVzeeTJXA_0 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18243739142169932577', time=2024-09-05T03:40:28.628561+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.J4MS7Zirao_fNkV_sup0iVtwVcMKr37_0 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5278968199806774064', time=2024-09-05T03:40:28.793554+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.N8ENLYo91ZlS1l5DFnRjib2ZUBEHRSV_0 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15949804885190261357', time=2024-09-05T03:40:30.809541+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.l9zmc6o1Dj-pnrTRQYzmbNLpxxpc18-_0 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12843713867899615211', time=2024-09-05T03:40:32.407823+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SmtUKbqBCE6F3QAu6w6YxvBH3veD4Rk_0 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14906699610350700313', time=2024-09-05T03:40:32.555154+0000, chain.objs.size()=1 2024-09-05T02:16:21.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._LCUpJ-UBP8Lp2zNYPnI2atGUZVUZbs_0 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13411176908181676425', time=2024-09-05T03:40:32.991066+0000, chain.objs.size()=1 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3RKAGCH0Cq44k2VzeExNl7d1sZWRF-Y_0 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8507889892857692970', time=2024-09-05T03:40:33.058026+0000, chain.objs.size()=1 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YlvRR91TdXZa0QWx1bCDgaX8htMEY0m_0 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.395930013500381219', time=2024-09-05T03:40:33.801725+0000, chain.objs.size()=1 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.DPzITheaO9jMr12ImBV8TG6mb04BDeI_0 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5100659173435341637', time=2024-09-05T03:40:34.626208+0000, chain.objs.size()=1 2024-09-05T02:16:21.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zFPOkfbgtQc0wJuhWjkWujVFd93ufFA_0 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10571860824764164029', time=2024-09-05T03:40:36.577476+0000, chain.objs.size()=1 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.89kCNs30XG1VFVhncUasYsIf9t3sdok_0 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6791980472086157585', time=2024-09-05T03:41:51.830504+0000, chain.objs.size()=1 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.299__shadow_.fKd9EYKd8GbeW1s_u_Mudb3a5MSrPNR_0 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12537493162515772279', time=2024-09-05T03:42:35.426009+0000, chain.objs.size()=1 2024-09-05T02:16:21.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.322__shadow_.b-E-w3P6cszMNASh9Kgc5vqtSC1B484_0 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6769260084797074827', time=2024-09-05T03:44:20.951955+0000, chain.objs.size()=1 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QgOc6-420kLKyjs_oBfDgAOrW6QLjXH_0 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17269126394960086290', time=2024-09-05T03:44:24.128243+0000, chain.objs.size()=1 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TW5UfVwf45nAgSBDZxeOxplrgk3NJlJ_0 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15098240484386620717', time=2024-09-05T03:44:25.773885+0000, chain.objs.size()=1 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Pdfh1Ph3hdM-R-ej0DxMEQ2xyL6r4Vt_0 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3727884242771602445', time=2024-09-05T03:44:26.405355+0000, chain.objs.size()=1 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PrWEdys9uPacFia5bBoLIy30ldB3SQJ_0 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17318522569017884188', time=2024-09-05T03:44:28.850626+0000, chain.objs.size()=1 2024-09-05T02:16:21.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.T5-WS1tF1RaFS6GjhpYAwp2bgzi150X_0 2024-09-05T02:16:21.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10750385077926030634', time=2024-09-05T03:44:30.187671+0000, chain.objs.size()=1 2024-09-05T02:16:21.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.c1WPXoz3RrkOv-P5QRWht2KK7yWXq0g_0 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1171248832360884677', time=2024-09-05T03:44:30.239447+0000, chain.objs.size()=1 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NdKZE-kQbD3N3znJ0EamjrxT7L4oa5D_0 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7468220442648113258', time=2024-09-05T03:44:32.287063+0000, chain.objs.size()=1 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TBhaVj5aR-uLnszBAtGO9uKkoR_orjj_0 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9084528816025896242', time=2024-09-05T03:44:32.856433+0000, chain.objs.size()=1 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.A-TuBQm7pT5DFM_EUOgmK4z4QFxPFMt_0 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12238161898433128310', time=2024-09-05T03:44:32.983242+0000, chain.objs.size()=1 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8d6Uo8uIDprwH2m76aJkyd4AgiW3A2f_0 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13884313230902920661', time=2024-09-05T03:44:33.458584+0000, chain.objs.size()=1 2024-09-05T02:16:21.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZuqWv4YJZlTJ9gkvn5ZpsdGCGxvW6-n_0 2024-09-05T02:16:21.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8504248064951756707', time=2024-09-05T03:44:33.926763+0000, chain.objs.size()=1 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.eMyWfvc0ThGa1s4lNB6EBMVw5rKUHRF_0 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6195910954080514822', time=2024-09-05T03:44:34.621182+0000, chain.objs.size()=1 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kgN3SZzJMTawJcAep0UYj-bzn2pk2tO_0 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7410391573333477077', time=2024-09-05T03:44:37.283894+0000, chain.objs.size()=1 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Xa5RwUe25tep-nIYMp4he7VJcID9ZOT_0 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10352782951852828283', time=2024-09-05T03:44:39.887848+0000, chain.objs.size()=1 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kn8ZPNB6eIXD8R5K7VsTdo8tYLwp36G_0 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15780418731791566728', time=2024-09-05T03:44:41.837556+0000, chain.objs.size()=1 2024-09-05T02:16:21.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LQmSiufAITzWIFm0tep5HCvpfMC7Mfx_0 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6452835335587622544', time=2024-09-05T03:44:42.932458+0000, chain.objs.size()=1 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-Ec4VQGp5si4K6m23ip3sOkgdAK4zzZ_0 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15161962921732316229', time=2024-09-05T03:44:44.623327+0000, chain.objs.size()=1 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5pqNPHyhsC_3x3mwRCngknFaeOIGkOR_0 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4628501958448200463', time=2024-09-05T03:44:44.742662+0000, chain.objs.size()=1 2024-09-05T02:16:21.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1CyrprKTbDTc-MBrAS-gHwIVdCERvVq_0 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3904401920902561821', time=2024-09-05T03:44:44.786089+0000, chain.objs.size()=1 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.c5c7WIa1yP8OGqEyvBfg2GigsUu6ViQ_0 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14376479177914488880', time=2024-09-05T03:44:46.785958+0000, chain.objs.size()=1 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GXU01LjZU0gctAU8agmCgFaLRK1YdRy_0 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12643430674139026631', time=2024-09-05T03:44:48.223546+0000, chain.objs.size()=1 2024-09-05T02:16:21.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MbciSs2DG2kw88AIASScWsxMnF0tWv8_0 2024-09-05T02:16:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16454665686640475414', time=2024-09-05T03:44:48.787241+0000, chain.objs.size()=1 2024-09-05T02:16:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AzqY7sH3bRZ8mNG98n_UsSp1O2fC3ns_0 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9239528786579053652', time=2024-09-05T03:44:49.159972+0000, chain.objs.size()=1 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CtKh-96tou1ktJa_l2my3cxnzDY9YcA_0 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9233796714877060827', time=2024-09-05T03:44:49.851857+0000, chain.objs.size()=1 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MqZQFegztK9XSgVZfDkarCroQ1t_fSw_0 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14650979686685231660', time=2024-09-05T03:44:50.104311+0000, chain.objs.size()=1 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rUpIAZ6B43mJmQHbdARHCddOv-KY3gA_0 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12098290158032104965', time=2024-09-05T03:46:33.659581+0000, chain.objs.size()=1 2024-09-05T02:16:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mp4GjL3CD9eqGyyUy8SYTaYmyIMkc6z_0 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5889727999607135177', time=2024-09-05T03:46:34.550655+0000, chain.objs.size()=1 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6KJ2BhAX_KqVf_K0myDd7N1h4fK_J7K_0 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5043872561253129435', time=2024-09-05T03:46:35.245167+0000, chain.objs.size()=1 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Bv9DOqbVYdsblyocpvO-yQoB31xKmEs_0 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10996139401183704691', time=2024-09-05T03:46:35.433484+0000, chain.objs.size()=1 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bzOa9hPi8PlpQ7-2d70w98lpMuQR1nL_0 2024-09-05T02:16:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10412290904526739228', time=2024-09-05T03:46:37.798313+0000, chain.objs.size()=1 2024-09-05T02:16:21.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.52gRzoXgHnuQlZct8Z1jfiXEYb4s7V-_0 2024-09-05T02:16:21.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2370402465999786812', time=2024-09-05T03:46:38.130828+0000, chain.objs.size()=1 2024-09-05T02:16:21.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lzcR-6ERTB8D5eSoXuLNeKr6PHhF78c_0 2024-09-05T02:16:21.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12507789479565659034', time=2024-09-05T03:46:38.770857+0000, chain.objs.size()=1 2024-09-05T02:16:21.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.399d9wgT0L3_-tjbH92fcXfaq-4pcMh_0 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3993229233402998966', time=2024-09-05T03:46:39.385156+0000, chain.objs.size()=1 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oStFCgpRbkxvczAPSIJOPJpPqBYs7Sd_0 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15652573777765748192', time=2024-09-05T03:46:40.747661+0000, chain.objs.size()=1 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fIXIi1RxNphJBWB4UDB00PNZ0QQenXR_0 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13899180056562379688', time=2024-09-05T03:46:43.871215+0000, chain.objs.size()=1 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aT1WBAFJ_CQTzQ_Q5TAsOfUkeB-MSnI_0 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4118911570719994387', time=2024-09-05T03:46:45.060259+0000, chain.objs.size()=1 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TLP0xn_9zRv603Nts_r0y_hlfu16ipU_0 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8497597642598477097', time=2024-09-05T03:46:46.751851+0000, chain.objs.size()=1 2024-09-05T02:16:21.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Qiu__w-22EmfBJQSP5-iams33KAB-oD_0 2024-09-05T02:16:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3973944475321322705', time=2024-09-05T03:46:47.379855+0000, chain.objs.size()=1 2024-09-05T02:16:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.B9mzKhuUx-QCcDErkSv9DdLsWMSAyva_0 2024-09-05T02:16:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13500592644396270994', time=2024-09-05T03:46:47.479435+0000, chain.objs.size()=1 2024-09-05T02:16:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PpS425F-Zlra7olLh3Q07F8bGPwD____0 2024-09-05T02:16:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11037167813955878473', time=2024-09-05T03:46:47.949247+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.YNc17s55G40O1avxBFf86cT7_z95x3W_0 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1833514933721794577', time=2024-09-05T03:46:48.344153+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LwQsFXwAUPlOf-_t3eXN94sNS6jyEvm_0 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16886616433916393515', time=2024-09-05T03:46:48.544329+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sLmIKJM8p_sE4OcLxUUtltU6NVLnM6w_0 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9542858423772878180', time=2024-09-05T03:46:50.652181+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V9k9Xnd6ElGW_9k5ddxnTJj125wtBLP_0 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16751254942687044162', time=2024-09-05T03:46:51.710970+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XmknZrUcJDGOK7zZGcpPXlhM0JGQISE_0 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.864492413661503206', time=2024-09-05T03:46:52.232338+0000, chain.objs.size()=1 2024-09-05T02:16:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2Yvownj3oOUfBY6k43D0ZwVHtpTTK1w_0 2024-09-05T02:16:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10079289352357036296', time=2024-09-05T03:46:53.151955+0000, chain.objs.size()=1 2024-09-05T02:16:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IBa5X-n2VjhYEvUyvk133YOQtKPy7bK_0 2024-09-05T02:16:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4907358145750511654', time=2024-09-05T03:46:54.197012+0000, chain.objs.size()=1 2024-09-05T02:16:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MT2gXNt2gT3SRLH-xRx6L21QLjcxv67_0 2024-09-05T02:16:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15523198233594478483', time=2024-09-05T03:46:54.198936+0000, chain.objs.size()=1 2024-09-05T02:16:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LqeNNW2Ru5p1R1xq9JzHQc3fmLxJFn9_0 2024-09-05T02:16:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2508803080542902554', time=2024-09-05T03:46:55.343315+0000, chain.objs.size()=1 2024-09-05T02:16:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wX1y1cB-w4kADk7ioufGZsji6XpsUYE_0 2024-09-05T02:16:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10245802553879517223', time=2024-09-05T03:46:56.834658+0000, chain.objs.size()=1 2024-09-05T02:16:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.escPK4mwI9FXj6Fq3s7yZr5hC6qpxWb_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17925164377784332189', time=2024-09-05T03:46:56.986306+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aD1a-je7MsL0D2ib4Qdp3uhArCUfy29_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14124902160583189045', time=2024-09-05T03:46:58.477346+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ub7c78sgGlOxS9jyrP5tg0XrejB5F8F_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4374158138040578262', time=2024-09-05T03:47:02.442543+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.idrPCpeaFAcohvmI6ZcT1sovBSIQzEa_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11749057271300008688', time=2024-09-05T03:47:04.412442+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._HOwo-jQ9w5JoNIM21TOrLksGqDqQQ-_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18293106827486720977', time=2024-09-05T03:47:04.487472+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QjrKYSDAFz_hWGemBqriWMpwWf_RDTl_0 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5400191873060477006', time=2024-09-05T03:47:04.560710+0000, chain.objs.size()=1 2024-09-05T02:16:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ltXlOL_V70vts2mku3aq57t_fa46DA6_0 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3759545664444787634', time=2024-09-05T03:47:08.825891+0000, chain.objs.size()=1 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.327__shadow_.5e1mPUxp_ynJ2V31cDV7EhCLzciD60l_0 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13777618255067317377', time=2024-09-05T03:47:17.923436+0000, chain.objs.size()=1 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.333__shadow_.lDnsB_6pr73K4rVcxi2ejqvkyajHC2z_0 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7062462090526408650', time=2024-09-05T03:48:26.112158+0000, chain.objs.size()=1 2024-09-05T02:16:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.381__shadow_.oWs5y4Nf_8_pvBjt2n43UOxbI7ysN6h_0 2024-09-05T02:16:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3407986003921740469', time=2024-09-05T03:52:04.771216+0000, chain.objs.size()=6 2024-09-05T02:16:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.396122994333605964', time=2024-09-05T03:52:23.138764+0000, chain.objs.size()=1 2024-09-05T02:16:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.518__multipart_mymultipart.2~Lu7hxJtsunO4gCFKbvLp3TuZUvjugXE.1 2024-09-05T02:16:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3116984941341797646', time=2024-09-05T03:56:55.503286+0000, chain.objs.size()=1 2024-09-05T02:16:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.558__shadow_.sNeWLr5PjsFrt6sE5dMDl2f0HjPpeV-_0 2024-09-05T02:16:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16510966733937744339', time=2024-09-05T03:57:34.028314+0000, chain.objs.size()=1 2024-09-05T02:16:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:pLfHZoKdftwOyrHKdhDgBCltty4pl-U_.idbBs7YkCbVqyqyzm50hJe4ZL86CHDP_0 2024-09-05T02:16:21.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16884245159621038755', time=2024-09-05T03:58:11.499207+0000, chain.objs.size()=1 2024-09-05T02:16:21.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:w.t2MFzCKigt6x7K1CAIuTm-iGhg1Ge_.aB0tFCttLJQHFV90lFwoV8pNmbL07lN_0 2024-09-05T02:16:21.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15596334522646530695', time=2024-09-05T03:58:19.615739+0000, chain.objs.size()=1 2024-09-05T02:16:21.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:eVoj2CRXDMXx7gu8eyngkkLr6dXrnq5_.wj4j4HejHIBZKYNC-CZup7g2fqcsVTQ_0 2024-09-05T02:16:21.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4460819853101563528', time=2024-09-05T03:58:51.740890+0000, chain.objs.size()=1 2024-09-05T02:16:21.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:SXdB1u..PewZao.UyGZ39fIY6vGmUgx_.9I2Zo2nDImtzIJYjAJqODF5C-i0bqZF_0 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9188134859422209448', time=2024-09-05T04:01:49.422195+0000, chain.objs.size()=6 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.1 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.2 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.3 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.4 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.5 2024-09-05T02:16:21.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.615__multipart_multipart_enc.2~GRrvh9cIj4wIfHAvTbLsXWMOUwrkVMM.6 2024-09-05T02:16:21.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.596+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49653 2024-09-05T02:16:21.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11250188659691657534', time=2024-09-05T04:05:21.808729+0000, chain.objs.size()=2 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.645__shadow_.uQMzQtAt9w9XXkZ1ccYPuUq4A69BfQi_0 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.645__shadow_.uQMzQtAt9w9XXkZ1ccYPuUq4A69BfQi_1 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12228878279744243342', time=2024-09-05T04:05:38.897430+0000, chain.objs.size()=1 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.652__shadow_.1KGQmbqJXuznQTqIhtoUjVXzIv4CIVt_0 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4854676502159465572', time=2024-09-05T04:06:15.129887+0000, chain.objs.size()=1 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.663__shadow_.XeJ7X___x2Tsj8bOYnMbKmglb7D4UoQ_0 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17024374149101343776', time=2024-09-05T04:06:20.052039+0000, chain.objs.size()=1 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.665__shadow_.iTKO_hcCd5SubkDI4l1wee86vsso5lh_0 2024-09-05T02:16:21.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13309203772589914383', time=2024-09-05T04:06:25.597938+0000, chain.objs.size()=1 2024-09-05T02:16:21.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.668__shadow_.U3kwizABDU-nyA7Kwb63pHxfTz87pf6_0 2024-09-05T02:16:21.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14601989239888052664', time=2024-09-05T04:07:05.302038+0000, chain.objs.size()=1 2024-09-05T02:16:21.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.696__shadow:uouiKq1Fdib4wMHuNaq6liqjmE3ekpB_.B9f_lcAQAgG9AUSl19SGwjZtl054G9E_0 2024-09-05T02:16:21.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15477524289859577168', time=2024-09-05T04:08:02.897534+0000, chain.objs.size()=1 2024-09-05T02:16:21.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.718__shadow_.f01So5foJ83boqDP29tR9o4ZGHz0x63_0 2024-09-05T02:16:21.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.608+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-05T02:16:21.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.608+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47157' 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4515857732042275205', time=2024-09-05T03:32:36.033686+0000, chain.objs.size()=1 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.157__shadow:rRBxWvxp.s.WTEIvmxKpwvrbYVl3bz-_.Z7WyXoOXkpKJsRsFg_wWjH2ceHIz2nB_0 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10053049158137739929', time=2024-09-05T03:33:16.005208+0000, chain.objs.size()=2 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.164__multipart_foo.2~yQjcTHxsAz-KRo8WKG_gxLb6jtseAu3.1 2024-09-05T02:16:21.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.164__multipart_foo.2~yQjcTHxsAz-KRo8WKG_gxLb6jtseAu3.2 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3410218156695231724', time=2024-09-05T03:33:46.744669+0000, chain.objs.size()=1 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.182__shadow_.ZqPMANvyQtzSUZ7hHCN5bgjGQ4HFNHb_0 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5357162485938594225', time=2024-09-05T03:37:31.708376+0000, chain.objs.size()=1 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.235__shadow_.bWjo5qONK1W1Ub8JnehvRcZK5FbKviy_0 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6639353805216299827', time=2024-09-05T03:37:38.966092+0000, chain.objs.size()=1 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.238__shadow_.orFAxoAfdJiSCypxz66WOWl8UnNRN8u_0 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13381018610123148539', time=2024-09-05T03:37:45.735505+0000, chain.objs.size()=1 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.242__shadow_.pM69uoBj2gcC6irVTyfQ5k5BC8dAYt3_0 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2477328968154228931', time=2024-09-05T03:38:06.027786+0000, chain.objs.size()=1 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.252__shadow_.9C9s5LeOfoXaWlXd-O8z_CYpR_I2XzJ_0 2024-09-05T02:16:21.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17650404122391264088', time=2024-09-05T03:38:15.405326+0000, chain.objs.size()=1 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.257__shadow_.VVh1wJu3CnRcT6U986koXd8zspkFuQd_0 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.211920756416172598', time=2024-09-05T03:40:04.691015+0000, chain.objs.size()=1 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Jl5vjLhJSeb_U3xhA8I_rkyoFm5d9FB_0 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13953430163616882857', time=2024-09-05T03:40:04.701702+0000, chain.objs.size()=1 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5WiY0bC3ruud9Nog1FGchtl8hQFCtMc_0 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17919744780283270388', time=2024-09-05T03:40:05.465926+0000, chain.objs.size()=1 2024-09-05T02:16:21.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.b440jEF_4oGvlRvST_DV1eSmtS50H_4_0 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9907952806834302630', time=2024-09-05T03:40:06.058186+0000, chain.objs.size()=1 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.p193IdjQLT7ScxxzZE8EYP74Yohen4K_0 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11029679477728296452', time=2024-09-05T03:40:07.322730+0000, chain.objs.size()=1 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.usfsgjf9XfJdikEIZRI_Sc2JtMb-vWS_0 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16406878127862104344', time=2024-09-05T03:40:07.425081+0000, chain.objs.size()=1 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iAAKAc5q8el6m56VYiNJOTO7W1SidLd_0 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13105673875974255175', time=2024-09-05T03:40:08.817063+0000, chain.objs.size()=1 2024-09-05T02:16:21.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qtBBDO2vVfANPIFuv2m0cSLZCVDuyVA_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13904735910819683886', time=2024-09-05T03:40:11.393217+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ov5CzIUYgoggWAGBmTIyd4lIvNPSRcX_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7685289998905691198', time=2024-09-05T03:40:12.007674+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2dCDiczerxNaTh30pTypxdmyxwUdy9V_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4216010522385762562', time=2024-09-05T03:40:14.239849+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pFNnKfwvVNKpCwomV6M-On1O8T2ZqzX_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15987223338963204590', time=2024-09-05T03:40:14.427025+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jWlh-PAx76XkQCU_Z6TNKCpiJZ607vl_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1260951502553522741', time=2024-09-05T03:40:15.264641+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.igRJwqxogWtDm37_JoY9uzASUxT25P2_0 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16632032434910607342', time=2024-09-05T03:40:15.479687+0000, chain.objs.size()=1 2024-09-05T02:16:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Rf7QKo_U2yjZomaCLbYOvICpLY24oZY_0 2024-09-05T02:16:21.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15220801165652440053', time=2024-09-05T03:40:18.467022+0000, chain.objs.size()=1 2024-09-05T02:16:21.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.r_8eLJUNMqgsqY4he3HsP_P9FL0Pvn4_0 2024-09-05T02:16:21.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18026166731501247451', time=2024-09-05T03:40:19.241102+0000, chain.objs.size()=1 2024-09-05T02:16:21.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PqaVoWnr50mivqFHCEKGHlB4-ieuAZR_0 2024-09-05T02:16:21.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7600924105711644537', time=2024-09-05T03:40:20.514525+0000, chain.objs.size()=1 2024-09-05T02:16:21.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OM_YvMMPOPpxoZ9QwsQmpcVdoMckw3N_0 2024-09-05T02:16:21.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14930744724096825564', time=2024-09-05T03:40:21.797694+0000, chain.objs.size()=1 2024-09-05T02:16:21.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6LQ6suBtmZ5dbxV0i3XPn7JiuVkmTm0_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16072248624318895772', time=2024-09-05T03:40:21.801640+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vZ_SEFyo_P-R1RjLEpCvcerz_Hdze6-_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.498345139045411521', time=2024-09-05T03:40:21.803618+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HP1JQQNNvqaN8q2lCdzEyt7LWAgZjIo_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9585269728051830348', time=2024-09-05T03:40:22.904785+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rVEkWxeD_oCz_SNE37HD8CIVW-s0JVE_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1800273580932716475', time=2024-09-05T03:40:24.605763+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PT-fXKHI4dGz3LoK9pYtQ6fM2g3Nzha_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6615276457488375046', time=2024-09-05T03:40:24.963761+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2ZTaEp-7br978eRHzpjnZiprMiuK7O8_0 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6672305228264185693', time=2024-09-05T03:40:25.881681+0000, chain.objs.size()=1 2024-09-05T02:16:21.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.G_SIfP2lbX2DwauRG7ARaka8cPfw1_k_0 2024-09-05T02:16:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7320095890218213528', time=2024-09-05T03:40:26.271205+0000, chain.objs.size()=1 2024-09-05T02:16:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9Je6AKlobNBzAG-lqUN9RXarj02vwDW_0 2024-09-05T02:16:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1232510852667421399', time=2024-09-05T03:40:29.044053+0000, chain.objs.size()=1 2024-09-05T02:16:21.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Kj3MQp8KcZ-_7nIa_1fmR4JL1Y6Uz5J_0 2024-09-05T02:16:21.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5382456027598150526', time=2024-09-05T03:40:30.913376+0000, chain.objs.size()=1 2024-09-05T02:16:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.h_4PGd2_0f7zRmVoO90r0q8eTiXamuV_0 2024-09-05T02:16:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17942719122385956726', time=2024-09-05T03:40:31.053855+0000, chain.objs.size()=1 2024-09-05T02:16:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H1GET3D-2yg2bWsIm3DbjJwNp1aQXu6_0 2024-09-05T02:16:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4102638089313710464', time=2024-09-05T03:40:31.194364+0000, chain.objs.size()=1 2024-09-05T02:16:21.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.L5tRnWnkxeheixv6Tieyg_QrzsR4fwJ_0 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.75718658346952772', time=2024-09-05T03:40:31.309737+0000, chain.objs.size()=1 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.y5sr_hPAg5sDj4ztSbQ5bU56aYahMnl_0 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7838758586885696665', time=2024-09-05T03:40:31.609883+0000, chain.objs.size()=1 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OQItwLJ6tCFXd4QOMflk5mvtwWoGRY9_0 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14186067073066741560', time=2024-09-05T03:40:31.780467+0000, chain.objs.size()=1 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wv5eAWJv0cvzXT4cDh_XSjkCy6O374H_0 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17324484807670929100', time=2024-09-05T03:40:32.167522+0000, chain.objs.size()=1 2024-09-05T02:16:21.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9tEnmJEWS6HoHpqunKdWEsaNAwbP9SP_0 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14729086277488553113', time=2024-09-05T03:40:32.615252+0000, chain.objs.size()=1 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.abTr3PLCZ0ZVtuLhcPHb2TsP_1tnm1j_0 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12887981916102851992', time=2024-09-05T03:40:33.839749+0000, chain.objs.size()=1 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MpzmXXOX_SJPAv0ulhlyUl9GnbhTk27_0 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17204240718896429785', time=2024-09-05T03:40:34.453240+0000, chain.objs.size()=1 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KPK7s19zVNSISzRgKzknPpUUzVYOHs0_0 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4097038580667197682', time=2024-09-05T03:40:34.455579+0000, chain.objs.size()=1 2024-09-05T02:16:21.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.W0pftO3R3yqeTOPH-JLui37qzqqtOPC_0 2024-09-05T02:16:21.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2520524382831134048', time=2024-09-05T03:40:43.659935+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.266__shadow_.sABr_cgRicwaGhOd_h8aMkqNCcYVX-B_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17237068832468304391', time=2024-09-05T03:41:08.645955+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.280__shadow_.__lOkfIrOyCCf4HFFC2SnbfPaDJj6lV_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12224516635456416497', time=2024-09-05T03:41:20.197164+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.286__shadow_.ibpTCWyG9PvMh-0r1x9bSX9BWvDKU5a_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6875422349522756059', time=2024-09-05T03:41:22.078178+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.287__shadow_.xs-6v_VU9nTYR8XeAAlQJS1iZ42Hobc_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17084148898641567241', time=2024-09-05T03:41:25.859887+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.289__shadow_.MQKlxbL1bNcg3N0gO0dp8R0wFDwdbPG_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17836462219462795431', time=2024-09-05T03:41:27.712014+0000, chain.objs.size()=1 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.290__shadow_.KwhFJDfvVZSGuX5NQGbFIdv6KpOUw_3_0 2024-09-05T02:16:21.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14224798379766705843', time=2024-09-05T03:41:35.002028+0000, chain.objs.size()=1 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.NhlVmxJCW7ku0KJ5tKnaomWTXojtcFt_0 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1281760747584362749', time=2024-09-05T03:41:35.070543+0000, chain.objs.size()=1 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.mgyIg9FpbnKqcBLjLQoOShpdRTaSBQA_0 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9174681617346019889', time=2024-09-05T03:41:40.312232+0000, chain.objs.size()=1 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.VJljgbcCa7zZNWnseAZhNnzAGbbKMRR_0 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8417543517994236356', time=2024-09-05T03:41:44.027849+0000, chain.objs.size()=1 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.295__shadow_.UJq3ELfXdW9EGAuG1MdlQ6riX8AnAqE_0 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5835211022671337698', time=2024-09-05T03:41:53.670780+0000, chain.objs.size()=1 2024-09-05T02:16:21.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.300__shadow_.5a3di8xg4vVJ5VRldDZBqdiE87Wu960_0 2024-09-05T02:16:21.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17476993576765917158', time=2024-09-05T03:41:53.672551+0000, chain.objs.size()=1 2024-09-05T02:16:21.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.300__shadow_.I_JqkAw9qnHUMXQefwbuNY7Ip4eMhYx_0 2024-09-05T02:16:21.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9127654623770635076', time=2024-09-05T03:42:29.985068+0000, chain.objs.size()=1 2024-09-05T02:16:21.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.319__shadow:Y6IbNVtYipM9pO7U0pP3tY1kQ0yt79b_.Ywgydpvb2ZRlnEK7CgQIkon8tMfLj9H_0 2024-09-05T02:16:21.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6783452999044326600', time=2024-09-05T03:44:21.413474+0000, chain.objs.size()=1 2024-09-05T02:16:21.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kpxrRpPF7cz_gq6kHcsZgSC5UOTO9JE_0 2024-09-05T02:16:21.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11092092545392722486', time=2024-09-05T03:44:22.378970+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.3exZX25dne4Spsi1KTn3u2_aoQsw0C7_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12566052807549474804', time=2024-09-05T03:44:23.413796+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.3tG_7OVHCLaYYxJJgBRRSahzCpBlj4Q_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11669497144814990155', time=2024-09-05T03:44:23.825844+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LNWQMYgu1RI7K5TRURKnEtOUa7wt71R_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15918468717493186189', time=2024-09-05T03:44:26.323602+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oKlyFhozB7g0zjL4Gr6BGtetoq1LDEp_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17406453703809211773', time=2024-09-05T03:44:27.793059+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XDzdiM4nhRUDJKfOBonlvU0HuuQrJfa_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16509061903183316150', time=2024-09-05T03:44:28.664056+0000, chain.objs.size()=1 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7tPi0keILDl300_ejVeIDYCvCOP8w9U_0 2024-09-05T02:16:21.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9616538279549625552', time=2024-09-05T03:44:29.327301+0000, chain.objs.size()=1 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UTp5EiO6dCP4wzENu2A_jmOtccLhUh2_0 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5342069206356349542', time=2024-09-05T03:44:29.989274+0000, chain.objs.size()=1 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.V2EwkacfWQdWD7WI3blLiMSEv85jptZ_0 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9007462330559561668', time=2024-09-05T03:44:30.415973+0000, chain.objs.size()=1 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5ryTPLSI65hESRa-Zg1zJPgZpbjy3jT_0 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9506622615679472895', time=2024-09-05T03:44:30.482969+0000, chain.objs.size()=1 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.b7dek42e4lcr5qOBkIJEsSxJj4UOTu__0 2024-09-05T02:16:21.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7071476421248472424', time=2024-09-05T03:44:32.381731+0000, chain.objs.size()=1 2024-09-05T02:16:21.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JX0v5dwK1jc70qYOYgN2TtzqHotQ59h_0 2024-09-05T02:16:21.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12289079797754507397', time=2024-09-05T03:44:34.867911+0000, chain.objs.size()=1 2024-09-05T02:16:21.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZXqOzwFV3wA7mB2b2BQtsH2EwBaGIoM_0 2024-09-05T02:16:21.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17130448969756062495', time=2024-09-05T03:44:44.578666+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.COlVLJlYSh0Aeh_QsjyQomYz7Y_eNAC_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6010195439166265563', time=2024-09-05T03:44:45.871759+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RNlHCmojLuPA9EAP_XqVokSvQJF3kRb_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13269583722827425632', time=2024-09-05T03:44:45.967032+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._Obo3ii4FhR0FCQ202KmZ3m3oqlTv6e_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1914236617431902598', time=2024-09-05T03:44:46.310485+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.w9RQQ1Q6ikAnc-AwSUmZpu5pRi-aa-a_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10861029577679976473', time=2024-09-05T03:44:47.787471+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mrVfNbZ62Z-LM86pDFNkx2NOfE9ELDq_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11654834638791147713', time=2024-09-05T03:44:48.116634+0000, chain.objs.size()=1 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wsufcwv9kYakcf52geCVK4zKj9GZ3x6_0 2024-09-05T02:16:21.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7720268355288778733', time=2024-09-05T03:44:48.847236+0000, chain.objs.size()=1 2024-09-05T02:16:21.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XVL-eweBJtuddyOAZON4ihlVR8KK7ld_0 2024-09-05T02:16:21.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3910724711996696327', time=2024-09-05T03:44:49.700793+0000, chain.objs.size()=1 2024-09-05T02:16:21.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9dNDdY4cxMecGDqWFbCDwHJdjzCV1-W_0 2024-09-05T02:16:21.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8829903093233825538', time=2024-09-05T03:46:34.630619+0000, chain.objs.size()=1 2024-09-05T02:16:21.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bJ_nykgbb491mkBTZugrfgYz4ZCk3Yg_0 2024-09-05T02:16:21.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10724749615539331773', time=2024-09-05T03:46:34.994148+0000, chain.objs.size()=1 2024-09-05T02:16:21.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5DhwAf9dc3GinN99O1IqOZBvEt6SSQQ_0 2024-09-05T02:16:21.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1603279812401227311', time=2024-09-05T03:46:35.168225+0000, chain.objs.size()=1 2024-09-05T02:16:21.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.g7vk-l77t-P8cuSO_v6Qy8cfvAGeRoz_0 2024-09-05T02:16:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9283972030016763432', time=2024-09-05T03:46:35.867824+0000, chain.objs.size()=1 2024-09-05T02:16:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ur-rHKBkkHA4nGK-ERptL6RccNTwJ4m_0 2024-09-05T02:16:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9988248295456991012', time=2024-09-05T03:46:36.601409+0000, chain.objs.size()=1 2024-09-05T02:16:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wOSOjNSlO4TCvd1iLsrpxlD11Y9eK-I_0 2024-09-05T02:16:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18078390059840581567', time=2024-09-05T03:46:37.796939+0000, chain.objs.size()=1 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eFI5Os08ky6mwG0e0GKw6JPJydFg5r__0 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13061514879991522187', time=2024-09-05T03:46:37.882211+0000, chain.objs.size()=1 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HFHf49ktRzIQwnlEU2MEXOxJeUK0qP6_0 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11333124775001518654', time=2024-09-05T03:46:38.218381+0000, chain.objs.size()=1 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.06aI6eWVa52aiJDLxNOMUjPP64xoxAa_0 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15082401281259478331', time=2024-09-05T03:46:38.454387+0000, chain.objs.size()=1 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WSPVo1sorO-sfxkg3soPZjKIyp3zEFL_0 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11217697753083447959', time=2024-09-05T03:46:40.168070+0000, chain.objs.size()=1 2024-09-05T02:16:21.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sjrRxCRvyMQwJyCoKGayEFfFJ_ovxEK_0 2024-09-05T02:16:21.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3536885223902499354', time=2024-09-05T03:46:42.672510+0000, chain.objs.size()=1 2024-09-05T02:16:21.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.l08p6WyK5OvtufDSvNV13Fk6hHkTKII_0 2024-09-05T02:16:21.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2749694148504421673', time=2024-09-05T03:46:44.133120+0000, chain.objs.size()=1 2024-09-05T02:16:21.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MN24OeK1PDhbXgeMztSh7k1_hE6yhqx_0 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8972303622793413481', time=2024-09-05T03:46:46.628080+0000, chain.objs.size()=1 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.z4V7ikaJFf8Y1o4UAH9RytF7TIlC38R_0 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6881255974373670801', time=2024-09-05T03:46:47.254690+0000, chain.objs.size()=1 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.L34u5vmAol6rcSTccqw8tmDH9aojauQ_0 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17874297335568664242', time=2024-09-05T03:46:50.609990+0000, chain.objs.size()=1 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tzd2K0oO2Z8MZiWHfNjl1aAPtA0_Ma1_0 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.55609513496344353', time=2024-09-05T03:46:50.984421+0000, chain.objs.size()=1 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oIfNkRZWI7p-WgOVcYd2CIbZs5O1F1B_0 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18155825314084738913', time=2024-09-05T03:46:51.303275+0000, chain.objs.size()=1 2024-09-05T02:16:21.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.h-9TxzkBtZ56fzocSPi9AgBiroA4g3B_0 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9644592467401688661', time=2024-09-05T03:46:51.543489+0000, chain.objs.size()=1 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3ILB49RN_VRlRRFLpe0z5Ccrp0si1Gg_0 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8580975640486583827', time=2024-09-05T03:46:52.191536+0000, chain.objs.size()=1 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.whrCn0qhyF1rbeROwfvLlRQ4vZpjAkt_0 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17537141070107301898', time=2024-09-05T03:46:55.011716+0000, chain.objs.size()=1 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.j4vUh-12w9Job-4gUcjLm63kWaI0X5m_0 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3167055226529344927', time=2024-09-05T03:46:55.427808+0000, chain.objs.size()=1 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ex7WWE8VUG-KXZ6swb963DQlaM6RObN_0 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11302997568454566108', time=2024-09-05T03:46:55.529638+0000, chain.objs.size()=1 2024-09-05T02:16:21.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eIPeEfKn-H7DgKyemsGlP9M4tCWasNB_0 2024-09-05T02:16:21.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47157 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8118382189917439183', time=2024-09-05T03:46:57.293554+0000, chain.objs.size()=1 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lH93qAMN8czj9X7a2LMBFHHvLD8cJ24_0 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3013974477131168066', time=2024-09-05T03:46:59.197388+0000, chain.objs.size()=1 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SgDfI2qXl994pWQq7K1WTGx3jHK0rsq_0 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4723619143008311271', time=2024-09-05T03:47:03.736094+0000, chain.objs.size()=1 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bZVQV80WqktsiUg692alsP9pZGX7pEg_0 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12056085862059319732', time=2024-09-05T03:47:35.856452+0000, chain.objs.size()=1 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.345__shadow_.3frLrHQdSGjL7doTG9dU2baxGJTNs31_0 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2984856404669635621', time=2024-09-05T03:50:02.028518+0000, chain.objs.size()=1 2024-09-05T02:16:21.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.443__shadow_.3Dvo8qYGuVPmGWu1_sjjYkzfXBPkEdW_0 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5301941289916696303', time=2024-09-05T03:50:34.389351+0000, chain.objs.size()=1 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.460__shadow_.p52T2pBc5tAIDbmOqwJqXWWBw2VSyPk_0 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10817422676146237508', time=2024-09-05T03:51:22.024641+0000, chain.objs.size()=1 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.488__shadow_.4YJMgqlU46ze4sfAle9zL5qwR0OqQtb_0 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16441128041353981596', time=2024-09-05T03:52:05.434304+0000, chain.objs.size()=6 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:21.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:21.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:21.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4474203043712959421', time=2024-09-05T03:53:44.429811+0000, chain.objs.size()=6 2024-09-05T02:16:21.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.1 2024-09-05T02:16:21.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.UefotdD2k8N0DYqAspgAptITwRkL3lpc.2 2024-09-05T02:16:21.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.3 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.4 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.5 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.6 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk', time=2024-09-05T03:53:59.890095+0000, chain.objs.size()=1 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.2 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk', time=2024-09-05T03:53:59.900089+0000, chain.objs.size()=1 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.3 2024-09-05T02:16:21.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LPX31bqmQhfZYuOHfNVoQHqLXhhNxnp', time=2024-09-05T03:55:22.118671+0000, chain.objs.size()=1 2024-09-05T02:16:21.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.531__multipart_mymultipart.2~LPX31bqmQhfZYuOHfNVoQHqLXhhNxnp.1 2024-09-05T02:16:21.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11103331237756634031', time=2024-09-05T03:57:43.969813+0000, chain.objs.size()=1 2024-09-05T02:16:21.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:LEYvjFM0tENy7JxxAEfEcL2NwjI835j_.r161tMmfWsM6zu8E3vw2izU_5U1JtxD_0 2024-09-05T02:16:21.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17188298540975065596', time=2024-09-05T03:59:39.835038+0000, chain.objs.size()=1 2024-09-05T02:16:21.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.585__shadow:RCn4HG7GBy.gZTW.LJT7R3uE27s2buY_.1qahN9WT69b0Cnumv64sk6d7ScsG3_h_0 2024-09-05T02:16:21.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.676+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.676+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-05T02:16:21.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50790' 2024-09-05T02:16:21.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2694236755350166028', time=2024-09-05T03:37:38.930475+0000, chain.objs.size()=1 2024-09-05T02:16:21.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.238__shadow_.IYLrLoKJlqpgRZfgA8TY7V8xioJq-Qo_0 2024-09-05T02:16:21.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5501300158679754658', time=2024-09-05T03:37:48.409276+0000, chain.objs.size()=1 2024-09-05T02:16:21.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.243__shadow_.N0UqRmvnZ_M_hv8dLtENpvAl2pJOus5_0 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1551074009813073322', time=2024-09-05T03:38:04.169111+0000, chain.objs.size()=1 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.251__shadow_.Q2TJ-VJ3gUiwnqWdrjbMa0G8tKXuSUl_0 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16208652774263237009', time=2024-09-05T03:38:20.781276+0000, chain.objs.size()=1 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.260__shadow_.9nz7RJ2N2StymA-M9xyBwV03clWbJPS_0 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7923619328609178534', time=2024-09-05T03:40:06.685988+0000, chain.objs.size()=1 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aD71TupI2spDUOhGFdStObfahxPYrTj_0 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17733422046730899049', time=2024-09-05T03:40:09.744260+0000, chain.objs.size()=1 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.um16mMc4aT29bPI36tbkbg-0A9DXYdd_0 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9061802258968012015', time=2024-09-05T03:40:11.209169+0000, chain.objs.size()=1 2024-09-05T02:16:21.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6OesDfV1VEqHfwsxo4uJ7o_1E_ebs5p_0 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12978805849969579905', time=2024-09-05T03:40:14.410525+0000, chain.objs.size()=1 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9LYXeA5kEZeS1mrt3huNImxrIedFJC0_0 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10800433602491470860', time=2024-09-05T03:40:15.791240+0000, chain.objs.size()=1 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C_fZomjj4l5KbqVHglxSZ0o42GEsh3X_0 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6640011614670110487', time=2024-09-05T03:40:15.960267+0000, chain.objs.size()=1 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.31agh_ZUqexDVf6kLBlTLrr5-NGZSso_0 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5858210950094404272', time=2024-09-05T03:40:16.487133+0000, chain.objs.size()=1 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8a9nCXADHJ9T7CMOdCu6f7CSoJOrMOl_0 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001242514259648965', time=2024-09-05T03:40:19.231491+0000, chain.objs.size()=1 2024-09-05T02:16:21.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PIiy-ukhEWiGpDRXkKppWX-jpTInTHO_0 2024-09-05T02:16:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1905102855619645682', time=2024-09-05T03:40:21.722835+0000, chain.objs.size()=1 2024-09-05T02:16:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eJxQIxb_Yf5k_2_A-jrXwVpMN_qLZZP_0 2024-09-05T02:16:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17216268963424442181', time=2024-09-05T03:40:22.797272+0000, chain.objs.size()=1 2024-09-05T02:16:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o-Q9TduN9rV1uCQJdsy24ToO--g3mA1_0 2024-09-05T02:16:21.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17354593341701459617', time=2024-09-05T03:40:24.294648+0000, chain.objs.size()=1 2024-09-05T02:16:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VojZPDZG8OQa8pWur9NmqzmltUery-I_0 2024-09-05T02:16:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11961800556897238405', time=2024-09-05T03:40:26.310559+0000, chain.objs.size()=1 2024-09-05T02:16:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ccrSGXKaAD7c_RRd8BpjY_HKjwuIhCG_0 2024-09-05T02:16:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2602137592764370431', time=2024-09-05T03:40:27.859594+0000, chain.objs.size()=1 2024-09-05T02:16:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QuFVCU1U3nA0x6RdZnWZgMRKo9lM4dP_0 2024-09-05T02:16:21.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14586304214408432960', time=2024-09-05T03:40:28.469165+0000, chain.objs.size()=1 2024-09-05T02:16:21.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.39-ff31qPQBUhyUA81ixXfQTkV2RKsu_0 2024-09-05T02:16:21.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18119494350246261198', time=2024-09-05T03:40:29.035077+0000, chain.objs.size()=1 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.40VQWhhkLmpOXVVLVB-Fc0cxy8Y3Q5W_0 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1789172526167855412', time=2024-09-05T03:40:30.518203+0000, chain.objs.size()=1 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KYPzJfw-sr4adp6TYPzBxQdUML4jAkY_0 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15212400287762313418', time=2024-09-05T03:40:34.369329+0000, chain.objs.size()=1 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7z20MlcAPp3OSjHY0ZvPAocKdg1w9br_0 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4731515770612036270', time=2024-09-05T03:40:35.468877+0000, chain.objs.size()=1 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YOQfAz9Zatq34-WguSQMUp5x9hFtfat_0 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4853266004534347065', time=2024-09-05T03:40:35.695548+0000, chain.objs.size()=1 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hnCeC7vyPgn2plR7Lp5JP93ZlU2QTK6_0 2024-09-05T02:16:21.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2513386157897439135', time=2024-09-05T03:40:35.864571+0000, chain.objs.size()=1 2024-09-05T02:16:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bTFggDxQZgEeNeFEsxYOAp_CWF7mkCF_0 2024-09-05T02:16:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16320052715284088247', time=2024-09-05T03:40:36.402157+0000, chain.objs.size()=1 2024-09-05T02:16:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.p-xx8skGb-5xmEIj7w8nnFKLgXsXEg2_0 2024-09-05T02:16:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18048351079054739620', time=2024-09-05T03:41:06.826246+0000, chain.objs.size()=1 2024-09-05T02:16:21.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.279__shadow_.ljk6sEJB9kKO0ocTlRN2JlY6z2wGEQm_0 2024-09-05T02:16:21.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15053872381989761407', time=2024-09-05T03:41:10.522435+0000, chain.objs.size()=1 2024-09-05T02:16:21.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281__shadow_.isilzChGUD9LdqNRDLdeBh5wAzZGjWv_0 2024-09-05T02:16:21.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3095596622813772576', time=2024-09-05T03:41:25.855157+0000, chain.objs.size()=1 2024-09-05T02:16:21.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.289__shadow_.OochkOgdpOhhqlU5Coiby37zLA94Qp__0 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7544042232556820902', time=2024-09-05T03:41:34.866046+0000, chain.objs.size()=1 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.stXiDtBlDWBn-RcUSSx2dmQLqpS2RTl_0 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16457991404627230530', time=2024-09-05T03:41:34.867605+0000, chain.objs.size()=1 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_._ieFK3vvYdU5sS26BbMF_IJd0Xcs20A_0 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9349747415518148255', time=2024-09-05T03:41:40.301604+0000, chain.objs.size()=1 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.YS4LmnipTN0QHNx5_9a6eCB79vXM2tV_0 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3311156821262878154', time=2024-09-05T03:44:19.278023+0000, chain.objs.size()=1 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pFzTi4-FCaNkosRz0IInQkXrN90FZ_N_0 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3841088685473201359', time=2024-09-05T03:44:20.120974+0000, chain.objs.size()=1 2024-09-05T02:16:21.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EgvwMyv3BFrfK8WCmy4JVf9hYl5WrCU_0 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17541530797258552624', time=2024-09-05T03:44:29.266061+0000, chain.objs.size()=1 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cKjJ538eRu7y6tvtgSsbts2XSHqX_Ga_0 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13120391267814692197', time=2024-09-05T03:44:29.602390+0000, chain.objs.size()=1 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.L10jTIzJRVvxWnr7JOdlhyBENaHushw_0 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7815907114021445528', time=2024-09-05T03:44:33.168453+0000, chain.objs.size()=1 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kK7XrM0oPgBS3bXvYOldVAr6xglFgzg_0 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.38331897385694913', time=2024-09-05T03:44:33.254922+0000, chain.objs.size()=1 2024-09-05T02:16:21.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ombv7gVygTchazWimAef42r2rTm-WfY_0 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10529559968581010104', time=2024-09-05T03:44:34.081789+0000, chain.objs.size()=1 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cvqqAFQwApSqnkegoJBDWi_28ieQpmF_0 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8288392529355335045', time=2024-09-05T03:44:34.116020+0000, chain.objs.size()=1 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.P8Ip93E1fiZahEFgzFW0_TxQr_L5sN1_0 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.741475547464438086', time=2024-09-05T03:44:34.207765+0000, chain.objs.size()=1 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AbcKuyfXpvbeLwdbltbXsaklYA3KY53_0 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13554115161117243721', time=2024-09-05T03:44:35.905739+0000, chain.objs.size()=1 2024-09-05T02:16:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vQOq3W8HDF9gnYRNQ5DDPqTEy1l15lS_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17748048040952039585', time=2024-09-05T03:44:37.024972+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GqQ8sL2ahAGAexENTMlzNAEzy1cZaY9_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10847343615274679404', time=2024-09-05T03:44:39.887900+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nXye44X6J6hUIF8mjIQ41DsCNcGKTBJ_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16580557854079249818', time=2024-09-05T03:44:40.235592+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZW7W4ru4-1s0XefGHMcNFX397x6Oeg0_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8753731378863770197', time=2024-09-05T03:44:41.731766+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mPpF6gS3XwaOc1szVFrm2kN0sq5lUy__0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4945067841387407100', time=2024-09-05T03:44:42.997901+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Z1_RBm8TUQtSBhv9Fh2p7qVLNiP_eIP_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17906758368298088940', time=2024-09-05T03:44:43.056575+0000, chain.objs.size()=1 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wZ3QiuLjqHDSyRsNmn2P0FnKLoMKnGM_0 2024-09-05T02:16:21.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15992563017234891190', time=2024-09-05T03:44:43.955066+0000, chain.objs.size()=1 2024-09-05T02:16:21.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.q7nS6ZATMJ-YHdMS3sS4VLnU6bKnVMp_0 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8749024197458037940', time=2024-09-05T03:44:44.780774+0000, chain.objs.size()=1 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VJ-Sr1BCkpKPrOEHJHMnaB4uVBlY5Zp_0 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15793377715900962460', time=2024-09-05T03:44:45.389723+0000, chain.objs.size()=1 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EJBMiqp9yW_KQVL6xV5v0UTD0EW42p1_0 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2962501481155144856', time=2024-09-05T03:44:45.849164+0000, chain.objs.size()=1 2024-09-05T02:16:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IzLl0IFXxT1cCr61PuLaFFrz5ja9J3i_0 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7869437922241667288', time=2024-09-05T03:44:46.572117+0000, chain.objs.size()=1 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SAGvD1n2UJlpmCjSP_cuow2D9f7iy8e_0 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14011767977653910932', time=2024-09-05T03:44:46.832307+0000, chain.objs.size()=1 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aklXwsFWi2PcaxzffUUTL5mn8lPfNEy_0 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10012787351487326693', time=2024-09-05T03:44:49.691190+0000, chain.objs.size()=1 2024-09-05T02:16:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EViy6YNDRYJPwq98QSFxbB_vGKBBmtx_0 2024-09-05T02:16:21.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1128265418928699720', time=2024-09-05T03:46:34.981276+0000, chain.objs.size()=1 2024-09-05T02:16:21.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SeHHa11wKps6msf26HpfUN_W5vCDgW4_0 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16031942639289163420', time=2024-09-05T03:46:34.984266+0000, chain.objs.size()=1 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DivcbBOG0ppIaTu9fVmdYDaVExYdwMp_0 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9599064764152652546', time=2024-09-05T03:46:35.432648+0000, chain.objs.size()=1 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vFTDiqnSXdHWXG1ntI8uCYcqNPvcFrA_0 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2733318091739000205', time=2024-09-05T03:46:36.208999+0000, chain.objs.size()=1 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cF4MdVEv5CniqjgwpC7uf6txEL9Rvdb_0 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6301309885475125880', time=2024-09-05T03:46:36.648822+0000, chain.objs.size()=1 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lIhJEPIfjwE4sVSz7aV8SAemlt4q_Gf_0 2024-09-05T02:16:21.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10749369164181663606', time=2024-09-05T03:46:38.130460+0000, chain.objs.size()=1 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vvw_rlJ5lMNvOb3pHs1ucXm2XxZUIXH_0 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10749494305475561275', time=2024-09-05T03:46:38.831254+0000, chain.objs.size()=1 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cBOjnR8Zsg0ESxlKlu8ah9Fh5jby-_D_0 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2171754467131731841', time=2024-09-05T03:46:39.174103+0000, chain.objs.size()=1 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iK3BvV6qjCoMGkGUQ7o7RLkkFfEoYEg_0 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13411758431976878360', time=2024-09-05T03:46:39.608185+0000, chain.objs.size()=1 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3sVVIvlmg4smbbTteqYVqUqF9dWi2iX_0 2024-09-05T02:16:21.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13585626590621272319', time=2024-09-05T03:46:39.623003+0000, chain.objs.size()=1 2024-09-05T02:16:21.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vJWqyMCFgtqiWZAK_Cl2IqAG1PtFK3N_0 2024-09-05T02:16:21.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4805218888113707344', time=2024-09-05T03:46:39.675960+0000, chain.objs.size()=1 2024-09-05T02:16:21.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5upbhZ29jG7onVOvcZpRGWIT9I6QcTs_0 2024-09-05T02:16:21.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14784036740275824972', time=2024-09-05T03:46:40.052641+0000, chain.objs.size()=1 2024-09-05T02:16:21.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.P1GzXat7yDjyBffgyoAnvKL5OyxoNCJ_0 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6702620830730912635', time=2024-09-05T03:46:40.113017+0000, chain.objs.size()=1 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4myM81AL59hCe-dZidXwBbBeRTiFsJD_0 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7227093332174285838', time=2024-09-05T03:46:40.297275+0000, chain.objs.size()=1 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cXLEpKrqdv80Y7xMpByIp0sZm9hgR5x_0 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10237798806805696131', time=2024-09-05T03:46:40.530557+0000, chain.objs.size()=1 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WrkfUeBk5tReyEnspcrPlle_4wRBeEh_0 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10025959786404265166', time=2024-09-05T03:46:40.879205+0000, chain.objs.size()=1 2024-09-05T02:16:21.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zfJPuBZqb9yVJDaHNQTKbdp0N_jV94n_0 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18175339521852315959', time=2024-09-05T03:46:41.871321+0000, chain.objs.size()=1 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OVjt37wvLjduM71_DvP6-MVdAoGT_GH_0 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15110876310480331750', time=2024-09-05T03:46:42.867804+0000, chain.objs.size()=1 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HC0MU5cALZnM_-caZsx4eznUhqGcyzq_0 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5795291087355556603', time=2024-09-05T03:46:43.211663+0000, chain.objs.size()=1 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fqBhcKSrGMuYSQ-2n0xdFBORHcpWEFq_0 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3771296724646813155', time=2024-09-05T03:46:44.950460+0000, chain.objs.size()=1 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RK0rdwA0vpYRFBPUYWl2xekuiQQcaM0_0 2024-09-05T02:16:21.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17049612238004185905', time=2024-09-05T03:46:46.082206+0000, chain.objs.size()=1 2024-09-05T02:16:21.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EwDgv6FzWzVRGKxP8CjWZbz9adSc0lo_0 2024-09-05T02:16:21.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14263224593224796063', time=2024-09-05T03:46:46.973641+0000, chain.objs.size()=1 2024-09-05T02:16:21.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Vt2Aq7o3Lnr-FNomIeI_3G8HPM8yurP_0 2024-09-05T02:16:21.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17949864204288598068', time=2024-09-05T03:46:48.762790+0000, chain.objs.size()=1 2024-09-05T02:16:21.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dHxkJs5UtGaKrp6HBzavZySTzu1_rgY_0 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5821587994914316247', time=2024-09-05T03:46:48.936795+0000, chain.objs.size()=1 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ANWynJeV79BWMXgMoMahW6ouE2O6Dm3_0 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6418157749528013989', time=2024-09-05T03:46:50.914377+0000, chain.objs.size()=1 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cKd7fnK1Nm1DIQC97wKXUFLre9oEqo6_0 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2938356704060496328', time=2024-09-05T03:46:52.424340+0000, chain.objs.size()=1 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AUb6iXQtlXJnEwghbI6aE90_9eNkt6u_0 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4663004989228487819', time=2024-09-05T03:46:52.542141+0000, chain.objs.size()=1 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mOJb6oDEZHHbhJcbSlHil-T66t3C17-_0 2024-09-05T02:16:21.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6220336899114490540', time=2024-09-05T03:46:52.828966+0000, chain.objs.size()=1 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.r3THg6yN6Xkj7wLWDzk8IZeQYlhzEnz_0 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3677922230261894518', time=2024-09-05T03:46:53.079282+0000, chain.objs.size()=1 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ro4cvRlef3ai2oKOUXQ8JQcZajnKWO1_0 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15296844249040344794', time=2024-09-05T03:46:54.678952+0000, chain.objs.size()=1 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GNMFHB-4adV3f_yWXdu_Q6_rwoVcHhu_0 2024-09-05T02:16:21.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6982667149899340932', time=2024-09-05T03:46:55.182927+0000, chain.objs.size()=1 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SL_AuUbidALz0WrsbTvr3QsbvVzJUj__0 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16923043784017703229', time=2024-09-05T03:46:55.535463+0000, chain.objs.size()=1 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._0DYuoR-lON5G7wNF7Q8WihDrA-xOQB_0 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1098758833570196427', time=2024-09-05T03:46:58.158442+0000, chain.objs.size()=1 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3GckinA9kgqc5uX7ngKhDqsZp0jpQp4_0 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.712+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14150131889266767645', time=2024-09-05T03:46:59.646127+0000, chain.objs.size()=1 2024-09-05T02:16:21.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.712+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PYCkGDUvIsIDIIjuBMZz8HjzGtsRdy0_0 2024-09-05T02:16:21.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.712+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16904500053179908637', time=2024-09-05T03:47:00.077779+0000, chain.objs.size()=1 2024-09-05T02:16:21.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.712+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1IUxVbDEcrTdOBEgP4djDLePN6q92au_0 2024-09-05T02:16:21.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3577567120296561156', time=2024-09-05T03:47:00.760416+0000, chain.objs.size()=1 2024-09-05T02:16:21.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eKDDvi0yfzbYU_DWSkkYhaNcLMn38vb_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15293029781425474602', time=2024-09-05T03:47:01.989130+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.A68HEYb401WW2bxJ05giqZh1tDh9eJ3_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10333646871670031377', time=2024-09-05T03:47:01.991139+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vf2oNoF-NuvIr3Kd6n_fB-EdSXXfRxS_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10444423380424340385', time=2024-09-05T03:47:02.092851+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Cpo3zyp24Wu5inoquZwOIYeCVr_zxqd_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7803956239639770622', time=2024-09-05T03:47:04.482021+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9GY1Mbe8d_qhHU0fG6bc8PdvrrmnuIr_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15415667753380097861', time=2024-09-05T03:47:31.611381+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.342__shadow_.XCVw7Q5PU8mMX1jpE5bftlXTBXJHeeL_0 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14270555612159176310', time=2024-09-05T03:51:04.362364+0000, chain.objs.size()=1 2024-09-05T02:16:21.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.481__shadow_.pZPQwiMtEP4_Q0ooPI6vvQ7kWLOaGd2_0 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18104272227079321068', time=2024-09-05T03:51:09.623133+0000, chain.objs.size()=1 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.p_iZmd2WYWQvFRw3oGEE-AT9cA-Ewer_0 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16014988911344352699', time=2024-09-05T03:51:24.861868+0000, chain.objs.size()=1 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.490__shadow_.MLyNjE7p5FfoOGOWEZRMuFiotRi4mmK_0 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16014988911344352699', time=2024-09-05T03:51:25.286729+0000, chain.objs.size()=1 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.490__shadow_.MLyNjE7p5FfoOGOWEZRMuFiotRi4mmK_0 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12767163628657195925', time=2024-09-05T03:54:47.783406+0000, chain.objs.size()=2 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~bWRCbV9ZuOtQZUwIq-1uxNavzvOdn-1.1 2024-09-05T02:16:21.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~bWRCbV9ZuOtQZUwIq-1uxNavzvOdn-1.2 2024-09-05T02:16:21.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50790 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1812299145380163527', time=2024-09-05T03:56:59.130189+0000, chain.objs.size()=1 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.558__shadow_.OwxQuAmsUETJfudb9ILxBYG-EASB_4K_0 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11438062522083829344', time=2024-09-05T03:57:26.495757+0000, chain.objs.size()=1 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:k4cpR2UqvEn9eg52XxCU-476CAFI53N_.hX-zIDLvUwyCvRlZKeg2GpfvbZXI9Z8_0 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9400916185842480414', time=2024-09-05T03:57:34.514435+0000, chain.objs.size()=1 2024-09-05T02:16:21.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:choPxEl4U8PoOf3LcWd1tiAlENjjgnj_.swqLf4hzT5dBiLJvSGeeYidhDgwoOwF_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4445883487082418649', time=2024-09-05T03:57:45.771769+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:QFML3IrD6PcogYtjLb4uEvnZakbl2pS_.aFrW_D7P_-7vSTDfmanlDODKYIaarp6_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13406692748992989124', time=2024-09-05T03:58:45.104752+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:aYE-TAKTOXk3AW4kmayFFj7uuXFRah7_.E2ukbauMmcDA0OA-lcLp_486zKztlBf_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14408855498193527281', time=2024-09-05T03:58:50.417657+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:3QOa76JsYbviXgDmT.wjkHRvnz0XQrC_.D17cjJKelpgQ_OVkAzHX7DeF0WnkKQT_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17069102196196647675', time=2024-09-05T04:06:26.197256+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.668__shadow_.U3kwizABDU-nyA7Kwb63pHxfTz87pf6_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2221302018496478515', time=2024-09-05T04:07:19.935214+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.704__shadow:FdKKEpEgmJWmBt1kRNFRpZdsWU2L7Cw_.hUoWm87jQHvY_9E30pK-laILt8jfrEX_0 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15966121237148071713', time=2024-09-05T04:08:01.218690+0000, chain.objs.size()=1 2024-09-05T02:16:21.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.717__shadow:z.vwmMi2Z0dyWcUdvRytmvClGr05DSp_.b5tLiIHD3Mg7yWAg52UJFbZqzHEXyCb_0 2024-09-05T02:16:21.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.728+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.732+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-05T02:16:21.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50654' 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5062761554328771455', time=2024-09-05T03:32:48.012916+0000, chain.objs.size()=3 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-STANDARD.2~nyCSKlPu2kbOY-PsuTvpRvuyoz4Doiv.1 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-STANDARD.2~nyCSKlPu2kbOY-PsuTvpRvuyoz4Doiv.2 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-STANDARD.2~nyCSKlPu2kbOY-PsuTvpRvuyoz4Doiv.3 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_pGc2y17UXQwHmNi8s5Ad18NFMsj3q05', time=2024-09-05T03:32:50.420311+0000, chain.objs.size()=1 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.H3zRQWHS0b-nb1keiX_eMUCeg5VWvIr_0 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9436576060084362923', time=2024-09-05T03:33:18.229591+0000, chain.objs.size()=1 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.166__shadow_.ShFkHAN9wXYKafTKpA1ifHxnwrrqXvJ_0 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2221866555563097220', time=2024-09-05T03:33:45.379987+0000, chain.objs.size()=1 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.181__shadow_.0WYeTarEZHtXYP4npTEm7HHASuYjlBn_0 2024-09-05T02:16:21.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15180417153341248399', time=2024-09-05T03:34:20.916305+0000, chain.objs.size()=1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.197__shadow_.9v9rNX4494TR5zbGIiYIHuuXoIdNEnt_0 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~fV5FGlITQIWUNwmwA990tmCzrUNJRLk', time=2024-09-05T03:34:31.448958+0000, chain.objs.size()=1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.202__multipart_mymultipart.2~fV5FGlITQIWUNwmwA990tmCzrUNJRLk.1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13695665280497393246', time=2024-09-05T03:37:24.110887+0000, chain.objs.size()=1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.231__shadow_.p2gpO57ejsljhwrX3-8O3nMG-HVx6WC_0 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5104581802058027627', time=2024-09-05T03:37:43.847252+0000, chain.objs.size()=1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.241__shadow_.-A-NMxPH1lwtrBSWW_DOzc1qq9oRd1a_0 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7423807264216745478', time=2024-09-05T03:37:45.705264+0000, chain.objs.size()=1 2024-09-05T02:16:21.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.242__shadow_.qV9wS79dl9YbJHsqlOAxWG55pOB8DFj_0 2024-09-05T02:16:21.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14022397258781721078', time=2024-09-05T03:37:48.396929+0000, chain.objs.size()=1 2024-09-05T02:16:21.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.243__shadow_.hFBTmKzoC__xL74OZ5-sGLOsdlA0wEM_0 2024-09-05T02:16:21.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14615625951517943825', time=2024-09-05T03:37:56.704377+0000, chain.objs.size()=1 2024-09-05T02:16:21.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.247__shadow_.z0wuFU3NKdPX7ayVf-CLPsd-JAAkEl0_0 2024-09-05T02:16:21.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2729456952496784964', time=2024-09-05T03:37:56.726926+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.247__shadow_.ahG7bpmOiJSAZ5xGcg1xd36qzzYIJiU_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15381591415907352046', time=2024-09-05T03:38:02.323140+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.250__shadow_.V1xuiJt8cajhljV2avPVC1_M7n8aj3I_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17875914489309892198', time=2024-09-05T03:38:11.661935+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.255__shadow_.2Sodd5F33tD1KxCSVYfZXj3qs3yJYrg_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15801780788536552061', time=2024-09-05T03:40:04.901293+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7BX__SvAUIn-xWAR-D6khkCvqXcbBJs_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8438028864121718574', time=2024-09-05T03:40:04.903913+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UV8MDMP2PmE730msqitaYUy9Fdz2Dt8_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3898747614486973032', time=2024-09-05T03:40:05.703749+0000, chain.objs.size()=1 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XTD8kGA3eS842jA5CFt_UJO7Hg4OjSe_0 2024-09-05T02:16:21.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7881379955363993999', time=2024-09-05T03:40:05.827740+0000, chain.objs.size()=1 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.g4IS8w6j-HLk6KdifHJG8UU0RIGXEVK_0 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7132298060079596989', time=2024-09-05T03:40:06.152829+0000, chain.objs.size()=1 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bDrqSbeeqDvJaah48BzM6xHimf34Fc0_0 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14214325202594324720', time=2024-09-05T03:40:09.294677+0000, chain.objs.size()=1 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hrDPnGM2R0G-lDRg9_vBy_mLsCXWLFp_0 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16960035250275559666', time=2024-09-05T03:40:13.673801+0000, chain.objs.size()=1 2024-09-05T02:16:21.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kiJE2MAJ1AFc7a-VANGnGvCwsl6jhx-_0 2024-09-05T02:16:21.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12232667789108848768', time=2024-09-05T03:40:14.478253+0000, chain.objs.size()=1 2024-09-05T02:16:21.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QMQiQHVLwxqi_HRZdX78_MpsGS9xzLI_0 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1866380501849053150', time=2024-09-05T03:40:14.727465+0000, chain.objs.size()=1 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VVFfKKr4EbkebR3DsfdIuKkAYFMk5Ay_0 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15516860568912206499', time=2024-09-05T03:40:15.353171+0000, chain.objs.size()=1 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i0v3_SBXW1DBxEM8QGGqk1iT3DRO8ra_0 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15225486554223575266', time=2024-09-05T03:40:18.660196+0000, chain.objs.size()=1 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.p8XeXlYE3QZG_Sa1EEeAS5QN_xstNwL_0 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14912629537711946193', time=2024-09-05T03:40:19.416166+0000, chain.objs.size()=1 2024-09-05T02:16:21.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yJZEi0S8c1N-ahXNEM8zy--lSL--1GL_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5804562355769336368', time=2024-09-05T03:40:19.903945+0000, chain.objs.size()=1 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JrpMDPvzfQURAQuZMLKkBMAdpATbUm4_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16447622044069248786', time=2024-09-05T03:40:23.395934+0000, chain.objs.size()=1 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UlnC_nXbo6HWGNruawXdLpZnLbnuLR2_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12373866278912307720', time=2024-09-05T03:40:26.240454+0000, chain.objs.size()=1 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hKwKFsGLcwwt3v9nadPZtVkZic-sQYb_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12161769663684038952', time=2024-09-05T03:40:27.487214+0000, chain.objs.size()=1 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5Ecog_u_o-zjnXavQVvJRUNznJ2i6Hp_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16186403975926149404', time=2024-09-05T03:40:28.204051+0000, chain.objs.size()=1 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GKRneozv_C-sdzmTJ8aL4uvxMhffERL_0 2024-09-05T02:16:21.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6425965846425564063', time=2024-09-05T03:40:31.603037+0000, chain.objs.size()=1 2024-09-05T02:16:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.e73C7rAavA4QJOPaCvBdzb0CGyW48Q0_0 2024-09-05T02:16:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.513349123411303205', time=2024-09-05T03:40:31.666791+0000, chain.objs.size()=1 2024-09-05T02:16:21.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.744+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AyDzXxIPU8IOFaBdqRj7xBfsvv09WWi_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7088940771113528832', time=2024-09-05T03:40:32.671701+0000, chain.objs.size()=1 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cXdkJGTW0VUlz7uIWyb5O2t7ALcammY_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1187059939739600464', time=2024-09-05T03:40:33.103210+0000, chain.objs.size()=1 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zZxvgyWygz8ldk0eO7mhIVh0zxIWzWS_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1264974447364886526', time=2024-09-05T03:40:35.556297+0000, chain.objs.size()=1 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-ttqO9y0USPIcJQ7NDNxblbK7UQZEJJ_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2347856616810021629', time=2024-09-05T03:40:52.330460+0000, chain.objs.size()=1 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.271__shadow_.iRDQsSfcoFCS62x89w5rFFeZ9h0qr9C_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3995106314156556683', time=2024-09-05T03:41:04.989804+0000, chain.objs.size()=1 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.278__shadow_.21cClmC98vyX6GsibWG7qHOCpshMXeT_0 2024-09-05T02:16:21.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2587278023508942091', time=2024-09-05T03:41:10.546936+0000, chain.objs.size()=1 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281__shadow_.a5x6aN3lMVKTk7H6TzJmiyRvJSLAOz6_0 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10385314154159537950', time=2024-09-05T03:41:22.091302+0000, chain.objs.size()=1 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.287__shadow_.8ZhctOE_74gYGvQeS1VDW8jkP9WCqJy_0 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15061683794628010913', time=2024-09-05T03:41:35.083774+0000, chain.objs.size()=1 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.cMPf5aXHqcTwSZhNiX1ZRtBp3SoBhxe_0 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8637536189591092819', time=2024-09-05T03:41:39.979450+0000, chain.objs.size()=1 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.paGJa-rVyKuYPCudOXiC6MxZyXZ1-BN_0 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4434077813796372885', time=2024-09-05T03:41:40.096343+0000, chain.objs.size()=1 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.kNiHXVsiH74M39vt2gVlwF7szqhhoI5_0 2024-09-05T02:16:21.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6990825989455894490', time=2024-09-05T03:41:40.354472+0000, chain.objs.size()=1 2024-09-05T02:16:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_._pL7zZ-TmjOvgbn0v2-2ToGIn4PflRL_0 2024-09-05T02:16:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3209393116357810837', time=2024-09-05T03:41:59.201763+0000, chain.objs.size()=1 2024-09-05T02:16:21.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.303__shadow_.bc19FyMTCQUMMO49IIk_qOLI1ktMgAo_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15373925451327300583', time=2024-09-05T03:42:02.866867+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.305__shadow_.LvXcgi77mS4uPvbilXJa-SbXsy82WwZ_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3638232726039754841', time=2024-09-05T03:42:02.897990+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.305__shadow_.K-v9YygyFO7pXHpwd2cb48MBD-zyf1M_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11810495036601134377', time=2024-09-05T03:44:19.278136+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GFSNP-vyQzj63i0hzyBsiGfA91QeFrk_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17549608682490512635', time=2024-09-05T03:44:19.280210+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fz7ysJg80pEAH3w-NQ9pdQEw1ugZduc_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12426591458780037471', time=2024-09-05T03:44:19.818167+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.u6Pv3NJ4LxlhZEuM05wQwTZN7Vg-beP_0 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5649674937862437948', time=2024-09-05T03:44:21.989838+0000, chain.objs.size()=1 2024-09-05T02:16:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.17_SMWRE3G0iYXzX11ZJlPQqoQ0AItI_0 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.790461050715574276', time=2024-09-05T03:44:22.406834+0000, chain.objs.size()=1 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HQ6aixipHbDDbwlR0bYuFt7HeKeaf8f_0 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17739052711313983955', time=2024-09-05T03:44:23.847659+0000, chain.objs.size()=1 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6uMODhP5ARtgjtUlyTRVLiXFOeTGJbZ_0 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11239988285944339166', time=2024-09-05T03:44:24.311562+0000, chain.objs.size()=1 2024-09-05T02:16:21.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FVVXJolfoE6810YBlDGMe9B4mHMir5c_0 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16306701612624444274', time=2024-09-05T03:44:25.951983+0000, chain.objs.size()=1 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SfjiBItf0jI2kn4EzJzwshjKv_6qHSL_0 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1415974621014046231', time=2024-09-05T03:44:27.687113+0000, chain.objs.size()=1 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.izK5qP6hgwbB9oixILpfeRJm8N_Xy7u_0 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5109450022375246707', time=2024-09-05T03:44:28.102212+0000, chain.objs.size()=1 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xpI5ntktOzyD-5_BB5E2pCQHqxyGXgv_0 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14648377029953568415', time=2024-09-05T03:44:28.241976+0000, chain.objs.size()=1 2024-09-05T02:16:21.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6pIVyt0vEAtkyZuGBF8e9pyCO0kgSQv_0 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3145061536213570551', time=2024-09-05T03:44:29.103950+0000, chain.objs.size()=1 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sNSX9nAKXOp5QSgZi7pWLFR6aX7g2PB_0 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1317354538942305542', time=2024-09-05T03:44:29.605729+0000, chain.objs.size()=1 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SEMrtNuI290_lxpzjobMlgOcBSEoIlr_0 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17793378333074416416', time=2024-09-05T03:44:29.646581+0000, chain.objs.size()=1 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PKq-e2cARYqvuFvm2Y0X2fQ6dR5SpVC_0 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18315401268798436644', time=2024-09-05T03:44:30.368084+0000, chain.objs.size()=1 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QcRtoHfdYl4tvh9zDJslk24WjKamoDV_0 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8284672047097790398', time=2024-09-05T03:44:30.586747+0000, chain.objs.size()=1 2024-09-05T02:16:21.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.InjYo0hqhilhWsEPYzuioqtwm5l2MJ__0 2024-09-05T02:16:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5010377945145627231', time=2024-09-05T03:44:32.446864+0000, chain.objs.size()=1 2024-09-05T02:16:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q36cyvc8WOl29j6oplzd_8CGhXs3Sby_0 2024-09-05T02:16:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16369426441519650936', time=2024-09-05T03:44:33.648687+0000, chain.objs.size()=1 2024-09-05T02:16:21.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.65cT5ZV8wdjm1tONjbrfpZUjj5Hz2mE_0 2024-09-05T02:16:21.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7511961232245094961', time=2024-09-05T03:44:34.451740+0000, chain.objs.size()=1 2024-09-05T02:16:21.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IMksKkKB2nFoPZgNQhknhSdqoaTT4b5_0 2024-09-05T02:16:21.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15289138570734416002', time=2024-09-05T03:44:34.814471+0000, chain.objs.size()=1 2024-09-05T02:16:21.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vdAMum2lwyHSqSEtu8mdHMESVaxjkm7_0 2024-09-05T02:16:21.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13614337761139454877', time=2024-09-05T03:44:35.903539+0000, chain.objs.size()=1 2024-09-05T02:16:21.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KGMA18RclKn-aUi3fbKf3wi7qVBoDKn_0 2024-09-05T02:16:21.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4522159539909483448', time=2024-09-05T03:44:35.968776+0000, chain.objs.size()=1 2024-09-05T02:16:21.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Ip0r5yWw8OmX6kvTvpQlY8NTRbSvR71_0 2024-09-05T02:16:21.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7801522453753729485', time=2024-09-05T03:44:38.648405+0000, chain.objs.size()=1 2024-09-05T02:16:21.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iBodDxykwYTCVO1FZu8R32GiqUDVdqp_0 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6533014403915752890', time=2024-09-05T03:44:39.004292+0000, chain.objs.size()=1 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.3F6sncX8efF3N-g75H9OT6A-bvMa8eE_0 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4421234826923945948', time=2024-09-05T03:44:40.362334+0000, chain.objs.size()=1 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.livIurXxc9ZIOgu_P4iVWg0b2571d3P_0 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17560971461725599426', time=2024-09-05T03:44:41.489201+0000, chain.objs.size()=1 2024-09-05T02:16:21.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AYpKwaI24MYe6_t3DXNQtqf-yA5rpuW_0 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2087682790089764798', time=2024-09-05T03:44:42.847224+0000, chain.objs.size()=1 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.D-mvVwTsqS4P92l77hJGFhymggGygLF_0 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8133310358927354961', time=2024-09-05T03:44:43.059436+0000, chain.objs.size()=1 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cSZu7W0SZY3npC-u33Fju2CVXwn4irm_0 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13711203535058535859', time=2024-09-05T03:44:44.783994+0000, chain.objs.size()=1 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZDniSh4JDfFIZf4ui5NVlCBU4TGFVMr_0 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9195235077892887167', time=2024-09-05T03:44:46.080173+0000, chain.objs.size()=1 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.y0BNdq8jLBIDxRCGUBJ4zoq4ooyRIEU_0 2024-09-05T02:16:21.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13619458967747556428', time=2024-09-05T03:44:46.259717+0000, chain.objs.size()=1 2024-09-05T02:16:21.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4QP1M4whlMRa4Fh81D19OHKnw1fOh9O_0 2024-09-05T02:16:21.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8155416681346871475', time=2024-09-05T03:44:47.705439+0000, chain.objs.size()=1 2024-09-05T02:16:21.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ldX-X86O8AbIzsvGj2A0BdgpVYsAuX9_0 2024-09-05T02:16:21.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14829227384738744119', time=2024-09-05T03:44:48.224116+0000, chain.objs.size()=1 2024-09-05T02:16:21.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BFLytzpULo7P4SyrTtYNFqQOLo0yJ_r_0 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4375416953413683667', time=2024-09-05T03:44:50.199546+0000, chain.objs.size()=1 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Wy2B6NanPom3frR5rL7jAYYeKEVpouh_0 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7801560286269209986', time=2024-09-05T03:46:36.045642+0000, chain.objs.size()=1 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XYYquVCkZ_AlLelUzoPM3xewHlXEao2_0 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3229387232494154764', time=2024-09-05T03:46:37.799046+0000, chain.objs.size()=1 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dlxVNmYcDgPL1oIGisqJmszLq5GddK__0 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12647275419362783670', time=2024-09-05T03:46:38.221415+0000, chain.objs.size()=1 2024-09-05T02:16:21.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.INBz5KR6KQGQnuDLo8M1VxUz71ahcTl_0 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3131316996438417001', time=2024-09-05T03:46:38.241774+0000, chain.objs.size()=1 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RUYA49hWsCv1lDFuAm6z9IWxOSf6ocJ_0 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7448309546449323987', time=2024-09-05T03:46:38.964843+0000, chain.objs.size()=1 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XFyp1d5pOvWAWDgc6CyrQGO-wdVDBdB_0 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13242942648256049590', time=2024-09-05T03:46:39.612687+0000, chain.objs.size()=1 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ioqnks9Lyr0P6Vu-NC_M31PU4ElP-jr_0 2024-09-05T02:16:21.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9263319354948967554', time=2024-09-05T03:46:40.054948+0000, chain.objs.size()=1 2024-09-05T02:16:21.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.r1OiP5dMBmcTbzkYKhTuqyP9Xvj9L0U_0 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2811353707652333202', time=2024-09-05T03:46:42.682456+0000, chain.objs.size()=1 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cogWY5W12g9TIUegH1fm_z1EB-7dP03_0 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4629239648476344558', time=2024-09-05T03:46:42.748550+0000, chain.objs.size()=1 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.babeMIzJDVriZbQ7A4H7f3gYHMhXQc-_0 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12250346240474068370', time=2024-09-05T03:46:42.971010+0000, chain.objs.size()=1 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nS2FDGYBOOYGzN1lAEaLmB34BNTY14s_0 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4675001064199697469', time=2024-09-05T03:46:44.289218+0000, chain.objs.size()=1 2024-09-05T02:16:21.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.q-MjB11Qixg2oH4rInqI_TGSa_tOCMj_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13222242517723226512', time=2024-09-05T03:46:46.081693+0000, chain.objs.size()=1 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.k7Ssnl-h93LuIiFQjrTCVNUZPTxM0EC_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5505865252865497817', time=2024-09-05T03:46:46.882865+0000, chain.objs.size()=1 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rdoCYYpxYvyHP52iWHp25_jre56VkE4_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16480228539889357892', time=2024-09-05T03:46:46.884614+0000, chain.objs.size()=1 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Gmo9EhSkf5j1NEvInaAO2ctHEUWvRG6_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.510537029550443876', time=2024-09-05T03:46:47.379457+0000, chain.objs.size()=1 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.26JFYG1c9L3FsSNIuIoPOB7JcoKFQFq_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15042084973195068408', time=2024-09-05T03:46:49.095396+0000, chain.objs.size()=1 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LDgmPPyRN0pK7fhEQ84KLT8qfPeAswC_0 2024-09-05T02:16:21.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14521615101208773610', time=2024-09-05T03:46:51.542997+0000, chain.objs.size()=1 2024-09-05T02:16:21.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.g3v5NzDMMkivlRx8rsiDJWa68r9v4HP_0 2024-09-05T02:16:21.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16049951247374060854', time=2024-09-05T03:46:53.259949+0000, chain.objs.size()=1 2024-09-05T02:16:21.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cOGQg163Ho2wp3GcbbOw55NreaholTm_0 2024-09-05T02:16:21.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.772+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1868879260361316608', time=2024-09-05T03:46:54.676062+0000, chain.objs.size()=1 2024-09-05T02:16:21.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.772+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o_w6LnN7ftNnCd6gKNbbifTbi0xylXt_0 2024-09-05T02:16:21.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50654 2024-09-05T02:16:21.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-05T02:16:21.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4020355260821689180', time=2024-09-05T03:46:55.147028+0000, chain.objs.size()=1 2024-09-05T02:16:21.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Glg_olu-2jq_Pkv-sXJsOYpglt81ska_0 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17998363184869572137', time=2024-09-05T03:46:55.404262+0000, chain.objs.size()=1 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0zVFb1O7d2zkoxdIWVvikAZ5qSacjrd_0 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14177935936266031702', time=2024-09-05T03:46:55.490494+0000, chain.objs.size()=1 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V1Uhf17YMX9aj8bxaVKvF4sQ2o2Kb7Z_0 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8373508608882678614', time=2024-09-05T03:46:56.611301+0000, chain.objs.size()=1 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Oya1G67YimB7iwcMOiJ-6aff-JqZz5y_0 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2568150677210487536', time=2024-09-05T03:47:01.045177+0000, chain.objs.size()=1 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0o5KVMHYNGn8ATAGMF0vZowV-Ilss7Q_0 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8367627925854337283', time=2024-09-05T03:47:01.172210+0000, chain.objs.size()=1 2024-09-05T02:16:21.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oHtvzY1xKVFT_lQpd_ptWvOKr3x722K_0 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8659721559354800616', time=2024-09-05T03:47:01.919990+0000, chain.objs.size()=1 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cPpzM0FZJmcAF5XOH7rIcaafygKxxlT_0 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8062018442049460823', time=2024-09-05T03:47:01.990649+0000, chain.objs.size()=1 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.pcXdVEGwHDtasVVDDQpLGJWn6zsfhiC_0 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11524317350233951088', time=2024-09-05T03:47:02.093058+0000, chain.objs.size()=1 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vMzlAXUgjaXr4C7GGv6B6Qrz0BwXuDz_0 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9499959362011003416', time=2024-09-05T03:47:11.866446+0000, chain.objs.size()=1 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.329__shadow_.O4d-HYESfw6JcXajAVKo7U46L6nbM4e_0 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10283165926413341459', time=2024-09-05T03:48:31.208170+0000, chain.objs.size()=1 2024-09-05T02:16:21.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.384__shadow_.KcOrl1ZUgoNY_EFKiVMOcmTOe2L3vjS_0 2024-09-05T02:16:21.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18359139794929940885', time=2024-09-05T03:49:45.131762+0000, chain.objs.size()=1 2024-09-05T02:16:21.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.433__shadow_.RwJAoDUaomJSgxeBJyImIg7x96rKKvp_0 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.149909035111441346', time=2024-09-05T03:51:20.273754+0000, chain.objs.size()=1 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.487__shadow_.vCFz6S_jDhzGHcSY02lO3xpXDbK35IX_0 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17374168325879373822', time=2024-09-05T03:51:23.653213+0000, chain.objs.size()=1 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.489__shadow_.u_XEqqpkc8LiUofLHxbmzVIoSBix71o_0 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17757520444258264136', time=2024-09-05T03:51:46.317326+0000, chain.objs.size()=1 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17172174903560407007', time=2024-09-05T03:52:48.579219+0000, chain.objs.size()=6 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.1 2024-09-05T02:16:21.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.2 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.3 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.4 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.5 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.519__multipart_mymultipart.2~Dadw0DahhR_QZ2E7u7QgoIPaCn4gYYD.6 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.357853+0000, chain.objs.size()=1 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.1 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.367041+0000, chain.objs.size()=1 2024-09-05T02:16:21.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.2 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.376321+0000, chain.objs.size()=1 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.3 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.385653+0000, chain.objs.size()=1 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.4 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.396127+0000, chain.objs.size()=1 2024-09-05T02:16:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.5 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_', time=2024-09-05T03:54:18.405587+0000, chain.objs.size()=1 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~ptQ-UP7pUEEbDdYANjAtiS2tICdehs_.6 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9450304156448547852', time=2024-09-05T03:56:24.516217+0000, chain.objs.size()=1 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.550__shadow_.lJ2kS4LqUNY3CdSGGavSXIgfgIPR0rD_0 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8140819890984391286', time=2024-09-05T03:57:04.784309+0000, chain.objs.size()=1 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.561__multipart_mymultipart.2~8iASL9GTRdzG0JJtfLxGTD0SR_UHm4K.1 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10283213302420835092', time=2024-09-05T03:57:53.086230+0000, chain.objs.size()=1 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.572__shadow_.B0h6KCQF00bgr9D3sIaaKxz7cTw92v6_0 2024-09-05T02:16:21.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1609462403928270906', time=2024-09-05T03:58:49.602224+0000, chain.objs.size()=1 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:1JqN5.m6CTyCWCaCdOvbUQRI.9yHKQ9_.VDkT5TRZ0bh0X8LmQ8gw2GZhZf6QVtj_0 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13803355932033077679', time=2024-09-05T03:59:39.719548+0000, chain.objs.size()=1 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.585__shadow:COO4dk9hue3l5A-8v-WIdwRfA3T0i52_.ESBV6byQOs1oSZU6A2oUpsLxYjNzb0j_0 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14341450297288243614', time=2024-09-05T03:59:46.067947+0000, chain.objs.size()=1 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:RysFogTmHHlhuktMDmkcy5co-DAC8nK_.c97-l7bpiS4p43euYVZ4_4coDwiO7fL_0 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14025456796234793685', time=2024-09-05T04:04:54.149796+0000, chain.objs.size()=1 2024-09-05T02:16:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.630__shadow_.iLfT8SHMgcL5ih-Yjw5UPW6wyBT4bMO_0 2024-09-05T02:16:21.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.792+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-05T02:16:21.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43168' 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9101935604288810438', time=2024-09-05T03:33:02.797366+0000, chain.objs.size()=3 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-LUKEWARM.2~VaWEljMmdsS6OX2yTg0gLcEzxXX4YoI.1 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-LUKEWARM.2~VaWEljMmdsS6OX2yTg0gLcEzxXX4YoI.2 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__multipart_foo-LUKEWARM.2~VaWEljMmdsS6OX2yTg0gLcEzxXX4YoI.3 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_87wNn6NCszdsnju42K9_auYYSL0Lz-p', time=2024-09-05T03:33:08.249557+0000, chain.objs.size()=2 2024-09-05T02:16:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.fiOUkriaSRxyVrZXCeW3bEZiaRtDP_N_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.fiOUkriaSRxyVrZXCeW3bEZiaRtDP_N_1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4563791655861537749', time=2024-09-05T03:37:24.129993+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.231__shadow_.9ZB8kyrQHbjMPqMy4_jCo1KCCAs8Dv5_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10343192152551628936', time=2024-09-05T03:37:27.933499+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.233__shadow_.8I37NADYORPAjholGw02l9oQ0jcpydZ_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1778482475072209466', time=2024-09-05T03:37:51.113740+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244__shadow_.u3yCFBOhI1oiSQnw8eYAU2OTL-zS1x0_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14031317093041351493', time=2024-09-05T03:37:52.966271+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.245__shadow_.K51WlIlIihS7MyZqCnYIqWAeI8Jt5OQ_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2500761397873562411', time=2024-09-05T03:40:04.394462+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0HSNjFVStVsSqx-lQszcG4XtLwo5iRt_0 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15378708029326437217', time=2024-09-05T03:40:04.989037+0000, chain.objs.size()=1 2024-09-05T02:16:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ISRAAO17akVCEPsZASGtE_MuDrFxtQD_0 2024-09-05T02:16:21.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2450069142867298199', time=2024-09-05T03:40:06.254781+0000, chain.objs.size()=1 2024-09-05T02:16:21.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xCNpA9XtX7WgTKr7cnOAhVM0dVnxGZa_0 2024-09-05T02:16:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4214205284112359507', time=2024-09-05T03:40:07.415141+0000, chain.objs.size()=1 2024-09-05T02:16:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SWlt36TFqh1-oaMvmTlRui1aG8gwx4c_0 2024-09-05T02:16:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1824169703244913039', time=2024-09-05T03:40:08.922980+0000, chain.objs.size()=1 2024-09-05T02:16:21.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8Z_Khxo7udO1t5swhF1ujs9rVOutgPS_0 2024-09-05T02:16:21.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2983164273097574817', time=2024-09-05T03:40:09.021912+0000, chain.objs.size()=1 2024-09-05T02:16:21.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sd02ow7I4ip5qF_wm1RweEW31PUPego_0 2024-09-05T02:16:21.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244459874409552023', time=2024-09-05T03:40:10.439254+0000, chain.objs.size()=1 2024-09-05T02:16:21.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i82ICan3gH-PhfA44_UrXY9h7YJy-Kv_0 2024-09-05T02:16:21.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8158628244652029664', time=2024-09-05T03:40:11.094164+0000, chain.objs.size()=1 2024-09-05T02:16:21.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0RZ_ANvHdlvepx1myDYEioCNnMMGqYD_0 2024-09-05T02:16:21.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.394327606644780820', time=2024-09-05T03:40:11.481280+0000, chain.objs.size()=1 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jzco9oqzmQVxWzITh1t-yi23htwtzud_0 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11719991174791940202', time=2024-09-05T03:40:13.762639+0000, chain.objs.size()=1 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mh8SzJ6j_kkATCc7zCaI3N8iNfqOpB1_0 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8849331738140836899', time=2024-09-05T03:40:15.550371+0000, chain.objs.size()=1 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jsjrdN3VBFrmCoXuisBc2BhL1Il-HYT_0 2024-09-05T02:16:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4256551727435129716', time=2024-09-05T03:40:15.965297+0000, chain.objs.size()=1 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.IHlXqODKXd7WEThJinWr7dgvUwmBxPO_0 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11455025063370499177', time=2024-09-05T03:40:16.102571+0000, chain.objs.size()=1 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0tLo0blYx2r3X0_y4fwvLugonr2wVGi_0 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4868455801376951380', time=2024-09-05T03:40:16.190925+0000, chain.objs.size()=1 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.s4xXg50QZLBow6L5L6MfmrOO72tt9OX_0 2024-09-05T02:16:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7844188215361374429', time=2024-09-05T03:40:17.534340+0000, chain.objs.size()=1 2024-09-05T02:16:21.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.34aiaziIpCnCetXK3vnTDPNxtKJOAYO_0 2024-09-05T02:16:21.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12000119253597631921', time=2024-09-05T03:40:19.148813+0000, chain.objs.size()=1 2024-09-05T02:16:21.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KOowVv5fANg8Aj0-alZzHw_0HvykL2C_0 2024-09-05T02:16:21.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.911190577672506947', time=2024-09-05T03:40:19.362667+0000, chain.objs.size()=1 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gyKjqpbEIoLARjYClTSFOdpTEIipat8_0 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7355739209379103860', time=2024-09-05T03:40:20.753046+0000, chain.objs.size()=1 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xK0aRBKAZDmPgweJ3iCt8uSVZrEOvAq_0 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6630733469959880216', time=2024-09-05T03:40:22.259853+0000, chain.objs.size()=1 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6AEcBz6avfuKomnXSFjRm_8sat5b499_0 2024-09-05T02:16:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1758661791072466625', time=2024-09-05T03:40:22.785402+0000, chain.objs.size()=1 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YE_aIa9yWhI2qpypjSaV_tdGTJ1s1qU_0 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17287837386018180046', time=2024-09-05T03:40:22.869460+0000, chain.objs.size()=1 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.afcna1suGcFyfbOr8KcSoLjfBmUtI1S_0 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9113394393974166759', time=2024-09-05T03:40:25.004636+0000, chain.objs.size()=1 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cAChQwPzAkolkyqOb4wHXfRDO0iy7U6_0 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17978288679201270608', time=2024-09-05T03:40:26.548747+0000, chain.objs.size()=1 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.slSdAXgVR6TP13lFMD6h-18nOxZsf0r_0 2024-09-05T02:16:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6553443629413896859', time=2024-09-05T03:40:27.625460+0000, chain.objs.size()=1 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sS26yufIFpqDM3aufrludLuH21_7n1B_0 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8269815033367901128', time=2024-09-05T03:40:28.262327+0000, chain.objs.size()=1 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OX4dDzuk9gjONTbKzqfLXQZE0Qn544f_0 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17556845443334993000', time=2024-09-05T03:40:29.209667+0000, chain.objs.size()=1 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zC08zvbNmQ8s59ZdzcEhRIv3vGsI6g2_0 2024-09-05T02:16:21.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11456660277590536863', time=2024-09-05T03:40:30.016606+0000, chain.objs.size()=1 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LEbdWg5KsF0HjI48yl0lpLl5g-bpPuz_0 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3537706056558198603', time=2024-09-05T03:40:31.187972+0000, chain.objs.size()=1 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1-d1zF8_pUcJE7Gs54Qk9Vf1ZT-o042_0 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2043539490187842787', time=2024-09-05T03:40:31.397653+0000, chain.objs.size()=1 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JJ0Vh0WY4yx5hOKZX1GjMTeVqSZBVsB_0 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15873388040085980619', time=2024-09-05T03:40:31.728839+0000, chain.objs.size()=1 2024-09-05T02:16:21.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7F4s-FIynlrVqMi6MwvKZ1D5WoUj9PR_0 2024-09-05T02:16:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5286541158289706550', time=2024-09-05T03:40:32.720530+0000, chain.objs.size()=1 2024-09-05T02:16:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eOSb47ruWg4n3pINrXeiq8EI1q2RyUo_0 2024-09-05T02:16:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2313641026817884676', time=2024-09-05T03:40:34.260402+0000, chain.objs.size()=1 2024-09-05T02:16:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B75WemL9swa_mQzEUR7KaO6ZJZd841c_0 2024-09-05T02:16:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2894258329868051077', time=2024-09-05T03:40:35.813137+0000, chain.objs.size()=1 2024-09-05T02:16:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0sgc2cYhCrpdwIwmW9xr-CEOai2FbN__0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6617413703626846419', time=2024-09-05T03:41:03.115601+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.277__shadow_.BtKfAMuKbUKqaRRkBRAMK6TLNmzGDD7_0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8729083049420367258', time=2024-09-05T03:41:20.216398+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.286__shadow_.PGtJovh_VclE1dflxdXrAudKgPERxxa_0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13845278115166353209', time=2024-09-05T03:41:39.964915+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.tIkOesYLpR00j2rB8QV05f3ayXqPGPY_0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4694386583002628490', time=2024-09-05T03:41:39.967017+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.crimrYDfYLlfkZQleTos_vTjpdEsZ81_0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12027308383169649893', time=2024-09-05T03:41:45.935122+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.296__shadow_.leyh7_lWZ7WV3Kt-buqfNNtl0YgHoke_0 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.883930589175541787', time=2024-09-05T03:42:08.102847+0000, chain.objs.size()=1 2024-09-05T02:16:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.307__shadow:ZvJF2N7gQVgrhviYvaCcbLTC.-7O5I0_.dZn-HZOLtpvOMPxEFiADxiRWCumF6cM_0 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10004160264489482850', time=2024-09-05T03:44:19.170481+0000, chain.objs.size()=1 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.M9tFeZeFXsqXVCXLdYb7EgwYSF0YJbA_0 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6678173653359958106', time=2024-09-05T03:44:19.631330+0000, chain.objs.size()=1 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WNVKPQDV957bG5FP2MGtW6eAvq54wJW_0 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16784549574962361194', time=2024-09-05T03:44:19.656737+0000, chain.objs.size()=1 2024-09-05T02:16:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5R0Uvx74XTRDsqTgfrnInZvf0HmcOzb_0 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7569711694170691659', time=2024-09-05T03:44:19.989857+0000, chain.objs.size()=1 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yzpx7meGh5kIESHPqtDe9PrXQRJLa5__0 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16977284459250216822', time=2024-09-05T03:44:20.503714+0000, chain.objs.size()=1 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qljJRNN3cUkELZ8TOcjUsT7RofShmVB_0 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17697249697275879914', time=2024-09-05T03:44:20.631064+0000, chain.objs.size()=1 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ob9zGgxo_jpUyNgY4qV_5whq1qGou5x_0 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1346637262411069950', time=2024-09-05T03:44:21.228499+0000, chain.objs.size()=1 2024-09-05T02:16:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YvfDIYPal9iQX0FIF-d-db2kto4d9Nu_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11385849572614184577', time=2024-09-05T03:44:22.296711+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0SW6z0y-PnCZi3UiCMBEWvomWwDNhIG_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11227388454105720866', time=2024-09-05T03:44:22.298577+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.t-EcJDszvvi8oWssZx3o3Gsk0HxrhYh_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9386880367695850144', time=2024-09-05T03:44:22.339438+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.71EugMqIfw5tlRMV_cc7JQVOMQ88gNe_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5292550695640245593', time=2024-09-05T03:44:24.932369+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oX0O_oVCe0GGbNLhS268BuThn3dHbp7_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7970998971823969095', time=2024-09-05T03:44:25.874216+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Sf-9r612Id26wIXELE5uWQ_x9TJFrsO_0 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15853927000134618947', time=2024-09-05T03:44:26.324293+0000, chain.objs.size()=1 2024-09-05T02:16:21.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d4QSLk3P5ZQnbmR6nMu1RVfbuFCCrBE_0 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17298508101019747180', time=2024-09-05T03:44:28.059482+0000, chain.objs.size()=1 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sq1lWKP54aIJJhPzsBw6-3qs7UQ4bKG_0 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9995191452187020864', time=2024-09-05T03:44:28.120661+0000, chain.objs.size()=1 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QPwIksQhR6yxriKT6JtjY-OJ5DGQrKy_0 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6648857495456624135', time=2024-09-05T03:44:28.436632+0000, chain.objs.size()=1 2024-09-05T02:16:21.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YbjQu8CoJZQl0lfMuaIdbFs6NUNfFw7_0 2024-09-05T02:16:21.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13274275221037349630', time=2024-09-05T03:44:28.865825+0000, chain.objs.size()=1 2024-09-05T02:16:21.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.y9pHOOPHGagY1pFJEPHvG3ynbybwSnP_0 2024-09-05T02:16:21.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11004299168460453945', time=2024-09-05T03:44:29.357862+0000, chain.objs.size()=1 2024-09-05T02:16:21.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Qcu2brEdJnjrRCWqDg5-x9LmlWTemTH_0 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16880768959835040570', time=2024-09-05T03:44:30.454841+0000, chain.objs.size()=1 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ozEQxe1BgGomkAsrqAVuMmNFNnrJDQb_0 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10491474168304744438', time=2024-09-05T03:44:32.325019+0000, chain.objs.size()=1 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.t0vbU8p70q0JYG9fuHTWAfDY6yA2m76_0 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3259826105781884812', time=2024-09-05T03:44:32.984715+0000, chain.objs.size()=1 2024-09-05T02:16:21.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.j9nSOIEdWWYU5ot74seujsxXfeLCMy7_0 2024-09-05T02:16:21.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10556485559044919563', time=2024-09-05T03:44:33.225767+0000, chain.objs.size()=1 2024-09-05T02:16:21.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jfNtbfGJp2GBZx4AzVodHzMbGczgeoV_0 2024-09-05T02:16:21.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7157923974679265006', time=2024-09-05T03:44:33.228028+0000, chain.objs.size()=1 2024-09-05T02:16:21.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8h44VNRWT9ZtMWy29hz8iYjDXrngtgY_0 2024-09-05T02:16:21.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1807841832094655985', time=2024-09-05T03:44:33.357832+0000, chain.objs.size()=1 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h5-OouJwNinphewxN7NwPeq1Zcp3nTM_0 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13543186269316199215', time=2024-09-05T03:44:33.360108+0000, chain.objs.size()=1 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hXhBgN2QTpkxcNCfD0H1X74YRWKWdVD_0 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11317468702123023102', time=2024-09-05T03:44:33.826741+0000, chain.objs.size()=1 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DPp-eaAWXxYg59GeTkFtGv6XBA4PShB_0 2024-09-05T02:16:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3004311249082190388', time=2024-09-05T03:44:33.929122+0000, chain.objs.size()=1 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QlhghAsWutksA_j5uuo3lWgpbqDEsp8_0 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6656241250559628703', time=2024-09-05T03:44:34.451731+0000, chain.objs.size()=1 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Amjo7ICbOpX3uCF9ke5r2SZ77CQC94X_0 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15558423462334641992', time=2024-09-05T03:44:37.137020+0000, chain.objs.size()=1 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AV5bv-deDFvEk5Ys2742bOuMhUgmzD1_0 2024-09-05T02:16:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12183588096487827192', time=2024-09-05T03:44:38.984562+0000, chain.objs.size()=1 2024-09-05T02:16:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bDjYzieyFp-0M4h17RG9KnrHCxciEpG_0 2024-09-05T02:16:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5775568464668999101', time=2024-09-05T03:44:40.571722+0000, chain.objs.size()=1 2024-09-05T02:16:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VW2R953R32S0li01BfYWgyqh1l3-qg3_0 2024-09-05T02:16:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14701507939229400715', time=2024-09-05T03:44:41.306983+0000, chain.objs.size()=1 2024-09-05T02:16:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1W8MTNiUuUxTZTXBuB_PwNuHhBQ0Wtm_0 2024-09-05T02:16:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16997606526623256544', time=2024-09-05T03:44:45.624842+0000, chain.objs.size()=1 2024-09-05T02:16:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ezb9S-fKOPeKf57hwbGrT50sg8fAqIE_0 2024-09-05T02:16:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14097898813422860556', time=2024-09-05T03:44:46.545080+0000, chain.objs.size()=1 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.K3U_EIiKdKlbgQpcUYrDCFnHRShQxAR_0 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1069355877993553102', time=2024-09-05T03:46:35.906941+0000, chain.objs.size()=1 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GCZkuzzFoGbGJ-c4VCPN22OoTJg6YZb_0 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3325190178373972480', time=2024-09-05T03:46:36.056142+0000, chain.objs.size()=1 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.w_2GTYr77887BZmB7piBiKfbG3OFg9y_0 2024-09-05T02:16:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13042223662228500108', time=2024-09-05T03:46:36.058372+0000, chain.objs.size()=1 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zH-JmExu2yTd50xWVcbl3Qp5yN9rUTo_0 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6454035627278399599', time=2024-09-05T03:46:36.636916+0000, chain.objs.size()=1 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iaLqyrVKHlmfUYHa9o1mAyQgm81O5r5_0 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3298303436193257791', time=2024-09-05T03:46:38.624768+0000, chain.objs.size()=1 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZUBj9GRXHiysdF_z01TYb9Ds2N3Ywjr_0 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13599499548776031622', time=2024-09-05T03:46:39.140531+0000, chain.objs.size()=1 2024-09-05T02:16:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.X1pf41HC4qDAA70XUz5rXpwL4D-T-u0_0 2024-09-05T02:16:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2860976979883052656', time=2024-09-05T03:46:40.727630+0000, chain.objs.size()=1 2024-09-05T02:16:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.s0QeBL9w9HWSu3wtpWL9oA-vB2q0Fgg_0 2024-09-05T02:16:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7637371640169711998', time=2024-09-05T03:46:42.364198+0000, chain.objs.size()=1 2024-09-05T02:16:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rFCErl8htoAgoCEtvh0bA39DdywDHas_0 2024-09-05T02:16:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13274583492579894133', time=2024-09-05T03:46:44.242646+0000, chain.objs.size()=1 2024-09-05T02:16:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WUgfJmp2H1FfJH0ry_4sZNoZZlyGe7N_0 2024-09-05T02:16:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17176393852885633361', time=2024-09-05T03:46:44.769401+0000, chain.objs.size()=1 2024-09-05T02:16:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tTHhKSZTbuwLk10HCW0PQpl-_N2I290_0 2024-09-05T02:16:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.257979845767334457', time=2024-09-05T03:46:45.033823+0000, chain.objs.size()=1 2024-09-05T02:16:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jgUOjGuA7JJOzJ8HbhBCJPMZGRH23Ad_0 2024-09-05T02:16:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16930332718385706035', time=2024-09-05T03:46:46.633331+0000, chain.objs.size()=1 2024-09-05T02:16:21.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.r1k1WTwIWEevDmiPgN3Lxc3pRAYwQMe_0 2024-09-05T02:16:21.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12849989459081276424', time=2024-09-05T03:46:47.093735+0000, chain.objs.size()=1 2024-09-05T02:16:21.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PYCWffCnYi7yeRJtB0yf4Z5H6uXWPCS_0 2024-09-05T02:16:21.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3764084376587465688', time=2024-09-05T03:46:47.859352+0000, chain.objs.size()=1 2024-09-05T02:16:21.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DeISHHyCRcr7HUOqeSokJqUzjxFBXgu_0 2024-09-05T02:16:21.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15322789383139866708', time=2024-09-05T03:46:48.237594+0000, chain.objs.size()=1 2024-09-05T02:16:21.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oPNS1g0TFnZ2GlTh2YEOVF1gawBQKkG_0 2024-09-05T02:16:21.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13540894847677688807', time=2024-09-05T03:46:48.395796+0000, chain.objs.size()=1 2024-09-05T02:16:21.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ejdqbP7JushMvLI8h-MDLXNKGKZzef-_0 2024-09-05T02:16:21.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10878949201936086593', time=2024-09-05T03:46:48.947148+0000, chain.objs.size()=1 2024-09-05T02:16:21.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fwXaJqAptF4nq4e4jPh5fVUNg_ou_oa_0 2024-09-05T02:16:21.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5623928750352399213', time=2024-09-05T03:46:49.015044+0000, chain.objs.size()=1 2024-09-05T02:16:21.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Sp7qCorY-ENPzPGe07Se6bxp0PxkYmw_0 2024-09-05T02:16:21.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18409375446242370978', time=2024-09-05T03:46:49.109797+0000, chain.objs.size()=1 2024-09-05T02:16:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ceOJjVBCjBlEpCqLSQN1zUPQvo1NpKP_0 2024-09-05T02:16:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3860521026228509139', time=2024-09-05T03:46:49.190387+0000, chain.objs.size()=1 2024-09-05T02:16:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ym0oYxwdFl40MZmDrTv09o5EsVxHYhE_0 2024-09-05T02:16:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10066421349251832362', time=2024-09-05T03:46:50.163383+0000, chain.objs.size()=1 2024-09-05T02:16:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Jjq6M_3ewR1RTKfERxtMq62YseuldUb_0 2024-09-05T02:16:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43168 2024-09-05T02:16:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-05T02:16:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7729052684417308495', time=2024-09-05T03:46:52.612902+0000, chain.objs.size()=1 2024-09-05T02:16:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-XUE2zRCtW1n0cdGLZUiBXChezPnD1Y_0 2024-09-05T02:16:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14784693467389390514', time=2024-09-05T03:46:52.615934+0000, chain.objs.size()=1 2024-09-05T02:16:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cjlCB5-d8jA0vahwGQdSSeTsfSObh1S_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13622010975681035668', time=2024-09-05T03:46:53.215710+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.w3G_EzH8rHaKd71awAJ5mZ7KXpYRmLj_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4939056107143921444', time=2024-09-05T03:46:55.009634+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._rB7CTwzeY5voVJiyFx0uCWgPVDCPr6_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17613308167351366483', time=2024-09-05T03:46:55.522153+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.71NHtOZ6ajJhlCkPyPhWF1LchFkuudB_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6439864072070636558', time=2024-09-05T03:46:55.524192+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PU-LDFZaEZ2aReZ7wLDt097FvDPo_51_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16312612813781739994', time=2024-09-05T03:46:55.835417+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6x35O1YB2BXePVfzTX2iNCgtYkwwKIR_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2416167901843987739', time=2024-09-05T03:46:56.931117+0000, chain.objs.size()=1 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mF4cnJ1PcIt-_-34Cw3_kqtrEvZmJmC_0 2024-09-05T02:16:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5761367555277544003', time=2024-09-05T03:46:59.452977+0000, chain.objs.size()=1 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sNvR-r9M9otm5FSWcPkygql3dJO3Ks5_0 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2398933628734981198', time=2024-09-05T03:47:00.212311+0000, chain.objs.size()=1 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JKRlUE5k7HsOlWEu05UKFPG-X3fvHdQ_0 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9249903322613127126', time=2024-09-05T03:47:00.689018+0000, chain.objs.size()=1 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.v17ZASrlYdjo35sBGQtTIoQOgYFad5R_0 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14920857097282995751', time=2024-09-05T03:47:00.794063+0000, chain.objs.size()=1 2024-09-05T02:16:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.YKnrIv5YlYmeOB04TagiZOQqlfeX-bq_0 2024-09-05T02:16:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15195790417590070669', time=2024-09-05T03:47:02.468595+0000, chain.objs.size()=1 2024-09-05T02:16:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6uSaXLdyh5yU4_UFDxeYyTkNKrCA1uU_0 2024-09-05T02:16:21.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15473945707989482208', time=2024-09-05T03:47:02.839473+0000, chain.objs.size()=1 2024-09-05T02:16:21.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.chGHFaF8psgs5wHgmq4x2nsxAcuERyS_0 2024-09-05T02:16:21.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2667155093143334341', time=2024-09-05T03:47:02.841594+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5ehGmWpP9pHCvocHBbCtlaZ6cSFqcRq_0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1020517564423465532', time=2024-09-05T03:48:06.238891+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.369__shadow_._j8i7TWGEFV81LrNMD88PGyEPFg500I_0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10095347551137874263', time=2024-09-05T03:49:55.106931+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.439__shadow_.ZzwCvf3Ne8p5tISdTjv_F0EiJXdItB__0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1420571429486496100', time=2024-09-05T03:50:25.470471+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.456__shadow_.fSZwX9_gMgIYLmyZEzNCkZWHFhl4_jk_0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.590766123901626857', time=2024-09-05T03:50:38.850572+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.462__shadow_.sEniiy09zj7kFkNEFRj_Gq4RVm5KzTQ_0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7560423164148270680', time=2024-09-05T03:50:45.049343+0000, chain.objs.size()=1 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.465__shadow_.MrIlhjKPleaG4ObiFSPz3j_3ZVucUmq_0 2024-09-05T02:16:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1528832828660092508', time=2024-09-05T03:50:45.850169+0000, chain.objs.size()=1 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.465__shadow_.0bkBr_Fs0byajK0AVEShUKOR0bg-Br7_0 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.871468575326012021', time=2024-09-05T03:51:09.621113+0000, chain.objs.size()=1 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.kG9cYsdbjbcNgcASubdQ9383yKVBU99_0 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16585799894095340320', time=2024-09-05T03:54:45.696335+0000, chain.objs.size()=1 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~kIHziypvfbQ94r52f8RNfYURx3idK5Z.1 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7737861230908446738', time=2024-09-05T03:56:34.704344+0000, chain.objs.size()=1 2024-09-05T02:16:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.553__shadow_.rgB3UxZdp0E0z7C-ZYs_YyA6mZyKkid_0 2024-09-05T02:16:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2253893509730922510', time=2024-09-05T03:56:38.697449+0000, chain.objs.size()=1 2024-09-05T02:16:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.554__shadow_.8L5JjuLDKNvIfMXPmCjj7t3uXCL0Rq5_0 2024-09-05T02:16:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14898775816866244864', time=2024-09-05T03:56:50.739691+0000, chain.objs.size()=1 2024-09-05T02:16:21.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.557__shadow_.dB5YjuyItgSQTE-30I_P-AxtyERXclJ_0 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4343885421157914536', time=2024-09-05T03:57:18.973309+0000, chain.objs.size()=1 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.566__shadow_.k69WCGixCbgyAtnDR9_WE7SFooBEIbz_0 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2021262546709818164', time=2024-09-05T03:57:43.126062+0000, chain.objs.size()=1 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:bKwfHK8aqFaNrZEf9oxCyajybVaTBVB_.8i5ggcsgKXZHdi39tntWa2UTC0ZaU7v_0 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15272262794908548728', time=2024-09-05T03:57:59.846583+0000, chain.objs.size()=1 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:tfiS1G94nti2-fO3-JAUkEz0sFqOtC._.wh6DMrZA4wYUJfomrZivB03apVixWGg_0 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.95792732367680054', time=2024-09-05T04:06:12.173958+0000, chain.objs.size()=6 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.1 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.2 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.3 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.4 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.5 2024-09-05T02:16:21.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.661__multipart_baz.2~btRtj9YxYvY21Hn6jQz5PACZre2k_uJ.6 2024-09-05T02:16:21.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11472854593540104588', time=2024-09-05T04:06:15.144591+0000, chain.objs.size()=1 2024-09-05T02:16:21.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.663__shadow_.J3XnUILqwieatujFx0TSKEE_j0L7bEG_0 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6626108990944093442', time=2024-09-05T04:06:58.860443+0000, chain.objs.size()=1 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.692__shadow:uOG0RF2UGq0LW.LsYJuj0-syNFYqgoh_.jNtvItDNtIm8NJ_i8hEjMqtFTxeAuml_0 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6177987152936023617', time=2024-09-05T04:07:09.092114+0000, chain.objs.size()=1 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.698__shadow:0DYLE0nYOws.b.HXMyyvYLeN68fMlK-_.u2goVaEB9N66CimWWOf4lDAfWx7mmjU_0 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2661093541184323185', time=2024-09-05T04:07:14.282382+0000, chain.objs.size()=1 2024-09-05T02:16:21.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.701__shadow:-1h9QKUi8arNKXTTu3nr-a.tmfwSDDh_.kaZ5HUjoz3vpS98XZJzMX8CE7KVF7mk_0 2024-09-05T02:16:21.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14826492289506627105', time=2024-09-05T04:07:35.639884+0000, chain.objs.size()=1 2024-09-05T02:16:21.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.713__shadow:EhYb48SnVkpgvsFN5DBSi0WpmfWPlkd_.T39jlbf0o6wv9WgeOvC5aC7P46cW1Dq_0 2024-09-05T02:16:21.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.49215446862174777', time=2024-09-05T04:07:37.290974+0000, chain.objs.size()=1 2024-09-05T02:16:21.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.714__shadow:Y6FTYhlOK0UWAqwH8oJVdzZYjtUMLSj_.wk1gxTqwvq-hp6S3Lm12o2u-v4A2Y86_0 2024-09-05T02:16:21.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.868+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-05T02:16:21.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49313' 2024-09-05T02:16:21.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13429404836192837843', time=2024-09-05T03:32:41.157467+0000, chain.objs.size()=1 2024-09-05T02:16:21.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.158__shadow_.rbs8uYIuxmczfuCIxziXAqxCiPENNz0_0 2024-09-05T02:16:21.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_2YytXzAdBEsSQ_7ryzl9F6XfEZc2Ygv', time=2024-09-05T03:32:56.771790+0000, chain.objs.size()=2 2024-09-05T02:16:21.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.cyp4OYwmeOtqIm4T3z31Tzu1W6krHy4_0 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.cyp4OYwmeOtqIm4T3z31Tzu1W6krHy4_1 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13415928972346876382', time=2024-09-05T03:33:10.941369+0000, chain.objs.size()=1 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.162__shadow_.EpjMOpZYd_24Qco87E4sCsw36EvYB_y_0 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_0QbTQ8fMHopRDhjmKGv22cDjcin0mh7', time=2024-09-05T03:33:16.514673+0000, chain.objs.size()=1 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.165__shadow_.ciPgqALk_ma1YBbd4Mj-nM6KS3SglcZ_0 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15801492033478124422', time=2024-09-05T03:34:24.069884+0000, chain.objs.size()=1 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.199__shadow_.n5pdu-f7Wh_q1ORY1x22GzVr_RwY0Xg_0 2024-09-05T02:16:21.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5369713732726963853', time=2024-09-05T03:37:56.707224+0000, chain.objs.size()=1 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.247__shadow_.E5AK_dCn7VV1VsV0UJri0FXaO_81PF7_0 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3144680017725575124', time=2024-09-05T03:38:06.005197+0000, chain.objs.size()=1 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.252__shadow_.ddzSXs1gnbJK4kFSnDm-oVcR_PtCvtu_0 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5284387649130304608', time=2024-09-05T03:40:04.398195+0000, chain.objs.size()=1 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.s6c6TOtpXfIZxrIhgEIHXLUcBlBvF4x_0 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10725808790680324486', time=2024-09-05T03:40:05.846235+0000, chain.objs.size()=1 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nuOjEQhncB7umYb7AKipUz_i-BcmVdq_0 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9999478715649157601', time=2024-09-05T03:40:06.730786+0000, chain.objs.size()=1 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eqTgfYSmS0i_wi0nuLfw6RlPcGsJLt9_0 2024-09-05T02:16:21.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17137818207756004783', time=2024-09-05T03:40:07.561582+0000, chain.objs.size()=1 2024-09-05T02:16:21.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xIWsgLCtZKq-sk416niUD4hp0cTFUbZ_0 2024-09-05T02:16:21.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15222470677602212602', time=2024-09-05T03:40:10.004938+0000, chain.objs.size()=1 2024-09-05T02:16:21.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Qqqgr8L3zvG3I7KxamAs9nqj30d5cDB_0 2024-09-05T02:16:21.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.203295037376100510', time=2024-09-05T03:40:13.216875+0000, chain.objs.size()=1 2024-09-05T02:16:21.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1hsERN5S96DnPdbwjwqCy2p0uikfn1r_0 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13764732013240766114', time=2024-09-05T03:40:15.000967+0000, chain.objs.size()=1 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AUYAag2g0VCB2tKNUE8jALh2Hry4-Q4_0 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3188254940830068466', time=2024-09-05T03:40:15.165998+0000, chain.objs.size()=1 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NwT-udwiw4GA01twFajI-cQHneu6gmm_0 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1126890428076071115', time=2024-09-05T03:40:18.596054+0000, chain.objs.size()=1 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EBfoJ-VYjPJ5dVJqw6eV01df7tCKHLy_0 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17227974043494268519', time=2024-09-05T03:40:20.635729+0000, chain.objs.size()=1 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Yi6O-uHCdolXR47qNzkBHRc6kzpkc2f_0 2024-09-05T02:16:21.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15780699090123223137', time=2024-09-05T03:40:20.791281+0000, chain.objs.size()=1 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sjptGz9CJx_9mbg4CXUEP_oho5wnQon_0 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2264964755041995480', time=2024-09-05T03:40:22.908674+0000, chain.objs.size()=1 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4cPvJYe8MgmW0nf_GTR7pFH7J_et_lF_0 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2586438788921861085', time=2024-09-05T03:40:23.213030+0000, chain.objs.size()=1 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.opKv1-vCwhhqeQeAJ94c1XWro9Y3BH7_0 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4697785137762231201', time=2024-09-05T03:40:24.833217+0000, chain.objs.size()=1 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ppRy6HSlL1zK6pIb5o3uTMcUQx8nUfb_0 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9069932306985975396', time=2024-09-05T03:40:26.084272+0000, chain.objs.size()=1 2024-09-05T02:16:21.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4iIWNJQ2Q3A_aRSnpDVX9OVQ0wrO39X_0 2024-09-05T02:16:21.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4949479801610864541', time=2024-09-05T03:40:27.368737+0000, chain.objs.size()=1 2024-09-05T02:16:21.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.V3nBxadJq894Ak__hyyfRSuSg_24VwO_0 2024-09-05T02:16:21.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17700488052796689731', time=2024-09-05T03:40:28.779649+0000, chain.objs.size()=1 2024-09-05T02:16:21.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Es9HoUBybYl7cUTpNVlV4VAyG73hm9r_0 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6096888758991417630', time=2024-09-05T03:40:35.348627+0000, chain.objs.size()=1 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.T5u0fEOH5Kmtx8Cyamlut4dltnS0YRx_0 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15425095475791880488', time=2024-09-05T03:40:35.576691+0000, chain.objs.size()=1 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C-fiAgo5un63tslequGL0mqwUjIacRR_0 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7609702911469009183', time=2024-09-05T03:40:36.530527+0000, chain.objs.size()=1 2024-09-05T02:16:21.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EstUpzpyhAraa3Vg5LXkez4_pbyo2dZ_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.623480256739441229', time=2024-09-05T03:41:01.278679+0000, chain.objs.size()=1 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.276__shadow_.5z7jIp1m1hLTZ5G3rijSA_uZcjYabXx_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1540207625307731093', time=2024-09-05T03:41:12.544317+0000, chain.objs.size()=1 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.282__shadow_.h1bhwFs0PfoaUWHPpE1F3iWc4lMDSXd_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2339383552839667852', time=2024-09-05T03:41:14.360248+0000, chain.objs.size()=1 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.283__shadow_.-tAbGsjCPNZMype2_NtfYALAfGVF-E9_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17275462506999530755', time=2024-09-05T03:41:35.023463+0000, chain.objs.size()=1 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.OF_FirdTGl6pzZBj4I7yO2dfXcd_rZo_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16441703081845315924', time=2024-09-05T03:42:29.872525+0000, chain.objs.size()=1 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.319__shadow:c2JK7DW3vVMo9Z5GlIc78yBCOezclo2_.aog9BgPyEwiGH4bZNdl3SEwudfCdu23_0 2024-09-05T02:16:21.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2260197368461063368', time=2024-09-05T03:42:30.117126+0000, chain.objs.size()=1 2024-09-05T02:16:21.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.319__shadow:qocrrZ4eYWkiQj6HZH3nmWldUwF-1fR_.-TLJSBX8MLeGGIWgSo2edC68lLFM0s6_0 2024-09-05T02:16:21.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8318511206030505081', time=2024-09-05T03:44:20.114090+0000, chain.objs.size()=1 2024-09-05T02:16:21.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.p5qPyR6JHtAPUo9ZFhZdYKnh-o3AFxd_0 2024-09-05T02:16:21.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15776490798842761828', time=2024-09-05T03:44:20.230785+0000, chain.objs.size()=1 2024-09-05T02:16:21.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MlgmqWlgWa3SH3-mGn5HGXIOIg5piTr_0 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6981838431621978267', time=2024-09-05T03:44:21.113531+0000, chain.objs.size()=1 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DzvhkY7CCrJfmYCn1Z9NbHDWI-jhJZg_0 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6939999114088716261', time=2024-09-05T03:44:21.659723+0000, chain.objs.size()=1 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.02JSqt1eptLdZCtez1yNkxumloZDFBc_0 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.445768806729080106', time=2024-09-05T03:44:23.826281+0000, chain.objs.size()=1 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TTh1xBg5XFHXaV5OfDTxarZdhb5B-cu_0 2024-09-05T02:16:21.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13747827130193775684', time=2024-09-05T03:44:24.051120+0000, chain.objs.size()=1 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZgsnAMPXYRzydjpSFP6nonFHOHv2OdZ_0 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14148185566656087043', time=2024-09-05T03:44:24.977222+0000, chain.objs.size()=1 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NIGsyiZWS32rx4uXg-CivrVl66Cpgrc_0 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17192372884062271483', time=2024-09-05T03:44:24.979407+0000, chain.objs.size()=1 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hKAZrLpImr9HsL_itNdclPJsY2_SQtp_0 2024-09-05T02:16:21.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4061355603615441799', time=2024-09-05T03:44:25.233043+0000, chain.objs.size()=1 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gq5jVYuxCUap8bZWIo4ZBjyB1eZoTQq_0 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12092258739799450305', time=2024-09-05T03:44:25.392904+0000, chain.objs.size()=1 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YHX5ywMIKhLBwiTAOeOwypYGFE1CDvw_0 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5968832931158616759', time=2024-09-05T03:44:25.780661+0000, chain.objs.size()=1 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Jrc1Z1PgTqAd70PLxPhuOtRig-fzjhH_0 2024-09-05T02:16:21.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15170426255378117463', time=2024-09-05T03:44:26.441272+0000, chain.objs.size()=1 2024-09-05T02:16:21.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uZHZwBeh_T8HpN7qjms5MtXLMxk3vi9_0 2024-09-05T02:16:21.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16641168578300866635', time=2024-09-05T03:44:29.865706+0000, chain.objs.size()=1 2024-09-05T02:16:21.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Wc1qKwEA9b7btl7rxz5Fq8c1Y-VH0sQ_0 2024-09-05T02:16:21.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2077607974251431981', time=2024-09-05T03:44:30.781865+0000, chain.objs.size()=1 2024-09-05T02:16:21.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SKHJmdGaMiCgU3R7kwCjVRYMvwWcrV8_0 2024-09-05T02:16:21.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16004030190762016023', time=2024-09-05T03:44:32.745518+0000, chain.objs.size()=1 2024-09-05T02:16:21.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.v_loqzyPEPKlB7A6hVGT0sl4lLuu6-M_0 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4294080620713886186', time=2024-09-05T03:44:33.651311+0000, chain.objs.size()=1 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wuokc2UKRv05Vhvb3gSbOeu4psCMUI2_0 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15983733418796812188', time=2024-09-05T03:44:33.910446+0000, chain.objs.size()=1 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NFj-n4MhjoTF9N0vbpRdmLU0Etw_7xK_0 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11994944967220833569', time=2024-09-05T03:44:34.775840+0000, chain.objs.size()=1 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zjdp_XAWoPxi6ek6Bl40jyX9cbzc-pN_0 2024-09-05T02:16:21.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5213763720858368350', time=2024-09-05T03:44:36.711132+0000, chain.objs.size()=1 2024-09-05T02:16:21.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7CJd0gyLaxTYmA4_M9TgJ1UYcYolsGH_0 2024-09-05T02:16:21.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8114396158491378821', time=2024-09-05T03:44:36.820537+0000, chain.objs.size()=1 2024-09-05T02:16:21.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.j4ojSZdIULi2a8SaTVXqieM3-IyC5KH_0 2024-09-05T02:16:21.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7656063909318873306', time=2024-09-05T03:44:38.142003+0000, chain.objs.size()=1 2024-09-05T02:16:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._BB8dPii1G0pS4CLCC7hDddQ2KkyBPc_0 2024-09-05T02:16:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.943918291303202897', time=2024-09-05T03:44:40.117187+0000, chain.objs.size()=1 2024-09-05T02:16:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.10I7xnoevc2TTzq2SgkV3aJ4Cpkm5RA_0 2024-09-05T02:16:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.424755323667640727', time=2024-09-05T03:44:40.422762+0000, chain.objs.size()=1 2024-09-05T02:16:21.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9xU4Bo13oXVP2mycSvKcWYa7O2jnwlI_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3782784063203191658', time=2024-09-05T03:44:40.486656+0000, chain.objs.size()=1 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-hBgqg4DanHBdzNCanxg_Hz3b2GwrUs_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6746973943574593199', time=2024-09-05T03:44:40.890922+0000, chain.objs.size()=1 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5sSCWG0GQhTrWgohveZiR6GOU_564V5_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.485641318792340796', time=2024-09-05T03:44:45.312907+0000, chain.objs.size()=1 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7Kd4CQv4N32PzQ7devKJsTtXmDj2gZ7_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12370831495696956844', time=2024-09-05T03:44:45.843630+0000, chain.objs.size()=1 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zKwdc90fZWJLxEafb8_sEqBriElIB7H_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4544177219952801481', time=2024-09-05T03:44:46.703427+0000, chain.objs.size()=1 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ecIPXN78_uMb0Znj8mC4SomXc97b1XA_0 2024-09-05T02:16:21.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1164985965119390683', time=2024-09-05T03:44:46.912135+0000, chain.objs.size()=1 2024-09-05T02:16:21.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jd9Br4Hr7VthzRZmGv2sYtrBPKnhpNQ_0 2024-09-05T02:16:21.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4927007341101580180', time=2024-09-05T03:44:47.830632+0000, chain.objs.size()=1 2024-09-05T02:16:21.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.B3gUGKpY3xH3BbKMe10rQyRXi32HzIH_0 2024-09-05T02:16:21.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12433773031010392995', time=2024-09-05T03:44:47.904939+0000, chain.objs.size()=1 2024-09-05T02:16:21.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZaAVdbkZHZtPnjnh7FQruj7yScS-Sdb_0 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14192437227283366981', time=2024-09-05T03:44:49.074475+0000, chain.objs.size()=1 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.crwjY5j2nN_N1eeHrH_lIBOdd8hblkC_0 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16694950813726641988', time=2024-09-05T03:44:50.003284+0000, chain.objs.size()=1 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JpUPo5-_VbRvraZ-qnrDUAPYy-OKzkR_0 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15240749578684126428', time=2024-09-05T03:46:34.086699+0000, chain.objs.size()=1 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UAEq56OPHuFtWX4YahQqeSsgohpbsXK_0 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16418953660350091800', time=2024-09-05T03:46:34.270894+0000, chain.objs.size()=1 2024-09-05T02:16:21.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5n3xQGNtnFaPZC2N8JtQWNic25ULtDJ_0 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7138346252438290032', time=2024-09-05T03:46:40.281021+0000, chain.objs.size()=1 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.886To9QlXf3ueByllbxo54Zu3WEeHON_0 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8023729462460319115', time=2024-09-05T03:46:40.887927+0000, chain.objs.size()=1 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.19FZ4_7Xk5nQBYu80S-9nyj9Zjq5ZNm_0 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8746756537912056783', time=2024-09-05T03:46:42.057575+0000, chain.objs.size()=1 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8WMOFqEzMlqomBjVnCS2FmYElOiVtxj_0 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7613057176179269222', time=2024-09-05T03:46:43.005267+0000, chain.objs.size()=1 2024-09-05T02:16:21.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9m5wCUplBXLnNuEURMFsUMVsqs-3JIi_0 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9648929752591860321', time=2024-09-05T03:46:43.270276+0000, chain.objs.size()=1 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AkhU-trYEEIXM_Rbb5bR_5cqfcQJjxY_0 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9899425061059914114', time=2024-09-05T03:46:44.979558+0000, chain.objs.size()=1 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qkjj8bsKP8PJVI9j9ZpfZJThNcx52NK_0 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1099795910931527770', time=2024-09-05T03:46:45.061989+0000, chain.objs.size()=1 2024-09-05T02:16:21.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uj7JiQ-vyoVR-4MIcK4qcTMO0yI1kZx_0 2024-09-05T02:16:21.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17295421477143460884', time=2024-09-05T03:46:46.076946+0000, chain.objs.size()=1 2024-09-05T02:16:21.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vfAQi8TNOs_8o84LSgFbahxrIH3Wt-D_0 2024-09-05T02:16:21.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12786192958739957848', time=2024-09-05T03:46:46.638356+0000, chain.objs.size()=1 2024-09-05T02:16:21.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.VUkUajv8RDSbz8xOTXt0ORZbVOQq_sK_0 2024-09-05T02:16:21.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4320924904663144612', time=2024-09-05T03:46:47.638170+0000, chain.objs.size()=1 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vW_eV7LH683_25Z6cL71z3kaDyNKoJO_0 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.754964377918134761', time=2024-09-05T03:46:50.611470+0000, chain.objs.size()=1 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HelvF3PPuuyDVld7bSxs1i69P6ncdK__0 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13734955978852907652', time=2024-09-05T03:46:51.469082+0000, chain.objs.size()=1 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9e-l-NtXunia7ejBeJuK9D4ZTLBmp6c_0 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5096876029262078903', time=2024-09-05T03:46:51.534208+0000, chain.objs.size()=1 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XpZntNq5v6PmntyiEPMKrKXDs8qVv9j_0 2024-09-05T02:16:21.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8800883749958119315', time=2024-09-05T03:46:51.989845+0000, chain.objs.size()=1 2024-09-05T02:16:21.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SdmMNYuk9Pd0wAEWtKvLIMNqPLLYM-P_0 2024-09-05T02:16:21.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17622717094839184454', time=2024-09-05T03:46:54.588769+0000, chain.objs.size()=1 2024-09-05T02:16:21.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fExFDV_dIgp2CKX-7LPETgzmc7NXWrt_0 2024-09-05T02:16:21.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11856313601606542524', time=2024-09-05T03:46:55.623730+0000, chain.objs.size()=1 2024-09-05T02:16:21.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ed_DrBEuNWLX2b2i0t6KFrT_Pi2nO9W_0 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16406477614732602132', time=2024-09-05T03:46:57.013870+0000, chain.objs.size()=1 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CIHrvzjFuThzdzS09BFi2AfEs380J5O_0 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6655197932561980942', time=2024-09-05T03:46:57.243087+0000, chain.objs.size()=1 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.am4k2_6frY03wnSqVO3IWgT-U70V_87_0 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7345669405806828345', time=2024-09-05T03:46:57.310739+0000, chain.objs.size()=1 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0zwHHty5ScNc3dJ-V4fm5nHzfomNttl_0 2024-09-05T02:16:21.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8583380763684078773', time=2024-09-05T03:46:57.992462+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BUIr84LEFj_X3erNotdU2EvPcK1DijP_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17441472523395834734', time=2024-09-05T03:46:59.198014+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Gk79xWcGDnN1b6N7LTtiblzDtTV_XVw_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6881265038973082914', time=2024-09-05T03:46:59.276148+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.efgDjX9vu3LJ7zIV3c_nMQMebbidnX6_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17082745191412864314', time=2024-09-05T03:47:00.077075+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.C19IopA7i4Q75ZLqFf-3hjzYP87sWes_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6092840142959638683', time=2024-09-05T03:47:01.116449+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o1Dpu7NC1xGfTUBFd-4Euj-GlCphcUv_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8837272350561255097', time=2024-09-05T03:47:02.292729+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5SkPeDuSSNwKjEBWsaPdu4Jv49qIJPQ_0 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.991744225914669077', time=2024-09-05T03:47:04.123304+0000, chain.objs.size()=1 2024-09-05T02:16:21.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.azJAKDs3accxgt_cbtoQZmFM46yWFfa_0 2024-09-05T02:16:21.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11657784015913482779', time=2024-09-05T03:47:19.836805+0000, chain.objs.size()=1 2024-09-05T02:16:21.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.334__shadow_.dMCaFWgiTxqoTT73oUW_Gl-QHkWlL6i_0 2024-09-05T02:16:21.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.908+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.908381681439822135', time=2024-09-05T03:48:40.451747+0000, chain.objs.size()=1 2024-09-05T02:16:21.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.908+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.390__shadow_.vViiJyHMJiyhl3agmNUVkesxgSxWhRR_0 2024-09-05T02:16:21.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.313449090976573403', time=2024-09-05T03:50:25.456658+0000, chain.objs.size()=1 2024-09-05T02:16:21.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.456__shadow_.-YtKUdiCXZ2qHAdNHuVyw3VfL2E7zmf_0 2024-09-05T02:16:21.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5998984866173285600', time=2024-09-05T03:51:33.307255+0000, chain.objs.size()=1 2024-09-05T02:16:21.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.496__shadow_.sB0gJpRHmsncO9PhHbB6MLT8ZiSwsFt_0 2024-09-05T02:16:21.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5283904510920856415', time=2024-09-05T03:52:15.158935+0000, chain.objs.size()=1 2024-09-05T02:16:21.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.514__shadow_.SH3qMUq9_3M42HsHnxEiVWd4cEG3nvS_0 2024-09-05T02:16:21.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4282449532772184769', time=2024-09-05T03:57:30.257432+0000, chain.objs.size()=1 2024-09-05T02:16:21.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:QbEWpRrtq1tzp2-PYISrP0nYR556nl6_.AbJdrapDjsSq0COaKIn5hJyAtcslnWx_0 2024-09-05T02:16:21.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49313 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15606338941272513719', time=2024-09-05T03:57:48.600621+0000, chain.objs.size()=1 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.570__shadow:BKIBKO-faBRcaFlUK1CrwMBm70ytKkd_.vwTOqphE5kiW67W8RcBxnNMjTlm6Nae_0 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10068973245515288046', time=2024-09-05T03:58:02.081131+0000, chain.objs.size()=1 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:RRKdLPX8Qcqnd0X..k1rxONaLQKB98H_.wf9qtuYfSQILqm2N8fHzu-KLDcc-cDl_0 2024-09-05T02:16:21.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14359616705853927941', time=2024-09-05T03:58:28.219179+0000, chain.objs.size()=1 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:ylyGkPI.MekWPJS2OBIKbKZ3XpLfphB_.FlCCMdtcvHjxxSYKFlDqGQpOBaE3320_0 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4816390855491043726', time=2024-09-05T03:59:01.994732+0000, chain.objs.size()=1 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:NRPhB5BCcod4IvGuWfQW6Qwt0aiUNdB_.zKlDzuJ6vC4F9aNg4h1J2UKWGDra0cC_0 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1736402951023260792', time=2024-09-05T03:59:02.475160+0000, chain.objs.size()=1 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:6wzWy0TkUW1raLbZgkF0OkN0I35PZT5_.kzVxGPLjkfmgseo3rfN-NMbUgb5uaDQ_0 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17241633967456572963', time=2024-09-05T03:59:24.661156+0000, chain.objs.size()=1 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:NHzcpThe1bW6WHrX5mw9dno1484cy4t_.W_2143OI8ptRx13_AoMJ9R3AypRA2Ll_0 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12835693952294866676', time=2024-09-05T03:59:29.667976+0000, chain.objs.size()=1 2024-09-05T02:16:21.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:D8pYjN2GLiUO1hdJkbUFT6CEAb4Ix77_.EMmWIVAluYaqzyGPVaEA3kMGpVM7f4Y_0 2024-09-05T02:16:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12952004814531944446', time=2024-09-05T04:05:10.473483+0000, chain.objs.size()=1 2024-09-05T02:16:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.640__shadow_.okhXsuEw8qmeJtQtCAVsPvhhTp85Xf__0 2024-09-05T02:16:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4621027834378633202', time=2024-09-05T04:07:03.727506+0000, chain.objs.size()=1 2024-09-05T02:16:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.695__shadow_.s5n6Lc0nAfZ1H47qk4_2sPFpPZBI8g4_0 2024-09-05T02:16:21.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5968078718261970476', time=2024-09-05T04:08:02.910139+0000, chain.objs.size()=1 2024-09-05T02:16:21.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.916+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.718__shadow_.f01So5foJ83boqDP29tR9o4ZGHz0x63_0 2024-09-05T02:16:21.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.920+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-05T02:16:21.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47269' 2024-09-05T02:16:21.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17543625875078112083', time=2024-09-05T03:38:02.304057+0000, chain.objs.size()=1 2024-09-05T02:16:21.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.250__shadow_.evqIoJ_MgqwyFcCUWzS1mQf_AkTLddw_0 2024-09-05T02:16:21.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15333084064369595377', time=2024-09-05T03:40:04.902868+0000, chain.objs.size()=1 2024-09-05T02:16:21.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VaCXmtIj-Wx5PJi1q7NS3GYHSICkzqu_0 2024-09-05T02:16:21.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17905927779547831712', time=2024-09-05T03:40:05.137534+0000, chain.objs.size()=1 2024-09-05T02:16:21.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Bfj28cnp99ZgWQ4FSyI7HYJdn02gw5B_0 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1022244264310301471', time=2024-09-05T03:40:06.290580+0000, chain.objs.size()=1 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aWEvSfxMuoruCu5WscScD4lowNyMIIP_0 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1423492307130302597', time=2024-09-05T03:40:06.550116+0000, chain.objs.size()=1 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B3-cQEGzLFs85y4FjmFJd3SL-aQAFuo_0 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1359081439121853904', time=2024-09-05T03:40:07.513982+0000, chain.objs.size()=1 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aLqBb8NygiW-zNpFzQDhB_aCNZGAAIG_0 2024-09-05T02:16:21.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7636713966008446683', time=2024-09-05T03:40:08.785716+0000, chain.objs.size()=1 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PUCI4ixDry-MlRjJSHJZKc_5rCIxgvG_0 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5644084861037914742', time=2024-09-05T03:40:10.778389+0000, chain.objs.size()=1 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XeIFftW0eTPdYFHAG-i13QCAg4GfQ2T_0 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8277793459263880897', time=2024-09-05T03:40:10.780466+0000, chain.objs.size()=1 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gmB9GcuJs_-yW5cqmH_ybEvRBGfrWys_0 2024-09-05T02:16:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12908475253079536629', time=2024-09-05T03:40:10.905623+0000, chain.objs.size()=1 2024-09-05T02:16:21.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4nDNCxj910i5jrbrhiVes55nUN-60-C_0 2024-09-05T02:16:21.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7845585117161124993', time=2024-09-05T03:40:11.685099+0000, chain.objs.size()=1 2024-09-05T02:16:21.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tqtZEdvGMvMOopnWZrG3LTvKK3NJzl1_0 2024-09-05T02:16:21.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11218803625621791157', time=2024-09-05T03:40:12.093638+0000, chain.objs.size()=1 2024-09-05T02:16:21.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YEZ6IcVKdNHYpBQVJjfTF5XqmAIcA8T_0 2024-09-05T02:16:21.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5175445219580499251', time=2024-09-05T03:40:13.264096+0000, chain.objs.size()=1 2024-09-05T02:16:21.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KiIzczWgSUur_CsuK4AOITPOkEJdQ1t_0 2024-09-05T02:16:21.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7956983312264107942', time=2024-09-05T03:40:15.854511+0000, chain.objs.size()=1 2024-09-05T02:16:21.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3A-i5i-fn7USDUaE7s7fwD-HJ4O58S3_0 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16308325855264667583', time=2024-09-05T03:40:16.387158+0000, chain.objs.size()=1 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.t6rgikJcPnNYhWN53oKd105-4xvolsO_0 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1000902149254522696', time=2024-09-05T03:40:20.013494+0000, chain.objs.size()=1 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PV2iSS1U1dY9apdS86Knse-1hBueEC9_0 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3213826317508232095', time=2024-09-05T03:40:23.671088+0000, chain.objs.size()=1 2024-09-05T02:16:21.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XxCTVTbGbirU4b7pDb0bxXyZx01rMXS_0 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10611083647072843658', time=2024-09-05T03:40:23.672735+0000, chain.objs.size()=1 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6_6oPDdL0ssXmMhjoSOHvN8eRyhuxWf_0 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14985678842258149640', time=2024-09-05T03:40:23.806543+0000, chain.objs.size()=1 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sORkR-VxODYj70V5SpYKzpkfio3iXBA_0 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16200951247075683866', time=2024-09-05T03:40:23.808534+0000, chain.objs.size()=1 2024-09-05T02:16:21.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NowrZnAvIws2phMvmHcDmqu9IocpDdx_0 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.176390148816557971', time=2024-09-05T03:40:24.911885+0000, chain.objs.size()=1 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MDCaM2GB2a-sFy9DFdVGRH6PuIqg2zD_0 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12402405870586780131', time=2024-09-05T03:40:24.914277+0000, chain.objs.size()=1 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xPdlrBcMXsDMzp22pvX09nAyhAb1Owh_0 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15965842749289309867', time=2024-09-05T03:40:25.004420+0000, chain.objs.size()=1 2024-09-05T02:16:21.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VWkqXuf9F_kVgH-Ep2f0Up_Vs_hec61_0 2024-09-05T02:16:21.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13382494099701976638', time=2024-09-05T03:40:28.262300+0000, chain.objs.size()=1 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-vFvO6DPY3YzvsV5B5D-HgbpTCDRm7b_0 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17970543684457048292', time=2024-09-05T03:40:31.905045+0000, chain.objs.size()=1 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZGIKdC2s6vrvthouYJ0UVlzyn2MnLfE_0 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7431019464098544882', time=2024-09-05T03:40:33.049077+0000, chain.objs.size()=1 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hLS6EFzRt7MVeJ1nThOeBSMcfeeyVtU_0 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17518330467240678931', time=2024-09-05T03:40:35.058270+0000, chain.objs.size()=1 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TmDvk8OpN2M5YMQQPTt2L3ieffmzSKI_0 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3215537737929344939', time=2024-09-05T03:40:35.060650+0000, chain.objs.size()=1 2024-09-05T02:16:21.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MdS7DLYENxp5j6sczECpgHhx_SnJwm__0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9477355878204063813', time=2024-09-05T03:40:35.462022+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NJM_51O8NpRzuHd5eCCFovt2J-TN3gl_0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14012243904556821145', time=2024-09-05T03:40:35.813209+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CP-oHDqBxWG-7BblFk4fmFKQX1hCGMQ_0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9383854636194908663', time=2024-09-05T03:40:35.872677+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ipM6LBxddM9TV3o2gsWF2huAI30XN0T_0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4000377231611255482', time=2024-09-05T03:40:50.630385+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.270__shadow_.hoCADUeTk18hLYpXcdPZAZclZdWFHEd_0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6681710943091342782', time=2024-09-05T03:40:52.326214+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.271__shadow_.MO7Yd02a_AhDxTs1zmd-xN7jSyFhqw4_0 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6565169542385617750', time=2024-09-05T03:41:06.797932+0000, chain.objs.size()=1 2024-09-05T02:16:21.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.936+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.279__shadow_.e6oj73E7nIAddv_RX792y0y30k91cbE_0 2024-09-05T02:16:21.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1583507672649207729', time=2024-09-05T03:41:25.855730+0000, chain.objs.size()=1 2024-09-05T02:16:21.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.289__shadow_.CXMNqIgqnu3vk-l_YGYjNseFTBqYeE8_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15251269693773925578', time=2024-09-05T03:41:35.004388+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.3eLu8Tuq8QgvtFbY0-0_Skj7agzXHKF_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17255744634583975289', time=2024-09-05T03:41:40.106528+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.8f6BUrs8iVyevNzUhUXPi76DP_OvdkS_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6717206056803453419', time=2024-09-05T03:41:55.545016+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.301__shadow_.Q9iY8wifD1AF8tP-fjmx422YOJasc9V_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14270994748084325727', time=2024-09-05T03:42:05.224833+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.306__shadow_.f2euhebDOCNjB9kOXtBo0lGi9iX7tDH_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2817363837712997273', time=2024-09-05T03:44:20.200542+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jbL4usK_NOLd-AK6wtru0CsNRoLFFkV_0 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2238434085616408621', time=2024-09-05T03:44:21.692956+0000, chain.objs.size()=1 2024-09-05T02:16:21.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._GXIfJfABH-RSuqgSY8-qzkvf5pbg0Z_0 2024-09-05T02:16:21.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12746998943002354761', time=2024-09-05T03:44:21.834015+0000, chain.objs.size()=1 2024-09-05T02:16:21.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4vL2mNUbBvWZ6sk6EvbjBtzBS5dnTET_0 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10161388339777760803', time=2024-09-05T03:44:21.994206+0000, chain.objs.size()=1 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Vrq2hcy0OsT7D1Y-reNEtLBheILsJw4_0 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11511431829967552033', time=2024-09-05T03:44:23.408392+0000, chain.objs.size()=1 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SicGz8f0kL1urdYgnLSGzEt0SY5ikxA_0 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16179989546692667676', time=2024-09-05T03:44:24.434888+0000, chain.objs.size()=1 2024-09-05T02:16:21.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uZ-ElqrHZY4tRi4lAdtXHGf46LbE6uo_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8484924913856981712', time=2024-09-05T03:44:27.827344+0000, chain.objs.size()=1 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CIrvu7EGa6T4q5HRzT6Zllh9pTMPJES_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9522162132970865066', time=2024-09-05T03:44:28.977389+0000, chain.objs.size()=1 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.T_gQn72Mo2j2RMGCFSyXx_Hj7xp0qMX_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5487282280751925556', time=2024-09-05T03:44:32.189157+0000, chain.objs.size()=1 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q2itgCUKQaaWOECXcSHOS_VRiGGBXcx_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10121553990945050376', time=2024-09-05T03:44:32.609910+0000, chain.objs.size()=1 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Kok5pIhkYIyZgjQBjhqReTzSP3cEYav_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16116871317189459138', time=2024-09-05T03:44:32.793486+0000, chain.objs.size()=1 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.940+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hNxZIvc2cOZ2M9cw_kuHZQ_oK3Ckjfc_0 2024-09-05T02:16:21.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1223255583132033290', time=2024-09-05T03:44:34.368826+0000, chain.objs.size()=1 2024-09-05T02:16:21.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kqhErJAdGrsZl6kpJoq_z55PzQAQvEo_0 2024-09-05T02:16:21.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13131970448522944151', time=2024-09-05T03:44:34.771638+0000, chain.objs.size()=1 2024-09-05T02:16:21.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mpI4URBBrkrbWX3C5g2xU77F5YCPJOb_0 2024-09-05T02:16:21.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16252691892475665825', time=2024-09-05T03:44:34.862928+0000, chain.objs.size()=1 2024-09-05T02:16:21.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8Sf18AKzVK363Jl7soB7LMw8Ao8yDNl_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17114884681046944969', time=2024-09-05T03:44:35.816440+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SKVrmagZWP9UpXS70W5XI7WkLSc0G21_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1924800152833344149', time=2024-09-05T03:44:36.304255+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dWsTkZ6JSIKKnmJp4ajLlPL5Qdx3ef5_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9377689929051637652', time=2024-09-05T03:44:36.748663+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tIV3ACbud3mus57ptwfyd0YzmXhiUXb_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1608883560213634315', time=2024-09-05T03:44:36.839310+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d1Q64FeT_C58Lt_takoE9yhgSUecHXK_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14256871651224301437', time=2024-09-05T03:44:37.580652+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-wsOhver0IICPmg5Ls9geJg6llSr5nB_0 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5456019014252745185', time=2024-09-05T03:44:37.591335+0000, chain.objs.size()=1 2024-09-05T02:16:21.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aD4Noley8sgzsajBeoaCiO85T8V2nae_0 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17319251613209204505', time=2024-09-05T03:44:37.633407+0000, chain.objs.size()=1 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fYp8E3DRgV4Jkl8RqaSl8oj9X7qC7aL_0 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8456368223783902515', time=2024-09-05T03:44:38.808297+0000, chain.objs.size()=1 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d5T2-48WomlAp5lujr6j_o3uITApA82_0 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14169427483635712938', time=2024-09-05T03:44:42.338498+0000, chain.objs.size()=1 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.irqN3ACI8SJoPXrHBGd01IYbtyXCYlj_0 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8984677870446946396', time=2024-09-05T03:44:42.340962+0000, chain.objs.size()=1 2024-09-05T02:16:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XFb7MhY5F4Vs7BZfygeMfUNlGPwm_7N_0 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13240213849495260772', time=2024-09-05T03:44:42.752464+0000, chain.objs.size()=1 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kHmnzmvEcXIrxscIOTYrtKRfcX_7lgt_0 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2214603764865609236', time=2024-09-05T03:44:45.885336+0000, chain.objs.size()=1 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0rkFbZ9nxW8of-8WMK0ZgkeY8dKVw1F_0 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4211201663276082114', time=2024-09-05T03:44:46.600719+0000, chain.objs.size()=1 2024-09-05T02:16:21.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.944+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._0KqV6uG6TGJMOKjxi04ODnQddyKOj__0 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18417223357798319672', time=2024-09-05T03:44:46.906044+0000, chain.objs.size()=1 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Hkh6PdCVKIDExiK2o6zVjviBY3tszjN_0 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13806942704469900381', time=2024-09-05T03:44:48.675866+0000, chain.objs.size()=1 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rNX_O-Cin9OAmnFxMrXnE37GAPQ2kvt_0 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13623208713993757300', time=2024-09-05T03:44:49.179616+0000, chain.objs.size()=1 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kUZ49EduNJAE51I0SxINsBHUO6xd_BZ_0 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3601536178166626153', time=2024-09-05T03:44:49.182120+0000, chain.objs.size()=1 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.X_bytf8WSYdEnWvsns3G7LZabkGAcOd_0 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9291968621619075128', time=2024-09-05T03:44:49.556714+0000, chain.objs.size()=1 2024-09-05T02:16:21.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cy2xkpclfwmk7bH1XhzYfiJ-fQ865W2_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2883909724901964384', time=2024-09-05T03:46:33.882723+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XmW1Cjdxz23d9tfWdfJ--wwp_6zOuFW_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7380519287975298349', time=2024-09-05T03:46:36.333224+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8YB29yLe9_OWAg3sdtmGQfTxb0FREhk_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8839679412951659102', time=2024-09-05T03:46:36.600206+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DfF3KNz4mfCDq9xfHRtA-1ap9kywk9G_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11408546064665726804', time=2024-09-05T03:46:38.973139+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7X8krO7BAWQWFBT1jT4cEcT8pcrshzK_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2474628825639484945', time=2024-09-05T03:46:39.910010+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.p1lGuMaIVC1O1xOW7LYV_ABdWC_Ffmd_0 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8625715331329343892', time=2024-09-05T03:46:40.288160+0000, chain.objs.size()=1 2024-09-05T02:16:21.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.948+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mcqKB65ETq31r98GRcBFPP7K6Ekq9HZ_0 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4982001415328051563', time=2024-09-05T03:46:46.308076+0000, chain.objs.size()=1 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rg2ILitC96j0OfapkI5r-igY8pw0uTQ_0 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3367282220203061691', time=2024-09-05T03:46:46.982639+0000, chain.objs.size()=1 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7HY08ufrxy_yP6DPxVed2kJ6bSUhKQh_0 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.121755014258319173', time=2024-09-05T03:46:48.630028+0000, chain.objs.size()=1 2024-09-05T02:16:21.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NmhWn2_1sUdw2lFgt0Y7GCSevzJHVT9_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1823031959652330062', time=2024-09-05T03:46:48.947341+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AjayTv7Z6cEsSgyj2P2IEcM_m2wDfAf_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10869943798373405940', time=2024-09-05T03:46:50.163413+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oytGqkViYpA-mWTG7bP2xNy8zwo5Qs-_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3910290770875125911', time=2024-09-05T03:46:50.235266+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._qj-zMTW4N3DzqtxNj9fN08FNwtaZsm_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6016228102949182963', time=2024-09-05T03:46:50.300566+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.t2IsaAJAusuJjZgjeU9qVfgmTANAiD1_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.132255501193961097', time=2024-09-05T03:46:51.051044+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4mXI3Qz6LniKhw22VbGQYfgt7B-HAf3_0 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4448541091908189611', time=2024-09-05T03:46:51.519853+0000, chain.objs.size()=1 2024-09-05T02:16:21.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.pdKdX00kjaNS67I8oVO77pDCo16_sHc_0 2024-09-05T02:16:21.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13948028044622008023', time=2024-09-05T03:46:51.831493+0000, chain.objs.size()=1 2024-09-05T02:16:21.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4Ce0FZyyKsXw0C6XjfuEOfLYo-yjvaU_0 2024-09-05T02:16:21.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7958253895939712593', time=2024-09-05T03:46:52.861150+0000, chain.objs.size()=1 2024-09-05T02:16:21.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hKpLAcX1_7aPuNNPRiVvCNRtFz8f0bu_0 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12685609389086398922', time=2024-09-05T03:46:53.087799+0000, chain.objs.size()=1 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.I2uV-20gSsW6QakBdc9ZGKsI4Lzd94p_0 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11574847260648469859', time=2024-09-05T03:46:53.162011+0000, chain.objs.size()=1 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cUuA1suP6UOHe7MLoJJ0dcSnhEZzRj1_0 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1813421175711915097', time=2024-09-05T03:46:54.549093+0000, chain.objs.size()=1 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eIH3jf9Mpg_0Zj78i19GUJleC2ai2AX_0 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15355122272369743637', time=2024-09-05T03:46:55.209588+0000, chain.objs.size()=1 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.952+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aZNqHD63L9PKGVL8CjHs-qQPM3sU-Rs_0 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17123893192042764307', time=2024-09-05T03:46:56.029821+0000, chain.objs.size()=1 2024-09-05T02:16:21.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FVtEt9zKKn1qGLs0COjhKWeD46x9OQN_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15460390365151755217', time=2024-09-05T03:46:56.425475+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8pWfT2DGKAT5qNcv5MICOBu-kVlF9jd_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13281251283916820801', time=2024-09-05T03:46:56.780863+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5SUPSsymeOG0P6LFaFlyP5WKRA0NQsS_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9237550678814168197', time=2024-09-05T03:46:57.208707+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._Yfx_psWr1M4CDQ0gXb8_iNZWMr4pTK_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9738962592389178935', time=2024-09-05T03:46:58.290889+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BrH9yH71Pw3E0W5mXD2n9lVhsMpTEVA_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3018933871727619714', time=2024-09-05T03:46:58.295885+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0DAWOtM2Q1k2F3H6LsMYmuhnnuWUw_R_0 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7101279924314642015', time=2024-09-05T03:47:00.091516+0000, chain.objs.size()=1 2024-09-05T02:16:21.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9bFcnXLjTv-OkU31RCqTfEvhJoMVWN1_0 2024-09-05T02:16:21.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4006571230660705413', time=2024-09-05T03:47:00.214212+0000, chain.objs.size()=1 2024-09-05T02:16:21.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2noXMCw9PI7U4ZHfXH2U2NbvzfFrv94_0 2024-09-05T02:16:21.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.956+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47269 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2938151244102139200', time=2024-09-05T03:47:01.118525+0000, chain.objs.size()=1 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.x1ebSahpnA82fteeSg1TCvNsGQCn2eO_0 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12273497706266617695', time=2024-09-05T03:47:02.079382+0000, chain.objs.size()=1 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OzWHJToihrYD2zHRevv6NDRlpYCno_O_0 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8608734529846322200', time=2024-09-05T03:47:02.736705+0000, chain.objs.size()=1 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PXSfdJ458rBcXCN1yVVGIzMYqCwpSRn_0 2024-09-05T02:16:21.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15575946726727126002', time=2024-09-05T03:47:02.738237+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.N6SJygzBTZucH90mBhf0yE0DchSyQON_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9414399149324939493', time=2024-09-05T03:47:04.172027+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GpI_CrdYEKnU3ryJmsxbwdJz66LqGhE_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18275775861022300852', time=2024-09-05T03:48:03.488937+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.367__shadow_.IBqZOWg7C9TPkRgLM40OlzaHqbihCEB_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14170972240841669358', time=2024-09-05T03:49:50.241771+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.436__shadow_.yaPG6awF64tzkhdN7Vau6vPN2O50EsD_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13774171838965118655', time=2024-09-05T03:51:11.779865+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.484__shadow_.CdnTg2D9WgvGnCkCRz5xhWt4zP3UNRi_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1040878679797242153', time=2024-09-05T03:51:20.270047+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.487__shadow_.vCFz6S_jDhzGHcSY02lO3xpXDbK35IX_0 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14432395775385610421', time=2024-09-05T03:51:31.833698+0000, chain.objs.size()=1 2024-09-05T02:16:21.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.495__shadow_.pI-ph1R00a_zImpikCX7-nDYQbljhkW_0 2024-09-05T02:16:21.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13343270792058194631', time=2024-09-05T03:51:39.949647+0000, chain.objs.size()=1 2024-09-05T02:16:21.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500__shadow_.YefWNBVz_q9stY24u-xQzhToGFI20al_0 2024-09-05T02:16:21.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.215906712679717105', time=2024-09-05T03:52:29.310285+0000, chain.objs.size()=1 2024-09-05T02:16:21.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.518__multipart_mymultipart.2~lzyxKOR_BtYadrOjp14yoGqOt1dnrQs.1 2024-09-05T02:16:21.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9744611272353564058', time=2024-09-05T03:53:31.072442+0000, chain.objs.size()=6 2024-09-05T02:16:21.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.iiXDQdUXjse_V5HSV-8XTpcVtPlzxMav.1 2024-09-05T02:16:21.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.2 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.3 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.960+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.4 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.5 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.6 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4667413790478762091', time=2024-09-05T03:54:26.556118+0000, chain.objs.size()=6 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.G8JJbphrzBrKX28hEdhgZD_2RSNNnAYX.1 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.53DcC8IkYL6u1XqvSHxhya4ws5kB6WYA.2 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.SMkW15-vdojimxXG4ZDkchxwzDwFsI9c.3 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.Z1jPz7cxr0BCy4qqjnlfDEWuqHoSJ1zo.4 2024-09-05T02:16:21.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.kr8iPu-oQWBdG0s6oPenvdPnI3WCECno.5 2024-09-05T02:16:21.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.964+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.lOoHqx1tPIRdItx6Z-vu1KdeIkxQINBf.6 2024-09-05T02:16:21.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xLbtggfe51Tjtdv4has0eqS33rkzhtd', time=2024-09-05T03:57:05.246361+0000, chain.objs.size()=1 2024-09-05T02:16:21.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.561__multipart_mymultipart.2~xLbtggfe51Tjtdv4has0eqS33rkzhtd.1 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17556505253493215558', time=2024-09-05T03:58:59.841762+0000, chain.objs.size()=1 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:Xe8As4dnMt2B7lMBQEJOCRhxRnsSAWO_.6pXILj_XdyfTk2WVI1NU6N3d2uksD6L_0 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9705621406599041769', time=2024-09-05T03:59:24.830117+0000, chain.objs.size()=1 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:vegIFpgd87meK-zuxayIVNFnpO0AwBg_.eOCk9wDKp6lO05bukh4PEpbKzTYQIV4_0 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5770923545743900673', time=2024-09-05T03:59:25.101518+0000, chain.objs.size()=1 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:zLnETli4UouahUZoEhb.LlqqzbaCP7i_.uLGvfVPpx--8JFp9x3qiwGiF_wQKcTq_0 2024-09-05T02:16:21.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7760214567420085930', time=2024-09-05T03:59:58.970257+0000, chain.objs.size()=1 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.596__shadow_.PkuCPNX5im2-fx2iayKyeW2-iMBX3uK_0 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk', time=2024-09-05T04:04:46.393661+0000, chain.objs.size()=6 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.1 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.2 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.3 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.4 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.5 2024-09-05T02:16:21.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.968+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.625__multipart_multipart_enc.2~0CWXgZtjSt_BM68Onj2dvNX3GstzdHk.6 2024-09-05T02:16:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9689088361108004642', time=2024-09-05T04:05:00.648829+0000, chain.objs.size()=1 2024-09-05T02:16:21.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.634__shadow_.Lz5wvWobXPc532xKw-YsqFSJF4HnT7k_0 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4618166994404974420', time=2024-09-05T04:05:04.042729+0000, chain.objs.size()=1 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.636__shadow_.pea3E5BNXM-hpIubjZIumnOnNLPJzLH_0 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5764103818766579', time=2024-09-05T04:07:30.389493+0000, chain.objs.size()=1 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.710__shadow:EX6X7LsecFJ2uceKmrDU-2ARGmerIpc_.Y2IAc_KOc0fJj0vrNr9H_UlVCQie6H5_0 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15904796325143268433', time=2024-09-05T04:08:04.639140+0000, chain.objs.size()=1 2024-09-05T02:16:21.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.972+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.719__shadow_.uP0eiZXXE0L5vFiqeu2gCrniC1iTwnn_0 2024-09-05T02:16:21.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.976+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:21.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.976+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-05T02:16:21.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:21.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:21.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50686' 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11614050852090592873', time=2024-09-05T03:33:42.624808+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.179__shadow_.kxnquDniN3oWIaFVah_MX0WFUuU66J0_0 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13657851482628538172', time=2024-09-05T03:37:33.560471+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.236__shadow_.YS1a1jg9LXapzPXZG4SE9rD45Nk0X8n_0 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2807704573949855833', time=2024-09-05T03:37:36.222919+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.237__shadow_.m9AnPnrCokD4tvHC0JYPhItZBpgxZvU_0 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16522532643093196753', time=2024-09-05T03:37:54.840390+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.246__shadow_.NsCk_IDhedr1qsqLoiDW8YUXqNZVmfp_0 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7698701064072983837', time=2024-09-05T03:38:07.938194+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.253__shadow_.edyqNH0vql_oGNy6lyfS2jYWCNfIV_9_0 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1751187871015442399', time=2024-09-05T03:40:04.895200+0000, chain.objs.size()=1 2024-09-05T02:16:21.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B9rnLqAamwwO_qo1LJYTYtXknwva2K9_0 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4369132005572548733', time=2024-09-05T03:40:04.897064+0000, chain.objs.size()=1 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.naenMxeBEaoWqYa2LiNbYiuXk8vdOIi_0 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7064972606603635477', time=2024-09-05T03:40:05.120829+0000, chain.objs.size()=1 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ChbM9JnxGPB_1ixIcLXIq_AWqAwpBRb_0 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8162043017335070237', time=2024-09-05T03:40:06.022859+0000, chain.objs.size()=1 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H77zUs-uQ2YrUDSIilAdhlm3ypQHHUm_0 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9593330179875129711', time=2024-09-05T03:40:06.379923+0000, chain.objs.size()=1 2024-09-05T02:16:21.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FR43c9qbgGuafw-d_ACqbQ6aeWKzDa__0 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11378124047109052353', time=2024-09-05T03:40:06.910323+0000, chain.objs.size()=1 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.I8xEWjoeaaYAW5AKFigjFZnj7O9_s2Z_0 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10490670502767666471', time=2024-09-05T03:40:07.004699+0000, chain.objs.size()=1 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.980+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.b37jN_DAKg4rfh4IKRwy-Wbqt7r7xpV_0 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10150309601837607316', time=2024-09-05T03:40:08.930365+0000, chain.objs.size()=1 2024-09-05T02:16:21.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LuSjh21QBt1uU22UDhknnbe-KPr-mVF_0 2024-09-05T02:16:21.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.135415318328203798', time=2024-09-05T03:40:10.966327+0000, chain.objs.size()=1 2024-09-05T02:16:21.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sq_L_nr9h3lJ8GiVy-exC5H3nDX-In2_0 2024-09-05T02:16:21.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1736445426434720679', time=2024-09-05T03:40:11.693039+0000, chain.objs.size()=1 2024-09-05T02:16:21.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.h8mjQLPcjsN_Hs_elBYufEH1m5ep1HF_0 2024-09-05T02:16:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13741168927446354855', time=2024-09-05T03:40:11.694547+0000, chain.objs.size()=1 2024-09-05T02:16:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gBZvITdrniemVjvw3PDeM3killItcQ7_0 2024-09-05T02:16:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1112706677213252293', time=2024-09-05T03:40:16.427447+0000, chain.objs.size()=1 2024-09-05T02:16:21.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UGBWsbsk_01LYG7Y91hRN2wdpSAdAkl_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11257875233833556438', time=2024-09-05T03:40:17.645559+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XiJ02vim2csgH-73LC96bQgirWDHb_L_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6180485232838127121', time=2024-09-05T03:40:19.455452+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9tf3_PqatZrFczBT-4CqteR-DOKA88y_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17303345298545405416', time=2024-09-05T03:40:20.703366+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CAk7KVxfuRUgIH5pXzIfHEk2qatSQRk_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13496362162993612030', time=2024-09-05T03:40:22.606853+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8nCu6o93RfOXnFUwM3AxpKAaS9INH05_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10830952953358677083', time=2024-09-05T03:40:23.399937+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gir6LK5HvAiTw-fKXxOKSr0-3dttmXP_0 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17688899216926401089', time=2024-09-05T03:40:23.876021+0000, chain.objs.size()=1 2024-09-05T02:16:21.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PxagaQfppIsi33AXFSrrMUS9w4Z24XZ_0 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14918071011800105899', time=2024-09-05T03:40:24.809740+0000, chain.objs.size()=1 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.crNQDfm9uU0w6gVXc3ubEWQV5kcdBkf_0 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4076933954157542375', time=2024-09-05T03:40:24.810997+0000, chain.objs.size()=1 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KqOiy0477sHvZPZXl8uPvkw2KYWLDEp_0 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5034652545085160968', time=2024-09-05T03:40:26.217124+0000, chain.objs.size()=1 2024-09-05T02:16:21.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.984+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8m5YObBTBf504RwMfKsbQxCmkNeC5lV_0 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2967610225818117648', time=2024-09-05T03:40:26.242949+0000, chain.objs.size()=1 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JomCncxKWp6GlceFZJA34F0KoHlbhWY_0 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15232811744841726071', time=2024-09-05T03:40:27.641952+0000, chain.objs.size()=1 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iAjinjOwUCUw3-_-xjE-w8_Jw6f3ge0_0 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.850480943875025856', time=2024-09-05T03:40:28.263256+0000, chain.objs.size()=1 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.L7FyNIpX-bX_tPfkh7SMFytfdmyJN1C_0 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7807944354141270394', time=2024-09-05T03:40:28.960763+0000, chain.objs.size()=1 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wMJOJ_vwkcDVsJzg7vFoQwwRXtdLHNr_0 2024-09-05T02:16:21.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13300777030204331816', time=2024-09-05T03:40:29.109378+0000, chain.objs.size()=1 2024-09-05T02:16:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.D6XXnOnmLUisSNA5t_o3ycM5EQIMV1S_0 2024-09-05T02:16:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5283198831534464738', time=2024-09-05T03:40:29.111325+0000, chain.objs.size()=1 2024-09-05T02:16:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bKOlgnmIWLkkRzRc_J7wdmIghItC6PO_0 2024-09-05T02:16:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5063822550550148312', time=2024-09-05T03:40:30.914585+0000, chain.objs.size()=1 2024-09-05T02:16:21.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.as90oCR7z8eLQDMsW04q2xnKh_myGwH_0 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11597950489285860704', time=2024-09-05T03:40:31.334180+0000, chain.objs.size()=1 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MHXEFMsHUq2I65kLDOWpW7fb5gprJth_0 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17414188774953840776', time=2024-09-05T03:40:33.057363+0000, chain.objs.size()=1 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8sJ75mFy7fAUg5dqLka1f7rh4w8GKGZ_0 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8506298283634353449', time=2024-09-05T03:40:34.399465+0000, chain.objs.size()=1 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.U2FveiJPl6f1OkU9C-I_k0-p62m6Oue_0 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2733482147888623493', time=2024-09-05T03:40:34.937525+0000, chain.objs.size()=1 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.r5q9riSOp94369HEiAnjUCqTpuYqQ5F_0 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6966429628388159300', time=2024-09-05T03:40:35.871612+0000, chain.objs.size()=1 2024-09-05T02:16:21.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fzdsknHTWQpRS3z0v_aoNLTcuK-4not_0 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15425945426406221964', time=2024-09-05T03:40:36.068599+0000, chain.objs.size()=1 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B4yQfWjrnlK_InHUe3CUfmO2mLQ5EiU_0 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14352085761069874753', time=2024-09-05T03:40:36.204525+0000, chain.objs.size()=1 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.988+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5DNxiwXZP4SuLVKCovgyaJ9L3Mj50OR_0 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13088757654124872905', time=2024-09-05T03:40:43.461184+0000, chain.objs.size()=1 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.266__shadow_.vMw5vVdICjc9yEM_3S4uPOpR215OEh4_0 2024-09-05T02:16:21.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12667017646580976609', time=2024-09-05T03:40:59.326178+0000, chain.objs.size()=1 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.275__shadow_.HCGSQWVwgIEzvBbHVZ5UT4HZepZ1_zn_0 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.680811333301537945', time=2024-09-05T03:41:34.702119+0000, chain.objs.size()=1 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.auLhFUol39tP6urclSv0gf2cACGxlJ1_0 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13124276126199410823', time=2024-09-05T03:41:35.018652+0000, chain.objs.size()=1 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.WEy8rE4EMLI3SI_TY6CVV7ePxSl32Hm_0 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3197208306161772023', time=2024-09-05T03:41:40.330901+0000, chain.objs.size()=1 2024-09-05T02:16:21.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.jyFApX8ForT1fWhver6rfLgy_TnBi5a_0 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4175319297249749734', time=2024-09-05T03:41:51.808921+0000, chain.objs.size()=1 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.299__shadow_.RqwBojuExu-acFgDnR0JEYsH8fou_Vm_0 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1499164083394865926', time=2024-09-05T03:44:19.760398+0000, chain.objs.size()=1 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.68YMWPkYswcrB1xfiX_4xgDoXrxn8RH_0 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14354922134570855700', time=2024-09-05T03:44:20.230402+0000, chain.objs.size()=1 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-IfahMnCtEu7bfS9KAmVP8lu-sYELBv_0 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9862352586789969611', time=2024-09-05T03:44:20.404485+0000, chain.objs.size()=1 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Aqjubka92zz9xsItlYBbqPBI-9dl5bH_0 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15054246248933659601', time=2024-09-05T03:44:20.606558+0000, chain.objs.size()=1 2024-09-05T02:16:21.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5w6EDj5xAo-wt7MU0NIrvBEN4O8csGl_0 2024-09-05T02:16:21.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1108309968538028864', time=2024-09-05T03:44:21.984597+0000, chain.objs.size()=1 2024-09-05T02:16:21.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.992+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PEn1A2nQdc3XE6SwQtEW3uOgpqfadtB_0 2024-09-05T02:16:21.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2387051562415320865', time=2024-09-05T03:44:22.205464+0000, chain.objs.size()=1 2024-09-05T02:16:21.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CqIBcM39BUzuizPU7mAla9sjKKKO9XM_0 2024-09-05T02:16:21.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18093538646149492812', time=2024-09-05T03:44:23.542854+0000, chain.objs.size()=1 2024-09-05T02:16:21.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.s-LQuRuU20fgfuedHgSBXVwSjI07nmO_0 2024-09-05T02:16:21.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3427329272800742362', time=2024-09-05T03:44:24.042094+0000, chain.objs.size()=1 2024-09-05T02:16:21.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ex1scgXUc8TxLuCRpP9y6oEhnMMltXC_0 2024-09-05T02:16:21.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2065518545288013162', time=2024-09-05T03:44:24.649539+0000, chain.objs.size()=1 2024-09-05T02:16:21.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZEOj9EuBJ4ywFFfZmegCALV13MFtgs1_0 2024-09-05T02:16:21.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16517818971941095530', time=2024-09-05T03:44:25.389165+0000, chain.objs.size()=1 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._duDFsnKXDKLbxlvSN0QciMvRC0zx5r_0 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13491559643305268838', time=2024-09-05T03:44:26.365683+0000, chain.objs.size()=1 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DbtCE4o3HiopvgY2y05JWblqali0Mm7_0 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6328747736402126665', time=2024-09-05T03:44:26.562366+0000, chain.objs.size()=1 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7bShJWCJNJz164NoBqHqCzEYil_WisX_0 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1511934330131948847', time=2024-09-05T03:44:29.266191+0000, chain.objs.size()=1 2024-09-05T02:16:21.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:21.996+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hPYa4tPdxlzy_ZSxTEzTNaai0yw5Bdw_0 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17070979848185342696', time=2024-09-05T03:44:30.099586+0000, chain.objs.size()=1 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2gPyFTxOiIMwbmTR-gQr4J9aUULe8fw_0 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6056225511491306486', time=2024-09-05T03:44:31.844309+0000, chain.objs.size()=1 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oAciD997m2QSR-AXTgUFdwLSXOuuR28_0 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2523894085922167510', time=2024-09-05T03:44:35.905985+0000, chain.objs.size()=1 2024-09-05T02:16:22.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wm-BtS_HQweCTHjFBZIGVWj9xx0eksv_0 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10626977675886551134', time=2024-09-05T03:44:36.308859+0000, chain.objs.size()=1 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0s-2_KwLojSSf5Ce5Nw1rxZdqHajOfZ_0 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16748152809562486300', time=2024-09-05T03:44:36.554506+0000, chain.objs.size()=1 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.e_MqqxvY11JlwAAuDHUmqo0n6ht-ZQP_0 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13780730459969016615', time=2024-09-05T03:44:36.901370+0000, chain.objs.size()=1 2024-09-05T02:16:22.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.z8TN1ow54FuGHBXiSE1B7oy5xOXiEvd_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7665197677573631581', time=2024-09-05T03:44:37.834839+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6tm66ZecfAb1HxcnvNjBbFkTSm-7r-D_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8971171999577138360', time=2024-09-05T03:44:38.144008+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CR_vviUBcBasPLKObCIGhmlBAhCGpBl_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5588583362519372189', time=2024-09-05T03:44:38.297606+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.q49LIsNQuu4DzndYof1EFX2B8hLftJ0_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7398538543367441757', time=2024-09-05T03:44:38.425880+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._7QRCuuC4foi8tAt1s3smzEk67EbBVw_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12506231972649529959', time=2024-09-05T03:44:39.032389+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jMY_DvG9AJkx655yI8zQmJ4l04QkxPL_0 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6332893155311825493', time=2024-09-05T03:44:40.028196+0000, chain.objs.size()=1 2024-09-05T02:16:22.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.peHbJ6FsuHrgIe5sowle6MH2P34BOXO_0 2024-09-05T02:16:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9526593798658479235', time=2024-09-05T03:44:40.030600+0000, chain.objs.size()=1 2024-09-05T02:16:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HowrI5c9fIAP0H5aHlFzP-jqAJrrkON_0 2024-09-05T02:16:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1454457000198984213', time=2024-09-05T03:44:40.576940+0000, chain.objs.size()=1 2024-09-05T02:16:22.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.000+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kg72V427AFwSjjL2SoFs32bRYsBeLdf_0 2024-09-05T02:16:22.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6189477882395617407', time=2024-09-05T03:44:41.023188+0000, chain.objs.size()=1 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7tPr3bj8weODJOrsmk1NgIYJuT50Oh1_0 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4433547855782048386', time=2024-09-05T03:44:42.808958+0000, chain.objs.size()=1 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ksEmBKihmhpdEtCyxjLEOhe89WhAg9c_0 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11818572288320477559', time=2024-09-05T03:44:43.796527+0000, chain.objs.size()=1 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XtTk71KUZh-EWKF6_l5EyDgIKz4fb4L_0 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4849967836830920292', time=2024-09-05T03:44:47.755726+0000, chain.objs.size()=1 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AcZTjctephz5zPUBiQ09HBpP6jSjyOX_0 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9809911424594668181', time=2024-09-05T03:44:49.402878+0000, chain.objs.size()=1 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iZS0oQX_-J_hn1-LIRQwAYxEux0pa-G_0 2024-09-05T02:16:22.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.65210760387247545', time=2024-09-05T03:44:49.404759+0000, chain.objs.size()=1 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.x2Q8gsKMFnYt24-iA2qZBZBCIdwmcXa_0 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4179295203211191007', time=2024-09-05T03:44:49.687196+0000, chain.objs.size()=1 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QQMV_buJv5FdgAAPyLEiVeVP4HocsN8_0 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8324575687180134129', time=2024-09-05T03:44:49.998829+0000, chain.objs.size()=1 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jlXd0OtH1hXkLI_EF8CfPfelh6bcWrs_0 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13230632393968532428', time=2024-09-05T03:46:33.867485+0000, chain.objs.size()=1 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vA8ULmPfGY-oAh_Z0T2x9SnHnulUKKQ_0 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13551741007023781488', time=2024-09-05T03:46:34.781915+0000, chain.objs.size()=1 2024-09-05T02:16:22.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0MHbPDOqewRWVM9QnYpywnypNFOLyZX_0 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10568956199403769030', time=2024-09-05T03:46:35.073187+0000, chain.objs.size()=1 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1_Go9MDtl-PEfeE-KNSOQkFX673rj4U_0 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15186287146112334696', time=2024-09-05T03:46:38.793967+0000, chain.objs.size()=1 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.juM05B27juuZ2Fgf9pZ8RSzn12XLE0A_0 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5824016276756696345', time=2024-09-05T03:46:40.157625+0000, chain.objs.size()=1 2024-09-05T02:16:22.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.008+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.f5nxhb1efETLf4NVCxeOYtnv5Zu9bvm_0 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7688761006035594029', time=2024-09-05T03:46:43.369822+0000, chain.objs.size()=1 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xc1N52N24Np1nj9BK70kXzydYO0Tn62_0 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17118048988604618087', time=2024-09-05T03:46:43.796568+0000, chain.objs.size()=1 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5xfUodHSocr_5odcP7yiaUVQkVeB5Cq_0 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2546850814226121536', time=2024-09-05T03:46:44.383881+0000, chain.objs.size()=1 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.S8IMp_ZBmBhmTAYPerKeHP812WUHqY-_0 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14949359803489687434', time=2024-09-05T03:46:44.386238+0000, chain.objs.size()=1 2024-09-05T02:16:22.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xtO7M51tbmaVxxo_MDbSw6j-M1n7QIs_0 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1444899931687400137', time=2024-09-05T03:46:44.771515+0000, chain.objs.size()=1 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NInmIS7ufLVeNvOowcCd8GAIG_MZLQT_0 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13876131756691592483', time=2024-09-05T03:46:46.754237+0000, chain.objs.size()=1 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ILXt_HDAwfbQrmh1S7Ilqp_Z6eieWW8_0 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18402629148731383989', time=2024-09-05T03:46:47.265410+0000, chain.objs.size()=1 2024-09-05T02:16:22.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OZNERhbrq6e0aRmXTfjaTp398YFjCT__0 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6945330713463698675', time=2024-09-05T03:46:47.464317+0000, chain.objs.size()=1 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.65e92zV11KW2pNuV8s2wadl8qtDnewA_0 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2053419280772519603', time=2024-09-05T03:46:48.245473+0000, chain.objs.size()=1 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0XUiJbwXX15vKSvKnPPmXua93LnoSiZ_0 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4594446924179931601', time=2024-09-05T03:46:48.606514+0000, chain.objs.size()=1 2024-09-05T02:16:22.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.012+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-ZVA4duMwwxcu5TPn-kJJVRad-CO3xn_0 2024-09-05T02:16:22.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11642967128229557814', time=2024-09-05T03:46:49.216360+0000, chain.objs.size()=1 2024-09-05T02:16:22.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XMy_RfMQxa26uYleli11rj-vJSI7R3d_0 2024-09-05T02:16:22.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8267176090321083542', time=2024-09-05T03:46:50.587618+0000, chain.objs.size()=1 2024-09-05T02:16:22.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GT1HNfJutMriEFaRJfnoyD5ihhZZDgA_0 2024-09-05T02:16:22.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12800396193874403545', time=2024-09-05T03:46:50.589571+0000, chain.objs.size()=1 2024-09-05T02:16:22.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dBTrxAhczMQPDTT1KlPUQoTjm-csu1G_0 2024-09-05T02:16:22.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9515505343278759117', time=2024-09-05T03:46:51.070782+0000, chain.objs.size()=1 2024-09-05T02:16:22.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.016+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tgzK8YCxjFQ-UTVX0lnhgWkRy9gfBTK_0 2024-09-05T02:16:22.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.020+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50686 2024-09-05T02:16:22.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-05T02:16:22.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.549163710028337999', time=2024-09-05T03:46:51.182984+0000, chain.objs.size()=1 2024-09-05T02:16:22.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.d5xYcS99MqvB8Zhxpa7_iHFWib3BDyZ_0 2024-09-05T02:16:22.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16269352458691119351', time=2024-09-05T03:46:51.467275+0000, chain.objs.size()=1 2024-09-05T02:16:22.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sCg1o3AvymxKShlJtXDVk63xU2Q5z1l_0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7003543431304321788', time=2024-09-05T03:46:51.716611+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V7ch43LYDFQ_H6InzXl2H4yJFAIOk_L_0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16783477950761242440', time=2024-09-05T03:46:51.789692+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WwNZDRKmQhVNelnivzwfpgJhSosbA-b_0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281388972959252434', time=2024-09-05T03:46:51.931114+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7bKvHotg6niIn7ZBdWxljbL_zy4B3ux_0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7500949661676609955', time=2024-09-05T03:46:52.420238+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SSnI_yZUrGc5BLjaktAfQ9rK4Dfdo99_0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6050608296719474', time=2024-09-05T03:46:53.241444+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jbgS2P4zrg66eqNfkIqoEFZpbdU_L5__0 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5872450608984033302', time=2024-09-05T03:46:54.139860+0000, chain.objs.size()=1 2024-09-05T02:16:22.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CDW8ukwyLfnV1eogkNjnbuC9HXXEBJM_0 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7574938398886047288', time=2024-09-05T03:46:54.522116+0000, chain.objs.size()=1 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jMs6vHa0D4Xoz9LV4NR89dqm01slZZ6_0 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16795826561554350635', time=2024-09-05T03:46:55.156280+0000, chain.objs.size()=1 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.--hsbyBULeYEuJ345uzHv4A2jjdku8v_0 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3069420134195431260', time=2024-09-05T03:46:56.438383+0000, chain.objs.size()=1 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7IsjOPBuhNtOnOP3JF4nFdXJ7qqITfV_0 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13972234809317232396', time=2024-09-05T03:46:56.839957+0000, chain.objs.size()=1 2024-09-05T02:16:22.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.024+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7FiY8-PQTsNJirHb7pAOf-PKalErJ5f_0 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2914413216478325202', time=2024-09-05T03:46:57.255403+0000, chain.objs.size()=1 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.f9fpqs4778re7vG1dpPywafFKmujJgg_0 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13112219064362819620', time=2024-09-05T03:46:58.032878+0000, chain.objs.size()=1 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NzqLBOr2T4copqkhz1WtqeBa3NOjqH6_0 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15314923286550098816', time=2024-09-05T03:46:58.178575+0000, chain.objs.size()=1 2024-09-05T02:16:22.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.a1s8R0l8ccdKEGEw6vjalto84_oQN8f_0 2024-09-05T02:16:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3084359519600196251', time=2024-09-05T03:47:00.075156+0000, chain.objs.size()=1 2024-09-05T02:16:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0Vo8La_InNhS9Z_LsP7_SnSoTkd34hU_0 2024-09-05T02:16:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8744733467930170061', time=2024-09-05T03:47:00.181150+0000, chain.objs.size()=1 2024-09-05T02:16:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MHlibPqwOcgWL8A9OohI6Q2tDhMy32E_0 2024-09-05T02:16:22.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7310808326570996399', time=2024-09-05T03:47:00.570437+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zrfUCiRYx9YMklnsghCpxz1HdKhGa8g_0 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15772290878519066313', time=2024-09-05T03:47:00.794973+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1ox-25OVSaHi6p96MgEQP9dznJqBsGo_0 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5485902359238256863', time=2024-09-05T03:47:02.936700+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DuAb4-78gjDIT3M_pysBxu07DtGvJfK_0 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9646585736519772296', time=2024-09-05T03:47:03.166153+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8dLJoE7zdT5IC4a189H4FkILySNV5j-_0 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16918915345394086272', time=2024-09-05T03:47:04.331664+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CyMgJOFpw2JFo1JJqSxyeq8vFRTGP5v_0 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7099734937326137124', time=2024-09-05T03:47:04.428997+0000, chain.objs.size()=1 2024-09-05T02:16:22.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.028+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rTQbpBESX2NcMWRj0Xobsfbptttt-t7_0 2024-09-05T02:16:22.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4374958842174531542', time=2024-09-05T03:47:24.462881+0000, chain.objs.size()=1 2024-09-05T02:16:22.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.337__shadow_.vnnDs_QH3MYw3uSc0KsbGNjmX7a3VKH_0 2024-09-05T02:16:22.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15867896836329813986', time=2024-09-05T03:48:25.686615+0000, chain.objs.size()=1 2024-09-05T02:16:22.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.381__shadow_.ni1Mn78oagUxoOfn0qSknm6xazCSD2b_0 2024-09-05T02:16:22.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11699958629134989840', time=2024-09-05T03:49:51.990714+0000, chain.objs.size()=1 2024-09-05T02:16:22.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.437__shadow_.MKPykqScvs6YEu6NjpEE2Id620HXarE_0 2024-09-05T02:16:22.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8757961420028819490', time=2024-09-05T03:49:58.572471+0000, chain.objs.size()=1 2024-09-05T02:16:22.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.441__shadow_.U3st0jHd68QS1PeiHUB0MxTUBr5werv_0 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11898957742179643470', time=2024-09-05T03:50:16.590173+0000, chain.objs.size()=1 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.451__shadow_.X7qRtDRvuzjJgMMbc5TkyeU4OQGI8uC_0 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10477544477483017781', time=2024-09-05T03:50:27.685100+0000, chain.objs.size()=1 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.457__shadow_.NImmn9FDgdLewv1rtQgIla-y2wiLNu-_0 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14148263911767613389', time=2024-09-05T03:51:11.794295+0000, chain.objs.size()=1 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.484__shadow_.dnXosBLG6_h5VlBLqblNbo_X2_wOAWD_0 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18398887775589432558', time=2024-09-05T03:51:47.590402+0000, chain.objs.size()=1 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1055822235647886870', time=2024-09-05T03:54:58.555265+0000, chain.objs.size()=1 2024-09-05T02:16:22.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.524__shadow_.yBnjakt0KFrR6TxoRtQ-Y6SQ8lS2Bl2_0 2024-09-05T02:16:22.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~N7JRT3NHX4gPvlzSFruf0rPKnjanrAo', time=2024-09-05T03:55:27.735229+0000, chain.objs.size()=1 2024-09-05T02:16:22.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.534__multipart_mymultipart.2~N7JRT3NHX4gPvlzSFruf0rPKnjanrAo.1 2024-09-05T02:16:22.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11910331748547098545', time=2024-09-05T03:56:34.250054+0000, chain.objs.size()=1 2024-09-05T02:16:22.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.032+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.553__shadow_.2PSh9NfLcnPFv2ckqkHe3UXePumQ00H_0 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10325416831735958604', time=2024-09-05T03:57:33.415374+0000, chain.objs.size()=1 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:w4dahKlDsMvBMsZUKzrlBY9guP.cAW6_.o35PESueEzFB0I1nmdsmRbe5G-0Ga60_0 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1685229286545396246', time=2024-09-05T03:58:23.249779+0000, chain.objs.size()=1 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:-Q2SVliQweJN-LQhUv92MkDLK1R3oDT_.RBA78KtWl0HBLmb3l-zhr-RPZqJe85c_0 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7876550009947348738', time=2024-09-05T03:58:52.227142+0000, chain.objs.size()=1 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:sItG0eD3-BD5-cKYYYAepy2R0dGudDM_.5AtJmdXIwEEnBpLmS7MPEZAK4KfMFfI_0 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2051425850591901993', time=2024-09-05T03:58:53.923537+0000, chain.objs.size()=1 2024-09-05T02:16:22.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.036+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:HONpoL.478SBjXmpPdFZPRlcyWFWIua_.c-7aBzS4WyzYNDdffFablkO8JAdyRKh_0 2024-09-05T02:16:22.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15357667670296845349', time=2024-09-05T03:59:00.673140+0000, chain.objs.size()=1 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:aN1cJ-oDGHEgACpz05MI8OPDqDSF514_.8FxEl5E5UAduV9xIxQEaWaqr6aONtXq_0 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7298629576621235951', time=2024-09-05T03:59:24.864092+0000, chain.objs.size()=1 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:q.LM84euXVoLM5wGx7Z6nB6-PDzYcQ0_.Xbz3mCOW8VBtkRSS3L6ZmgKTzcdAtJI_0 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17323047586550173461', time=2024-09-05T03:59:45.126869+0000, chain.objs.size()=1 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:atpmW4IF-jOakVxsfEMZCGfJbCNv064_.8ZqfqoPfzzS73yd6F6eKz0F0m-j0z01_0 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10110956696836470859', time=2024-09-05T04:00:17.606620+0000, chain.objs.size()=1 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.608__shadow_.MnRRc-ZYnHx1Q-QFMbiToz0ju83FGg1_0 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4726818201418331641', time=2024-09-05T04:01:01.187277+0000, chain.objs.size()=6 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.1 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.2 2024-09-05T02:16:22.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.3 2024-09-05T02:16:22.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.4 2024-09-05T02:16:22.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.5 2024-09-05T02:16:22.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.613__multipart_multipart_enc.2~tmBIvw_HbFUcAqxwQsMkjDE2pSmq3Fd.6 2024-09-05T02:16:22.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16043635351903880931', time=2024-09-05T04:06:17.594308+0000, chain.objs.size()=1 2024-09-05T02:16:22.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.040+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.664__shadow_.aevnO0VvSj4403lIEZuvS-M0XyuT6RM_0 2024-09-05T02:16:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.044+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.048+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-05T02:16:22.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.048+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48475' 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16082518274283327467', time=2024-09-05T03:37:29.781281+0000, chain.objs.size()=1 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.234__shadow_.VFDg_oXlfWYVjDh_8iOAMssk26tlxxX_0 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3555799742168542538', time=2024-09-05T03:37:36.249956+0000, chain.objs.size()=1 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.237__shadow_.11cADWHprDnE-h0oxamRRmFDFaWfzMs_0 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11220650379373951608', time=2024-09-05T03:37:51.086495+0000, chain.objs.size()=1 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244__shadow_.s7qLTLDzbkvkHyiEO5C6WnaebmmilvP_0 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1395036034178422486', time=2024-09-05T03:37:52.966087+0000, chain.objs.size()=1 2024-09-05T02:16:22.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.245__shadow_.4Ul6fbI0m5vw5U-5QxabkiLEnCiLvsf_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6212643500216152002', time=2024-09-05T03:38:05.998534+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.252__shadow_._LlSOVK5BEgBrxgkwzLv2lS6Nq1UQw3_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7905787567186602456', time=2024-09-05T03:38:09.758410+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.254__shadow_.0EFtuVu69EpOdBUV6OYC0JNtuONiUNV_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1506303959756409196', time=2024-09-05T03:40:04.298526+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wCKeU7_Lr4xxOh0fe6mShqCR3m1xrAU_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6074958924601630015', time=2024-09-05T03:40:04.796679+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fcHLRxngeSz9CECWVZcXPUmu9d86v87_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6898082132201554704', time=2024-09-05T03:40:05.614151+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.g3sY1WVdi-auBYEsb-EDCQGaol4gUo8_0 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16578204773407749680', time=2024-09-05T03:40:05.616066+0000, chain.objs.size()=1 2024-09-05T02:16:22.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BjvhKCkUQ1BqfpbRE_0mDvjl3RqjDSA_0 2024-09-05T02:16:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14739034869692743143', time=2024-09-05T03:40:06.093650+0000, chain.objs.size()=1 2024-09-05T02:16:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.uFfGz5SmXQ_7t1TS85DfEMfIB8vh_qS_0 2024-09-05T02:16:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3619440810722073880', time=2024-09-05T03:40:06.131398+0000, chain.objs.size()=1 2024-09-05T02:16:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Bptp1IBGHqgxaQbY8b34FxlZ5elgyuH_0 2024-09-05T02:16:22.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18349778430282155958', time=2024-09-05T03:40:07.645499+0000, chain.objs.size()=1 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.DHmurBwXXAFB7ioIWwvBxiBwENK0XRU_0 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3876945861319220049', time=2024-09-05T03:40:08.785797+0000, chain.objs.size()=1 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.n0rJ6957YNVI3RuX_RwiCjqtf3fQzka_0 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18222895406134316936', time=2024-09-05T03:40:09.436983+0000, chain.objs.size()=1 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.052+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i-ur-fHyNuZwYSzTKZsfayE2L0yzXv0_0 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2805971360694145945', time=2024-09-05T03:40:09.660197+0000, chain.objs.size()=1 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C9GfIVXzfdSY51Fpqm9MqchR96h_82F_0 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14044802700096868215', time=2024-09-05T03:40:12.112519+0000, chain.objs.size()=1 2024-09-05T02:16:22.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PhWdVzTCa-wQo3JwPo9ulE83vkUfork_0 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8951089084297062883', time=2024-09-05T03:40:13.196841+0000, chain.objs.size()=1 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QOmRRTg5pfDNEWNDuvyzApzB1ItBXMP_0 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9668280743882508008', time=2024-09-05T03:40:13.199018+0000, chain.objs.size()=1 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LlT_OlJNkGoD3vlwuqnGkDXKr6VpUy-_0 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1373381900191808723', time=2024-09-05T03:40:14.418837+0000, chain.objs.size()=1 2024-09-05T02:16:22.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YE5oR1MVjjDf6RhRQEWCRycL-cO_aNn_0 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12741668733060165438', time=2024-09-05T03:40:15.854671+0000, chain.objs.size()=1 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yQ4uiRWSgPp_scqjUET_nc2VbH_2_yl_0 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5019066951024032423', time=2024-09-05T03:40:16.387575+0000, chain.objs.size()=1 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aPqpIPxkyTC0mnVWMx8BVYViS8JW_De_0 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6243127174658332536', time=2024-09-05T03:40:16.389478+0000, chain.objs.size()=1 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.odC3rOK3MRINaD1V5FQBvTq7L6g3J31_0 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3543565262434526287', time=2024-09-05T03:40:17.685992+0000, chain.objs.size()=1 2024-09-05T02:16:22.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nS5WF67KpdHeDHKsJzsa8LlODzSG9qx_0 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13237973905590109227', time=2024-09-05T03:40:17.687776+0000, chain.objs.size()=1 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.IUkn0spZEstopgUoPlkkD6Z7MnrPogJ_0 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2700668590074819321', time=2024-09-05T03:40:17.976571+0000, chain.objs.size()=1 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.02_wT7K35xRdonu6OsrlybHFHKsMHEm_0 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8159474024820491414', time=2024-09-05T03:40:20.795471+0000, chain.objs.size()=1 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lCZ3L_Y19-xS3jGocz7PlBfsFXIlPWZ_0 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13290067604359598904', time=2024-09-05T03:40:22.388255+0000, chain.objs.size()=1 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NpxZSnato5NbiiTgT0-1aA36Rziu3YY_0 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9849513950753460452', time=2024-09-05T03:40:22.985149+0000, chain.objs.size()=1 2024-09-05T02:16:22.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.056+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.j-5y-Pq4evxu_WqUOAMod64cGUEQ3to_0 2024-09-05T02:16:22.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8256228358498564867', time=2024-09-05T03:40:23.421665+0000, chain.objs.size()=1 2024-09-05T02:16:22.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.k8ueavKQJmf-HrgPvQsRI5tkennMtqL_0 2024-09-05T02:16:22.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2558298245781581940', time=2024-09-05T03:40:23.424805+0000, chain.objs.size()=1 2024-09-05T02:16:22.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bgPekj58IkyDTpHm1PRBpTZdcJN0KiT_0 2024-09-05T02:16:22.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5460380877585618236', time=2024-09-05T03:40:24.562061+0000, chain.objs.size()=1 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7Hj3DQDfMDLYbbFFZktEGqzvy6Izpxh_0 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14071435820326566345', time=2024-09-05T03:40:24.912006+0000, chain.objs.size()=1 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Iof29va8VAyv3pPrjaqwc4pPIAI6zDI_0 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7910769839105379913', time=2024-09-05T03:40:25.837464+0000, chain.objs.size()=1 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.WRw8oiR8oimexoN9xLFRCj2gjJUcniJ_0 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9915073795929361765', time=2024-09-05T03:40:25.987223+0000, chain.objs.size()=1 2024-09-05T02:16:22.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mt5FJ2I_uG0qoNRRorIwXI4Dj6HjWM1_0 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4244397181962975031', time=2024-09-05T03:40:26.371360+0000, chain.objs.size()=1 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B6rHIkrloe0QtasB0tstNX6ZdRowglo_0 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.544864633166209309', time=2024-09-05T03:40:27.300819+0000, chain.objs.size()=1 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kf1TqArzSpdQ5kEO4jde8ha32ldM2G2_0 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2216587331576663023', time=2024-09-05T03:40:28.171973+0000, chain.objs.size()=1 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.r2TMtyZP60CKeg5Y7kUYdlG2OeOMgjB_0 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9397529974915464741', time=2024-09-05T03:40:28.262444+0000, chain.objs.size()=1 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SITjw-OQiFJijZxaDPiUtH6ZqW4t2T-_0 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16981133761469935127', time=2024-09-05T03:40:31.554140+0000, chain.objs.size()=1 2024-09-05T02:16:22.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7tRoQ3IIOye69qqvcmke5Om_hggyaVn_0 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13352407556076101647', time=2024-09-05T03:40:31.652686+0000, chain.objs.size()=1 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lvjFqh3cY4wMG3kwuon0RMAelUYznnI_0 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12986444642226399559', time=2024-09-05T03:40:32.008525+0000, chain.objs.size()=1 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NrDtWG4253UBkFMhMTcf63WV0ChgWae_0 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5521011519873919822', time=2024-09-05T03:40:32.833587+0000, chain.objs.size()=1 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YK0Rjvqm7xgnpoUUR1kjm_U3f-xOqO6_0 2024-09-05T02:16:22.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16992906457739024623', time=2024-09-05T03:40:33.941198+0000, chain.objs.size()=1 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gO55khnaDGNeymyjEf9xxDbuKhErFwS_0 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11813128909399399236', time=2024-09-05T03:40:34.357336+0000, chain.objs.size()=1 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.20HrmBReIJu1uVJB2QTZUFjYV-hyIu1_0 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1639631903349161640', time=2024-09-05T03:40:34.553519+0000, chain.objs.size()=1 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.060+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H78glMxPzfq_kEQhx61rzULyK2AvTC4_0 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6954529173022119928', time=2024-09-05T03:40:34.990442+0000, chain.objs.size()=1 2024-09-05T02:16:22.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0lCAoYRsUWRBXawnUu8wQfYVgW0WHoD_0 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15087181881410714558', time=2024-09-05T03:40:35.361873+0000, chain.objs.size()=1 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2_fiiUKxENMzZCOCt0lV2bxEMopmfGy_0 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7353939135844273464', time=2024-09-05T03:40:35.959227+0000, chain.objs.size()=1 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XSvyXE4nojH3T-jWDFjTxhulyyF6HVU_0 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11989225655966532470', time=2024-09-05T03:40:36.252067+0000, chain.objs.size()=1 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9wvbY8hemOrV9LmWhZcDxH6FBygeJvY_0 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9070221616099519909', time=2024-09-05T03:40:36.521570+0000, chain.objs.size()=1 2024-09-05T02:16:22.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.F7tNqIFSJYQhdKtuKDQk-glKMkPfqWO_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10291923607208749944', time=2024-09-05T03:40:40.063159+0000, chain.objs.size()=1 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.264__shadow_.yO34w-mrTDudaipn4nGPooF6jrg2b3K_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18165453484188821366', time=2024-09-05T03:40:59.340702+0000, chain.objs.size()=1 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.275__shadow_.h-iIM3o6y6s_gBOfOvaocFhVESYkaMO_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3207066817164443256', time=2024-09-05T03:41:18.197372+0000, chain.objs.size()=1 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.285__shadow_.kvHwTd_4FmKzgdDE1gjESetKdbPI3Gx_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9736347052802281337', time=2024-09-05T03:41:18.214707+0000, chain.objs.size()=1 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.285__shadow_.KVoymOL6JQrlkUSDM5vCOtyVg1vHuhw_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9617711467637185294', time=2024-09-05T03:41:39.965305+0000, chain.objs.size()=1 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.tt0RuLXvlOK2M4TjNqg4E0qYD9PvbvH_0 2024-09-05T02:16:22.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13801364146837807067', time=2024-09-05T03:41:49.761210+0000, chain.objs.size()=1 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.298__shadow_.Mu0tdf1skE0lMYjKrKaTKZ_yx9jzMN0_0 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4073631697613253090', time=2024-09-05T03:44:19.656716+0000, chain.objs.size()=1 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6IWyfOH5w6wvAUjdG57zDnQb4sqduE__0 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10529278227259061963', time=2024-09-05T03:44:22.123061+0000, chain.objs.size()=1 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.l-EX_hCNuSHZ0cFaC3FC-wZwjlCCi5K_0 2024-09-05T02:16:22.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2851900324402841916', time=2024-09-05T03:44:24.690408+0000, chain.objs.size()=1 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cVQVkAjgsLakqoBb5YjhRSJEYJF2Sp0_0 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9959657694204258492', time=2024-09-05T03:44:24.780938+0000, chain.objs.size()=1 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yEa4CB5_DEsN9ZRTT2ARxI6A2qhPx5f_0 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17765400411553457955', time=2024-09-05T03:44:28.524490+0000, chain.objs.size()=1 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.064+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0C_gi4Gvz5H18ZFiUTkN5gnkDrXjiIW_0 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16253221433874902442', time=2024-09-05T03:44:28.865862+0000, chain.objs.size()=1 2024-09-05T02:16:22.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AHombO8Yo-z-pUWnQ3TgZt-oUaM2r0M_0 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3972526023354526286', time=2024-09-05T03:44:30.227566+0000, chain.objs.size()=1 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8ABrdxo8FVobVAnYN_JQtWUpGGYzPAT_0 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17198322665065205348', time=2024-09-05T03:44:32.245400+0000, chain.objs.size()=1 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uBI4vFzFt0A-0Ugw2Xi9yaAlUZWgWKK_0 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12700942888069332991', time=2024-09-05T03:44:32.793298+0000, chain.objs.size()=1 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.k1lSB3w-fSmObZ9vhZjz2_B6VvUIjnC_0 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10622322932146880231', time=2024-09-05T03:44:33.461112+0000, chain.objs.size()=1 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lYg_ZTAq9WXHPS3VKFanpQByRBfL4mL_0 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4621582471468163577', time=2024-09-05T03:44:36.353888+0000, chain.objs.size()=1 2024-09-05T02:16:22.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1rC5u8PQ-i7fXHMs3Cli6o_tRSDNbe6_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1639262073706131892', time=2024-09-05T03:44:37.137010+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Qp6q3F1a-cfV9RtkT0O0DnIOf5HAGq7_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14764384396689092348', time=2024-09-05T03:44:37.287694+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZwqBrzEVluj5hm8pa-wlpXfi9Ue4gqk_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15811048092664495588', time=2024-09-05T03:44:38.148835+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tJ50Bt6Okt5Zjc3eq14Q1XGRxQM3dUK_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15607624042051180650', time=2024-09-05T03:44:38.955624+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0BQChnYVfI42j3oAqUN6wRSTNA7uww7_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12114076008657976213', time=2024-09-05T03:44:39.931382+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QQYU8tKgNta7jZzPxnl9Hre9KlW4D3n_0 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10459101064981384631', time=2024-09-05T03:44:40.344019+0000, chain.objs.size()=1 2024-09-05T02:16:22.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vikDZWnImIjoWsXaJhS2LPt4zsHqEeO_0 2024-09-05T02:16:22.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7227418036390296697', time=2024-09-05T03:44:40.863570+0000, chain.objs.size()=1 2024-09-05T02:16:22.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.068+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.U_FgBOgtEW9SusPhXXfRZtXj-bnzUiW_0 2024-09-05T02:16:22.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6186364805608734251', time=2024-09-05T03:44:41.869943+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0Y8uF6jELfcQ0G5u6-zTvDBvKG-yNxb_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6591641505591304142', time=2024-09-05T03:44:41.871614+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2lAelNWFi3_3dutk5EQ0CbLgDFXgld9_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14746718269828972513', time=2024-09-05T03:44:42.339189+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.k3piEywOepMbODXxKVb8TkUQko4dIHn_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13984069448089405030', time=2024-09-05T03:44:42.466696+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.P0oqqp8SFRKigKMVNJ_GqV871btl7pR_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6596091203840222152', time=2024-09-05T03:44:42.734159+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0xnjjWruq6z6jc-hKfLklFRue3TRmRT_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7755691845565780914', time=2024-09-05T03:44:43.872480+0000, chain.objs.size()=1 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xbE73ue7-LZnIF6U_lN0G0aqYGX_mQi_0 2024-09-05T02:16:22.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3761106379726610297', time=2024-09-05T03:44:44.332089+0000, chain.objs.size()=1 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BlODOe5eyDqqFV656nsuZz64nP5tPrJ_0 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5383654339293493109', time=2024-09-05T03:44:45.107968+0000, chain.objs.size()=1 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.P61NE7SfaiCzh-5l8Xy3IuCRQZLiV-N_0 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9001959575398458348', time=2024-09-05T03:44:45.219178+0000, chain.objs.size()=1 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vrbRbUj_-7S4hjvPpAAjtRGv-G57rHC_0 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10369828060236915060', time=2024-09-05T03:44:45.710482+0000, chain.objs.size()=1 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._61HBD717RrvfK2dW-_YuP6SoPUgsrX_0 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9949343507227915224', time=2024-09-05T03:44:46.223545+0000, chain.objs.size()=1 2024-09-05T02:16:22.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hYnp915gyTs9h2v3t7tASKVmlP1OASS_0 2024-09-05T02:16:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10039042331247241965', time=2024-09-05T03:44:46.323204+0000, chain.objs.size()=1 2024-09-05T02:16:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zW7xfGW9vkgWtCE3pUgYMhx5v6zI8fk_0 2024-09-05T02:16:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5973972348570542944', time=2024-09-05T03:44:48.226387+0000, chain.objs.size()=1 2024-09-05T02:16:22.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.076+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jio6ZOtcM25Y9rrbMK2qGpmvBMT-J0B_0 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7418047421038894457', time=2024-09-05T03:44:48.451134+0000, chain.objs.size()=1 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.svawFmEqcNLRl7lwT1e56ubikw2zxCQ_0 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.248145367442215941', time=2024-09-05T03:44:50.210831+0000, chain.objs.size()=1 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CkYCYr3tY-wM-9LuJuyb8ZUUugXmWg1_0 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13879989474965586095', time=2024-09-05T03:46:35.861753+0000, chain.objs.size()=1 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.E7i1ycqk4h6VNoz0K-Gp8qHtGcm5QMS_0 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13214154341669095725', time=2024-09-05T03:46:39.759442+0000, chain.objs.size()=1 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ThtkW_eLHtOiqWj7-GFzJC9Rp4wumFU_0 2024-09-05T02:16:22.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13447721410875215454', time=2024-09-05T03:46:40.727870+0000, chain.objs.size()=1 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3Iwlky7E3VswvbgcRdX-LDFsC0Rqs1F_0 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14797693230384905069', time=2024-09-05T03:46:40.928730+0000, chain.objs.size()=1 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uJOIzup_bFlUjbbvt05mJCTNwmKVOoK_0 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13430532046295682049', time=2024-09-05T03:46:41.865150+0000, chain.objs.size()=1 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.D8uo51AopelbbOHuqUK1bd3EaB-IFnu_0 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9766831208284563343', time=2024-09-05T03:46:42.363879+0000, chain.objs.size()=1 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GXayW85n0bCSChxG94dM6NvhSXGEERS_0 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11832403526983919625', time=2024-09-05T03:46:43.002609+0000, chain.objs.size()=1 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.way2O7_Q3h9-QwgmCEvXjyisJ-WjcpH_0 2024-09-05T02:16:22.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10416162800598740352', time=2024-09-05T03:46:43.600576+0000, chain.objs.size()=1 2024-09-05T02:16:22.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aNvmg9a2dauecXYbaNICqPmNNEZqvX8_0 2024-09-05T02:16:22.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14512872487278308', time=2024-09-05T03:46:46.171923+0000, chain.objs.size()=1 2024-09-05T02:16:22.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BAhlf_ieoY3HNsyX6fnb-CJeb9YQHIN_0 2024-09-05T02:16:22.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4024384826376949564', time=2024-09-05T03:46:46.173601+0000, chain.objs.size()=1 2024-09-05T02:16:22.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.080+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.p6flpBNacFBTfwT-ztHCdWgm6rrscMn_0 2024-09-05T02:16:22.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48475 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11994942480415308995', time=2024-09-05T03:46:46.769012+0000, chain.objs.size()=1 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZSVBGiIJKPpABGfDmcvqEYvGUrIp8HX_0 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4194502104894903467', time=2024-09-05T03:46:48.553934+0000, chain.objs.size()=1 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yBJIPJKv3Ulyt_5hMtpiAzlIjZ1Gd0S_0 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10004995603510742114', time=2024-09-05T03:46:48.947152+0000, chain.objs.size()=1 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._jBz2ic1ai6OjewGYWnoityySpE_0h0_0 2024-09-05T02:16:22.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15865090931565260203', time=2024-09-05T03:46:51.184669+0000, chain.objs.size()=1 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7fnFfqVLh1BJ89DGvYkekJb6pInUeUy_0 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5034293467976899391', time=2024-09-05T03:46:53.087826+0000, chain.objs.size()=1 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wd7bEpnVyrWIrFh1E13Obb-xzPC24ZX_0 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1626606243645701164', time=2024-09-05T03:46:55.009794+0000, chain.objs.size()=1 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.w3UmEx7gN5CCwrqKut095o3Tvamq9Zl_0 2024-09-05T02:16:22.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4035254311872962731', time=2024-09-05T03:46:56.860648+0000, chain.objs.size()=1 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ng1Xh3QsvJuNz4JnjNuqfDBerB_AzLS_0 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4711734963548205186', time=2024-09-05T03:46:59.233702+0000, chain.objs.size()=1 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.joBp0TVknk_gGcy-QtDU8J9XeMqt-wt_0 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17571936173834199972', time=2024-09-05T03:47:00.616980+0000, chain.objs.size()=1 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.YuNbPg-gHlIf1GxEQw0ORneOsTpVbsK_0 2024-09-05T02:16:22.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8218592227637187389', time=2024-09-05T03:47:01.000606+0000, chain.objs.size()=1 2024-09-05T02:16:22.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4EJoEpOxMZbdLjbiBJTYw5FSsH3nCyG_0 2024-09-05T02:16:22.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8022391853148092687', time=2024-09-05T03:47:02.163724+0000, chain.objs.size()=1 2024-09-05T02:16:22.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZfHlSwDntzLMCcNyD15AlgOkVbbiOH2_0 2024-09-05T02:16:22.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11568166433983793481', time=2024-09-05T03:47:02.738479+0000, chain.objs.size()=1 2024-09-05T02:16:22.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.084+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cSGvDuHehnj0JU3QI3VEzCC7tYs60il_0 2024-09-05T02:16:22.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8859323658314183463', time=2024-09-05T03:47:03.174410+0000, chain.objs.size()=1 2024-09-05T02:16:22.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jDb1-_8ukhE4U0p-TqcZ_boEP29vLiY_0 2024-09-05T02:16:22.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18336838765086835414', time=2024-09-05T03:47:03.461895+0000, chain.objs.size()=1 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZdAfEE5DqEFzm6BfjBTOesMc9muIUM4_0 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2287759426519264767', time=2024-09-05T03:47:04.564434+0000, chain.objs.size()=1 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZxEI5HqVKL47N36-yUzNDs7ghljarii_0 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12619946919158849645', time=2024-09-05T03:47:23.010804+0000, chain.objs.size()=1 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.336__shadow_.OahInCyc-z4Ar9uOfRQINh0ZIXOIPyZ_0 2024-09-05T02:16:22.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4307076851071138750', time=2024-09-05T03:56:47.464263+0000, chain.objs.size()=1 2024-09-05T02:16:22.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.556__shadow_.G8w-GUiWbGPXESqWBoaD7qmEmLJIlGB_0 2024-09-05T02:16:22.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2836746614157849813', time=2024-09-05T03:58:08.268503+0000, chain.objs.size()=1 2024-09-05T02:16:22.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.575__shadow_.BtvJzdbSgtYjvBYDcnqVYgU0RljdVXy_0 2024-09-05T02:16:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1411136478588171869', time=2024-09-05T03:59:30.573306+0000, chain.objs.size()=1 2024-09-05T02:16:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:D8pYjN2GLiUO1hdJkbUFT6CEAb4Ix77_.EMmWIVAluYaqzyGPVaEA3kMGpVM7f4Y_0 2024-09-05T02:16:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1900832926781165561', time=2024-09-05T03:59:45.078694+0000, chain.objs.size()=1 2024-09-05T02:16:22.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:kNiv0F.nbSmItl4ztEljk054t3UELpe_.UMLo05fN1jy3Pj1bJ8tM76APCIWXndx_0 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1529648762867258464', time=2024-09-05T04:06:17.582237+0000, chain.objs.size()=1 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.664__shadow_.RtEC6epQKR1dhTz-PmyaBOry4q_KVqX_0 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3597250248302270729', time=2024-09-05T04:07:33.732980+0000, chain.objs.size()=1 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.712__shadow:1dYhWgAlowZ7bzT5.0F-EMrzz0V52.5_.AYz3swDdw_3GQB96TtgVldUrO7qBCdZ_0 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8380102513319019364', time=2024-09-05T04:08:55.829947+0000, chain.objs.size()=3 2024-09-05T02:16:22.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.088+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.743__multipart_mymultipart3.2~_Lvx0oWbq96bsG12jUskj7YGTg3WCbx.1 2024-09-05T02:16:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.743__multipart_mymultipart3.2~_Lvx0oWbq96bsG12jUskj7YGTg3WCbx.2 2024-09-05T02:16:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.743__multipart_mymultipart3.2~_Lvx0oWbq96bsG12jUskj7YGTg3WCbx.3 2024-09-05T02:16:22.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.092+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.096+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-05T02:16:22.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.096+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.096+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43005' 2024-09-05T02:16:22.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='__LN6MR5FhU02RyLwG6rJ_McKfxW72mD', time=2024-09-05T03:33:11.532785+0000, chain.objs.size()=1 2024-09-05T02:16:22.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.163__shadow_.I2KVb-1zrnDYbxgO1kmkzmpyIeG8uWg_0 2024-09-05T02:16:22.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13312110210440691714', time=2024-09-05T03:34:33.213034+0000, chain.objs.size()=1 2024-09-05T02:16:22.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.203__shadow_.2gFLY7Vf59blsAsvOz6SCDiEgZ50pG__0 2024-09-05T02:16:22.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4718726346695924865', time=2024-09-05T03:37:33.565945+0000, chain.objs.size()=1 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.236__shadow_.40VemxML3Jf-_gwyT152D41iwAVzvq6_0 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3198668256427322214', time=2024-09-05T03:37:58.616112+0000, chain.objs.size()=1 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.248__shadow_.sl79gs5mFJY86717k2WJ7BVZVIJm0f9_0 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12350230203872499897', time=2024-09-05T03:38:11.670051+0000, chain.objs.size()=1 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.255__shadow_.2tPu5qRJo87pkTv6Al1yL5D9BRzOf8C_0 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7351743237173429755', time=2024-09-05T03:40:04.278358+0000, chain.objs.size()=1 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dxxUU5AKil7XfolmIcFXMlSe2kpoVgJ_0 2024-09-05T02:16:22.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.688835720002212820', time=2024-09-05T03:40:04.522608+0000, chain.objs.size()=1 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LaVj36P8sBqk219LEbnojEiUCXU-5hh_0 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8843560257658031071', time=2024-09-05T03:40:06.691749+0000, chain.objs.size()=1 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qGh3Tns5yByWThnS9DPvn1WQARN2u5x_0 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4426303832091035975', time=2024-09-05T03:40:06.722064+0000, chain.objs.size()=1 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mjArjbE37zVI9LQC4tVMJTWlXj46Xm5_0 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11973139698594839025', time=2024-09-05T03:40:07.263449+0000, chain.objs.size()=1 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zBzUHSHQsYkA1E0VvVHLtArEbik3Wof_0 2024-09-05T02:16:22.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15215770821936005385', time=2024-09-05T03:40:07.271447+0000, chain.objs.size()=1 2024-09-05T02:16:22.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.j4lHqTHMbg9qdDnCUYu5gTEvNAULE6d_0 2024-09-05T02:16:22.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.892325576471925843', time=2024-09-05T03:40:07.274910+0000, chain.objs.size()=1 2024-09-05T02:16:22.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.100+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.V9pZ5tyjvQ1diy92UiOh7vZ6j3-kk9H_0 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14884192229336549719', time=2024-09-05T03:40:07.684154+0000, chain.objs.size()=1 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Noir5dJr-RTbaFxSEMBPx4BjzmcUWr-_0 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6504937967958996701', time=2024-09-05T03:40:09.849248+0000, chain.objs.size()=1 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.foeZ60Rxr13XbtyUQ-5F3xuTe4NWKZF_0 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4391089431048156492', time=2024-09-05T03:40:10.100927+0000, chain.objs.size()=1 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QGDJBXrZ-e7O9nim7Phkbv5jcn_CZI2_0 2024-09-05T02:16:22.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14303074427683273073', time=2024-09-05T03:40:10.407289+0000, chain.objs.size()=1 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YDAIjEtoIeo8cEBe_dn0_RwSAKstM4i_0 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7325981396532589103', time=2024-09-05T03:40:11.680802+0000, chain.objs.size()=1 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.M0qquTJDofdc96ohTf_zBeaqG0-Nt1q_0 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8299935629908476146', time=2024-09-05T03:40:12.156155+0000, chain.objs.size()=1 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.K1dPshpAsuRXGT2IS8BiCnItT9sRb7L_0 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7854785365587423595', time=2024-09-05T03:40:13.120579+0000, chain.objs.size()=1 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B1CulM2saDhwC0rLlxEgQWaAGXamkAK_0 2024-09-05T02:16:22.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7611402488425123732', time=2024-09-05T03:40:13.207394+0000, chain.objs.size()=1 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AEg4vTJ92lyaLQEt_-9JKD6IJpyIcau_0 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8500399473554688345', time=2024-09-05T03:40:13.730265+0000, chain.objs.size()=1 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XfnJjW9Ue-JbOnnUAl_-qpK8Qorc6qb_0 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1911172473590358306', time=2024-09-05T03:40:14.122440+0000, chain.objs.size()=1 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.63foigAwLaGbA7XluYi1X68s2oNAv8J_0 2024-09-05T02:16:22.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7653626906477153575', time=2024-09-05T03:40:15.031162+0000, chain.objs.size()=1 2024-09-05T02:16:22.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.104+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ueCyvqTMZqWHLrf9tqVzqZu2Pg7DZIW_0 2024-09-05T02:16:22.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.108+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1925182803054095113', time=2024-09-05T03:40:16.424022+0000, chain.objs.size()=1 2024-09-05T02:16:22.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.108+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KjTJylKqQh3o80OMUy_UgQaKzopwyhC_0 2024-09-05T02:16:22.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.108+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2735070636793787999', time=2024-09-05T03:40:17.616401+0000, chain.objs.size()=1 2024-09-05T02:16:22.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.108+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SQJv8WartMnKJKQxrUYwHd9pDuNlBCe_0 2024-09-05T02:16:22.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4051423942304823221', time=2024-09-05T03:40:18.941829+0000, chain.objs.size()=1 2024-09-05T02:16:22.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.avzm0ceCYTEIIPesup_IuPA7VeAtICf_0 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.608735617413256543', time=2024-09-05T03:40:19.568441+0000, chain.objs.size()=1 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.b4tXUrdjIF7BqPg3rAWptoPPBGapaYC_0 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18095588669409565137', time=2024-09-05T03:40:22.301229+0000, chain.objs.size()=1 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UnXmDEmptHq-7A1lYRavaeMezPMDiV__0 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5381476269171410206', time=2024-09-05T03:40:22.934865+0000, chain.objs.size()=1 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VBTlVNNrMuL1pWwa0zNVxdZ_BqCBIik_0 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1610567932866541624', time=2024-09-05T03:40:23.320272+0000, chain.objs.size()=1 2024-09-05T02:16:22.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.idFNEkMUu6u3YhjmQpnUXoSSAecjdRF_0 2024-09-05T02:16:22.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6930351824788100749', time=2024-09-05T03:40:23.809384+0000, chain.objs.size()=1 2024-09-05T02:16:22.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vXG_Iko4fGQkYtAa0EcnNS-V5IVOZGh_0 2024-09-05T02:16:22.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7712432263575323351', time=2024-09-05T03:40:26.939489+0000, chain.objs.size()=1 2024-09-05T02:16:22.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gGCnM7H8bHwmMjjqhZtfi6-CAdOsJbN_0 2024-09-05T02:16:22.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17480196799179315895', time=2024-09-05T03:40:27.319474+0000, chain.objs.size()=1 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nW1eylC8r8VbbKXX-zouFxZfFv7_cxz_0 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16448167343826809517', time=2024-09-05T03:40:27.828733+0000, chain.objs.size()=1 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yShrCOnhcQv2Jh0Sf3Y2xkKGiPXQ6Jr_0 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.636900135248592980', time=2024-09-05T03:40:28.787577+0000, chain.objs.size()=1 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vFyYcfWSk9gFpf_luUJKaAwxX2nDe8F_0 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.554890494600635', time=2024-09-05T03:40:29.172092+0000, chain.objs.size()=1 2024-09-05T02:16:22.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.112+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yWsWtqWApeRRgtRC10DCB6D8sMyp0nf_0 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17657251455503580627', time=2024-09-05T03:40:31.299978+0000, chain.objs.size()=1 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zVYqE8oWePCUOv46w9QtP-kwKj7MpjG_0 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16271441274399374668', time=2024-09-05T03:40:32.380564+0000, chain.objs.size()=1 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PxHFArFq5Hp1e8R1m8dQ4tQymD_l8wU_0 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12875391060816127232', time=2024-09-05T03:40:32.949587+0000, chain.objs.size()=1 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.utGe16vOxFsVkxQDeh1yH5MUlFjXiWH_0 2024-09-05T02:16:22.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9140728767591822933', time=2024-09-05T03:40:33.001668+0000, chain.objs.size()=1 2024-09-05T02:16:22.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Mc3xRbJj-fGbtqEfQfQyak8pyVqOIcR_0 2024-09-05T02:16:22.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8021579155224109402', time=2024-09-05T03:40:33.140740+0000, chain.objs.size()=1 2024-09-05T02:16:22.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.116+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3ioqJUbcFt1TRumjkBKPx6jrN8cnmje_0 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16918541076867620173', time=2024-09-05T03:40:35.826635+0000, chain.objs.size()=1 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.juefhEIFNQQ-6mkCKiy5N36MuH0oc6y_0 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1848039288893995076', time=2024-09-05T03:40:36.470125+0000, chain.objs.size()=1 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.E35mMNYHPORSGu4EzfZw3Lx3jJ2zMde_0 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18076312520657204953', time=2024-09-05T03:40:38.286753+0000, chain.objs.size()=1 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.263__shadow_.EW9EcVNSxvR1ZKsudzXi_lSe5BsJx-K_0 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4224179721484501392', time=2024-09-05T03:40:38.288730+0000, chain.objs.size()=1 2024-09-05T02:16:22.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.263__shadow_.ImvrH6BsSlPFQGD6NSyDIcmblaLGhzM_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3308624149423477726', time=2024-09-05T03:40:47.126949+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.268__shadow_.nadsbDweci83VfJGwyGDRHR2dJ9Iy6F_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5502025955850390039', time=2024-09-05T03:40:54.019521+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.272__shadow_.DucDkol0kb5fA0m41QNxCE6MleXPL0m_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10913349532802210130', time=2024-09-05T03:41:18.183253+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.285__shadow_.OWvfqTx0uiu3fDpFC2SMGUIE-ehaEMI_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13233564387074683653', time=2024-09-05T03:41:27.721230+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.290__shadow_.LqaPrK2UAsXsDQO0vV9wgIpJWxNwxxU_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10948384355562192041', time=2024-09-05T03:41:34.638875+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.AVJS5M8Pm6MklOwaZbR_0y4b7sarOSs_0 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15778483331368190084', time=2024-09-05T03:41:34.767035+0000, chain.objs.size()=1 2024-09-05T02:16:22.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.120+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.1raf_DD5iKUMIymN3qYg1TbO7HYRZ_c_0 2024-09-05T02:16:22.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4537191948591387846', time=2024-09-05T03:44:20.379465+0000, chain.objs.size()=1 2024-09-05T02:16:22.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.X6ajVMDcsvM-Kla4ImU-oMDJvJMZjoR_0 2024-09-05T02:16:22.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18376535169227947386', time=2024-09-05T03:44:21.142127+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HbKoV-p06kUtu4h9Ar1qWsNGd1iSVfV_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.786241476467732905', time=2024-09-05T03:44:22.010765+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WJbWpo_RoCNsFSFXEZ2GN7m_mcbFzNm_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1907483108614377629', time=2024-09-05T03:44:23.897778+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FP3fXtpop1VDrlym-_5dEMaYJJSQc9J_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11975109347355440113', time=2024-09-05T03:44:24.439790+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Zp4oCjdSepQHHyCqDWcyFgCBVQEbrId_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.781771334014519141', time=2024-09-05T03:44:24.947849+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yUv5MzDuNPI94vZFqCIUr_uFD323rjI_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9861476436670101535', time=2024-09-05T03:44:28.246169+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dLvgrMx994Mjhd0W7xdhO4kGJAWH75Y_0 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18313104143398723068', time=2024-09-05T03:44:28.625805+0000, chain.objs.size()=1 2024-09-05T02:16:22.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OsvrBnRa-wI4R1BojY-vSGUl9Y3za7k_0 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14729846022346349518', time=2024-09-05T03:44:29.598213+0000, chain.objs.size()=1 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jJy69eBd_q-9XCkRnBcO8xrY4VyMSMM_0 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14193024723277328709', time=2024-09-05T03:44:29.997753+0000, chain.objs.size()=1 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.o9hXPWnGWq-3-M3Ct9vgz--mH_HYn-j_0 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10484622061298920880', time=2024-09-05T03:44:31.779767+0000, chain.objs.size()=1 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.124+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9K1aeQjNPwd8eus0DJ9VlIOb02Qziyy_0 2024-09-05T02:16:22.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.128+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4919572438980286511', time=2024-09-05T03:44:34.795959+0000, chain.objs.size()=1 2024-09-05T02:16:22.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.128+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uPZX9kx5dID4SHNlOOapwB-xhiQg2IG_0 2024-09-05T02:16:22.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7787792214184092462', time=2024-09-05T03:44:34.915339+0000, chain.objs.size()=1 2024-09-05T02:16:22.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JVf6yyBNtLLZoOUOq58m9DIG4XqTFy1_0 2024-09-05T02:16:22.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10435464740831524260', time=2024-09-05T03:44:36.694716+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.K47jjTdCsj6_FKdMzvmTTUVE9kFBFGi_0 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2349875885716089735', time=2024-09-05T03:44:36.699219+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ogZGji_xChRMiWY44_bk8ewgKsh9Rja_0 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11762837773117748176', time=2024-09-05T03:44:38.043414+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VVEzmh9C71mePl5nmpuiyOLEtgmJSs6_0 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5367361687150682061', time=2024-09-05T03:44:38.246626+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6ugQasFWEmKAUwgiGwiTn54bVmZ0YKy_0 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11181118542487570738', time=2024-09-05T03:44:40.047061+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VW8xDoMyakOcFDAKd8HvSRahhrjYyZY_0 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13532903392896460687', time=2024-09-05T03:44:41.567421+0000, chain.objs.size()=1 2024-09-05T02:16:22.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iVgpJq9-bIe4mUUNN6ooKVpRHRK1Kzr_0 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5537940723363557283', time=2024-09-05T03:44:42.297025+0000, chain.objs.size()=1 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.56W_hTIWsUrqCX3IpbCXd82yA1vy9e-_0 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7233232067447095073', time=2024-09-05T03:44:42.900061+0000, chain.objs.size()=1 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5a-n1aollF4525lRo72FnaGbuYzKMWc_0 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3616035942311139349', time=2024-09-05T03:44:44.279606+0000, chain.objs.size()=1 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.k1bBBb9C6d-aKmIV8TorXHZJJW2UvOE_0 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10593399425373890039', time=2024-09-05T03:44:44.804997+0000, chain.objs.size()=1 2024-09-05T02:16:22.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.132+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Lrk7OfjA10DarvaDnhrs9wfQY7QePEz_0 2024-09-05T02:16:22.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3026289120909611160', time=2024-09-05T03:44:46.611362+0000, chain.objs.size()=1 2024-09-05T02:16:22.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.diP1f_eP36-uOjNaBZCsj5iE9QVkY3__0 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10655156100934821199', time=2024-09-05T03:44:46.861763+0000, chain.objs.size()=1 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BWQCtNiMIJglenQTQT2Q6r98NJYHsav_0 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14302505383013203521', time=2024-09-05T03:44:47.014274+0000, chain.objs.size()=1 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZqISmWOF8FjWxv64Bkf2L9qSeafwjad_0 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10064904687794302541', time=2024-09-05T03:44:48.820719+0000, chain.objs.size()=1 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.3YEWHu-uCEcG_7iRs1ml7niHzArCE4R_0 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12121419375719961210', time=2024-09-05T03:44:49.462416+0000, chain.objs.size()=1 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FyWjS_xvgzK3DpdyAQk_jaJYQACb4o-_0 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5455948632072881757', time=2024-09-05T03:44:50.268465+0000, chain.objs.size()=1 2024-09-05T02:16:22.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YdnUzyTTr0rvMcHEfGf2jUmsigVB-9m_0 2024-09-05T02:16:22.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3364515369881746166', time=2024-09-05T03:46:34.494742+0000, chain.objs.size()=1 2024-09-05T02:16:22.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.136+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.h1r4tpNM6g7MzOVJePXZbihIjhZVZsl_0 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17729004043441183672', time=2024-09-05T03:46:35.641898+0000, chain.objs.size()=1 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qzDWQKh19_YNiD51MKs8RGTdUhGQSTf_0 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10298513901696829201', time=2024-09-05T03:46:35.753666+0000, chain.objs.size()=1 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7cxarO3BL-NHao-ggwh_Lycrja2iJ-s_0 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15558311100815940126', time=2024-09-05T03:46:36.166127+0000, chain.objs.size()=1 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yyrGMOEP7pCNMN6Yfb19OCUpEa70b5y_0 2024-09-05T02:16:22.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2496150929150747815', time=2024-09-05T03:46:38.775206+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QFoKw4Wju_CHMdW8vEvsvmf-rfPLk9I_0 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2626292443783643982', time=2024-09-05T03:46:42.980001+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sz0B4sfeCX9MhjPXFD3r71VJ35oAY6N_0 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12912208055547163331', time=2024-09-05T03:46:44.241264+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XOCUWnTsVse2sXzcwTL3ytWem8bc3Zh_0 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11562401922139957638', time=2024-09-05T03:46:44.529488+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.t7UyOQqt9G76vUHHAwt5p3R-2kyCghg_0 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11001969609361398710', time=2024-09-05T03:46:45.030332+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1U6nDWQmHOXpCP-Pb1q7JpbuZ3TDwl-_0 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3187148239356550410', time=2024-09-05T03:46:46.160090+0000, chain.objs.size()=1 2024-09-05T02:16:22.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o1JHcGmuRsem4IhCPGXoJTMVxzY-VKO_0 2024-09-05T02:16:22.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7463879388594629777', time=2024-09-05T03:46:47.087221+0000, chain.objs.size()=1 2024-09-05T02:16:22.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iYfGi9QkAhaqFlEaXln-rb0iWzWoFRL_0 2024-09-05T02:16:22.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12842401145970121794', time=2024-09-05T03:46:47.148207+0000, chain.objs.size()=1 2024-09-05T02:16:22.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.140+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3cnnVlnUO7phgi7ml3Tt2-pB0HNz4lR_0 2024-09-05T02:16:22.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8347519135341303609', time=2024-09-05T03:46:47.957384+0000, chain.objs.size()=1 2024-09-05T02:16:22.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.e80NU2XyFYFNvquvi9v_7ObnXncU-6X_0 2024-09-05T02:16:22.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2850230513950506400', time=2024-09-05T03:46:50.183817+0000, chain.objs.size()=1 2024-09-05T02:16:22.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3gPcp8qplthoR7kFVOodnsrfOj19CD2_0 2024-09-05T02:16:22.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6835200220090712451', time=2024-09-05T03:46:50.748027+0000, chain.objs.size()=1 2024-09-05T02:16:22.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.144+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V91jMUkB9rLYKWdZTuP7t6ufxrmE54g_0 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16673299205200560953', time=2024-09-05T03:46:51.322609+0000, chain.objs.size()=1 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vRGwjiefmFDgM4APsSCfrLUSG-xf26P_0 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16592179147271401908', time=2024-09-05T03:46:52.565346+0000, chain.objs.size()=1 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nmmg2BjxAAAPIMbOeEHpQs3hGAEW-Ap_0 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12580769271669699324', time=2024-09-05T03:46:53.141825+0000, chain.objs.size()=1 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9PABAfkaTx_Pe9rNlFEVGPHypohGdZq_0 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18419885974890147936', time=2024-09-05T03:46:54.204954+0000, chain.objs.size()=1 2024-09-05T02:16:22.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZYe_t11l6twnBP6HALnlgGJqQLCkhOG_0 2024-09-05T02:16:22.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2360755582576756917', time=2024-09-05T03:46:54.854620+0000, chain.objs.size()=1 2024-09-05T02:16:22.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.148+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xCUFhNiKNqPBwzkCJqjDQ69bK1d-JaK_0 2024-09-05T02:16:22.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.156+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43005 2024-09-05T02:16:22.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-05T02:16:22.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12910179492259134641', time=2024-09-05T03:46:55.014626+0000, chain.objs.size()=1 2024-09-05T02:16:22.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JYfTi4YX9a5OMTlBwNGlw4twGwTeVNx_0 2024-09-05T02:16:22.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12981983633092612404', time=2024-09-05T03:46:55.072746+0000, chain.objs.size()=1 2024-09-05T02:16:22.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FeHPd5Dw8JXhVVRPZtZPUpsP1nNtu9f_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9426103084777007576', time=2024-09-05T03:46:56.965751+0000, chain.objs.size()=1 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fF2I8Q8oZh9FRTjELWTYLNGNYzTntJv_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17188366563051914371', time=2024-09-05T03:46:58.019606+0000, chain.objs.size()=1 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lh9QEI0JiXgLau6GPQ6wyGhtusw0juf_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16851725240281709150', time=2024-09-05T03:46:58.893221+0000, chain.objs.size()=1 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Z4r2jmreUzpXGVcrGsLxcLQC3XklAdQ_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13661103290092185581', time=2024-09-05T03:46:59.726084+0000, chain.objs.size()=1 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.m-a47gSLUNeO8yb3suh5tjtLNY1MXi8_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17555711019778127167', time=2024-09-05T03:47:03.545694+0000, chain.objs.size()=1 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6hbjSI9jEktu1QYRSUR_MfXdxmu5KWd_0 2024-09-05T02:16:22.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5490991993294681602', time=2024-09-05T03:47:03.662429+0000, chain.objs.size()=1 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SD6ry_5ZD9fE6RBA0qsR8oWc-BWPr_a_0 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5559414138744532931', time=2024-09-05T03:47:04.155277+0000, chain.objs.size()=1 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.afEnJy8Ls5qkBPyVVSDagLIyGaz0NWi_0 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11675443056022107714', time=2024-09-05T03:47:04.281922+0000, chain.objs.size()=1 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LHIblZP2vpiSl8zTsphuZ4BvhJdzp4V_0 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15802526368481377284', time=2024-09-05T03:47:04.424298+0000, chain.objs.size()=1 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qaVUwiVa8MmPFXxBJMNEPKz5kEJvq37_0 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3548285784113072580', time=2024-09-05T03:47:04.500921+0000, chain.objs.size()=1 2024-09-05T02:16:22.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.160+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.a77zVfGz3IUNt0oD2GJJeCdCEvT3BAz_0 2024-09-05T02:16:22.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17047714775323811959', time=2024-09-05T03:47:18.311706+0000, chain.objs.size()=1 2024-09-05T02:16:22.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.333__shadow_.2DjiwQt-7M6LKu7yNjHRAc6bYnEWYSp_0 2024-09-05T02:16:22.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4990416537588682947', time=2024-09-05T03:49:06.286259+0000, chain.objs.size()=1 2024-09-05T02:16:22.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.407__shadow_.eqwSmVp6xs79G_I275iSKQWl8cL4Uk-_0 2024-09-05T02:16:22.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6054475390964530129', time=2024-09-05T03:51:46.986959+0000, chain.objs.size()=1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6536693310564510651', time=2024-09-05T03:54:29.967092+0000, chain.objs.size()=1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~xCBol-nCGKvoVpymTKnMSvJOm5FDfX6.1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7647354246633593901', time=2024-09-05T03:56:51.372859+0000, chain.objs.size()=1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.557__shadow_.YN72gDgqhVxVWz6Xr_DKgD6c4jlbdhD_0 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1615188260763952749', time=2024-09-05T03:57:32.701405+0000, chain.objs.size()=1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:Gub1keS.1q.0sw3Jo9f2bAaHhXbLRhu_.zGQE5M6c8CMg4rU2yhD78rWrJ0JCylw_0 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7173742898959629713', time=2024-09-05T03:57:58.507740+0000, chain.objs.size()=1 2024-09-05T02:16:22.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow_.YOvpuWmyjRMua8oMQY4bGhX7nUYVF2z_0 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5880053400543258864', time=2024-09-05T03:58:04.638939+0000, chain.objs.size()=1 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:p14Km7Bjx-Tr.PAXLNRfE.Jbpeko7Fb_.foAHH9qKuiKCyy2KMXyfNslyl7hQ0vC_0 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10580326539987967640', time=2024-09-05T03:58:12.952480+0000, chain.objs.size()=1 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:XnrIrUdunqGjLoTUiaBGmwa3vKn9Yw._.H7YY8mhNqZeh2wQpaSB9IJC-jUdQSWG_0 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9515400916774231086', time=2024-09-05T03:59:30.554530+0000, chain.objs.size()=1 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:D8pYjN2GLiUO1hdJkbUFT6CEAb4Ix77_.EMmWIVAluYaqzyGPVaEA3kMGpVM7f4Y_0 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.667283905822182695', time=2024-09-05T04:04:50.733212+0000, chain.objs.size()=1 2024-09-05T02:16:22.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.164+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.628__shadow_.uHqcfMklRZrQ-annctzPrMoZkXhA-Li_0 2024-09-05T02:16:22.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9377929880014770413', time=2024-09-05T04:05:08.361294+0000, chain.objs.size()=1 2024-09-05T02:16:22.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.639__shadow_.qVuFu7gzI-5z6kAwNaqyKst3iSQaZ3y_0 2024-09-05T02:16:22.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15478370175255561115', time=2024-09-05T04:05:27.177861+0000, chain.objs.size()=1 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.647__shadow_.dz10JA3f0aYuabhDY_RnOOcYHOU83WK_0 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11842254100824933376', time=2024-09-05T04:06:15.126217+0000, chain.objs.size()=1 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.663__shadow_.1C7PRNQTts85iWjBuJSQKvtZ-Lhbhn4_0 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16515725461796849955', time=2024-09-05T04:08:04.639440+0000, chain.objs.size()=1 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.719__shadow_.uP0eiZXXE0L5vFiqeu2gCrniC1iTwnn_0 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4388263743509412867', time=2024-09-05T04:08:46.284091+0000, chain.objs.size()=1 2024-09-05T02:16:22.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.740__shadow_.Bs6USVXkmCwYnZfgcOr4hqyRcU5u4fy_0 2024-09-05T02:16:22.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.168+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.172+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-05T02:16:22.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.172+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45383' 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4253629090988452212', time=2024-09-05T03:32:26.212001+0000, chain.objs.size()=1 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.151__shadow_.rkdIGy7vbawuRdbq8DU6XHOhgZM12s1_0 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1797124346680722964', time=2024-09-05T03:37:41.990683+0000, chain.objs.size()=1 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.240__shadow_.bdv-0WeVWcPFiBH9kRa73aS2k9_ozHb_0 2024-09-05T02:16:22.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7433609315285023694', time=2024-09-05T03:37:48.374488+0000, chain.objs.size()=1 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.243__shadow_.FN9_4WyTuqXZO-oLFgxi4-wBWbHYvH5_0 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15035553984079516005', time=2024-09-05T03:38:20.780367+0000, chain.objs.size()=1 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.260__shadow_.LAKkWoirJiMuj4LmKyLnmef4gPMwkp6_0 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4472835670044437607', time=2024-09-05T03:40:06.057961+0000, chain.objs.size()=1 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MFYcdyl0KAEtrzeWdNNq07pfoJTAn94_0 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13671582744408390823', time=2024-09-05T03:40:07.425147+0000, chain.objs.size()=1 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gLHMFm2H4_aBgBWhBoEkHpgQEaRxAKE_0 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17854146454046751768', time=2024-09-05T03:40:07.718804+0000, chain.objs.size()=1 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2LncWSIqAqOU3DqQD02ey0Fv4L5v56u_0 2024-09-05T02:16:22.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.228553926968330397', time=2024-09-05T03:40:09.742790+0000, chain.objs.size()=1 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Q-pVvn-2xnSxW0CBPTerZsHgGqR37Bb_0 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8973266325771556075', time=2024-09-05T03:40:09.747133+0000, chain.objs.size()=1 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hFzqxroddFMgml9_kI2a0yoG8idH38Z_0 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8785477558084851196', time=2024-09-05T03:40:11.574921+0000, chain.objs.size()=1 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.WKGt9u3cYykJ9SZS5EWKZyFAtoCW4P3_0 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6256357252782430435', time=2024-09-05T03:40:14.787705+0000, chain.objs.size()=1 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Su00zGd5Zj0VOCndEzBbXNCFn4YWX82_0 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16563823151853157826', time=2024-09-05T03:40:14.849701+0000, chain.objs.size()=1 2024-09-05T02:16:22.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B0pA7cu5klgI5ZzgnT70wrdfGlJvI1O_0 2024-09-05T02:16:22.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11220544344391584280', time=2024-09-05T03:40:15.703533+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1ly18S-Q0oh3jKUJbSNb03R8dLLaJAd_0 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9140478880144094141', time=2024-09-05T03:40:16.246770+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mH5Pq9ftE-bHjsfGnMJLEh_x-krmmhN_0 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14213876250444587834', time=2024-09-05T03:40:16.249198+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.176+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tqW2w726ictjsz-Fnfb-Lr3zLKd4Ma1_0 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13996156937859914790', time=2024-09-05T03:40:16.369805+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.80GbIEKWWWoCgLHdIaz28gT8YMX-lkS_0 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16751534203645969088', time=2024-09-05T03:40:17.737102+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.heq5IoZMPyHE9KO2SCsZLBZ3GE-Tv99_0 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10499175046947160775', time=2024-09-05T03:40:17.960902+0000, chain.objs.size()=1 2024-09-05T02:16:22.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6irV_unEr0-9LIc1MhkmKsxSLDoMIVN_0 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9735060992090911915', time=2024-09-05T03:40:18.148641+0000, chain.objs.size()=1 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UPUOUzmJAeKnWUO2UzTE_BoM1YbQsyZ_0 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3894904988846163104', time=2024-09-05T03:40:19.837524+0000, chain.objs.size()=1 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lqWYVmaQwoomct5v7MJFvwki4oDalaj_0 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18132038183863067070', time=2024-09-05T03:40:20.159495+0000, chain.objs.size()=1 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LsDcK1Cqc-C8ZoClqTyYDP_cTZhJarn_0 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4982909470862149860', time=2024-09-05T03:40:20.512156+0000, chain.objs.size()=1 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.s1Xh8dAOvSLfbj4auUZAejpWqIChZ3v_0 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13829338359625483197', time=2024-09-05T03:40:22.118929+0000, chain.objs.size()=1 2024-09-05T02:16:22.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4HU79zaTc_fsoaCSBZwI4WJdbCnFK5I_0 2024-09-05T02:16:22.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.708884642497617760', time=2024-09-05T03:40:24.603770+0000, chain.objs.size()=1 2024-09-05T02:16:22.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ObOn_mYZlcpKxOpwx6Geh5XQcn4IQvD_0 2024-09-05T02:16:22.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7412568303415277308', time=2024-09-05T03:40:24.855201+0000, chain.objs.size()=1 2024-09-05T02:16:22.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-P0Tzt7o_Clfo-eEBg62OxpIlfdr-so_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2136074513760613782', time=2024-09-05T03:40:26.804008+0000, chain.objs.size()=1 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YiCfhSGjJWYN1LplSronf8c8_X2iZru_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15635677553440584258', time=2024-09-05T03:40:29.160396+0000, chain.objs.size()=1 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yhZgmHRJ-n6fhD7oPc9cU09nIb2GyoO_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15530133822532911963', time=2024-09-05T03:40:30.008860+0000, chain.objs.size()=1 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Nc8VGpwb8hTgEnSi5h4TuicHgNnN4E6_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4579483740175129658', time=2024-09-05T03:40:30.328897+0000, chain.objs.size()=1 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1rlpUqSH9ewSkzRA-phCM1DjP45IOz2_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8068299298902249598', time=2024-09-05T03:40:30.714203+0000, chain.objs.size()=1 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UUgBdf-6Tv3_ijn1pfI9TakOda0mfTm_0 2024-09-05T02:16:22.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7693838446584446634', time=2024-09-05T03:40:30.913322+0000, chain.objs.size()=1 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.180+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UVpkN-Q5ed5Qf7fo-5tFwKwi94XQoVn_0 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12880894421572358298', time=2024-09-05T03:40:34.749782+0000, chain.objs.size()=1 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7yPMJh48iDZsTGp5NecCxmeogSzfi7a_0 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5370650916957206642', time=2024-09-05T03:40:35.787137+0000, chain.objs.size()=1 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zuKGlnW0n_huouhA6FXbeTm5ALGMaB6_0 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7444742417199144876', time=2024-09-05T03:40:36.097859+0000, chain.objs.size()=1 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.860W4WwPuZLOqNAvywb9Qsmtsh4RyDL_0 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12891928145755516452', time=2024-09-05T03:41:06.829623+0000, chain.objs.size()=1 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.279__shadow_.DFh0f-1zTTEcVOCcI4nHWMb4wL7bkqF_0 2024-09-05T02:16:22.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15242797868911333182', time=2024-09-05T03:41:14.332982+0000, chain.objs.size()=1 2024-09-05T02:16:22.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.283__shadow_.kh-R7BTJWhJB9IW1vJQdFh5KVj98_ON_0 2024-09-05T02:16:22.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9130031354864624103', time=2024-09-05T03:41:23.890021+0000, chain.objs.size()=1 2024-09-05T02:16:22.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.288__shadow_.f9sYyoJLv7bod0PvUQ91rnu8IQjsR6H_0 2024-09-05T02:16:22.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17502165786797362606', time=2024-09-05T03:41:40.312386+0000, chain.objs.size()=1 2024-09-05T02:16:22.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.P5_vMfyZJrrbZ7BX7V4G5rBeNm6h5N9_0 2024-09-05T02:16:22.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2845027066665056761', time=2024-09-05T03:41:44.011713+0000, chain.objs.size()=1 2024-09-05T02:16:22.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.295__shadow_.SnPpjhezqSXs5BMz4Nv5jJydoeJWT9j_0 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7735741508373671845', time=2024-09-05T03:41:49.769757+0000, chain.objs.size()=1 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.298__shadow_.PX2TzwiArGfCMl_-rKev9QZyZWjIy3E_0 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16990598384382018459', time=2024-09-05T03:42:02.874130+0000, chain.objs.size()=1 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.305__shadow_.YT8EDbDSDTd_QLrBZCx7N9wK9PYvKXP_0 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4506899146136987211', time=2024-09-05T03:44:20.640649+0000, chain.objs.size()=1 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ID6mFtjeQJG1vVK9ZKPQpCtfHNs-Hu4_0 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10184955344760498787', time=2024-09-05T03:44:21.653923+0000, chain.objs.size()=1 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WWfW63mMfb1QXXgwTRwciCcfFUTqyiX_0 2024-09-05T02:16:22.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735154502288171869', time=2024-09-05T03:44:22.092346+0000, chain.objs.size()=1 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HljBLTT5yzKcagH4g4gkQ7zH6Q1wGGf_0 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6033668815276753200', time=2024-09-05T03:44:22.332173+0000, chain.objs.size()=1 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kHd6iAkj4eDx-jRSrnO3Odn81I-f55f_0 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9175196416154646661', time=2024-09-05T03:44:25.810028+0000, chain.objs.size()=1 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rgWmkzqIlTZ86WjH1PBVkicQQd1CXBH_0 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7934322376377566036', time=2024-09-05T03:44:26.362237+0000, chain.objs.size()=1 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.r_Dcaf027SKxP4iQOMg7uXU_J2mqHcl_0 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13582225847558708001', time=2024-09-05T03:44:26.584545+0000, chain.objs.size()=1 2024-09-05T02:16:22.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.184+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vvVT083lwr5sEm1wJWO1X2Vb35XVeNq_0 2024-09-05T02:16:22.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6741364567163498882', time=2024-09-05T03:44:27.789576+0000, chain.objs.size()=1 2024-09-05T02:16:22.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ywrGkOSAqdXdIedH69GpPbAtlcUb3tb_0 2024-09-05T02:16:22.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8805705749623071670', time=2024-09-05T03:44:28.237962+0000, chain.objs.size()=1 2024-09-05T02:16:22.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._CWJDyIae6ryRJutMbHeKGAz7FE3sQ__0 2024-09-05T02:16:22.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11159989405789235044', time=2024-09-05T03:44:29.222936+0000, chain.objs.size()=1 2024-09-05T02:16:22.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wsGqWMrdM-y196cSjKWXxUg-3sc66Q3_0 2024-09-05T02:16:22.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8715496039540960329', time=2024-09-05T03:44:30.305506+0000, chain.objs.size()=1 2024-09-05T02:16:22.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RMsIrOQ_nZP4kAApGANwr2t84zHNic3_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15222826082484699549', time=2024-09-05T03:44:31.707520+0000, chain.objs.size()=1 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UgsKql4CE6h9-odzqFXjZnsgDlinXcF_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10616035224767646386', time=2024-09-05T03:44:31.832511+0000, chain.objs.size()=1 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SKyYA0D699iCA8EpC6RCR6aQTDhnt4E_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14331075082644026992', time=2024-09-05T03:44:32.868373+0000, chain.objs.size()=1 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fKswavnxydGSl5HsKAmHhyA6IVc7V1b_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2504566427223941668', time=2024-09-05T03:44:33.689763+0000, chain.objs.size()=1 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.O7sRhE9ZxEIkhSGLIypfz8s4sPSI-YK_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3577417115242401847', time=2024-09-05T03:44:34.605270+0000, chain.objs.size()=1 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RwumNw1bPczeHVeHeUWtP94QTusMHp9_0 2024-09-05T02:16:22.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.669121418879910693', time=2024-09-05T03:44:38.109878+0000, chain.objs.size()=1 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.p2-w5EGIUuvckbP2YJBqs_KxfyvvEVX_0 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6651956123860442701', time=2024-09-05T03:44:38.541370+0000, chain.objs.size()=1 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Yqn6uxPIYx0ZmsJrNkO5bvQUcp6hG25_0 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9236714386302707801', time=2024-09-05T03:44:40.260178+0000, chain.objs.size()=1 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JxIifoZb-RfJTj6NopolgUhW7vkCaUF_0 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7864216210464864884', time=2024-09-05T03:44:40.337854+0000, chain.objs.size()=1 2024-09-05T02:16:22.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.188+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xTvAzPIYqU5BeittZoJE3ZzDcExVLfi_0 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10536388231889304003', time=2024-09-05T03:44:40.408460+0000, chain.objs.size()=1 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.e80W3Zl79zclYuSRiHsm1VQsLQlUIHC_0 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16752852498339138040', time=2024-09-05T03:44:40.843023+0000, chain.objs.size()=1 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PQgNHSDSHeUDEAPVlp_b8VM1HiAKMdZ_0 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15634980814098561614', time=2024-09-05T03:44:42.193787+0000, chain.objs.size()=1 2024-09-05T02:16:22.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.F0d6_ZNJ2JIaFkPrzvJV0Sf8pezncYT_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1628228843448061122', time=2024-09-05T03:44:42.407942+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OrYjd323D47_JC2K6J9jzMnI7PZ_iBH_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14983864393355286862', time=2024-09-05T03:44:42.920020+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2xQo8PxCbiuxOYmdawVVTvbHjq07Fqr_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14324455358809739823', time=2024-09-05T03:44:43.041350+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6P8Lgr1HOIubfteHRJll_mt6pevFXUy_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2860916244275240910', time=2024-09-05T03:44:43.855322+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NsXE9zE_Yk5K6mXVS29zC4eaqnp71M7_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12971384419118627905', time=2024-09-05T03:44:44.453880+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Y5QE4jntkX1uxBBzEpx4cuqE0TMF0dc_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10413946159221004310', time=2024-09-05T03:44:45.060049+0000, chain.objs.size()=1 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fb2iwU9s81XUAW0_j9yRMNjf3wfh0dk_0 2024-09-05T02:16:22.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4338966421044983818', time=2024-09-05T03:44:45.452325+0000, chain.objs.size()=1 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.l8qihYIXB1-x9CPFcIeNJOp38XXuY4s_0 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13882414202694716478', time=2024-09-05T03:44:47.787277+0000, chain.objs.size()=1 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.192+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bDvbHBo0FaiBStj1aNsiwCqFPU4Faa9_0 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15255721932515862681', time=2024-09-05T03:44:48.116644+0000, chain.objs.size()=1 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5ee_YPHFBRtS6TW6w1RjSGkox4dbHjO_0 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17288378246892304426', time=2024-09-05T03:44:48.671034+0000, chain.objs.size()=1 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GP9hQpB6hpI-e2XzK0dFQBWYpDLUUzQ_0 2024-09-05T02:16:22.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17244980196220137876', time=2024-09-05T03:44:48.673462+0000, chain.objs.size()=1 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mKhUEjbRl9bZvsm3ZAPJ-5JSLG-DghY_0 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14590171594286964619', time=2024-09-05T03:44:49.303623+0000, chain.objs.size()=1 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.glR9H_2y76--b1dPL0jAdqejhTRf95f_0 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10614885380010027560', time=2024-09-05T03:46:33.442471+0000, chain.objs.size()=1 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0kvNOV5S38Pb2bVyB8EVBGO-eCjfAzt_0 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5230051959887748483', time=2024-09-05T03:46:34.154344+0000, chain.objs.size()=1 2024-09-05T02:16:22.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b2jVry3srQTkasBkWORp40CaqLzVRDR_0 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17953119104152897797', time=2024-09-05T03:46:34.630316+0000, chain.objs.size()=1 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dGSH1eNwQKxbITCgXWSlH_iy3JSh8H9_0 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16243414338328076935', time=2024-09-05T03:46:34.810145+0000, chain.objs.size()=1 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Tfri9Oxhq61W9PJxEf1Ogx1TjjzNSW__0 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9767255736911648260', time=2024-09-05T03:46:35.782064+0000, chain.objs.size()=1 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NHX_gWP5nusi5SAe80PeC122CPaL0MK_0 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17471344123701368955', time=2024-09-05T03:46:36.442669+0000, chain.objs.size()=1 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7IKMz7h08Easz3-b-JBHGeXOiB4M3Ho_0 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17196220964354232031', time=2024-09-05T03:46:36.556030+0000, chain.objs.size()=1 2024-09-05T02:16:22.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.196+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b_Hcx7QpI4_AgyKCCNEs0kcw79_6LXo_0 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16028872166763784137', time=2024-09-05T03:46:36.641315+0000, chain.objs.size()=1 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cQQ8NM8uSRHkNjbAo_WvaBLiCbhXGAB_0 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4510379767626401317', time=2024-09-05T03:46:37.796691+0000, chain.objs.size()=1 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dL2fRIN8X9KO8r3FNfbI0k2LHe7trcx_0 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3853829620976601283', time=2024-09-05T03:46:39.417400+0000, chain.objs.size()=1 2024-09-05T02:16:22.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dPQmLqxnT5zxmbFr1mv6mZNKGr3vflc_0 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6507185391608226045', time=2024-09-05T03:46:42.000791+0000, chain.objs.size()=1 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.KM2NSEnVDp3KunY3XVAoxPNMH6ndYLD_0 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2132333494956253902', time=2024-09-05T03:46:42.333579+0000, chain.objs.size()=1 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.e6m87P_YMNkdvqlU47VwW4WxCoUkFNI_0 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1297327566049030715', time=2024-09-05T03:46:42.335786+0000, chain.objs.size()=1 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._jmjr7rZBDibVZ_X7-nqiW4jW9KNjMm_0 2024-09-05T02:16:22.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3710403243335533928', time=2024-09-05T03:46:43.361460+0000, chain.objs.size()=1 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BZwtssNsE3_8lvgtnysU_l44UV0NE26_0 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11551695762643413739', time=2024-09-05T03:46:44.953735+0000, chain.objs.size()=1 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.oGizJUhHEsaASnY9e0EcGgAoQkUU00V_0 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.515361932636025493', time=2024-09-05T03:46:46.191846+0000, chain.objs.size()=1 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wLXVd3BsKLEiUDkNGmxA9mEOuCn9W1N_0 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8293270879432190926', time=2024-09-05T03:46:46.628188+0000, chain.objs.size()=1 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.B06AWKOowXLHEA1SWwK6FzinWwODAqf_0 2024-09-05T02:16:22.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1962528372809163979', time=2024-09-05T03:46:47.820592+0000, chain.objs.size()=1 2024-09-05T02:16:22.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vsCDEIp3lZpIaeA1f-vMUVdY4hgp5x3_0 2024-09-05T02:16:22.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12881657529415880907', time=2024-09-05T03:46:48.713486+0000, chain.objs.size()=1 2024-09-05T02:16:22.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9z618CAinvemZQxwhZI-kNdh5xoRCmf_0 2024-09-05T02:16:22.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11994559989109608359', time=2024-09-05T03:46:49.130251+0000, chain.objs.size()=1 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vwK_fgtbcoFb7ZkUOKtIxmJ0WeWiExC_0 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4184091164433150737', time=2024-09-05T03:46:49.193240+0000, chain.objs.size()=1 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cOnals4ypu5AfG87gnYl-tp7Yg1xhRb_0 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10979170206940631464', time=2024-09-05T03:46:51.139758+0000, chain.objs.size()=1 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nbLu1OofETYTA5ipvdzQDPFB9xWQXmq_0 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.582897808943874210', time=2024-09-05T03:46:51.543314+0000, chain.objs.size()=1 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hmCjhruz2chmbMWq4GZQZ43VipnJlXT_0 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6167280924719465222', time=2024-09-05T03:46:59.006071+0000, chain.objs.size()=1 2024-09-05T02:16:22.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.200+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.l5fAw1xE8hA8UywQFZN0Rf4mXMfJXm-_0 2024-09-05T02:16:22.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45383 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7400267281232207593', time=2024-09-05T03:47:00.401609+0000, chain.objs.size()=1 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.F-2FgJ48vFuysN6lmG7Q_4IAsBcAh5b_0 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.768342204073415866', time=2024-09-05T03:47:00.403637+0000, chain.objs.size()=1 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8c8hdmhq0e7mOGtUVdFHEHPN5eD6OyC_0 2024-09-05T02:16:22.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12031594132643967265', time=2024-09-05T03:47:02.912929+0000, chain.objs.size()=1 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1D90G9BkcrFYOirxYc_dFtkFWHSQJSN_0 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15758250305806433101', time=2024-09-05T03:47:04.562699+0000, chain.objs.size()=1 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.KoyaJj__Qc7WXK770urtRHmW8KGb4SQ_0 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12295191702156656850', time=2024-09-05T03:47:07.378191+0000, chain.objs.size()=1 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.326__shadow_.JOymQN7iViMa8K47lxn3CxDomfohN2K_0 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2520115292584822554', time=2024-09-05T03:48:07.717614+0000, chain.objs.size()=1 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.370__shadow_.h_c8u0pnSmUt4ppBvVRi0mz06ieA9GT_0 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9643349425419393735', time=2024-09-05T03:48:10.685960+0000, chain.objs.size()=1 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.372__shadow_.yNzB7jZ23CZgHAnIRVwQMkVJ4UdSVbs_0 2024-09-05T02:16:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5684208400871644767', time=2024-09-05T03:48:22.530053+0000, chain.objs.size()=1 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.379__shadow_.K7i4dV8Pigyte7tSmFNSfxfAv-H1RIw_0 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13697779037275909705', time=2024-09-05T03:50:42.649670+0000, chain.objs.size()=1 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464__shadow_.6MHkpRdho53g78CK4DZ0UgWxxS7C1Y-_0 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8044375622011757397', time=2024-09-05T03:50:45.845934+0000, chain.objs.size()=1 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.465__shadow_.vCNqWksm0-ffig8Uz90Pv9vjrGnaFU2_0 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2065687276546122631', time=2024-09-05T03:51:04.369707+0000, chain.objs.size()=1 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.481__shadow_.DHqOfzev5A6FEuiftbEu3Scx4V9H_vP_0 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3800349336999537254', time=2024-09-05T03:51:09.695026+0000, chain.objs.size()=1 2024-09-05T02:16:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.208+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.-JVTaW9kyoGTOb2aJ_pMZcWQPjNPQAp_0 2024-09-05T02:16:22.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2549029457730825390', time=2024-09-05T03:51:13.035598+0000, chain.objs.size()=1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.485__shadow_.ebWbpv_gImAgn0wjHZ8H1h-twC3Q9C9_0 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11420948820387756488', time=2024-09-05T03:52:25.462213+0000, chain.objs.size()=1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.518__multipart_mymultipart.2~MiYZgilZFIaIxsoSPXzIhCLC-sEBv_M.1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL', time=2024-09-05T03:53:17.302626+0000, chain.objs.size()=1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~IKqoKAo_ZWAjIc6PDDpStTmnI95M2oL.1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17433427409020787503', time=2024-09-05T03:54:51.349336+0000, chain.objs.size()=2 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~dQEi08nypjbx_CYIw9C6d2pmi_YrAR_.1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~dQEi08nypjbx_CYIw9C6d2pmi_YrAR_.2 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xIyjlTMs01x_ffESJN3sTEb7oc39R3u', time=2024-09-05T03:55:32.765774+0000, chain.objs.size()=1 2024-09-05T02:16:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.535__multipart_mymultipart.2~xIyjlTMs01x_ffESJN3sTEb7oc39R3u.3 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9038419900369223877', time=2024-09-05T03:56:46.378165+0000, chain.objs.size()=1 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.556__shadow_.hfPnitfL-xWCaDcPjJ1U9GzrbJsaIKg_0 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9760446317919829436', time=2024-09-05T03:57:24.367671+0000, chain.objs.size()=1 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:dU6aj6k3sjnldeArhWpCCQpOnfSKEyA_.l3-bI_DWDIo1Q5dQ4b0i5Ls_dkRO6AF_0 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16540048657524151435', time=2024-09-05T03:57:28.103907+0000, chain.objs.size()=1 2024-09-05T02:16:22.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.212+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:1aR.wCMvgOt0lJnq4swtt77nSqFxtHp_.56ZhUHvVV9BEcmsAyfEL7oGi5VANBee_0 2024-09-05T02:16:22.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.45565065461934215', time=2024-09-05T03:57:48.087366+0000, chain.objs.size()=1 2024-09-05T02:16:22.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.570__shadow:4xZF5gryzdbfwKeAmefJjQ2R.5MeDpF_.3vfsIMpXs-YZ04q6ohkflKTOx8NBHWm_0 2024-09-05T02:16:22.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.216+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5205186730751075285', time=2024-09-05T03:58:51.139904+0000, chain.objs.size()=1 2024-09-05T02:16:22.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.216+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:tfsHMlkC6zg8reiGLjJbp4kQRVjP6T2_.UsWmL9q-DQBpFE9bJKpz4E_yLfBLKh3_0 2024-09-05T02:16:22.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2363223996907602679', time=2024-09-05T04:04:55.638410+0000, chain.objs.size()=1 2024-09-05T02:16:22.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.631__shadow_.hMgWhaTkPaViJrDubnMdD8vP6GE0GLr_0 2024-09-05T02:16:22.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12946188520009685414', time=2024-09-05T04:05:43.314379+0000, chain.objs.size()=2 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.654__shadow_.Ks_iRItKce12Ps6Zuww4vh3uxK2pFTQ_0 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.654__shadow_.Ks_iRItKce12Ps6Zuww4vh3uxK2pFTQ_1 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9919445376701784641', time=2024-09-05T04:07:00.336297+0000, chain.objs.size()=1 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.693__shadow:VB3h6GgCHX0AMOO3OlwSMHzJc9rXn-r_.weenpzQUT_qNqX_VxU2u939Pmbaxx8p_0 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13490557879441386627', time=2024-09-05T04:07:32.391528+0000, chain.objs.size()=1 2024-09-05T02:16:22.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.220+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.711__multipart_file1.2~ylik0eT-YWiUQrk50NDkHEYTQDzhb7G.1 2024-09-05T02:16:22.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.224+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.228+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-05T02:16:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42462' 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.670304919264628935', time=2024-09-05T03:32:23.679363+0000, chain.objs.size()=1 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.148__shadow_.8mRYn_PJkbVLXf7r95v0R4YZ-iOoOpY_0 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14369596376684690593', time=2024-09-05T03:32:50.061963+0000, chain.objs.size()=1 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.SMdYdtmfVZOGZFT-4dYdDQmMr_huYpt_0 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_H7OSoH6aNU-bs71ykjZ-_q3R0uiG-VL', time=2024-09-05T03:32:56.854812+0000, chain.objs.size()=1 2024-09-05T02:16:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.QqvAbU0Q85IkGN8m7-cF-mLqfjk1mg9_0 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16072299597389648180', time=2024-09-05T03:33:54.966561+0000, chain.objs.size()=1 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.188__shadow_._V9N6LZ4crAEg-3kDLJjn0TKJRIui4o_0 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1926744579201124752', time=2024-09-05T03:38:11.640413+0000, chain.objs.size()=1 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.255__shadow_.whnyHqeE095wOtMBmVhqMv-Nez-gVfw_0 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9489457356792524415', time=2024-09-05T03:38:15.387136+0000, chain.objs.size()=1 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.257__shadow_.AdTCuhBGAEkQUUUMScvTRozmZjSHT0G_0 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5138789983173584924', time=2024-09-05T03:40:05.619286+0000, chain.objs.size()=1 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NDzpDo-hIVd7WSGgLlF2_1IIRTcprep_0 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10387601706002215246', time=2024-09-05T03:40:06.514348+0000, chain.objs.size()=1 2024-09-05T02:16:22.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.tdRtWXe3HVWGZz2bk28a_mRxnfppicD_0 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16531640772340046661', time=2024-09-05T03:40:07.034588+0000, chain.objs.size()=1 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LVRRP26JAF3krchHmdD6b_-2XjFqUfl_0 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18416432190713878165', time=2024-09-05T03:40:09.271338+0000, chain.objs.size()=1 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8scSc-TTZJnVdx2PSUqYUITLstPvzFB_0 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8676199991761817500', time=2024-09-05T03:40:09.578151+0000, chain.objs.size()=1 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9hj7mzM4DPY24xiR7VFIaiTC8o17tQK_0 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4345298686911116960', time=2024-09-05T03:40:10.524091+0000, chain.objs.size()=1 2024-09-05T02:16:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.232+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.reBREIUd2qy-AesxGGPtRXgBATdn-PG_0 2024-09-05T02:16:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3656166083561261896', time=2024-09-05T03:40:10.636100+0000, chain.objs.size()=1 2024-09-05T02:16:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.svSbzHtRjp9JIVNFleEL4wRunaQIWXd_0 2024-09-05T02:16:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.143162956645483757', time=2024-09-05T03:40:10.638910+0000, chain.objs.size()=1 2024-09-05T02:16:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5ZPaShIIgTF0j66onktTvZrGXoXDJ6M_0 2024-09-05T02:16:22.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5513792948358276367', time=2024-09-05T03:40:11.213898+0000, chain.objs.size()=1 2024-09-05T02:16:22.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Fwtiqrk6bycSR3eFRsUeG12chKTLdXK_0 2024-09-05T02:16:22.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14871328166894677040', time=2024-09-05T03:40:13.542570+0000, chain.objs.size()=1 2024-09-05T02:16:22.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gSMFW2sLdg3KGN53UCT0v49IqLb40kQ_0 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6255554641668074891', time=2024-09-05T03:40:13.587846+0000, chain.objs.size()=1 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bmDis5SbvxKDEF-yOu0XJ5hs69XlNZQ_0 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15473559415607979762', time=2024-09-05T03:40:13.589950+0000, chain.objs.size()=1 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.01mYahskJ8oK2t2VdPtdH248D8c8e1G_0 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12203021702120901789', time=2024-09-05T03:40:14.159394+0000, chain.objs.size()=1 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.x48NmsmXyTJLVgt5MjjJ9NFq1sSIMfd_0 2024-09-05T02:16:22.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16608142669199768464', time=2024-09-05T03:40:14.209525+0000, chain.objs.size()=1 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dalflEsWj44HbEvv6_Jmh81MsHO8WOr_0 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.347960892148710811', time=2024-09-05T03:40:14.407511+0000, chain.objs.size()=1 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.952Wfc8alAvxZKVSKznp8ZkLzpf8T4E_0 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16981200810729078693', time=2024-09-05T03:40:16.421751+0000, chain.objs.size()=1 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.D3exWzlnc5mvIw-q0wAojF2LcHF1McV_0 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11980637878964480792', time=2024-09-05T03:40:18.363436+0000, chain.objs.size()=1 2024-09-05T02:16:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mQihf-v7-NFwdNMxhH16fv2d0Bp40tf_0 2024-09-05T02:16:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17405228213348136022', time=2024-09-05T03:40:19.582510+0000, chain.objs.size()=1 2024-09-05T02:16:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.236+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.j2vHgbs1fwOsgKT3C93VMnd7W-ilfTh_0 2024-09-05T02:16:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6033493164772184165', time=2024-09-05T03:40:20.001640+0000, chain.objs.size()=1 2024-09-05T02:16:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Zyd7c1TZO_QW1l9rmv3HLYnOmhkEEtJ_0 2024-09-05T02:16:22.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16907059435629943479', time=2024-09-05T03:40:20.506522+0000, chain.objs.size()=1 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-sAon9lQrbdKT7cSmCoJXmZpV2B9k8I_0 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1387600713294540482', time=2024-09-05T03:40:20.786654+0000, chain.objs.size()=1 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.teDtQforD1qrSBUx9K1k3gBGnpOTR-h_0 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6923179177569644699', time=2024-09-05T03:40:21.789878+0000, chain.objs.size()=1 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._e--1qa2xUIpsgVTU4rmFraJwkSvtEc_0 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9635693964264057895', time=2024-09-05T03:40:21.871764+0000, chain.objs.size()=1 2024-09-05T02:16:22.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KqsKOnNPyDfbaLYAlrmUMS8N26oE48Q_0 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2051901962179867970', time=2024-09-05T03:40:24.129566+0000, chain.objs.size()=1 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mAlD1yfUv8NN9s-xve6s6Fwx0QIWj2o_0 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6963577926028944839', time=2024-09-05T03:40:24.142380+0000, chain.objs.size()=1 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zVxekZq1Ow5-aCC_KSTan11w1W34UkO_0 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5285393950662644008', time=2024-09-05T03:40:25.857087+0000, chain.objs.size()=1 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C4rjVl2O3FfwAucBectpZvPXZudPXsH_0 2024-09-05T02:16:22.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15482701954254588089', time=2024-09-05T03:40:25.981989+0000, chain.objs.size()=1 2024-09-05T02:16:22.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mma3cwDlg7tL0OKmcRGzI-VRHuPfzBU_0 2024-09-05T02:16:22.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13507384816811934969', time=2024-09-05T03:40:26.543874+0000, chain.objs.size()=1 2024-09-05T02:16:22.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.x8x8wy8iBMTS5BY3sxXuWkeCctHd6La_0 2024-09-05T02:16:22.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8713950060407246152', time=2024-09-05T03:40:26.545212+0000, chain.objs.size()=1 2024-09-05T02:16:22.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.240+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lkDw-kIgjIGJmfd6isI4ljjz7KDcjhj_0 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5725140206188423085', time=2024-09-05T03:40:26.675622+0000, chain.objs.size()=1 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o1_1eHxpKE9Cc8aP_yIhDxy3PkUt1Ak_0 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17869041250899611120', time=2024-09-05T03:40:27.174218+0000, chain.objs.size()=1 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wqgk3JH5sFBDnIuU9SSydaZg2DBAGe0_0 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4117960144266730496', time=2024-09-05T03:40:28.895732+0000, chain.objs.size()=1 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0NvAGZUl8SWCKa2VjnK_VVB19AClPRf_0 2024-09-05T02:16:22.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5406982746238383722', time=2024-09-05T03:40:28.961775+0000, chain.objs.size()=1 2024-09-05T02:16:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aBNb4HKx-fk05e8f_0EriwNf0IiQOIj_0 2024-09-05T02:16:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12981817949137645742', time=2024-09-05T03:40:29.931875+0000, chain.objs.size()=1 2024-09-05T02:16:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KZ_5mNEbFp6KYoydwAooavNVG5kuksq_0 2024-09-05T02:16:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12818630057576817055', time=2024-09-05T03:40:29.938055+0000, chain.objs.size()=1 2024-09-05T02:16:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PfnHUb1ESrqzO4OY4jHN4YNvV7exXDL_0 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11564523010485020639', time=2024-09-05T03:40:30.134596+0000, chain.objs.size()=1 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oj9-tTB5T4kkUvY7pnoSvz53UkM4gLt_0 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8939350286322623992', time=2024-09-05T03:40:30.514607+0000, chain.objs.size()=1 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.21M6omDvu95yScZrmcZkPkmIQXINimh_0 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7586415659222799862', time=2024-09-05T03:40:30.520086+0000, chain.objs.size()=1 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.viiVakxSvai1mw9Tvn_sIMZjiN1-IyR_0 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17599771393950056583', time=2024-09-05T03:40:31.715112+0000, chain.objs.size()=1 2024-09-05T02:16:22.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aaQDBqCwGN3nNEnHwsMt9Yk3SBmMimL_0 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2701423208849051221', time=2024-09-05T03:40:32.246132+0000, chain.objs.size()=1 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.244+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YKm4-tcshgXHUIeSTE9FSEXu7Q3agZw_0 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2608790218453098013', time=2024-09-05T03:40:32.264762+0000, chain.objs.size()=1 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VhTU5R7ySmSBJAtqGSNOZ31cbSZVWMI_0 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14452173526556313692', time=2024-09-05T03:40:33.845505+0000, chain.objs.size()=1 2024-09-05T02:16:22.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.S6gCQVZxKWiG6JSmjxIHuY_fN_d62EG_0 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11935824013456074107', time=2024-09-05T03:40:34.242259+0000, chain.objs.size()=1 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ybQMCiiT2SH3oA9LJxby-sIDzrx1gP-_0 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9309248406705182098', time=2024-09-05T03:40:36.269762+0000, chain.objs.size()=1 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sU7FTGyPwWGeqERh2Gyj4fDb9rIEACU_0 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16858762307206548692', time=2024-09-05T03:40:36.499324+0000, chain.objs.size()=1 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6gS3FNKbyK-CJ8RvUqPztIkf9QudjKr_0 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4921578492168566855', time=2024-09-05T03:40:38.298104+0000, chain.objs.size()=1 2024-09-05T02:16:22.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.263__shadow_.gm9z4ETTXDZz1XVHdP4M8tfq2Rr4bNb_0 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1959156741262740529', time=2024-09-05T03:40:47.140819+0000, chain.objs.size()=1 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.268__shadow_.czkzgOEx3ht7z9z1e6eQf-Fz9aklTIv_0 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6483610150961250806', time=2024-09-05T03:41:10.500494+0000, chain.objs.size()=1 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281__shadow_.imhx5VxA7pys3WNyT3_pMCxj2PQO4N6_0 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8509788446468297040', time=2024-09-05T03:41:34.864291+0000, chain.objs.size()=1 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.j8pfK50FNWBjXMPozppSeAKttIiMFzl_0 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2063284957984219303', time=2024-09-05T03:41:51.811062+0000, chain.objs.size()=1 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.299__shadow_.vovz1zVUOyUXc3bSbRXnOeDo1EJ83Zs_0 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11630972962386234075', time=2024-09-05T03:42:30.081002+0000, chain.objs.size()=1 2024-09-05T02:16:22.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.319__shadow:.pUMnRvQUxpv22-zpyzyMGUjt3xI8Ed_.oplQakGVWktzahvpLqw2FnBhgrwwZoY_0 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.861577903356523048', time=2024-09-05T03:42:35.426104+0000, chain.objs.size()=1 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.322__shadow_.NeReG2PhUF4Wv3Q9PiHnT4nXl6HOjIx_0 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17371655161934071640', time=2024-09-05T03:44:19.280421+0000, chain.objs.size()=1 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ngegN4TabmZLKAzjZFbUzz3ZvkZ8Iv1_0 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.755932275699856356', time=2024-09-05T03:44:20.614406+0000, chain.objs.size()=1 2024-09-05T02:16:22.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.N6M6V-Z1OloKilTa0DT-dOHmQ_ASy4Q_0 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13372146027315985483', time=2024-09-05T03:44:21.314490+0000, chain.objs.size()=1 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZU8KLoVmei5QwpNhjsDu3po4U356JZl_0 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17964584035689532892', time=2024-09-05T03:44:21.491213+0000, chain.objs.size()=1 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.248+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lpmOxK-5jLXUKUk-1BXqIVsRRgIYRFk_0 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.252+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17813682185348613792', time=2024-09-05T03:44:22.406997+0000, chain.objs.size()=1 2024-09-05T02:16:22.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.252+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IpXlBhaw0EolLM7d1-_xH-wc3OJn_oT_0 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5040364108157827643', time=2024-09-05T03:44:23.885919+0000, chain.objs.size()=1 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GLa_r_s8BVXxscrwMmSknFyp1ymWNGJ_0 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12377263255259094282', time=2024-09-05T03:44:24.127147+0000, chain.objs.size()=1 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aumevVRTBrVflMxMfpwQ7hO6fOSsjYh_0 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12919143062512990854', time=2024-09-05T03:44:25.497734+0000, chain.objs.size()=1 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h7gm4Mqt-zQgDujb13Hb80-TDMc2SX-_0 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8939110719762089124', time=2024-09-05T03:44:29.646721+0000, chain.objs.size()=1 2024-09-05T02:16:22.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Fsnv2PQoGqG9Cb30qglXpsSVcbOq5D8_0 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13200163947452064117', time=2024-09-05T03:44:30.422757+0000, chain.objs.size()=1 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G9eFU5uX-g2hR8qvlsF2I3GfC_GOxrT_0 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11561714391279877458', time=2024-09-05T03:44:30.693124+0000, chain.objs.size()=1 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UU47-sJkN6iuc77F385rB0Q-jnso3i3_0 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1280852071422616729', time=2024-09-05T03:44:32.436131+0000, chain.objs.size()=1 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.E-On_XDAcZxEv-HBJZi0GTjDv_jM-g__0 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1985181191143993545', time=2024-09-05T03:44:32.585768+0000, chain.objs.size()=1 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Yi7qs8hD8hn4PvQIc_7Zpc6HD9dGZk-_0 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18405161569313231416', time=2024-09-05T03:44:33.355598+0000, chain.objs.size()=1 2024-09-05T02:16:22.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.u7m-XFiqk0y0GBcHFmMs1C3mS4cPszg_0 2024-09-05T02:16:22.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5334505658220418908', time=2024-09-05T03:44:34.701489+0000, chain.objs.size()=1 2024-09-05T02:16:22.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IpAm4rflaFdMqJdUeWwk04HtmsuGVlB_0 2024-09-05T02:16:22.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12050224266015004665', time=2024-09-05T03:44:34.866395+0000, chain.objs.size()=1 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.o5ddULmuVU5hPHbp-JDk_1_Ni7MXFlx_0 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8231179548138166511', time=2024-09-05T03:44:35.903499+0000, chain.objs.size()=1 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FqOi2iMiYCYkPz0-xqyhiVPuOdI2jKd_0 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1117599956713257430', time=2024-09-05T03:44:36.324231+0000, chain.objs.size()=1 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OAFOFFbYT-8U9HzQnyg1_BfZPeo7nM6_0 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14907525717267512130', time=2024-09-05T03:44:36.405511+0000, chain.objs.size()=1 2024-09-05T02:16:22.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9kMCW1uOPHCafM5hi4KCH1jvu1oqDNm_0 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15450652346104484102', time=2024-09-05T03:44:38.647435+0000, chain.objs.size()=1 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2Bhnfver8JXm2IzSGcSEx0w8Jdm8WGQ_0 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.638486236133253750', time=2024-09-05T03:44:39.850763+0000, chain.objs.size()=1 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._pOAYTVh2lcaDisZ5QhiLgQHxtdgUE7_0 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16583930574408419745', time=2024-09-05T03:44:39.904176+0000, chain.objs.size()=1 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-pALZLLhfa0KFxUelo1G6VFPHUJETSA_0 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15364766282437167418', time=2024-09-05T03:44:41.044794+0000, chain.objs.size()=1 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8I3ODCaNQiAmaHfWv2wxGHxhpAa_Kho_0 2024-09-05T02:16:22.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.930342229381088556', time=2024-09-05T03:44:41.925954+0000, chain.objs.size()=1 2024-09-05T02:16:22.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.256+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mfbNORtxIKXm9mNdeRcnQs4vrGnGzcp_0 2024-09-05T02:16:22.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4718614934372406419', time=2024-09-05T03:44:44.113408+0000, chain.objs.size()=1 2024-09-05T02:16:22.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7aokwtycbm9d6sCNJjuP4B4jx4atV4g_0 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15948868325882633585', time=2024-09-05T03:44:45.998967+0000, chain.objs.size()=1 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-P0OwEuAVg1Poz0F15PEhm3kiNGjRGE_0 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12944576258274489392', time=2024-09-05T03:44:46.002218+0000, chain.objs.size()=1 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SDKTyA1Ooyc4Pyu5-5jf8R2jRuhtVD-_0 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13605976863265278549', time=2024-09-05T03:44:47.771116+0000, chain.objs.size()=1 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.I5NnNkoTfEmtTKZZNS5ZxUjbdptlNG7_0 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17183281997096558712', time=2024-09-05T03:44:49.907898+0000, chain.objs.size()=1 2024-09-05T02:16:22.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.260+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Z-wR_BEEkhPOKtQngyXP-Dnc7Jjz45z_0 2024-09-05T02:16:22.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13050701351914829647', time=2024-09-05T03:46:35.073731+0000, chain.objs.size()=1 2024-09-05T02:16:22.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.B4lK35wYHf3r8wuAtOPpIpwMaZLzyw7_0 2024-09-05T02:16:22.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16489728995993983176', time=2024-09-05T03:46:35.226734+0000, chain.objs.size()=1 2024-09-05T02:16:22.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sGdI21T2eN8njYdNBxdQHARFtzxXz4j_0 2024-09-05T02:16:22.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1199250198144288539', time=2024-09-05T03:46:38.245177+0000, chain.objs.size()=1 2024-09-05T02:16:22.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qMbaVzPNhQ0m1WuOV4PWDhVlSjz0bAC_0 2024-09-05T02:16:22.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10437240785983769233', time=2024-09-05T03:46:38.264697+0000, chain.objs.size()=1 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DFvXBzMVF0PbMSLpqFDa_-BER3-lh4Z_0 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5085584830512091508', time=2024-09-05T03:46:40.528415+0000, chain.objs.size()=1 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Kb4I8mDuBp4tGZSuYJo0IPbLvK9qlxq_0 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18240855418431446627', time=2024-09-05T03:46:40.946164+0000, chain.objs.size()=1 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vq9LgTCsVkM_8t_jbFJQuET9mOXwooD_0 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17646699671224617892', time=2024-09-05T03:46:42.970747+0000, chain.objs.size()=1 2024-09-05T02:16:22.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NLb9E1iaAyN4pg4Kx1fa3-BeqZv_JqY_0 2024-09-05T02:16:22.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8957724074712070429', time=2024-09-05T03:46:44.016960+0000, chain.objs.size()=1 2024-09-05T02:16:22.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.K9ukeS7Skw1nnt-vMgxUKJQgOBmPxKD_0 2024-09-05T02:16:22.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6017649653759133061', time=2024-09-05T03:46:44.672040+0000, chain.objs.size()=1 2024-09-05T02:16:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2oi8M3HOzQv3W9ES3mr-_KBciAmr15t_0 2024-09-05T02:16:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14868050956648171094', time=2024-09-05T03:46:44.776062+0000, chain.objs.size()=1 2024-09-05T02:16:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DY7XJB_290HTBKXPqdxMFcQ00Yxif5D_0 2024-09-05T02:16:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4955130470160669142', time=2024-09-05T03:46:46.480078+0000, chain.objs.size()=1 2024-09-05T02:16:22.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.264+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OpH-SzmD7mZeI3gNTM8VDfjd9xszesj_0 2024-09-05T02:16:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11927991997698478519', time=2024-09-05T03:46:46.883385+0000, chain.objs.size()=1 2024-09-05T02:16:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gx3ZK7Td7pXTeU_PZcMbnJ17ysFWTh9_0 2024-09-05T02:16:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.268+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16159117560288592820', time=2024-09-05T03:46:47.478501+0000, chain.objs.size()=1 2024-09-05T02:16:22.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.268+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZrKkWUM4KurFvyWLnqBn2LSYgpviTwd_0 2024-09-05T02:16:22.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/42462 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1657800867440385037', time=2024-09-05T03:46:47.512268+0000, chain.objs.size()=1 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Gw6NaS1B2Bl2SNDJ_4uqPhAn5uBcTJ-_0 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10184273897769201956', time=2024-09-05T03:46:47.951715+0000, chain.objs.size()=1 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bPzYsau7_iBBC96BjyMhx1vggdnYgAz_0 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17721090727611438410', time=2024-09-05T03:46:48.079013+0000, chain.objs.size()=1 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6HA7KYhhsW9gtq3c9_lI2485suo0qtm_0 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16088906821841349639', time=2024-09-05T03:46:48.766321+0000, chain.objs.size()=1 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0mHMo3B1JWCkq1r5rI0aNH2oMoGkK1H_0 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12421346676405868488', time=2024-09-05T03:46:48.865501+0000, chain.objs.size()=1 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eKJqIwPybc1LRV8Cdaad4DGkY2Da--2_0 2024-09-05T02:16:22.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16072749932529676798', time=2024-09-05T03:46:50.637061+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iaS5Fhb2Tim6YC120pm99lYuDhypo1j_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9036904976239577339', time=2024-09-05T03:46:51.856356+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NsPQM6I1W5DB0eeNYX3ERqBJMw9VILT_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11467232383666286337', time=2024-09-05T03:46:52.422335+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rEe95IlOHYvgbAT4EqD2bk2Lb0OPAJ7_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6369224529322906537', time=2024-09-05T03:46:54.197138+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.azH11WiSeebRc6Dk6jh_3vmcthjA1jw_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3826862635293942990', time=2024-09-05T03:46:54.965200+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wHN1ER3ynTLBvsC68QE-eWDU74-SoFF_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16855652844662944741', time=2024-09-05T03:46:55.834982+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iSvfIRk6Y71dpTZaiYah63nDsFI-ZUD_0 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12384270630842670646', time=2024-09-05T03:46:55.968635+0000, chain.objs.size()=1 2024-09-05T02:16:22.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.272+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8nV1OEyI4F2gw_jlj9vM-uCKIrQXNdt_0 2024-09-05T02:16:22.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2097184266257122063', time=2024-09-05T03:46:56.986489+0000, chain.objs.size()=1 2024-09-05T02:16:22.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lfzFg6sDHBAhi00zwNk7eFN91srqrRJ_0 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12985913997011930100', time=2024-09-05T03:46:57.273823+0000, chain.objs.size()=1 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dEEZoSBXT2WzlsnyXlqg4rsRB1FzuNI_0 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3423141041322012526', time=2024-09-05T03:46:59.978971+0000, chain.objs.size()=1 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PaY7Saql3ijbXnRaSwyenUxKJdoDIsc_0 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15877702520968858678', time=2024-09-05T03:47:03.169678+0000, chain.objs.size()=1 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PUzxGngBEZQp6JwcyrVnMCQxVnENdYU_0 2024-09-05T02:16:22.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12656241727679700652', time=2024-09-05T03:47:04.057664+0000, chain.objs.size()=1 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.y6PORUrVxu1XejFZ8H4TEeUA_BbYuyP_0 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14260684031468731313', time=2024-09-05T03:47:04.149209+0000, chain.objs.size()=1 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ix2YORBuMtJJQRy2Qu0b3p6ys7WsOOD_0 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9815499388278745635', time=2024-09-05T03:47:04.151458+0000, chain.objs.size()=1 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bZYw0jrtv2wFAa5f7ETYWf_IltDleJs_0 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10478448334653747269', time=2024-09-05T03:47:30.164528+0000, chain.objs.size()=1 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.341__shadow_.5_qRIiCl4JqzL7T_lCJmwQdMJmRXFT7_0 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1667963945547336154', time=2024-09-05T03:48:16.263054+0000, chain.objs.size()=1 2024-09-05T02:16:22.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.375__shadow_.Hjb_tMmNIAe5gZTBv1oXvC23VRM8AbZ_0 2024-09-05T02:16:22.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13430278692782222115', time=2024-09-05T03:49:43.626225+0000, chain.objs.size()=1 2024-09-05T02:16:22.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.432__shadow_.4qdlh-YxjsT1-0Vo6izb1CA3jJMye6U_0 2024-09-05T02:16:22.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5127766343652554058', time=2024-09-05T03:49:56.891925+0000, chain.objs.size()=1 2024-09-05T02:16:22.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.276+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.440__shadow_.Si0r7OVK2Iu85iCZUUCR579x5geRhgu_0 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13967615439205040115', time=2024-09-05T03:50:47.695299+0000, chain.objs.size()=1 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.466__shadow_.boKnOmf49-aoyzXGC2usIbu-m33GOOz_0 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7828595676283780882', time=2024-09-05T03:57:44.678812+0000, chain.objs.size()=1 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:Q6JMrQy8czDEA0HxVzNnNNS9v5uEnYu_.DAtyFyjKniAwzsawzrnjy6seEgLlRqe_0 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12231969067623908005', time=2024-09-05T03:57:52.836384+0000, chain.objs.size()=1 2024-09-05T02:16:22.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.572__shadow:QjnZ.GnWYwDr8-3WhcvMNHjlSIiwLzm_.4bEk8VrQ2FHS4aR6_iUM65I-hQr1o7U_0 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10450164505988226252', time=2024-09-05T03:58:03.064721+0000, chain.objs.size()=1 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:8MDJT5LBxQsja.TP1ds5GDiLgpimvfV_.O7CHwSzjQ1AUPfRmcF3vFCpOSvbjgVQ_0 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2666144372055062667', time=2024-09-05T03:58:15.402424+0000, chain.objs.size()=1 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:BJdAI39IJUsT6XvWLCKSFKdoFIcCDaj_.F4SREaQRHKWs5_FV2KJdkzQkRSL6t2z_0 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12891304457936420315', time=2024-09-05T03:58:31.786329+0000, chain.objs.size()=1 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:SCsPZmSko4WEpJmaulH91g9h11GKZil_.igBSzZ7vVD2jlg-1UJA0mekfWDsIDKW_0 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6701365152855952257', time=2024-09-05T03:58:55.321393+0000, chain.objs.size()=1 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:4fqVq.9O5oq3C-jLDIyKDWXoFO4cMob_.YjBZhmR7fITYsTAS9k2H-VYTXctldhq_0 2024-09-05T02:16:22.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15304112932479059004', time=2024-09-05T03:58:57.775769+0000, chain.objs.size()=1 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:HDNhX6NOEs6RTkcxm318L6LK0qQ-zYa_.VlTaMKrXJPIVd9EEZ2JKm9GwXlwv_7j_0 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6692577793604283312', time=2024-09-05T03:59:24.471024+0000, chain.objs.size()=1 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:3AOuJ2u1X3ud-LKU6jRg2L.2eUWwxjA_.qUE5ouQjV0nqshvzBy9USK2bLZAyXMS_0 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15822662786587738803', time=2024-09-05T03:59:46.317849+0000, chain.objs.size()=1 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:X8Nuhpbu9AX22mA0A7VsneWPB0gnq7U_.mJf8QM4Y8jhYCH2TmAMKhkS9k5STJWD_0 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1672063521764864791', time=2024-09-05T04:03:55.079362+0000, chain.objs.size()=1 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.280+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.618__shadow_.5_rhe7fme5pUBbL7jmMBG_UtbXSw9X3_0 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.284+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5893648326109352357', time=2024-09-05T04:06:30.508948+0000, chain.objs.size()=1 2024-09-05T02:16:22.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.672__shadow_.5bmdAV0ZxCU-dZBlFC8C4MQhjoVFkXV_0 2024-09-05T02:16:22.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.284+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.288+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-05T02:16:22.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.288+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.288+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51078' 2024-09-05T02:16:22.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15714889793442184991', time=2024-09-05T03:37:29.794316+0000, chain.objs.size()=1 2024-09-05T02:16:22.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.234__shadow_.fZhlT1wLhVUp094UF_Mv1k0ZGbhlxfy_0 2024-09-05T02:16:22.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.995988236570165135', time=2024-09-05T03:37:36.222867+0000, chain.objs.size()=1 2024-09-05T02:16:22.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.237__shadow_.T4Um_17dx-fw9n023P37VH0Fd_j4LSg_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13063343180272306815', time=2024-09-05T03:37:36.224808+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.237__shadow_.SoSWlBye_cuUupKyu5KMFxnkw_2YFkl_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17276746834678034606', time=2024-09-05T03:38:13.650230+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.256__shadow_.tSm-9E2U3yC2lDH_nIisKM-CRMGTZiz_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3085700281443104489', time=2024-09-05T03:40:05.121027+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GM1Cigp3aF6L4hT6gb0DpQnBPWKAc3t_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6170739609491751933', time=2024-09-05T03:40:05.298824+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sV0QJvOWpoiayqEQzz4i92zQhIrIp1n_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2307159694355306992', time=2024-09-05T03:40:05.300756+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.djrdIPWSFqRqVpCyxXsfdcak6fUhc74_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17214590612362805084', time=2024-09-05T03:40:05.709890+0000, chain.objs.size()=1 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OFjnC0Y6LCWzOHIzF6EBaL1Q8NurSpn_0 2024-09-05T02:16:22.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14842451958819180979', time=2024-09-05T03:40:06.676982+0000, chain.objs.size()=1 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RAvZGqacwoxaIRYSgnrYQhwcxPvuGma_0 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9394780592362833918', time=2024-09-05T03:40:07.555346+0000, chain.objs.size()=1 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QF7Jsnq-rC9T59mDBzGtc4Na0v0lZ2R_0 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7051525038223642744', time=2024-09-05T03:40:07.691274+0000, chain.objs.size()=1 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iPjWa4eabPvbwEZQWtQsAOrCSs9sC-9_0 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13319356452499672074', time=2024-09-05T03:40:08.787995+0000, chain.objs.size()=1 2024-09-05T02:16:22.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Uocpqje9YdzLKGE-8K2Pb_iAR7U6IDf_0 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3348161241243467087', time=2024-09-05T03:40:09.990722+0000, chain.objs.size()=1 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xPYGUNx911ss1-R5m1BRNex12pJy_Z1_0 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15969825600267216142', time=2024-09-05T03:40:09.994476+0000, chain.objs.size()=1 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7wglpUuMGhPq3Q6f6Ox0nRX_UgeCfDO_0 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17206985583108107496', time=2024-09-05T03:40:11.590766+0000, chain.objs.size()=1 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.B-vMjd9CHjwR_T4SVn8jGKR48Vh82Wy_0 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6548909641772215405', time=2024-09-05T03:40:11.979840+0000, chain.objs.size()=1 2024-09-05T02:16:22.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5AECAGV3_oBHSEkiQVkjpI5C2tk3dr1_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9700612018192044281', time=2024-09-05T03:40:13.204359+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lQ_efiKK68odZLZ_MH5K-N58C9OOxQ3_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15422303136787688306', time=2024-09-05T03:40:13.660190+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pAevzoNMubIWAg5z2nhfaLp0EedLU4C_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1540910886608612692', time=2024-09-05T03:40:13.662112+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wmYHeUtFd6eEmyGGTQEdnh0k_aoQO9q_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11329640232176277370', time=2024-09-05T03:40:14.609619+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Eux0695J1nuBQYddXD9xO_I_HVZcmRc_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16670740071860578659', time=2024-09-05T03:40:15.360442+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jUDOChfcRKHzqwDw7v9mcrecgJrfMeQ_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18423217598503131996', time=2024-09-05T03:40:17.980660+0000, chain.objs.size()=1 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MgY6rEEA80RsD-7vjivZZOest87lrEZ_0 2024-09-05T02:16:22.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11063185443375709567', time=2024-09-05T03:40:18.566722+0000, chain.objs.size()=1 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.292+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eE6mKeA5kPpmC4TlSeQ6CvgOBXMBI8q_0 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1592766904322948429', time=2024-09-05T03:40:18.869517+0000, chain.objs.size()=1 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oD6k6-mzR1XMUNblYfMvrtSZTl03nmY_0 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.952944867072832871', time=2024-09-05T03:40:19.520898+0000, chain.objs.size()=1 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Alt3l7JvQCOYkL3MPO3lf_pdWxBxJ2p_0 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14889244567752607207', time=2024-09-05T03:40:20.080672+0000, chain.objs.size()=1 2024-09-05T02:16:22.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pdi21rq3jUYqYy8se8JL8ivt4sqCzYO_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5644527503831320714', time=2024-09-05T03:40:20.367011+0000, chain.objs.size()=1 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NEBidQqnpGdGo2HIoXtmy0unjaHccLu_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7242320890664872511', time=2024-09-05T03:40:21.771642+0000, chain.objs.size()=1 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1zbVBHQWL9I_A2C4iULcZ6GpuUWwIgj_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14661261770677303031', time=2024-09-05T03:40:21.773908+0000, chain.objs.size()=1 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VY5zZ3AQ9CbIIOqChJ2Ez0rVi76Q-vn_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13834620794125094629', time=2024-09-05T03:40:21.775700+0000, chain.objs.size()=1 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6jUO_l9PYi6_uK2QYYK5-aeuvzDdDce_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4053372509053477208', time=2024-09-05T03:40:22.274153+0000, chain.objs.size()=1 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.uWslDXaNORyIrEndBAkNeQUyX7kscGK_0 2024-09-05T02:16:22.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10077697811853711271', time=2024-09-05T03:40:23.560983+0000, chain.objs.size()=1 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.25Ow9um-xqabSuPepw5r0cKk6zZjVwL_0 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11623838976618433384', time=2024-09-05T03:40:24.143980+0000, chain.objs.size()=1 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fgAKwJwffCR1WwrwMxkLUykh7cyOlSC_0 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2178137592251110188', time=2024-09-05T03:40:24.315614+0000, chain.objs.size()=1 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.296+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.42fz66K3bScNa0VSnzRo1NegMt_1ODB_0 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7113823762226431987', time=2024-09-05T03:40:25.811073+0000, chain.objs.size()=1 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._4g33XwRt_H7dIDj-BybzFAGYzCOxBf_0 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6684281707293778524', time=2024-09-05T03:40:26.219556+0000, chain.objs.size()=1 2024-09-05T02:16:22.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hJULDZ4USKpL_Tk-IT34aow5rhgidx1_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7170199413689438132', time=2024-09-05T03:40:26.374703+0000, chain.objs.size()=1 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1ERIFc796ntEI3GeBGBubmFJA_W39cv_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15015296266557550428', time=2024-09-05T03:40:29.992238+0000, chain.objs.size()=1 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.z90gQbC-WHJ_WAEYFksQmhNRQx2BYK6_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13324481305563542819', time=2024-09-05T03:40:31.197242+0000, chain.objs.size()=1 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MhEJMXWRF-UejipShDlneoU1_cyzwZT_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1981064565920368541', time=2024-09-05T03:40:32.835078+0000, chain.objs.size()=1 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dYsE7syRY_HrJMtLBibqQ1_OZig6n45_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17929139270125542840', time=2024-09-05T03:40:33.001688+0000, chain.objs.size()=1 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oRVK9QIGvxSKSjozzWJoHzT_gB_ubuC_0 2024-09-05T02:16:22.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12402803780945750113', time=2024-09-05T03:40:33.127706+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Vci1_V9qJ-acPZJ8A8gFHlnHybYJZH2_0 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15424594148253595385', time=2024-09-05T03:40:33.129409+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.s9Qx_ynl7AA4pjadU21pU9qwayt9TB3_0 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18325313319134918426', time=2024-09-05T03:40:34.399215+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._7wAAJWLINFMQlgwpLjaW4pGhdpFoVl_0 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13197029651213204868', time=2024-09-05T03:40:34.708106+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.h3X7YN5l1Bq10t5P7LMk2Ow49jJIeqi_0 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8940810172163177399', time=2024-09-05T03:40:35.471613+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VeckC7Qd2ET6cQdCiyN1oQJQF8BJLLh_0 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3421544252327580369', time=2024-09-05T03:40:36.419408+0000, chain.objs.size()=1 2024-09-05T02:16:22.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.300+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.y7w_mQ0vgsLVKfVbSx2wn7zgXLuOOnG_0 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2361133226973951938', time=2024-09-05T03:40:36.507091+0000, chain.objs.size()=1 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LQdwqoU0La0EVoPnpmrpg8EGspYPzWE_0 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3720991593104709894', time=2024-09-05T03:40:40.070553+0000, chain.objs.size()=1 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.264__shadow_.4SWA0Rc2KjPpVQkJtSgTQUrn_YhO69k_0 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1781111722154498563', time=2024-09-05T03:40:55.791622+0000, chain.objs.size()=1 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.273__shadow_.HHDSD7LMW8JU-R9F6lgTnEWTzIhblrn_0 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12363375915293801238', time=2024-09-05T03:41:12.527834+0000, chain.objs.size()=1 2024-09-05T02:16:22.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.282__shadow_.Vfqrb45WVyUG-3Ewi0cPCgmWKfn1YEp_0 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11326609046024185269', time=2024-09-05T03:41:16.251282+0000, chain.objs.size()=1 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.284__shadow_.P6jgI7iu_9YtXOVILc9kh8D4Kide8sM_0 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10132437570486536582', time=2024-09-05T03:41:34.702061+0000, chain.objs.size()=1 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.x19u_lnQdPOS7XqGu88Ky5MgpofKjkd_0 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9882378992743124846', time=2024-09-05T03:41:57.419530+0000, chain.objs.size()=1 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.302__shadow_.qEB3e4BkTnjngzbMmjQL6qtPiGgp7LF_0 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1037040188094804250', time=2024-09-05T03:42:33.353966+0000, chain.objs.size()=1 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.321__shadow_.z91lzXO6zO6Lo4_z88bKMgR7512SF3x_0 2024-09-05T02:16:22.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8303530910742093634', time=2024-09-05T03:44:19.254286+0000, chain.objs.size()=1 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OeYhwOUKc2hwU80cHzrBhVgecIFTr61_0 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12969363191692146663', time=2024-09-05T03:44:20.122230+0000, chain.objs.size()=1 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7vvDq0fWSkSmPTHrOTAp4PCe4CLxnRB_0 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7880604142907791442', time=2024-09-05T03:44:20.445443+0000, chain.objs.size()=1 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.304+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6b1K13oTM70FZEBjEtTIN0Xic1cQfd8_0 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11894877121948613464', time=2024-09-05T03:44:21.524866+0000, chain.objs.size()=1 2024-09-05T02:16:22.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WxlfHwDyQKOnHXtSOBEsGe8bxZAfJ-d_0 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17088080903251231029', time=2024-09-05T03:44:21.527075+0000, chain.objs.size()=1 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vGV87W18FC7x9VpOxwnzL2fHeIxj5Ai_0 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2899105717283375604', time=2024-09-05T03:44:22.205464+0000, chain.objs.size()=1 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OtJYyMkMbx4xAN-AB5aPIOE8fanCPJf_0 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12947899573208220795', time=2024-09-05T03:44:23.542818+0000, chain.objs.size()=1 2024-09-05T02:16:22.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.308+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RheQ2W8mvnS8Lz6gG6aiHpPLEcIaTfT_0 2024-09-05T02:16:22.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9025132535523041750', time=2024-09-05T03:44:23.544968+0000, chain.objs.size()=1 2024-09-05T02:16:22.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2PLsndEczc9ZU2ohE6z5ZMldn721SDG_0 2024-09-05T02:16:22.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2566827419643771701', time=2024-09-05T03:44:24.548336+0000, chain.objs.size()=1 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RcgvnT11svSrFiHRteXFMEjgSqkdRZs_0 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10705148491985920458', time=2024-09-05T03:44:24.573201+0000, chain.objs.size()=1 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2it7YkS_5a0vJJ-T0A_nzUZmBlT-ZH3_0 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5868008411954214427', time=2024-09-05T03:44:25.503251+0000, chain.objs.size()=1 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Ni5S9HrpkypXrkzXL3BiCrNxbsUtSgh_0 2024-09-05T02:16:22.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9201373278438066799', time=2024-09-05T03:44:25.701286+0000, chain.objs.size()=1 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PGb4_fNkyoqt1PW3dk3Di1dG6Lu4Q5s_0 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16681376014534810817', time=2024-09-05T03:44:26.113223+0000, chain.objs.size()=1 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JfM9T6tXYWuLXsUEQqW9Y6p5bj_Yfr-_0 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12823800976672905103', time=2024-09-05T03:44:28.089465+0000, chain.objs.size()=1 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VLkRfFekP5aTSpqILu4ZnTJgkIX-8kq_0 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18421888113185102461', time=2024-09-05T03:44:28.145053+0000, chain.objs.size()=1 2024-09-05T02:16:22.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.312+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q89YBD8Nxf4gwcsA9JunfO9m9wcSKNM_0 2024-09-05T02:16:22.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1075247863316778572', time=2024-09-05T03:44:29.357225+0000, chain.objs.size()=1 2024-09-05T02:16:22.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gkH50ThkgoQjWJLF9O962U87GQnujP9_0 2024-09-05T02:16:22.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6058073085588656789', time=2024-09-05T03:44:31.729438+0000, chain.objs.size()=1 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iQBdIb45L6xr_o7IsqMyTfD2J2FN4TA_0 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1976585547847782528', time=2024-09-05T03:44:33.819566+0000, chain.objs.size()=1 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vgQG86ZAbFf3bhkPfvk4AGcjdy5GS5Z_0 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8418285004803181355', time=2024-09-05T03:44:34.079718+0000, chain.objs.size()=1 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.eUylMXc5rc5iZaiuixecnNqbPDXAz2__0 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1174024633464088306', time=2024-09-05T03:44:35.793806+0000, chain.objs.size()=1 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.zOU_d3b5L-rZXD8UYOReWHu5TyQtgb-_0 2024-09-05T02:16:22.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17353260622247747864', time=2024-09-05T03:44:35.906155+0000, chain.objs.size()=1 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-jEsi3BsfAuE7U_T7GCOPpCBqMO1un2_0 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7713040536636167854', time=2024-09-05T03:44:38.455344+0000, chain.objs.size()=1 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Fk7YrgALSgKUpfIlPVo3GHMM_tZsxeO_0 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17835389822161513597', time=2024-09-05T03:44:40.788452+0000, chain.objs.size()=1 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8UCObllYCPMykcW5Cmp7r5EpalZUgVA_0 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15692721028151996596', time=2024-09-05T03:44:41.494564+0000, chain.objs.size()=1 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Vwy0CcAfrhVihEqTnVevYUvHuatizt7_0 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10297247301634564865', time=2024-09-05T03:44:42.346789+0000, chain.objs.size()=1 2024-09-05T02:16:22.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SEfBU2naHisbL_JNL9C8da0rLlKjJ1V_0 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8948237306775332567', time=2024-09-05T03:44:43.863244+0000, chain.objs.size()=1 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.22NBmcWGPYOcR_35-TxY0rOBeA2SaXe_0 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5412533613999636054', time=2024-09-05T03:44:43.865064+0000, chain.objs.size()=1 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rjhGnxb3yYBzWkd7-5qhjwoldsrqopy_0 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3030392081587853725', time=2024-09-05T03:44:44.019585+0000, chain.objs.size()=1 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.e3KSJSOJDsfq_fzhWvCza5ZKKWaFbsV_0 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.20437587864924757', time=2024-09-05T03:44:44.201747+0000, chain.objs.size()=1 2024-09-05T02:16:22.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ohQirGWNoN7xnIPDjFKVQ42ALt7d8qp_0 2024-09-05T02:16:22.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2776139499884494489', time=2024-09-05T03:44:44.272837+0000, chain.objs.size()=1 2024-09-05T02:16:22.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4eqxFQIbG53azEXhLfoizqQUpLPuhx__0 2024-09-05T02:16:22.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14070245289025364981', time=2024-09-05T03:44:46.525700+0000, chain.objs.size()=1 2024-09-05T02:16:22.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.316+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cyINVFQIuWhT9NA86GXoItCVWk5Oj4F_0 2024-09-05T02:16:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13354287080685174878', time=2024-09-05T03:44:46.827174+0000, chain.objs.size()=1 2024-09-05T02:16:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lodKdGGDK8sAbBQK91taTePDlVBAgpm_0 2024-09-05T02:16:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5178643354565324831', time=2024-09-05T03:44:47.754367+0000, chain.objs.size()=1 2024-09-05T02:16:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9LRzv2ri4KKXE7fB0xPcUihJ73RHcul_0 2024-09-05T02:16:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3523982205802409255', time=2024-09-05T03:44:49.180958+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.z8luCBcXNQsCAmEs56ccL2dzXMWZT___0 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13466183081425700010', time=2024-09-05T03:46:33.612628+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wsyazboFQJY1eG2eYcuC5YSt4BTiFIu_0 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14378080867504954783', time=2024-09-05T03:46:34.689120+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iPY-7kwS_oW2p5Zs6bv1jRX9Kql5KV5_0 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14506345995026922746', time=2024-09-05T03:46:39.276143+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ROzvBpP_hTa4OSk1AAEeK6DLV7lbjW0_0 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17312191394081981170', time=2024-09-05T03:46:41.990522+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eVatkFnoW9FIJT00UV3GGFBwDS0vZiL_0 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5453972132785835599', time=2024-09-05T03:46:42.057559+0000, chain.objs.size()=1 2024-09-05T02:16:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UGE3Nwy2477OtYtENpQsYTsc-ABy_th_0 2024-09-05T02:16:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5938586634974009486', time=2024-09-05T03:46:42.456784+0000, chain.objs.size()=1 2024-09-05T02:16:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.320+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fjkLn5reknF1YPFOchlE4-Xm8DSdw9y_0 2024-09-05T02:16:22.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10058525438913258665', time=2024-09-05T03:46:43.796489+0000, chain.objs.size()=1 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Klu0rAdvmjBJz_lwNNqtxyHh2yuzD5m_0 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6122859841338929949', time=2024-09-05T03:46:44.674967+0000, chain.objs.size()=1 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cU3Q92iqltEc9uqPLa34BOIrd70UPck_0 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.628575538722057358', time=2024-09-05T03:46:44.772006+0000, chain.objs.size()=1 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.KTPgkj8-n79VO1ivskYcxyQjUwOWkTB_0 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3578908580077116619', time=2024-09-05T03:46:48.925617+0000, chain.objs.size()=1 2024-09-05T02:16:22.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.324+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QGTyGxECquE5tenWR8O6jwQamqCokww_0 2024-09-05T02:16:22.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.328+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9900708609195753526', time=2024-09-05T03:46:49.216406+0000, chain.objs.size()=1 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dsAejJlzGbvEy5-VtP20kokxP-fkXuX_0 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.328+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51078 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1145538445830881099', time=2024-09-05T03:46:51.183065+0000, chain.objs.size()=1 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mMKvc5c0AQYLhhICcaKYfcAg-mbZMWk_0 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7574658046996892238', time=2024-09-05T03:46:52.674781+0000, chain.objs.size()=1 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.R2sOoPsogqLrMzyNd9mJSqMkceNjRqb_0 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12417117726171049319', time=2024-09-05T03:46:52.828242+0000, chain.objs.size()=1 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ulLjcV4wX_3Qw8SVQip9XcHNvGPBUwa_0 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1804469079552996069', time=2024-09-05T03:46:52.830197+0000, chain.objs.size()=1 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.EnP6PC_u-kr7iq3rc8X7ByS6Xs7zxoN_0 2024-09-05T02:16:22.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1680023595121973222', time=2024-09-05T03:46:55.049151+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1-Ge5cZPbtkEmPW4YQo7wZvm-yDx3Uw_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.501264657321431269', time=2024-09-05T03:46:55.395922+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Pn-ULczzKbY1pS4uksP6mhfW7HmzL-I_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13211300957817009759', time=2024-09-05T03:46:55.464644+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8UboygxXgWKKBsxZMV9M_Fbpq4QittB_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15694147385067960508', time=2024-09-05T03:46:55.996697+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uTOf4qRduTBbcBQROeBkyJEceEMFQxA_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8986168289448923751', time=2024-09-05T03:46:56.263919+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MeE-2ybUss1bSHU5ob_-Fms3nxaXFTX_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3360610668592841820', time=2024-09-05T03:46:58.178212+0000, chain.objs.size()=1 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ry-s7OgnT8vsWXpF5UmrXrmxPaBTRH-_0 2024-09-05T02:16:22.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11655357142831399849', time=2024-09-05T03:46:58.933949+0000, chain.objs.size()=1 2024-09-05T02:16:22.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yP3XUULR2onle4SbnjmjiTKwYnHwBZ__0 2024-09-05T02:16:22.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8245496192771535138', time=2024-09-05T03:46:59.742697+0000, chain.objs.size()=1 2024-09-05T02:16:22.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1SaMd7NVqEoYJpIr31rzi24jhlI6J3G_0 2024-09-05T02:16:22.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16435791790493017984', time=2024-09-05T03:46:59.744267+0000, chain.objs.size()=1 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JbhujPrNgc1hymt6lEqzY_GL1I3SLuO_0 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1767213822929478118', time=2024-09-05T03:47:00.442578+0000, chain.objs.size()=1 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wVJ484M2opzkOTecv9NTY7LEAB2tFb5_0 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1224897916316072671', time=2024-09-05T03:47:00.796325+0000, chain.objs.size()=1 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7tFaLUM3YrgV8HSxJ0ZKQf_51r8yOoE_0 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9832681410554230233', time=2024-09-05T03:47:00.906680+0000, chain.objs.size()=1 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hMeq3zhDiN0I1jnO_4rgUSrLz9avDD9_0 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9926671183146471059', time=2024-09-05T03:47:01.173398+0000, chain.objs.size()=1 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LfSXUyC3Oo023_bY7xNNAPPUhPZmnX7_0 2024-09-05T02:16:22.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14691114971198939142', time=2024-09-05T03:47:01.980064+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Lmsg1cSTamJ3EU-L13H6DgbK6RhBwBU_0 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7051471614854873463', time=2024-09-05T03:47:01.981796+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.332+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MfOaJ_DQGV1LQvhNj-RU5kvJtbH04Ms_0 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10453412853828643878', time=2024-09-05T03:47:02.417781+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V5TeGkZRQAb-8ZmpfCCsXjsALF3omIs_0 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12741297640686852520', time=2024-09-05T03:47:02.419459+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.q6B5kg7ZvI6l44QWN1dcGx2wzWHGbwW_0 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3534263709969358316', time=2024-09-05T03:47:02.420700+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7zIelevemRjSLjYtPZ3OOXqY_swF4IV_0 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.726348567157584474', time=2024-09-05T03:47:03.637181+0000, chain.objs.size()=1 2024-09-05T02:16:22.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aIDVCrgAO7WPyZXpzRF8q4zNnDvUeoB_0 2024-09-05T02:16:22.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14467199224299285659', time=2024-09-05T03:47:03.748363+0000, chain.objs.size()=1 2024-09-05T02:16:22.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XjjbpWXQ_LxrHBY2Ap9soGxDvaxCXey_0 2024-09-05T02:16:22.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12119063303580330043', time=2024-09-05T03:47:16.739458+0000, chain.objs.size()=1 2024-09-05T02:16:22.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.332__shadow_.ti6OYVTPQbNlOSBvnI0TEGh3V-J58PV_0 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18399721823962919569', time=2024-09-05T03:47:37.394503+0000, chain.objs.size()=1 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.346__shadow_.6P8ZjrjI5YydY2_7DX4QS4Loj2H4e32_0 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1230343354690068615', time=2024-09-05T03:51:33.779248+0000, chain.objs.size()=1 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.496__shadow_.sB0gJpRHmsncO9PhHbB6MLT8ZiSwsFt_0 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11760056392808367653', time=2024-09-05T03:51:39.337972+0000, chain.objs.size()=1 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.499__shadow_.csvIoCTYkp7Q7eniioaTv0RsmLY9a_s_0 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10162885778958719015', time=2024-09-05T03:52:18.134672+0000, chain.objs.size()=1 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.516__multipart_mymultipartcopy.2~_UumisniIdst3YVCRx9yhzxb1iBhtpv.1 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17944394761154521684', time=2024-09-05T03:55:12.017929+0000, chain.objs.size()=2 2024-09-05T02:16:22.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.528__multipart_mymultipart.2~gLkYYkB7RmmmQt5V2U5qTxk94NDzIRQ.1 2024-09-05T02:16:22.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.528__multipart_mymultipart.2~gLkYYkB7RmmmQt5V2U5qTxk94NDzIRQ.2 2024-09-05T02:16:22.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15917676055748429394', time=2024-09-05T03:57:07.451692+0000, chain.objs.size()=1 2024-09-05T02:16:22.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.562__shadow_.wzZX1ujMOf9WGg3gBnkG4RLOeVT6P7r_0 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1902081236582071696', time=2024-09-05T03:57:25.900240+0000, chain.objs.size()=1 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:Fdkgdo9T0YCeX96Vxci5mn0AR4Oh5bf_.LgBEziLGRllS023VE3XH332EDW3gyCX_0 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15637354364744396554', time=2024-09-05T03:57:58.980343+0000, chain.objs.size()=1 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow_.M5kUtijW1yQ3tR0YqaVt7bFDnt2goHn_0 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6723068307835406651', time=2024-09-05T03:58:01.021459+0000, chain.objs.size()=1 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:Vy8FIi7M.l3lhOs.zBdDJXLH8eqLAkb_.GCm0DEti4NRAMCrUqn7rMglQpktgx_D_0 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2896896815497288980', time=2024-09-05T03:58:05.736260+0000, chain.objs.size()=1 2024-09-05T02:16:22.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.336+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:yo6mnPXERfGLmM815aQlX.X8hZ1-nhg_.r0oIUDP1GDk1kiErXYvtRatqBdHGEQJ_0 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2557996025895313991', time=2024-09-05T03:58:20.097406+0000, chain.objs.size()=1 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:MFl8ECotL6438f-Ycw0iBLk0jRGLJzG_.Zr1gLIQnYgavtvw394X9wEBqkTW8LaL_0 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11730814469700709792', time=2024-09-05T03:58:36.197895+0000, chain.objs.size()=1 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:lN7fLpSppnJVoGoj5coIhygpKgSnlxo_.hjETxXmwwG5RA2M0ziEZlrtz819ELY-_0 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5016329798486481435', time=2024-09-05T03:58:46.387104+0000, chain.objs.size()=1 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:-2awHQPpnAYWvumuDqXpTHz6AeAOtAF_.dRacC0Mu_m00XDiD_kMFIq7LEVwXnlk_0 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6435499142107116623', time=2024-09-05T03:59:42.230656+0000, chain.objs.size()=1 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.586__shadow:YXvCfncIHTg4Q1eyAOEZS55-xbdbnRs_.WKlsJxhlvAxFmY06LuZil6chUm0x2b7_0 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2756424520152049214', time=2024-09-05T04:06:29.922292+0000, chain.objs.size()=1 2024-09-05T02:16:22.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.340+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.671__shadow_.oDRXQesKoW3h5CpyM3EJ9tEINSP9my4_0 2024-09-05T02:16:22.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.344+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.348+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-05T02:16:22.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.348+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.348+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51445' 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_dzKyZA-7_HbwKKYomLTvcK6q7zYs_JT', time=2024-09-05T03:32:59.958164+0000, chain.objs.size()=1 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.cIU6J2MQWyGWWv2HWirHW9yWmCqRFFl_0 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7537839856108103818', time=2024-09-05T03:33:48.091553+0000, chain.objs.size()=1 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.183__shadow_.OTP8wp5iLnVcsJFvmCqDYJ3VVoYImz5_0 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9270987707549522753', time=2024-09-05T03:37:43.861136+0000, chain.objs.size()=1 2024-09-05T02:16:22.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.241__shadow_.7rF1NQ4z36Zhzusdz1SK21DvA-vAwzb_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17772434078985097204', time=2024-09-05T03:37:51.116100+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244__shadow_.yrEWw12-huF35uAzfrcnOP8c0V_bJcj_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18435643886535125654', time=2024-09-05T03:38:13.660879+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.256__shadow_.qUtqXljjRCVKDa7fvMCPi8o6BucDVfA_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1215835410716346748', time=2024-09-05T03:38:22.614158+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.261__shadow_.VtJWKjWd20UKtMQsHxVsSW7eQZ4CGs6_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3922619732039089156', time=2024-09-05T03:40:04.622381+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.p-5Wjp6QAnN0tENE8jTdXShX9krUj1h_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7221002950021693157', time=2024-09-05T03:40:07.020433+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZG22SnIoWMoRbtfqqDV7EWxUsL6iuEi_0 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6447992958290871672', time=2024-09-05T03:40:07.545151+0000, chain.objs.size()=1 2024-09-05T02:16:22.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.J3VlPeD_5q9Wk4THIl1BgxZj_DFoj1F_0 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9356055968684279371', time=2024-09-05T03:40:08.864209+0000, chain.objs.size()=1 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.L5oaxxjkGnuLzG5GuARqwQTdmf9T1rC_0 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7942451084355246745', time=2024-09-05T03:40:09.022248+0000, chain.objs.size()=1 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CPsDk13Xh7926av6J_RpUznVzujlLNd_0 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1703798031468484188', time=2024-09-05T03:40:11.377970+0000, chain.objs.size()=1 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.P9lm24pJmy3uCLF5QCexPgfAjiJtEXW_0 2024-09-05T02:16:22.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16579050005963595915', time=2024-09-05T03:40:12.125389+0000, chain.objs.size()=1 2024-09-05T02:16:22.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gj2whzwtom3aE_tEIWl9Zv_uEpR0lX7_0 2024-09-05T02:16:22.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14359370602301997335', time=2024-09-05T03:40:13.205479+0000, chain.objs.size()=1 2024-09-05T02:16:22.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gBbzPXy-h3eYVJuKW8cmfmpOttbv3tu_0 2024-09-05T02:16:22.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3715451772085787794', time=2024-09-05T03:40:13.665865+0000, chain.objs.size()=1 2024-09-05T02:16:22.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.352+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6pxGOIS4oo8rGRb5Lh6NmKlkHPrp-Lj_0 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5888494118861789555', time=2024-09-05T03:40:13.913628+0000, chain.objs.size()=1 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Zso6LOu3ggzPw6sFd7yXKD-LA5efpKA_0 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17920051655950520441', time=2024-09-05T03:40:15.285592+0000, chain.objs.size()=1 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2ZiAXgQkQLQrB_BMHi-Sb6aC3rs1JFd_0 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17433287284616212447', time=2024-09-05T03:40:17.543135+0000, chain.objs.size()=1 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BGcMuHm6RRJmdbotfQkdQLAHf5zI5sE_0 2024-09-05T02:16:22.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16399668925890937328', time=2024-09-05T03:40:24.417782+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BxgC37f59JtqMt9ZIrSAn66rs_puNsb_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.276169249767869508', time=2024-09-05T03:40:26.269219+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kmlbPn-OHrBzIp01vhCqCI6sIeeCEV5_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9418955808128903268', time=2024-09-05T03:40:26.805055+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GNCX4ZvbrW34SDlCWI3gOysYcadpd2I_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9366784749950595172', time=2024-09-05T03:40:27.480209+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.41bSRQwDbO_qZtTbfVp6nSZy6Spm2lS_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7059641537661264954', time=2024-09-05T03:40:34.275831+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FYjXEfpPXT_c3NOlB6GWNGcMZFvVo3j_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16550872515078022905', time=2024-09-05T03:40:34.836795+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Dz_vyJlnb-VZB4KGC1wqEBm8J1rVUcj_0 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4227471805319144816', time=2024-09-05T03:40:35.947738+0000, chain.objs.size()=1 2024-09-05T02:16:22.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.F818L5L3EjgJFCmKFC-q_Ym5eLQkd6B_0 2024-09-05T02:16:22.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15750697417862751159', time=2024-09-05T03:40:36.179242+0000, chain.objs.size()=1 2024-09-05T02:16:22.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.356+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.73VVuszlrMPOfgT0TbbIdaEKgMMl_iw_0 2024-09-05T02:16:22.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1005799375860360447', time=2024-09-05T03:40:41.796775+0000, chain.objs.size()=1 2024-09-05T02:16:22.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.265__shadow_.BoN_bVj-rcIwfY8UChzqSYDQdMsF7DK_0 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4679905096234470777', time=2024-09-05T03:41:01.259532+0000, chain.objs.size()=1 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.276__shadow_.RUtO3m5AYGTIsu2rvHQnwmvDdgTz5cV_0 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.863319586354036374', time=2024-09-05T03:41:18.210983+0000, chain.objs.size()=1 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.285__shadow_.t_FGtbmt1972M-a1BkvUGIdQjtCbiY8_0 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.115034261265220619', time=2024-09-05T03:41:39.991711+0000, chain.objs.size()=1 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.T9heDrUPYcw0lnrghlRT-9iAlachrmf_0 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16707616872331730355', time=2024-09-05T03:44:20.623142+0000, chain.objs.size()=1 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.44ay5eCq7XTnU2RaSpNUBnXbyJSfLri_0 2024-09-05T02:16:22.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3247111146443964376', time=2024-09-05T03:44:20.845613+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h3nXbocaSGFphcz99rhnajapyn-Hjvi_0 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11099971600000240586', time=2024-09-05T03:44:21.534358+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KcVMPA8KFXV8yv4FxoSSKYq34uNPFdC_0 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5184045144992613550', time=2024-09-05T03:44:24.322842+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AQGUE_JcXd3eNQK58vV_wJantQYXABA_0 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14387538523925551777', time=2024-09-05T03:44:25.073852+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KYGrbAAddGBJWwzziCCNH6l3tsqYkGF_0 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15016436928603232226', time=2024-09-05T03:44:25.234850+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dJMlM60IaUCAbbcq5gOppg6OxljYUcc_0 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5092941920101954369', time=2024-09-05T03:44:25.702593+0000, chain.objs.size()=1 2024-09-05T02:16:22.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.360+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kbo_PLNW6X6KWtBkTuRZE4q8EXXJ2yw_0 2024-09-05T02:16:22.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10121175148242602581', time=2024-09-05T03:44:25.817309+0000, chain.objs.size()=1 2024-09-05T02:16:22.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.B1Z1JBgsLJnTc_WYatlbnHwkb10JVQc_0 2024-09-05T02:16:22.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15258916732432484752', time=2024-09-05T03:44:26.253033+0000, chain.objs.size()=1 2024-09-05T02:16:22.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NELiavPpy2BDqvrC7EJdK5tpHjJiXvQ_0 2024-09-05T02:16:22.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9015700187395283361', time=2024-09-05T03:44:27.671559+0000, chain.objs.size()=1 2024-09-05T02:16:22.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.364+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.g4a6WKN9tdLl6j2Z65Ckvc2aIq8zAef_0 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12448670544451325392', time=2024-09-05T03:44:28.213208+0000, chain.objs.size()=1 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9noW7eDSUX1lMi0jwvT7O2Sk_S5_LwT_0 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5588021593580837401', time=2024-09-05T03:44:28.521911+0000, chain.objs.size()=1 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RE16JdyMolaqfiWpVZbWhVUDONvq3QH_0 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11109939603461025283', time=2024-09-05T03:44:28.524184+0000, chain.objs.size()=1 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fRW8dh50ztdUqjQiyVIrJictuEM1XOw_0 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14641233219371195249', time=2024-09-05T03:44:28.771633+0000, chain.objs.size()=1 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qUm6fx5uRkrFjIUKAXxQEyyV_xxQtT9_0 2024-09-05T02:16:22.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1888333514211229994', time=2024-09-05T03:44:29.925883+0000, chain.objs.size()=1 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5V5QiB9s7hgTgGwO7CL1MsqOCSHK50a_0 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2541153031663878568', time=2024-09-05T03:44:31.800834+0000, chain.objs.size()=1 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CLjBx6cGCl8HkIN4eVgsJQdPJx4Iy6U_0 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9932635751837507476', time=2024-09-05T03:44:32.593974+0000, chain.objs.size()=1 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.p7stD1Pb8ZhaS6ry5WTvDZwvzMyIp9k_0 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7354716301225761411', time=2024-09-05T03:44:33.457783+0000, chain.objs.size()=1 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ObZa4tMtNGZIbmXBBsTI0VfK_0if7oj_0 2024-09-05T02:16:22.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17320348614423176360', time=2024-09-05T03:44:36.821938+0000, chain.objs.size()=1 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.368+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WkH1UI96bNy7BQ_I9dJB4K2Ilq_pDK1_0 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10800340776784389935', time=2024-09-05T03:44:38.724577+0000, chain.objs.size()=1 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HAu00QP5Pk1QLvMiCH8bezEm8ROIe7I_0 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6635508548887434974', time=2024-09-05T03:44:40.304281+0000, chain.objs.size()=1 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sGMWIhNuG_GiRFzBok2H6YElvPXZA2R_0 2024-09-05T02:16:22.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18253611227522984029', time=2024-09-05T03:44:41.405951+0000, chain.objs.size()=1 2024-09-05T02:16:22.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Tx_n3tVuwKQtjz36zSQqVst7h9f_aAu_0 2024-09-05T02:16:22.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7171359706036760803', time=2024-09-05T03:44:42.053516+0000, chain.objs.size()=1 2024-09-05T02:16:22.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.p5BlrqRE4yJwZrTFSgjUQRMs3KCntA7_0 2024-09-05T02:16:22.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7444047090912437112', time=2024-09-05T03:44:44.295661+0000, chain.objs.size()=1 2024-09-05T02:16:22.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G_ymVOUm_b6IL5CJwpuuNUYVvE33wYM_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15431842520633041927', time=2024-09-05T03:44:44.600320+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UuqceSbBdMRUbGaQscQa-W8ltza_KGX_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16616434323069338260', time=2024-09-05T03:44:44.854865+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0heTDGw5ApOo0N7TIHW4Ir9_yhXPXCf_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12884113376574075713', time=2024-09-05T03:44:48.022812+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BuXugBhX8jyiosVrvQl0bqrZTYy0yLa_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16723388976807218756', time=2024-09-05T03:44:48.672549+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QOc9FenyHIBG66yyOa6tQOIpUW7tzTI_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17535521285678019017', time=2024-09-05T03:44:49.201836+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uFYW0eNlaePEnMQO-Df1BP8zTGRXtFE_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5757872109592502838', time=2024-09-05T03:44:50.155897+0000, chain.objs.size()=1 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uCW2_CigzXXOb6BOIiXs2uRPRHtRtID_0 2024-09-05T02:16:22.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17683885728941022018', time=2024-09-05T03:46:34.276613+0000, chain.objs.size()=1 2024-09-05T02:16:22.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.372+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PsQjbNFVDZWwpX3y3y7fvyWsyqs1oh0_0 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9695459245474784083', time=2024-09-05T03:46:35.179339+0000, chain.objs.size()=1 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gnPidapVl-AlfypL5JfbG4_iHa6r4Ro_0 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2099773775991012042', time=2024-09-05T03:46:35.443455+0000, chain.objs.size()=1 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NeSaqjNW8krM68V7SIt6tw2DNTGI2tP_0 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8727741196647228896', time=2024-09-05T03:46:36.319849+0000, chain.objs.size()=1 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QyF9FKfP3w1Gi0UBFHG5om0xq_PxMsF_0 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7964400050826570137', time=2024-09-05T03:46:36.444042+0000, chain.objs.size()=1 2024-09-05T02:16:22.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.376+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HTdJbql9PT7N1qm7SIsafJsZDnlndiJ_0 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f576591b640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.99:6824/2421217256,v1:172.21.15.99:6825/2421217256] conn(0x55f30108bac0 msgr2=0x7f563008bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4991665180252142491', time=2024-09-05T03:46:38.659899+0000, chain.objs.size()=1 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.c3YJvy3jQwqAjyIgrxNyFqu_4x-lMDQ_0 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3424774359299150213', time=2024-09-05T03:46:39.793682+0000, chain.objs.size()=1 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qHVjgBi19yRmqmRnrwGgQikAUJKvLno_0 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7283368536451086555', time=2024-09-05T03:46:42.459021+0000, chain.objs.size()=1 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hEhOUPq7IWx7YkpcmRJLzyTREK-NG5O_0 2024-09-05T02:16:22.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3799309055567530035', time=2024-09-05T03:46:43.118183+0000, chain.objs.size()=1 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CX5R_cJj_qZFusvyI6FJzH-v5V9diVf_0 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1471478638550620153', time=2024-09-05T03:46:43.765353+0000, chain.objs.size()=1 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.38O18EpgSXG4VO0af3LJVDuqiC_8Cwq_0 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6626710037665913600', time=2024-09-05T03:46:44.098701+0000, chain.objs.size()=1 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aJdVuZBaIQHavBKVRmOaTETgGTcbq-m_0 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13438590292636016181', time=2024-09-05T03:46:45.033073+0000, chain.objs.size()=1 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dRsPurlxQ774QOpqRRNpHxEbQxaGvj7_0 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12553862538407267658', time=2024-09-05T03:46:47.468485+0000, chain.objs.size()=1 2024-09-05T02:16:22.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.A1NXaGinM3M9d0R2LGXpebU8KwiTADm_0 2024-09-05T02:16:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16044905070136786217', time=2024-09-05T03:46:50.925352+0000, chain.objs.size()=1 2024-09-05T02:16:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Or2Cxh-mHQ3F-lTA6qiXDE5NDFY12cc_0 2024-09-05T02:16:22.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16560019872715647764', time=2024-09-05T03:46:51.020938+0000, chain.objs.size()=1 2024-09-05T02:16:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5q3yBM74AVXaZAVK1_JWqN06CEZhMrB_0 2024-09-05T02:16:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11750379742881558725', time=2024-09-05T03:46:52.076125+0000, chain.objs.size()=1 2024-09-05T02:16:22.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.380+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DXz3fzRTUGmQymMO-07mVuoUqQ8vmE3_0 2024-09-05T02:16:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5363061512915821888', time=2024-09-05T03:46:54.571921+0000, chain.objs.size()=1 2024-09-05T02:16:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TncaZ6c_sve4a9ERftw6m7g3wvmOHSM_0 2024-09-05T02:16:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4743351745129473864', time=2024-09-05T03:46:55.006383+0000, chain.objs.size()=1 2024-09-05T02:16:22.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LvY3z06bbJ951B7OvxX1lIq-UoA72r1_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11750449822263841474', time=2024-09-05T03:46:56.731637+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.i2GX43d8C0KD2LMxvgV6z409Uxrmmu2_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17411213851166133628', time=2024-09-05T03:46:57.200516+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._BTBA06cuW-0VUAGQ1W6UEZxmwWn2ds_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3266177933229644331', time=2024-09-05T03:46:58.221455+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vy9V0MB95_E2xv1fajAvIYR5bPUqdcI_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3882059152240635036', time=2024-09-05T03:46:58.463381+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9OR6ZbgNpCOleSIMXMsUhh9UUbJC49y_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14674165798102606040', time=2024-09-05T03:46:58.575614+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.K1PJngcl5lMUt1yTdukdZWidMJSVgEB_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14927106257029081440', time=2024-09-05T03:46:58.935187+0000, chain.objs.size()=1 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aVaowTEYDNoyNIsUfjxnpBObQpxBMtN_0 2024-09-05T02:16:22.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2253079553371673767', time=2024-09-05T03:46:59.687452+0000, chain.objs.size()=1 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZcsPYwZoxsRXsZYwmf6ZuHx85iez-4S_0 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16407514367821365072', time=2024-09-05T03:47:00.402727+0000, chain.objs.size()=1 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zW0mpfFhGGj7u18yFgnrrzUjqfJAUt7_0 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4314399123236173928', time=2024-09-05T03:47:01.174107+0000, chain.objs.size()=1 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.384+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IFOlp6QzOr5ePwVBJCnBQ8JMQsGCIak_0 2024-09-05T02:16:22.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.388+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2434537201957487406', time=2024-09-05T03:47:01.986475+0000, chain.objs.size()=1 2024-09-05T02:16:22.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.388+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sYPiCVEyuSTsD9p151TaYV6Ny26xl0W_0 2024-09-05T02:16:22.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.388+0000 7f576511a640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f5630081660 msgr2=0x7f5630083a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8087617102720879817', time=2024-09-05T03:47:02.624193+0000, chain.objs.size()=1 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.h-Q0f1UMVSwfUSWMzqPmmZpLxipvwq3_0 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5839729767354803758', time=2024-09-05T03:47:04.558086+0000, chain.objs.size()=1 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9I-rHbgahwsqR-Z7JqSsBjTeSRS3vya_0 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18375910422691111114', time=2024-09-05T03:51:27.705843+0000, chain.objs.size()=1 2024-09-05T02:16:22.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.491__shadow_.-yo8Jzf7d60Hn_xatZNFV320yQXKIv1_0 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12261330681669330627', time=2024-09-05T03:52:09.255679+0000, chain.objs.size()=1 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.511__multipart_mymultipart.2~weL3um8ZjB8GsF0PNY8WMfcXbDG9q30.1 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11310575597186051321', time=2024-09-05T03:52:12.880075+0000, chain.objs.size()=2 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.512__shadow_.MQGN7YzhA7xuz0cSll-OAGB-jNj-UwK_0 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.512__shadow_.MQGN7YzhA7xuz0cSll-OAGB-jNj-UwK_1 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6849328765159386002', time=2024-09-05T03:53:09.252851+0000, chain.objs.size()=3 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~d69c1b2NVuygnlPmnlFy5KMG6w20eTw.1 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~d69c1b2NVuygnlPmnlFy5KMG6w20eTw.2 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~d69c1b2NVuygnlPmnlFy5KMG6w20eTw.3 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3249075737841015455', time=2024-09-05T03:53:59.953667+0000, chain.objs.size()=6 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.1 2024-09-05T02:16:22.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.392+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.2 2024-09-05T02:16:22.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.396+0000 7f576511a640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.204:6816/4289187000,v1:172.21.15.204:6817/4289187000] conn(0x7f57600ef3d0 msgr2=0x7f563008e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:22.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.KSto1LPAkVj3ttcKr1ljsoE6Cf6tht5D.3 2024-09-05T02:16:22.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.4 2024-09-05T02:16:22.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.396+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.5 2024-09-05T02:16:22.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.6 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2822286890159282802', time=2024-09-05T03:58:56.604834+0000, chain.objs.size()=1 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:QrPCcYU.ssLX2p9JwRgEk0X5d6KKdeM_.IAbYLKZ0nFBLhAvvbgX4X7E5_o7zSkg_0 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4325167899550926401', time=2024-09-05T03:59:25.201091+0000, chain.objs.size()=1 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:shcCBnLlGReQOR6IGIFrU.yiQQlmeUO_.no_0UFUU3JNshhh9D3wGYhD5mpQzsYu_0 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12394260326205547902', time=2024-09-05T03:59:42.344054+0000, chain.objs.size()=1 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.586__shadow:rkzyhPXS8-niX0cJ5HRZD0PYYJmNwtf_.OVczOKHh0f5IAzi56mhoM8DJqeGcnD3_0 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8102292330537422637', time=2024-09-05T04:01:50.839681+0000, chain.objs.size()=1 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.616__shadow_.nhW_vmeKrooKaQlVrIYbay13_w4m5Gq_0 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12071103004160503753', time=2024-09-05T04:03:54.760169+0000, chain.objs.size()=1 2024-09-05T02:16:22.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.400+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.618__shadow_.8o_LlfImURPnEwE28S1_7Uot7aIGxxm_0 2024-09-05T02:16:22.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.404+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51445 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12285422945935401946', time=2024-09-05T04:05:48.842377+0000, chain.objs.size()=1 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.656__shadow_.k7Rp4PtQpLAyeTOoPjcD_biObEW3jTk_0 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16543945758808952614', time=2024-09-05T04:06:12.811491+0000, chain.objs.size()=6 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.1 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.2 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.3 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.4 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.5 2024-09-05T02:16:22.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.408+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.662__multipart_foo.2~DRXIYGkaxm1IBXUL4uci7EBAUiKL-fs.6 2024-09-05T02:16:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.416+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.416+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-05T02:16:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47763' 2024-09-05T02:16:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_UD2OSxNSPhfXcXjdmQWorUyu4Bhc6Ki', time=2024-09-05T03:32:56.076401+0000, chain.objs.size()=2 2024-09-05T02:16:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.ynhns0IjznCmkhxDOKWQxEZi8HIoJB-_0 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.ynhns0IjznCmkhxDOKWQxEZi8HIoJB-_1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_y-txWC9QKx7uIRbbbCIPeW8hkLiCe5T', time=2024-09-05T03:33:08.175500+0000, chain.objs.size()=2 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.8ZonrJUtRwpMS40u-s4F0s_VLxi4Iiz_0 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.8ZonrJUtRwpMS40u-s4F0s_VLxi4Iiz_1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8887014321584530026', time=2024-09-05T03:33:56.455845+0000, chain.objs.size()=1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.189__shadow_.6Y2Jw_yM4OXCYJfaP6hEVXOkqFZ1bOy_0 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15307001056445973151', time=2024-09-05T03:37:58.615495+0000, chain.objs.size()=1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.248__shadow_.VoEszLAp-TOb98nrKHahDS_S0LMd9Z7_0 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12164674649824510055', time=2024-09-05T03:38:00.493222+0000, chain.objs.size()=1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.249__shadow_.s9tfhT63XaX4PGOoFhbqP2WRjBxfmwK_0 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17771194481593545696', time=2024-09-05T03:40:04.800711+0000, chain.objs.size()=1 2024-09-05T02:16:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Z3EGIXeWlbiUFfsswv3ZVdkw9NPAJ22_0 2024-09-05T02:16:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10813807988351026259', time=2024-09-05T03:40:04.904021+0000, chain.objs.size()=1 2024-09-05T02:16:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UgTvNLdvcRsqR36DC1cIdjdsEjm8Gng_0 2024-09-05T02:16:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4124114906335420470', time=2024-09-05T03:40:05.302402+0000, chain.objs.size()=1 2024-09-05T02:16:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Nh8v0Edditom3tGKC63c1LpqSOORtoG_0 2024-09-05T02:16:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6193455847809976301', time=2024-09-05T03:40:06.513609+0000, chain.objs.size()=1 2024-09-05T02:16:22.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bw6CJuHZBmyvMiBbAzsRZ5XEAI6dU___0 2024-09-05T02:16:22.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9236057285524063437', time=2024-09-05T03:40:08.818132+0000, chain.objs.size()=1 2024-09-05T02:16:22.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.420+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HohbbfEszj6n7Vi-0C11HRpxVYBLef3_0 2024-09-05T02:16:22.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16823271619492871688', time=2024-09-05T03:40:09.271360+0000, chain.objs.size()=1 2024-09-05T02:16:22.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Jn6O8PehbhdwAdyuP34US-adKS5atCc_0 2024-09-05T02:16:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.424+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14202837563387882797', time=2024-09-05T03:40:09.425671+0000, chain.objs.size()=1 2024-09-05T02:16:22.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.424+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GGajI8Ns5kQz1Y_-ELvqyFAD0CAQWZ1_0 2024-09-05T02:16:22.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.719197414271162501', time=2024-09-05T03:40:11.913734+0000, chain.objs.size()=1 2024-09-05T02:16:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ltfp_Q-yiGzXGE3rmCM3RdqzjhTL84p_0 2024-09-05T02:16:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3928047234489318450', time=2024-09-05T03:40:12.111553+0000, chain.objs.size()=1 2024-09-05T02:16:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.k6jubYLYauYGxU8SSbZPrsMmDbAwbf-_0 2024-09-05T02:16:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6843910810496187552', time=2024-09-05T03:40:13.681919+0000, chain.objs.size()=1 2024-09-05T02:16:22.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qkQ5DGsQC6pjUUtsjoT0wtp8hHr-rr0_0 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16392403515242913490', time=2024-09-05T03:40:15.743983+0000, chain.objs.size()=1 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PDuLBTUCcLQSWGHbWP0Lu7t5Pq6dn8G_0 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8049248863185018785', time=2024-09-05T03:40:16.195103+0000, chain.objs.size()=1 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7fNe_RtwF_q02F4PrQTuTfJ44Q_6K6b_0 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9944297390120670077', time=2024-09-05T03:40:16.487139+0000, chain.objs.size()=1 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BFehzIEPno5Ak85sC-Yl_cZW49K_8mc_0 2024-09-05T02:16:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15723000926276175154', time=2024-09-05T03:40:19.165915+0000, chain.objs.size()=1 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rkLnLSoG5Q-40hm2HEDiZzaJU3-XC1f_0 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4706875749847885988', time=2024-09-05T03:40:20.508799+0000, chain.objs.size()=1 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.A73pRtrtYXW4wcROZUajFOz1hnzwE6i_0 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16315552651707062834', time=2024-09-05T03:40:22.148615+0000, chain.objs.size()=1 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rrBWgp7O_eDuY1nfg7X1rMMwYHcb1RC_0 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1899403977832154878', time=2024-09-05T03:40:22.295591+0000, chain.objs.size()=1 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.t1s51G4VNac7deQh06N-EqnMUndNjr0_0 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12241653321849821006', time=2024-09-05T03:40:22.486667+0000, chain.objs.size()=1 2024-09-05T02:16:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ft-SCJwm3FHTXYXxicZv2x9DDSvc_n-_0 2024-09-05T02:16:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.954968896987422084', time=2024-09-05T03:40:22.899449+0000, chain.objs.size()=1 2024-09-05T02:16:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HImdtS_q70V020-aPzqx9FoDjX3lBVA_0 2024-09-05T02:16:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16397482459042083195', time=2024-09-05T03:40:24.533564+0000, chain.objs.size()=1 2024-09-05T02:16:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.YezJvBEwOfCTuRYWlRya8yVrY3FmbV1_0 2024-09-05T02:16:22.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12502008921598438375', time=2024-09-05T03:40:24.968160+0000, chain.objs.size()=1 2024-09-05T02:16:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bkd9f4tE7uXpjSEqEC6EH2S80HfSTFL_0 2024-09-05T02:16:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2759830833830805420', time=2024-09-05T03:40:25.884221+0000, chain.objs.size()=1 2024-09-05T02:16:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MCKcOuELJalGkFq24QX0up6hvB9YcWW_0 2024-09-05T02:16:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17121512065015347989', time=2024-09-05T03:40:27.057646+0000, chain.objs.size()=1 2024-09-05T02:16:22.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KyAxHGtTVtCbVyrjqzrCeqT5nMC94kv_0 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9695647381546986860', time=2024-09-05T03:40:27.481861+0000, chain.objs.size()=1 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Aj-CZpZ1mMGJT00BHUb5gt62o14Oydm_0 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16193386193541918873', time=2024-09-05T03:40:28.625989+0000, chain.objs.size()=1 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Qlz_UGtBPTldteeLt2N-QrDAHtSpwvz_0 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.883297905477048033', time=2024-09-05T03:40:29.011242+0000, chain.objs.size()=1 2024-09-05T02:16:22.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ag7CYB7l-gyE31x3EDGRHKnitbo1lDq_0 2024-09-05T02:16:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6580180482505493507', time=2024-09-05T03:40:29.935083+0000, chain.objs.size()=1 2024-09-05T02:16:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ifeV94vdsGDvJ7Zx-Y1LKykOTpCf7kA_0 2024-09-05T02:16:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4345870785326830678', time=2024-09-05T03:40:30.522023+0000, chain.objs.size()=1 2024-09-05T02:16:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hspHQ5SuKlS70HhqTnbqD4FNZo_QHQN_0 2024-09-05T02:16:22.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11344029518159969175', time=2024-09-05T03:40:30.809432+0000, chain.objs.size()=1 2024-09-05T02:16:22.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.428+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QE2XUZTEHgRTopvBry--9EFRh7cd5o9_0 2024-09-05T02:16:22.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.432+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8541898702178694200', time=2024-09-05T03:40:31.666723+0000, chain.objs.size()=1 2024-09-05T02:16:22.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.432+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.COcePKxwl5NulzWvsCenOaNGV_O3ccX_0 2024-09-05T02:16:22.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7625496018498911118', time=2024-09-05T03:40:31.831413+0000, chain.objs.size()=1 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ztn2faiTQco97InbTpxBTAjktC-cVtN_0 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3711277385542478449', time=2024-09-05T03:40:32.822639+0000, chain.objs.size()=1 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AQSVFxPWBMUxzJIVV7ONT8r0PmekTOy_0 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10368855002011588100', time=2024-09-05T03:40:33.845426+0000, chain.objs.size()=1 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OtU4CXVO0x-IqRm6m2zXog7TJdSTDIs_0 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18250106092315882122', time=2024-09-05T03:40:34.986738+0000, chain.objs.size()=1 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3X1u8SLE_YkF8RSArhdEo01_EXtA0fz_0 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8991044876427907719', time=2024-09-05T03:40:35.105190+0000, chain.objs.size()=1 2024-09-05T02:16:22.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._zxe-3Brx9bteUGeZFEgWebvjkbMyEt_0 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17884073154918909063', time=2024-09-05T03:40:40.058355+0000, chain.objs.size()=1 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.264__shadow_.s_wNxVVxC-_47AaPksj2uSqqA3FdHQD_0 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6474094436865890151', time=2024-09-05T03:40:41.769078+0000, chain.objs.size()=1 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.265__shadow_.S0rl1sAhqbgE4iRv-LFq6IdhNA-ANR2_0 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11556990695595661631', time=2024-09-05T03:41:20.205271+0000, chain.objs.size()=1 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.286__shadow_.YWJjMpxWgHiET6q_fUb5AfHLBfMebOz_0 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7697029514145281391', time=2024-09-05T03:41:22.060252+0000, chain.objs.size()=1 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.287__shadow_.ewbF2ddsQ0jjD3IU7Dvt6fB3NbbqLV4_0 2024-09-05T02:16:22.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16283401524768027372', time=2024-09-05T03:41:23.911980+0000, chain.objs.size()=1 2024-09-05T02:16:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.288__shadow_.vRxKoIHgT8eAxEycPQ2t11PMhYRBnt-_0 2024-09-05T02:16:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3252653477890932839', time=2024-09-05T03:41:27.701422+0000, chain.objs.size()=1 2024-09-05T02:16:22.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.436+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.290__shadow_.dwiki-00Xp1uvBLHxtpj0_hAXgphr2C_0 2024-09-05T02:16:22.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13046575949856853232', time=2024-09-05T03:41:29.872582+0000, chain.objs.size()=1 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.291__shadow_.sH4Wo-BSRs0QW_cf6hfQvG_NhkNojda_0 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6058945514090239816', time=2024-09-05T03:41:34.863445+0000, chain.objs.size()=1 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.7AZMXW9t3SKfDcosyoOy7VXF-rnqCC5_0 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10939169188450263254', time=2024-09-05T03:41:40.095989+0000, chain.objs.size()=1 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.hDU665HuPC3s_jgHNjeXDZlZEy_6f_Z_0 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7210005237273631360', time=2024-09-05T03:41:47.794839+0000, chain.objs.size()=1 2024-09-05T02:16:22.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.297__shadow_.HD9EGXsb5-JIZxXjHfRsAwQ_DglCHey_0 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.575790883829281772', time=2024-09-05T03:41:51.830653+0000, chain.objs.size()=1 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.299__shadow_.YD8T906O0piNk3ScYp-IbbnphD9Ep7x_0 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6210996760361183065', time=2024-09-05T03:42:22.950709+0000, chain.objs.size()=1 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.315__shadow_.K75d4EnIJaJe_mgud9uDJ7Da123Yo1J_0 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12687823807801149303', time=2024-09-05T03:42:30.310145+0000, chain.objs.size()=1 2024-09-05T02:16:22.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.319__shadow:8xqEJIcMD3VIbQBzCxcPNv0ynYMQKZe_.aJF4ON9NJpsAUC_OInoG-brDqYOaL-E_0 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16767267509230773138', time=2024-09-05T03:44:20.050044+0000, chain.objs.size()=1 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GZUGZECrgyX4UTl3QS-1YVknoKKPNam_0 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15122678672320678988', time=2024-09-05T03:44:20.508224+0000, chain.objs.size()=1 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.s1XyaJlS-3DpwMGjfAwZDG8ZWk1-gXG_0 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6075751051618774013', time=2024-09-05T03:44:21.136334+0000, chain.objs.size()=1 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TOzIphQHhDVYM8xFcPAvlFzbf7hzgbN_0 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4899323429572657849', time=2024-09-05T03:44:22.403387+0000, chain.objs.size()=1 2024-09-05T02:16:22.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.440+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1Z30dh-3EfuFfXP4EuD4ZSYzV9CSRg6_0 2024-09-05T02:16:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5567569355467822278', time=2024-09-05T03:44:23.560139+0000, chain.objs.size()=1 2024-09-05T02:16:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QolWUAjeHBPBffYSNqI94N-97D_nemd_0 2024-09-05T02:16:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3572603780741777347', time=2024-09-05T03:44:24.569128+0000, chain.objs.size()=1 2024-09-05T02:16:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-yMQHYRM47rkH4nUp_hSlVXJ9rMCJKy_0 2024-09-05T02:16:22.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7463989205325311644', time=2024-09-05T03:44:25.773907+0000, chain.objs.size()=1 2024-09-05T02:16:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2ZCxu5t0DvapuaVDDCUZ7QCBHHr6zFY_0 2024-09-05T02:16:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9455208907895956109', time=2024-09-05T03:44:25.842327+0000, chain.objs.size()=1 2024-09-05T02:16:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aXl6KeBgJ0habpxKksZwueb2OoOWLrd_0 2024-09-05T02:16:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17158797891307814395', time=2024-09-05T03:44:27.690609+0000, chain.objs.size()=1 2024-09-05T02:16:22.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.UCdb56Q-wpnxGCxD89cGKY9Qbve6dOb_0 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.737749872550798085', time=2024-09-05T03:44:28.854238+0000, chain.objs.size()=1 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ADj437o4YZtFua9jbCbT8bh61oo-MDu_0 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16704659976810326142', time=2024-09-05T03:44:28.862499+0000, chain.objs.size()=1 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KMpPIWixuFTmw7FhQG7KSZrIzUSzuED_0 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3813597797727512833', time=2024-09-05T03:44:29.504169+0000, chain.objs.size()=1 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wsh_EPK5ymL0jePhvZ9RKYZH5jhNUNU_0 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12733407923739602081', time=2024-09-05T03:44:30.419297+0000, chain.objs.size()=1 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.L8MXURfAVWzD2FNA5Tks6hkVrvZWGPL_0 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11993039674753807985', time=2024-09-05T03:44:30.562167+0000, chain.objs.size()=1 2024-09-05T02:16:22.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4BaSSkZmde9L97k8JzK4PNHMotP-5DO_0 2024-09-05T02:16:22.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8696938377867710320', time=2024-09-05T03:44:32.856671+0000, chain.objs.size()=1 2024-09-05T02:16:22.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.444+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kWvMPywXtjWw3rX8znWOYRR7mxcOYXA_0 2024-09-05T02:16:22.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3625060271795312291', time=2024-09-05T03:44:34.081092+0000, chain.objs.size()=1 2024-09-05T02:16:22.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0FU0Wx76AECvYNo_K6chLuOiL7RcPUm_0 2024-09-05T02:16:22.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9428634375773633531', time=2024-09-05T03:44:34.454580+0000, chain.objs.size()=1 2024-09-05T02:16:22.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1lPPRD3K3ypWTBTok2l9fZy2yGKEW2q_0 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16294570580134749486', time=2024-09-05T03:44:34.785693+0000, chain.objs.size()=1 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ceNnXeCwF2JNUVw_wUfHGUmaLY_AIyT_0 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.925802681860734285', time=2024-09-05T03:44:35.999219+0000, chain.objs.size()=1 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PR2bA2YL6bk60wFmXZakHV99Keu-Yrw_0 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15636643393916871879', time=2024-09-05T03:44:37.527152+0000, chain.objs.size()=1 2024-09-05T02:16:22.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Ets_bNRAqzNXmn--5YAMvRt2hVfQfJP_0 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10986602173428805882', time=2024-09-05T03:44:37.836381+0000, chain.objs.size()=1 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SVBL0HBdF-DtAC3H_kdLwBMRSZZNXjl_0 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18338719814421247081', time=2024-09-05T03:44:40.487727+0000, chain.objs.size()=1 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.58rciph_k89jRenggNy4F784xnIxz08_0 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12009434133450611210', time=2024-09-05T03:44:42.062830+0000, chain.objs.size()=1 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MfWjExvg0P4iHkaFJtkZAcpZGVLOYSY_0 2024-09-05T02:16:22.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2761404940925436185', time=2024-09-05T03:44:42.847224+0000, chain.objs.size()=1 2024-09-05T02:16:22.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.dw1J2sy5J14hEYF_2C954gjJiK3RoTl_0 2024-09-05T02:16:22.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5658372986865267529', time=2024-09-05T03:44:44.140068+0000, chain.objs.size()=1 2024-09-05T02:16:22.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4o8Ig7o3RCp2j6yOZM46xTpz7-OWfqt_0 2024-09-05T02:16:22.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6526096458841024452', time=2024-09-05T03:44:44.278739+0000, chain.objs.size()=1 2024-09-05T02:16:22.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.448+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PIOOV9UL8TjbBk4uOlWdzjfpJOjjVAa_0 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8771749506818175780', time=2024-09-05T03:44:44.785938+0000, chain.objs.size()=1 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.S_931WIXCfTXT2kt5bNFWIvvrjQlmey_0 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3538525978673705780', time=2024-09-05T03:44:45.423386+0000, chain.objs.size()=1 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.hI2fY3Lmi76xVybtNiHWdz6Gu5JTD2G_0 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9195352494627655395', time=2024-09-05T03:44:46.903895+0000, chain.objs.size()=1 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GTF4oDF7agJGGWNbavkcFDoSivt1vI0_0 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14120272619908834550', time=2024-09-05T03:44:48.333171+0000, chain.objs.size()=1 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MLHJ8WAg9nILpk7l9rOSQQozNWmsTUT_0 2024-09-05T02:16:22.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16933139688310484506', time=2024-09-05T03:44:48.636463+0000, chain.objs.size()=1 2024-09-05T02:16:22.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qXNj5a1MUK2JtZEHl31NHgIBrubhgR6_0 2024-09-05T02:16:22.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13956357135866991774', time=2024-09-05T03:44:50.199602+0000, chain.objs.size()=1 2024-09-05T02:16:22.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1Khxd6-6VPRcabOLJOwERxNGLgriSRU_0 2024-09-05T02:16:22.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8183785843090392900', time=2024-09-05T03:46:33.408628+0000, chain.objs.size()=1 2024-09-05T02:16:22.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.452+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mxTPBuCZhVmTAVgncsxn4BAf6IBlYcP_0 2024-09-05T02:16:22.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4622203099099114189', time=2024-09-05T03:46:33.659460+0000, chain.objs.size()=1 2024-09-05T02:16:22.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Wwau16Ux6_rTpQyOFCX79toY6kL9Rz__0 2024-09-05T02:16:22.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15446080259657265975', time=2024-09-05T03:46:34.802092+0000, chain.objs.size()=1 2024-09-05T02:16:22.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.N9LRypk4pXv5jv7tpJXm7QPlwAkvzaZ_0 2024-09-05T02:16:22.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.65870781766524795', time=2024-09-05T03:46:34.977456+0000, chain.objs.size()=1 2024-09-05T02:16:22.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Z-v9XSJJWii3T6pIAC4RH19p7VIS679_0 2024-09-05T02:16:22.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17517294051309487112', time=2024-09-05T03:46:35.223506+0000, chain.objs.size()=1 2024-09-05T02:16:22.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wqbXltI4SZOYwBYPLjDcbnlhsgMFQeg_0 2024-09-05T02:16:22.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8280651636336977959', time=2024-09-05T03:46:35.927523+0000, chain.objs.size()=1 2024-09-05T02:16:22.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vzHwj4L40VUs_cd4s703FUt9gBsuSl1_0 2024-09-05T02:16:22.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5367935256604206084', time=2024-09-05T03:46:36.590887+0000, chain.objs.size()=1 2024-09-05T02:16:22.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kNbQW4o7UiZSkHFtA6iaIONghCmVE-a_0 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16200571519603049435', time=2024-09-05T03:46:37.728144+0000, chain.objs.size()=1 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HHyCo2FytXA-5pV8IBXKPbHhR_7CsfZ_0 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7786856627694169899', time=2024-09-05T03:46:37.796963+0000, chain.objs.size()=1 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.87z7hETukR9C7GfO3OUpIKFs0Av4CZo_0 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11507886661057005300', time=2024-09-05T03:46:39.759906+0000, chain.objs.size()=1 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6oGm8iwfSU_cV8DdrNP641EszkxtLhf_0 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5331411838070097803', time=2024-09-05T03:46:39.761713+0000, chain.objs.size()=1 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1npxG2PGJPrYJ-I-pQxA21HpVgKgf8O_0 2024-09-05T02:16:22.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10187035933394518661', time=2024-09-05T03:46:39.771302+0000, chain.objs.size()=1 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.70IKQkUIFAjF1Z7BWzoolHjF46y5Z8m_0 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8045937666596343661', time=2024-09-05T03:46:40.588159+0000, chain.objs.size()=1 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.456+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.iIcnG5u7e5cTFYIH2P5It_VqgGkCXt8_0 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8831430240936050552', time=2024-09-05T03:46:41.871343+0000, chain.objs.size()=1 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ENiYKAz_k8OhOala8aafRHQwNqyLgoh_0 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.460+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13431279333503367407', time=2024-09-05T03:46:41.916029+0000, chain.objs.size()=1 2024-09-05T02:16:22.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.460+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MCna8dE6y46V4kzF15_dz0SVJm17vpJ_0 2024-09-05T02:16:22.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.464+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47763 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4567929887087220386', time=2024-09-05T03:46:42.352710+0000, chain.objs.size()=1 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UAYZqmmWlISCE4VZT3BLnFTQxt0-ENX_0 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16539638310990058130', time=2024-09-05T03:46:42.707512+0000, chain.objs.size()=1 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6PDeFVQTqURjH8V4228tO5tsQJ1CH7n_0 2024-09-05T02:16:22.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12748803635810659560', time=2024-09-05T03:46:44.374125+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3MSHbRRIlBCDWj8TSz0TMkqCQCtyf6X_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12912685569452925117', time=2024-09-05T03:46:44.671903+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4quLnroObiBF1MyeNwDmVSwuXxoHGbW_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9061006017340000069', time=2024-09-05T03:46:44.980761+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tD2l8MlxD0Oq7oGefESV7o2ku2s2OaK_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13809577262320809747', time=2024-09-05T03:46:45.060295+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.knyPL-hQJSE7QL4Oo-P_UOXG4Fyu40o_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8373564463221960691', time=2024-09-05T03:46:46.082202+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.aTCSx-0alzXYKSo5i_xH3bmgi89SC-p_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5152238197951230816', time=2024-09-05T03:46:49.244762+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.i-U7TRlCTSk0TprhelKyLet5wayyGhH_0 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11252782917549065902', time=2024-09-05T03:46:50.633517+0000, chain.objs.size()=1 2024-09-05T02:16:22.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.E6oS4l7-PciSZdp5GhWd8mgAeb23Rq1_0 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16014038455561310370', time=2024-09-05T03:46:50.762750+0000, chain.objs.size()=1 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0bsS_bFVV3JhyWAX1VSRRwzz2qaGNvC_0 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12710486186808012431', time=2024-09-05T03:46:50.980230+0000, chain.objs.size()=1 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TCw_YOUxVrKgqN5uopXUddGSMM-8F1G_0 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13092536511887214645', time=2024-09-05T03:46:54.197832+0000, chain.objs.size()=1 2024-09-05T02:16:22.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.468+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5KOCuRPm6zS7OjhwH4iGLHFPCuCDxUh_0 2024-09-05T02:16:22.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16749555621283483520', time=2024-09-05T03:46:54.750634+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZTxXxdWsvNwoNRxLgHpo5pT3hZO962z_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16097416178569359116', time=2024-09-05T03:46:58.562579+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xQqjHW4w0vLQ42Hv-chIrEG4DPiRl7o_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18269871308526424426', time=2024-09-05T03:47:01.000560+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.tJMb__WdKucWjuBmwV5bvuBXcdN8c-g_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15416637072807119342', time=2024-09-05T03:47:01.990514+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ySvL0XbC-VGHvq5CijPOfjPTNn6cG7h_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12487846252747566654', time=2024-09-05T03:47:03.272484+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Q7yFsuJ04EY2apMF9zE8U25v62CuW-c_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17537045903624710397', time=2024-09-05T03:47:03.564146+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sH4HGA4Fpa9bx-J9_QHbRypL0YqmXvU_0 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11567169396768408323', time=2024-09-05T03:47:03.945175+0000, chain.objs.size()=1 2024-09-05T02:16:22.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DITZ2UbsR0LdMsFeAYw5QTt73bTxLDE_0 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10522531500247967568', time=2024-09-05T03:47:04.149544+0000, chain.objs.size()=1 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6U4ccU8R12cTsIRvIUAI452vgHZ0l80_0 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2962250221454626597', time=2024-09-05T03:48:17.767330+0000, chain.objs.size()=1 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.376__shadow_.pqOAJZTi0DrHxpANn7_INkI2MG25Dra_0 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5351164100557907611', time=2024-09-05T03:49:42.100786+0000, chain.objs.size()=1 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.431__shadow_.eIB6HBpdIaL15MHc_HYDVeDzAYI1Onx_0 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3401530057062000892', time=2024-09-05T03:51:09.566516+0000, chain.objs.size()=1 2024-09-05T02:16:22.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.472+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.UJ194bb0UcQNIXCvykPM3dOOM3ZNw5F_0 2024-09-05T02:16:22.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1483717784803137579', time=2024-09-05T03:51:09.684623+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.eWP4EtdfipQ-ysbrNmR8KcxlxNAA_CV_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13629402691568219507', time=2024-09-05T03:51:09.686142+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.LNNSSwp2j80yCXr6tLO-T0_uZ3ouXGC_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8292745527806338112', time=2024-09-05T03:58:41.999992+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:55HqH8qjbafkxI-1gTWMRVF59wFffl4_.5K5oRTVel8tTF2jejQMOqUXU5I8jcml_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16281233777680622040', time=2024-09-05T03:59:32.245682+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.582__shadow:f2armLW5oJ0BOg5xZxge28bDg3Gn.eK_.T21oAyENYMsH1NdF4E_0sTiPlcru4X6_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15402165316363530978', time=2024-09-05T03:59:45.177291+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:oy8oCC8jY9C7HP72Y4-Ve2Ox3sohBza_.J_N157I9XkJdTk8WSUDuLpD3V1qawPn_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5286337143599154291', time=2024-09-05T04:04:47.717430+0000, chain.objs.size()=1 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.626__shadow_.M22JoghXCQ8n-FAsA0cmS9qtFTKYjue_0 2024-09-05T02:16:22.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14484302957298255689', time=2024-09-05T04:07:10.768780+0000, chain.objs.size()=1 2024-09-05T02:16:22.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.699__shadow:WS1vF5jMpsFQNw6HIwY8yJ-Cc7OeJ4d_.Dt-pPRBvikIwac3ani1xqMtsAgnwbiH_0 2024-09-05T02:16:22.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1712012867099349721', time=2024-09-05T04:08:47.903052+0000, chain.objs.size()=1 2024-09-05T02:16:22.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.476+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.741__shadow_.AZWfc2NJQxQ-WTJDOt5xqN4lDbYGH3s_0 2024-09-05T02:16:22.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.480+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.484+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-05T02:16:22.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.484+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.484+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47523' 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12406357713805645539', time=2024-09-05T03:37:27.957039+0000, chain.objs.size()=1 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.233__shadow_.3NT1SXVcRCpLEaoJAHDoeannhEj-yeT_0 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4629876425310718536', time=2024-09-05T03:37:40.476662+0000, chain.objs.size()=1 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.239__shadow_.MRomEwTmSIt_eZVvMkc1c7WEGn28Unv_0 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2510653182248269232', time=2024-09-05T03:38:13.650313+0000, chain.objs.size()=1 2024-09-05T02:16:22.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.256__shadow_.ViZxvfRDvkqKxQn9Lw0eF0VTkizwaZM_0 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16502249591508387135', time=2024-09-05T03:40:04.246047+0000, chain.objs.size()=1 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Suvx_h2k821b6Oi0IosGcc_YULqXi5S_0 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18182374771991789069', time=2024-09-05T03:40:05.255111+0000, chain.objs.size()=1 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bv2fNV-8ic7KbTWD9hDum15dpyxtQxr_0 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18206036125259429155', time=2024-09-05T03:40:05.364374+0000, chain.objs.size()=1 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6_ixjRimPzAizDWeE6cAkMUJfYQJw8v_0 2024-09-05T02:16:22.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5636075423087893200', time=2024-09-05T03:40:06.824019+0000, chain.objs.size()=1 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0hVU1iwbx1W4DBUi9s-imrzVgIwpfzw_0 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15894082711672635365', time=2024-09-05T03:40:07.004768+0000, chain.objs.size()=1 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.W3r2FmqXZXlMUBjFE1vuWrjl-wInovB_0 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15630596436370939311', time=2024-09-05T03:40:07.127608+0000, chain.objs.size()=1 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ckplc3Oz8BfjO7z-viq835HVXml-oP2_0 2024-09-05T02:16:22.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17596008745521117281', time=2024-09-05T03:40:07.136831+0000, chain.objs.size()=1 2024-09-05T02:16:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pDD6C21jqny2Mkwn7iAXS5D-nx22NEP_0 2024-09-05T02:16:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11400139225314359447', time=2024-09-05T03:40:10.765821+0000, chain.objs.size()=1 2024-09-05T02:16:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SajPeYLw77Iqm81B0vaXA_-gX0d1iza_0 2024-09-05T02:16:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5262404659809304337', time=2024-09-05T03:40:11.767642+0000, chain.objs.size()=1 2024-09-05T02:16:22.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lsxJXzAId_C0dNqt_jWM63qCdal_CP9_0 2024-09-05T02:16:22.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9250011374098436627', time=2024-09-05T03:40:14.052586+0000, chain.objs.size()=1 2024-09-05T02:16:22.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OnPsMRWgXoqIpKeCmxPThCLV43wS3r-_0 2024-09-05T02:16:22.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12228278704060233489', time=2024-09-05T03:40:14.256089+0000, chain.objs.size()=1 2024-09-05T02:16:22.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8XJGqShcjBAWA5JpNuDBUwztCaI73jM_0 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5017227462265887665', time=2024-09-05T03:40:15.620985+0000, chain.objs.size()=1 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.IyxQfTmxS7m7K-5p05BpgJm8HVzsnZp_0 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5072897142282423719', time=2024-09-05T03:40:20.789947+0000, chain.objs.size()=1 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cI0nA2ouJkYyS0kBIsT8zIZlaIgP5eZ_0 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11119174224779574603', time=2024-09-05T03:40:24.315950+0000, chain.objs.size()=1 2024-09-05T02:16:22.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.488+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.avoOAc7DvaqnDLuiu6HX-uEsjyc1Y0b_0 2024-09-05T02:16:22.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.70165391827694439', time=2024-09-05T03:40:26.374593+0000, chain.objs.size()=1 2024-09-05T02:16:22.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OQElxqV35l-zM7-qMBx5ooYemvICqK1_0 2024-09-05T02:16:22.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10700296659244658221', time=2024-09-05T03:40:26.563023+0000, chain.objs.size()=1 2024-09-05T02:16:22.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aJPwsZiDKo4oLbYBmwYgL5GBQeryApu_0 2024-09-05T02:16:22.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17828038661820401469', time=2024-09-05T03:40:26.918239+0000, chain.objs.size()=1 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.UygWnlHY5ZXuK--CSiUeO9pFppmi_aA_0 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5035681238604723799', time=2024-09-05T03:40:27.130979+0000, chain.objs.size()=1 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qeoXG02UmaMVv_5dTl7qDL3VK7GTiWK_0 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1400095347675951318', time=2024-09-05T03:40:27.457233+0000, chain.objs.size()=1 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o_cjHcjOwYsEn33Fpnz1DaLfAWfCN_u_0 2024-09-05T02:16:22.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16810309231595257951', time=2024-09-05T03:40:27.721095+0000, chain.objs.size()=1 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iVqE-WaEc7kpLh6mTV4TLZdYofqyZwQ_0 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1383246181528213973', time=2024-09-05T03:40:27.875808+0000, chain.objs.size()=1 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EDptpfZN4zUuirLvr9Z03IlqlslY7JU_0 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10836976148812097206', time=2024-09-05T03:40:28.463839+0000, chain.objs.size()=1 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.J3ICV6A4oT4yTmUZgx-F-6oxnivvKPO_0 2024-09-05T02:16:22.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14222828924281145525', time=2024-09-05T03:40:28.596381+0000, chain.objs.size()=1 2024-09-05T02:16:22.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TCNnKLvdCA4v5wZ3Yfu_74iZ3zMsLfz_0 2024-09-05T02:16:22.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11928453317303324232', time=2024-09-05T03:40:29.109907+0000, chain.objs.size()=1 2024-09-05T02:16:22.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.84-3cga2wEKpuc39g09b-ncoRrGZIsP_0 2024-09-05T02:16:22.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15119234631353981284', time=2024-09-05T03:40:30.433054+0000, chain.objs.size()=1 2024-09-05T02:16:22.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.492+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ESNC9-IgxcRDCwPzYH1U5sqznwZsqUM_0 2024-09-05T02:16:22.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10957694399244151174', time=2024-09-05T03:40:30.435069+0000, chain.objs.size()=1 2024-09-05T02:16:22.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.dp9Ge7dUWWaG1lMmn9DwSAN_2gpIIVu_0 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5617525004933671160', time=2024-09-05T03:40:30.837622+0000, chain.objs.size()=1 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.i-M-e8U7teg_jOZBr2kytmL6XaDEyCP_0 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6462503380480133107', time=2024-09-05T03:40:30.914858+0000, chain.objs.size()=1 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hEWWxV1YXiiW7g_RpZp3EIPfCo8y2yr_0 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7409331942922388328', time=2024-09-05T03:40:31.239273+0000, chain.objs.size()=1 2024-09-05T02:16:22.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EXf13cCNY5Pc0INJIWzxlzi3vRBnJJx_0 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13151306684337979275', time=2024-09-05T03:40:32.618134+0000, chain.objs.size()=1 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.khyDT1wCC6YWneaX14UcL84giRW7o3m_0 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17738776759653257102', time=2024-09-05T03:40:32.954555+0000, chain.objs.size()=1 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Sle2EndsPKTAGp180oEA8DF8zU7KbXG_0 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.902408479796947852', time=2024-09-05T03:40:34.030584+0000, chain.objs.size()=1 2024-09-05T02:16:22.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.nqpJ-RpaL20f4H0w7djkXQeZoqmzXJZ_0 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12979900570538070674', time=2024-09-05T03:40:34.989075+0000, chain.objs.size()=1 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.CkmaW8CkN6moYNWj39m-VPNGxhDyjnI_0 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6011090425012623708', time=2024-09-05T03:40:35.957505+0000, chain.objs.size()=1 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6Gm3Mu5YXtH8VPxHvk_OznGF9Agrto6_0 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16239900505744140378', time=2024-09-05T03:40:50.639027+0000, chain.objs.size()=1 2024-09-05T02:16:22.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.270__shadow_.1_BU4bkxJz_gz6drdWw_4dUnSJDo1Us_0 2024-09-05T02:16:22.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5030644710086984491', time=2024-09-05T03:40:54.032963+0000, chain.objs.size()=1 2024-09-05T02:16:22.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.272__shadow_.NAl6FLq9t0hjpIYQdrkyav7NyNmKx1Y_0 2024-09-05T02:16:22.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6116789463153056963', time=2024-09-05T03:40:55.768815+0000, chain.objs.size()=1 2024-09-05T02:16:22.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.273__shadow_.QRsdZCapVtVds4i-SSf5h8SrIeMwksB_0 2024-09-05T02:16:22.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16566488410370543280', time=2024-09-05T03:41:23.902916+0000, chain.objs.size()=1 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.496+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.288__shadow_.f-dw0A3nQQa5Zfa2pQ6N3wpHgcyPbaO_0 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11558918704322479049', time=2024-09-05T03:41:59.217837+0000, chain.objs.size()=1 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.303__shadow_.ZfaRbnW04EUf3Nxhj-dVsBGJsDYmIB8_0 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10164961716106757691', time=2024-09-05T03:44:20.127407+0000, chain.objs.size()=1 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JwnmX8BgXQkTC_8nKI6yal6B0jZb63-_0 2024-09-05T02:16:22.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15562240156907481945', time=2024-09-05T03:44:20.882960+0000, chain.objs.size()=1 2024-09-05T02:16:22.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.500+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d6wfVRGC9DL4sTzAAnzoOComZAjeIXC_0 2024-09-05T02:16:22.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15109444361473188226', time=2024-09-05T03:44:23.890858+0000, chain.objs.size()=1 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BfhXF30iLYPKfGMpLh1W4ZytEhxzRVX_0 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16793410316452009602', time=2024-09-05T03:44:23.892831+0000, chain.objs.size()=1 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VYkhIsMdRjN8G1PruiCeAfudD2ygk5a_0 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.116967050328046415', time=2024-09-05T03:44:24.341012+0000, chain.objs.size()=1 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JlObE0f17UyHl76Hc4qnc7KVV8V7eSU_0 2024-09-05T02:16:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14756132999863014490', time=2024-09-05T03:44:24.854825+0000, chain.objs.size()=1 2024-09-05T02:16:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.eIZFvGSU7NrBC9ED8WSndG8hABl3uZq_0 2024-09-05T02:16:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18140465907656339852', time=2024-09-05T03:44:25.503037+0000, chain.objs.size()=1 2024-09-05T02:16:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YQx_kaXiaBNShbAdERu9d8UN2-dBM6k_0 2024-09-05T02:16:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.429407524766775278', time=2024-09-05T03:44:26.203780+0000, chain.objs.size()=1 2024-09-05T02:16:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vQEdyh82OFewCFQNtPhMeJk27oxeA56_0 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9859573401226052054', time=2024-09-05T03:44:26.506675+0000, chain.objs.size()=1 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YlFfO_4hMI4EFBbQ4MEluCj_2_wU5hf_0 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6831496836231774590', time=2024-09-05T03:44:26.596917+0000, chain.objs.size()=1 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nRwWveZ0p_79XXLGPDCm3rAAGWVz3vS_0 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2868429212333002035', time=2024-09-05T03:44:28.620195+0000, chain.objs.size()=1 2024-09-05T02:16:22.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YM_riqLS85382qyhS2or2pr3m7MC_ks_0 2024-09-05T02:16:22.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15880657887469957161', time=2024-09-05T03:44:33.272992+0000, chain.objs.size()=1 2024-09-05T02:16:22.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ofjc9JKtluUb62xH7AP_geWjRMc9WV5_0 2024-09-05T02:16:22.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6359061288005920992', time=2024-09-05T03:44:34.263852+0000, chain.objs.size()=1 2024-09-05T02:16:22.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.504+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.d6NgyqnhVIkirMexMOsnK3PMwc9E_0u_0 2024-09-05T02:16:22.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15148380324966340215', time=2024-09-05T03:44:34.616607+0000, chain.objs.size()=1 2024-09-05T02:16:22.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JzJnl3bVrj_JXyp4br2p6QM0XhxIomo_0 2024-09-05T02:16:22.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2086074580687923587', time=2024-09-05T03:44:35.905971+0000, chain.objs.size()=1 2024-09-05T02:16:22.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TPZkU6Ck2RF6G-DiLJprgqUgXKArzF3_0 2024-09-05T02:16:22.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3445140126158908032', time=2024-09-05T03:44:37.682455+0000, chain.objs.size()=1 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.r48-h4T-8BFo2O8BvRiL-1gn4q0iJip_0 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4479443361433703423', time=2024-09-05T03:44:37.683827+0000, chain.objs.size()=1 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6Gm8FuwquN2Xgp1vt_ea3cY-7WfWtgf_0 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15025957075139527873', time=2024-09-05T03:44:38.025700+0000, chain.objs.size()=1 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NdZwB5Diy5sackWJPQ0dG7sOryCS2xl_0 2024-09-05T02:16:22.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2773339318208647951', time=2024-09-05T03:44:40.379890+0000, chain.objs.size()=1 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.46_Tg4TkOaSVqs03eoyuvG5zSQo2r84_0 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16914790735763777014', time=2024-09-05T03:44:41.160470+0000, chain.objs.size()=1 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TosU29Y83TPSGoBsCbPUVjqpwQ1whBQ_0 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10834575825278114715', time=2024-09-05T03:44:41.737691+0000, chain.objs.size()=1 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.VQoTQ2lW6VI4sT6RVaH2j4Dv3TcF2uv_0 2024-09-05T02:16:22.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2858612747241700089', time=2024-09-05T03:44:42.218230+0000, chain.objs.size()=1 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XBRMqHDaLR52o0EsUxZecrUkTjdtqjW_0 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4825352845184549725', time=2024-09-05T03:44:45.424798+0000, chain.objs.size()=1 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aBtSMnVHSiT8grOkvpvBCeJ_Wr685WH_0 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17401729185632322447', time=2024-09-05T03:44:46.326586+0000, chain.objs.size()=1 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KtGNkRzosF2ehdzGlI9TLNMWhGlFJC9_0 2024-09-05T02:16:22.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10656354792737743963', time=2024-09-05T03:44:46.924904+0000, chain.objs.size()=1 2024-09-05T02:16:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.508+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZOizHZ40Nh2McmkRDYAMu2jR9cO8Z7N_0 2024-09-05T02:16:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3279964669241198878', time=2024-09-05T03:44:46.966712+0000, chain.objs.size()=1 2024-09-05T02:16:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FeNBSoud_x-EIlirclfUnY5jUUMZrTw_0 2024-09-05T02:16:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4944512654537760757', time=2024-09-05T03:44:47.754113+0000, chain.objs.size()=1 2024-09-05T02:16:22.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SixWaxeFdgq4AKdMUoznoEoE16crYAp_0 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17163362828726024485', time=2024-09-05T03:44:48.492228+0000, chain.objs.size()=1 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qE04FrjQEuqpU1YPvzg-DYl0pfsYY0v_0 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5595886599240375169', time=2024-09-05T03:44:48.640712+0000, chain.objs.size()=1 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.PpeKeYr26E_dSjD0-CZMLJYQozfCSeI_0 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14617012556053022254', time=2024-09-05T03:44:49.543148+0000, chain.objs.size()=1 2024-09-05T02:16:22.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.M5v4oPrxbXHDHDk2dtOrzSU1o8NBOTv_0 2024-09-05T02:16:22.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5658242721635289002', time=2024-09-05T03:44:50.000400+0000, chain.objs.size()=1 2024-09-05T02:16:22.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CagDxVjnJqBDirVWSGWMqgIPfTJvy5g_0 2024-09-05T02:16:22.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16164599656495338280', time=2024-09-05T03:44:50.002625+0000, chain.objs.size()=1 2024-09-05T02:16:22.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.z0futHt4nqX66Kc3ZRiOyJk9_WzkyDX_0 2024-09-05T02:16:22.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6249947060567359282', time=2024-09-05T03:44:50.104250+0000, chain.objs.size()=1 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Ag_XJ0kdXQsdRTLmNWPZ6jH_aKPhJuu_0 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2257121170699459581', time=2024-09-05T03:44:50.275767+0000, chain.objs.size()=1 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NuMNte5FW8EWZMacVm667o1qZxwWEJB_0 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17985196565383860388', time=2024-09-05T03:46:33.753513+0000, chain.objs.size()=1 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XyWBkTvziwBScfMos0uTt7oodIA12n0_0 2024-09-05T02:16:22.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13187589443233788499', time=2024-09-05T03:46:34.781965+0000, chain.objs.size()=1 2024-09-05T02:16:22.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.L4jZ1o-E40aMCgLziZJEgNPUTLZHhtQ_0 2024-09-05T02:16:22.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8017319014692694055', time=2024-09-05T03:46:36.611329+0000, chain.objs.size()=1 2024-09-05T02:16:22.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gKVc3lUxmi3DP7VszsF8X4YoI4y5Vat_0 2024-09-05T02:16:22.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8647984292548201520', time=2024-09-05T03:46:38.793950+0000, chain.objs.size()=1 2024-09-05T02:16:22.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uU3GRBAANJAmznc9niQykIG6EPpxmd7_0 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6135548397158763944', time=2024-09-05T03:46:39.130185+0000, chain.objs.size()=1 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.512+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LB0O02wAx3GAUGA0-ce5IR-jJ-vgAn2_0 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8016257438646194888', time=2024-09-05T03:46:40.778262+0000, chain.objs.size()=1 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FM_vHhpkjOuoV7k6ZoY4XmARIlfEX8u_0 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18414679179651492070', time=2024-09-05T03:46:42.251784+0000, chain.objs.size()=1 2024-09-05T02:16:22.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7XTc-YHyslsYEohxqA6zoOIY5T6YeDc_0 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4893050153396468164', time=2024-09-05T03:46:44.384177+0000, chain.objs.size()=1 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.puSQ54TkEuiEzFT1tgp-62ef8hPDMPM_0 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10574614820147767896', time=2024-09-05T03:46:47.170679+0000, chain.objs.size()=1 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TpDj-Zq0sIwwpVYEwsWaOH6JdiuDKvW_0 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18309309946040645549', time=2024-09-05T03:46:47.639765+0000, chain.objs.size()=1 2024-09-05T02:16:22.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uoYFjdJWvxr7Qse18jXKWDo84455FSM_0 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4455137103042474754', time=2024-09-05T03:46:48.384319+0000, chain.objs.size()=1 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9PxdF70lfswYG3VHpCix5XoBcv87EJH_0 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18083214314381026378', time=2024-09-05T03:46:50.637821+0000, chain.objs.size()=1 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.pEyPRxnP-vwzM0fN_mIncH6e2Kn_e-D_0 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11118063670690243865', time=2024-09-05T03:46:52.265761+0000, chain.objs.size()=1 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GCtmSDMumC_WUY4NhgrVBWmMYKDbCnR_0 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11776147360298634753', time=2024-09-05T03:46:52.562917+0000, chain.objs.size()=1 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.H4t9-rI8tvcrjatLlWSGQFvi03lkJVi_0 2024-09-05T02:16:22.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11730692347792432235', time=2024-09-05T03:46:53.068934+0000, chain.objs.size()=1 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.E4YLj38sgEIm3NgxN3El6sesTJk2Xjn_0 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13657424267478386552', time=2024-09-05T03:46:55.049278+0000, chain.objs.size()=1 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Z2YUW4yoZ5EcbnQuprt4IKCiOY_x_vi_0 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7110429021427633804', time=2024-09-05T03:46:55.051165+0000, chain.objs.size()=1 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4SfzeUXUixTIKZJdMkdJY8nlJvYBygB_0 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11445970868597526364', time=2024-09-05T03:46:58.690660+0000, chain.objs.size()=1 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vzNYrKrO5QCrAIv9gHOn8cbLF5G0PlQ_0 2024-09-05T02:16:22.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2527446292191698724', time=2024-09-05T03:46:58.692742+0000, chain.objs.size()=1 2024-09-05T02:16:22.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1dKNCuRJU-CX6eSf3vEF3_kHQGhKVyS_0 2024-09-05T02:16:22.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8204584365651471079', time=2024-09-05T03:46:58.844750+0000, chain.objs.size()=1 2024-09-05T02:16:22.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.f9Rg4c-CXHbb-tfNOeQ8r6Fep_SWHJF_0 2024-09-05T02:16:22.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16599273026320742371', time=2024-09-05T03:46:59.868586+0000, chain.objs.size()=1 2024-09-05T02:16:22.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.516+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.G4mUHZojG5EQ50z25cynqntGJdeRZve_0 2024-09-05T02:16:22.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4141959327273166983', time=2024-09-05T03:47:00.570471+0000, chain.objs.size()=1 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yaLNfsY1rghDVDuCeQm_UM5sQcdxlq9_0 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7732096076961975448', time=2024-09-05T03:47:01.059252+0000, chain.objs.size()=1 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.puR7ns6S96adCvhMLNv-cszbhY4_OID_0 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12635747585390362946', time=2024-09-05T03:47:01.981748+0000, chain.objs.size()=1 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.520+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vS8FINBWspyFMfDJsh1GX_e3h18BPJx_0 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.528+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47523 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12642850795329171694', time=2024-09-05T03:47:03.225694+0000, chain.objs.size()=1 2024-09-05T02:16:22.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0Qoomzjjqb0WJoMRL2wDzxweptGNEF7_0 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11295824749436057012', time=2024-09-05T03:47:03.324532+0000, chain.objs.size()=1 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NoCyCnMYu4-JnmyhIb7D8jRlWvZpes6_0 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17276003243318628861', time=2024-09-05T03:47:03.823699+0000, chain.objs.size()=1 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1f5RBM1WX9oGbWmvcP-f6XuYzEPn_Av_0 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10628542286734195539', time=2024-09-05T03:47:04.063093+0000, chain.objs.size()=1 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SQpcMzzE7aTxbpjJzqghJHJS1nTpY3d_0 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1554161827699628292', time=2024-09-05T03:47:04.257184+0000, chain.objs.size()=1 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rdn6GrtRRRkQUSWzgvIneC93U520nJW_0 2024-09-05T02:16:22.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7997058846872711605', time=2024-09-05T03:47:04.527028+0000, chain.objs.size()=1 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RdaDjDHs7IBIZ7gf4Qp-wtgH0ThCkBL_0 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12829116119751916178', time=2024-09-05T03:47:04.528463+0000, chain.objs.size()=1 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QwIc1-Yu0_7DWVOrcBCsrn3yVyQE66K_0 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.489125876650102057', time=2024-09-05T03:47:21.360568+0000, chain.objs.size()=1 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.335__shadow_.w9Sg4L68rZYhnUl0883kVJ21cg_wwAo_0 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16497128853055384338', time=2024-09-05T03:47:46.145792+0000, chain.objs.size()=1 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.353__shadow_.-D6jtCMrQVkmx9Jq8rxY43ULPJsGsMu_0 2024-09-05T02:16:22.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14071112406758327739', time=2024-09-05T03:48:22.955746+0000, chain.objs.size()=1 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.379__shadow_.ljns3IEB1UAja6A6GwHedW6boh1QUy-_0 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2778215561587559439', time=2024-09-05T03:48:47.675537+0000, chain.objs.size()=1 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.394__shadow:oed0Lm51EuUnh8RzVLX.UxXfBR.JohK_.j85anlnwFiNMHrDADW1n0uCBnEL40pn_0 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17505356710475667012', time=2024-09-05T03:50:36.593349+0000, chain.objs.size()=1 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.461__shadow_.JxSnXqxF0mLjo0ZB2stlG5ccuB61kIn_0 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10663439413912631543', time=2024-09-05T03:51:09.660857+0000, chain.objs.size()=1 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.iDgnBq64xR3tZqyp5dg59ewV3MbdSSI_0 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4390565232630046939', time=2024-09-05T03:51:22.031685+0000, chain.objs.size()=1 2024-09-05T02:16:22.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.488__shadow_.4YJMgqlU46ze4sfAle9zL5qwR0OqQtb_0 2024-09-05T02:16:22.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8934801955525416951', time=2024-09-05T03:51:36.837842+0000, chain.objs.size()=1 2024-09-05T02:16:22.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.532+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.498__shadow_.CLniGJ4o2cvU7PxoJmCkMwsdIrihrNV_0 2024-09-05T02:16:22.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12480691109805303007', time=2024-09-05T03:51:39.338004+0000, chain.objs.size()=1 2024-09-05T02:16:22.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.499__shadow_.csvIoCTYkp7Q7eniioaTv0RsmLY9a_s_0 2024-09-05T02:16:22.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14024057469907031684', time=2024-09-05T03:52:17.554931+0000, chain.objs.size()=1 2024-09-05T02:16:22.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.515__shadow_.u7uDuR_2zbuAC6LrgaloUeLN-YK_PoX_0 2024-09-05T02:16:22.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7431707793828793578', time=2024-09-05T03:57:14.451061+0000, chain.objs.size()=1 2024-09-05T02:16:22.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.563__shadow_.2UxtIHgppSsmougk8XnTiFPKopu_0FW_0 2024-09-05T02:16:22.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6196884235645888894', time=2024-09-05T03:57:39.367953+0000, chain.objs.size()=1 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:Q1iuzhSY8yrO.Qb6MjHbqavkcxBy1n2_.cw0VBhuoK5ib8xrp7jPxfJma1ORRpQ7_0 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11296516319744489285', time=2024-09-05T03:58:05.244493+0000, chain.objs.size()=1 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.574__shadow:qHU3bEASmTdENQCIRqoS4L2yy7EYOq3_.E3ZGEZAJnkL61fguIILVBDLlV2g43w9_0 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2811369236228108845', time=2024-09-05T03:58:08.030200+0000, chain.objs.size()=1 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.575__shadow_.BtvJzdbSgtYjvBYDcnqVYgU0RljdVXy_0 2024-09-05T02:16:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16106943658819684952', time=2024-09-05T03:58:17.397322+0000, chain.objs.size()=1 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:-acIBnRQ0CaLf3pxhpzH-MhdfbOit8x_.VZ5sJb6PvhlKzld4791vO5HtvGqdWgD_0 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11494543117598972693', time=2024-09-05T03:59:01.390899+0000, chain.objs.size()=1 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:OxQV-SmLONKvwiCf12LpHtcoMw3YS4K_.KtLn7TfHez9JjIHxgDETbw0mS6_oBX0_0 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11003280643355536069', time=2024-09-05T03:59:58.967451+0000, chain.objs.size()=1 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.596__shadow_.ypVzudAlSTOw54N_G8CDWjvqi3HDTo7_0 2024-09-05T02:16:22.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.247023474550493363', time=2024-09-05T04:00:07.032781+0000, chain.objs.size()=1 2024-09-05T02:16:22.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.602__shadow_.7awc47PZSsUQRF9KXpj7OsiVnKp2jlH_0 2024-09-05T02:16:22.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10977625735352252099', time=2024-09-05T04:00:14.596792+0000, chain.objs.size()=1 2024-09-05T02:16:22.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.536+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.606__shadow_.ZmEN6_mmX7uGFKYvh8xRfneZs-w7FKc_0 2024-09-05T02:16:22.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.540+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13361982006456335499', time=2024-09-05T04:05:13.745322+0000, chain.objs.size()=1 2024-09-05T02:16:22.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.540+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.642__shadow_.1W1N8qg518FaRD9yQMRQ_J4x4_MrBwu_0 2024-09-05T02:16:22.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.540+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15228373159907652336', time=2024-09-05T04:07:27.091774+0000, chain.objs.size()=1 2024-09-05T02:16:22.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.540+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.708__shadow:qD1qWi37ZkZJa6.42BVjCPJe1sgh6Om_.i-QUcaUzqMm1Nmb6Twkr5ryxEOZH0Xe_0 2024-09-05T02:16:22.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.548+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.548+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-05T02:16:22.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45431' 2024-09-05T02:16:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_ve-SGDlzwHf2gZEHiBBCZCY1_LmgEv2', time=2024-09-05T03:33:16.583309+0000, chain.objs.size()=1 2024-09-05T02:16:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.165__shadow_.GDkBm5uG2Eb7r-vh0wWe7tuDoD1EQH__0 2024-09-05T02:16:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17525390540337888268', time=2024-09-05T03:33:41.167080+0000, chain.objs.size()=1 2024-09-05T02:16:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.178__shadow_.4Zf-GIK8V8ATgdK8z995tW-rNM-d-on_0 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ysvodIDDQOGwlwLQgZUhjLPHnpdQznE', time=2024-09-05T03:34:28.638510+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.201__multipart_mymultipart.2~ysvodIDDQOGwlwLQgZUhjLPHnpdQznE.1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1235498528312835267', time=2024-09-05T03:37:27.918227+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.233__shadow_.9VIHzRYPVRD842THTJWsl4FFs2hAFzn_0 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.39446497365879103', time=2024-09-05T03:37:27.945536+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.233__shadow_.nFeWuwNEoDVA6VwdDTcK9qg8t264fF3_0 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13293782303398423622', time=2024-09-05T03:37:31.710857+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.235__shadow_.5R1QW-Vyyo7YwCFi3uc4bzWgNLc1zKs_0 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7374539882203632155', time=2024-09-05T03:37:43.847831+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.241__shadow_.Pq-PHjOJIuHpjEtZXj1AcWZ8lb2cXtm_0 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5941480194264570176', time=2024-09-05T03:38:02.314880+0000, chain.objs.size()=1 2024-09-05T02:16:22.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.250__shadow_.mdKv_Xgkuf6BimaXxGwQgfshDmdUsC6_0 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5978232308711920239', time=2024-09-05T03:38:06.028555+0000, chain.objs.size()=1 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.252__shadow_.FUlf4jXEWyJfWOaXXJfU7Q44u2HyBmW_0 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3632451594689913231', time=2024-09-05T03:38:09.781462+0000, chain.objs.size()=1 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.254__shadow_.QX-FgSzjqfa69j7-8SoPi9PYzhwjlqw_0 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17529598608278302465', time=2024-09-05T03:40:05.484835+0000, chain.objs.size()=1 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.irDc-Fchhq8Ks-kDozdnEDVTMw6mKbV_0 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4916663325343944742', time=2024-09-05T03:40:07.714390+0000, chain.objs.size()=1 2024-09-05T02:16:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._M20rPXFbNIdpQR7pktXKJUbsA8XrN0_0 2024-09-05T02:16:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11225951606650044049', time=2024-09-05T03:40:09.972353+0000, chain.objs.size()=1 2024-09-05T02:16:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BaPMlXWJRQFBfSTVHN5jvDJard9F1Ut_0 2024-09-05T02:16:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9322472703758077327', time=2024-09-05T03:40:10.083350+0000, chain.objs.size()=1 2024-09-05T02:16:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.552+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pFap6Kk_cIE-Ykae8dXgC7H31mY2xPH_0 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16852595980847936119', time=2024-09-05T03:40:10.201183+0000, chain.objs.size()=1 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.g_bMtORgPdhWjhXogXigxJBoT3nTPLr_0 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16350245753457444314', time=2024-09-05T03:40:10.597482+0000, chain.objs.size()=1 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.J5fU69tg9Q5sU_gciHy4cm5WiEYj-7M_0 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6474025710408892792', time=2024-09-05T03:40:11.168557+0000, chain.objs.size()=1 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.L5_G98Pq_t3Qp6pTZUn5qntvKXftQ7q_0 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12920700730491653904', time=2024-09-05T03:40:11.685043+0000, chain.objs.size()=1 2024-09-05T02:16:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.blZuKpNk1HG_dFGVlXsNDQX51pxG1l__0 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7430660661870341289', time=2024-09-05T03:40:11.990869+0000, chain.objs.size()=1 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OLgsvWS4QxkFn1L_RmIqyp8_oWA5urk_0 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.354489849728834676', time=2024-09-05T03:40:13.196845+0000, chain.objs.size()=1 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.WhpqO9WDvVoln2cx3bJtisPn8w1EktJ_0 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.497609663090217663', time=2024-09-05T03:40:14.266017+0000, chain.objs.size()=1 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ot7iRzPjCbWtKWCzZ1LuT6BYou0UqNE_0 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1447157167266199238', time=2024-09-05T03:40:14.418849+0000, chain.objs.size()=1 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.I7mRbpTs3f0Sz3cKnwyoXkDsBbra0Pj_0 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6791825010233364009', time=2024-09-05T03:40:18.533930+0000, chain.objs.size()=1 2024-09-05T02:16:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PQHdo624oQCoI06WsA8ndQufa7j46uH_0 2024-09-05T02:16:22.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8890164709044266798', time=2024-09-05T03:40:19.050425+0000, chain.objs.size()=1 2024-09-05T02:16:22.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HVHevhI98S270DtG424N8XdjRgZ1woN_0 2024-09-05T02:16:22.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12520975454472953672', time=2024-09-05T03:40:19.626114+0000, chain.objs.size()=1 2024-09-05T02:16:22.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.556+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qyh7_UgjTjyi_yUpl24vuNZdxa0Tv76_0 2024-09-05T02:16:22.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.560+0000 7f576591b640 0 -- 172.21.15.99:0/3563938198 >> [v2:172.21.15.99:6808/643721128,v1:172.21.15.99:6809/643721128] conn(0x55f301083f00 msgr2=0x55f301086390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-05T02:16:22.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3302673103542777044', time=2024-09-05T03:40:19.940697+0000, chain.objs.size()=1 2024-09-05T02:16:22.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0cnp57AtXw_PGHrV2Yzwd00ZEkfoIIX_0 2024-09-05T02:16:22.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.560+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18437065100187504631', time=2024-09-05T03:40:20.231402+0000, chain.objs.size()=1 2024-09-05T02:16:22.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.560+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.90_LFdu-58wXaxH71npnUyPBIZl1xHN_0 2024-09-05T02:16:22.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8019594903460411108', time=2024-09-05T03:40:20.642663+0000, chain.objs.size()=1 2024-09-05T02:16:22.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cl5vDh21YqpUqW_qKjPlD5An4pX2MvJ_0 2024-09-05T02:16:22.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1015825948101016619', time=2024-09-05T03:40:23.252382+0000, chain.objs.size()=1 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VY44n67rWU7x58f1dOcK2YjskNOMHaz_0 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14604829790277414696', time=2024-09-05T03:40:23.421778+0000, chain.objs.size()=1 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.v-n51PT9ukHFdKj429CsQXnmoeyP77y_0 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8281434636477196707', time=2024-09-05T03:40:24.262566+0000, chain.objs.size()=1 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.8US1z0YJHXDSQR1VrBu8SGgwUfgM-IM_0 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8396761333616604601', time=2024-09-05T03:40:24.561912+0000, chain.objs.size()=1 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6T0SG0GAspSQe4u3vp0o6ZA-JEGy5C__0 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14261970156605097519', time=2024-09-05T03:40:27.168143+0000, chain.objs.size()=1 2024-09-05T02:16:22.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2WycQgX8OIyvrnVbZfYQe_jfcSMKwoJ_0 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8618584536747216359', time=2024-09-05T03:40:27.300716+0000, chain.objs.size()=1 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GANRPrFzSDgj_07w_30nbVZFb1I9nOe_0 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.223403114919000594', time=2024-09-05T03:40:27.625541+0000, chain.objs.size()=1 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JruYs_GuOZtrXQFYZZEOveeBnnvZAK6_0 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3123861933582870568', time=2024-09-05T03:40:27.867880+0000, chain.objs.size()=1 2024-09-05T02:16:22.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.564+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hWES5T94UbclwgFlQ2LFacwFI0RY-Gv_0 2024-09-05T02:16:22.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16852318066371795224', time=2024-09-05T03:40:30.919907+0000, chain.objs.size()=1 2024-09-05T02:16:22.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.uEtmPnqIPnZoOYKQ0g1uqw1E5P7zOz3_0 2024-09-05T02:16:22.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12291514612293265521', time=2024-09-05T03:40:31.554140+0000, chain.objs.size()=1 2024-09-05T02:16:22.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HlzbwxKb7BDiG_2WW5MF9yuNIxDkOHl_0 2024-09-05T02:16:22.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4846908479767885737', time=2024-09-05T03:40:32.284082+0000, chain.objs.size()=1 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.GyuXMAY2BO6zAdWEz50Nyl2vhcWPgBt_0 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14845037996044838457', time=2024-09-05T03:40:32.410447+0000, chain.objs.size()=1 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EpXgsfwxSX453xSpXKetkDFTzVs6dAz_0 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17616682285703314507', time=2024-09-05T03:40:33.158612+0000, chain.objs.size()=1 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TZ2pXH5a9JraQ3i-JJ3JBEfO36KYecP_0 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12946199914647089032', time=2024-09-05T03:40:34.738988+0000, chain.objs.size()=1 2024-09-05T02:16:22.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jHU0wJMT4wOMiEh7ePaJLR9ZIitBKEY_0 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13094672946270514784', time=2024-09-05T03:40:36.158714+0000, chain.objs.size()=1 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mF49wHFUCoCt4hozWqajJFBJs8igRah_0 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16066598943619282745', time=2024-09-05T03:41:08.625390+0000, chain.objs.size()=1 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.280__shadow_.jifGnR4VrsyEWJnl5BZrqzXHqwlw3UA_0 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12801505450873460671', time=2024-09-05T03:41:34.698725+0000, chain.objs.size()=1 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.568+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.i-7OnLSmGHaK2j72gggG2bZMhkm85B0_0 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12349538438141543207', time=2024-09-05T03:41:40.301152+0000, chain.objs.size()=1 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.NpUACnJNUSlwqqY1HzgLFRla5bCHf7i_0 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2197840243183437984', time=2024-09-05T03:41:45.892230+0000, chain.objs.size()=1 2024-09-05T02:16:22.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.296__shadow_.VFdniFY7nMWd-9lSBCyDkFqViuiEBuM_0 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1402393684265903580', time=2024-09-05T03:44:19.731895+0000, chain.objs.size()=1 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JdGMBj6BnHmUFtfQ5_wnB0zWVA-1EQY_0 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12785264115401474511', time=2024-09-05T03:44:20.332228+0000, chain.objs.size()=1 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OEO7fme-laz4kjHcsvgrsDfovhyZQdB_0 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.274142032962624849', time=2024-09-05T03:44:20.766127+0000, chain.objs.size()=1 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FVitk5SVHKGdl-IRUNK9w4RC_X2COgT_0 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1097198006618350208', time=2024-09-05T03:44:21.317498+0000, chain.objs.size()=1 2024-09-05T02:16:22.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fyxtOWq09q3gejtQCM5ei5MNswHZLpR_0 2024-09-05T02:16:22.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17051668497605556936', time=2024-09-05T03:44:22.123140+0000, chain.objs.size()=1 2024-09-05T02:16:22.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.572+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nQ7N-U_avd3Q0CfIcQeDJmCwZ8rS6tE_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11461536697064468691', time=2024-09-05T03:44:23.405941+0000, chain.objs.size()=1 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YeTvTyHOOax4vr-F3QQK7xvVINy75vf_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13276156968309408522', time=2024-09-05T03:44:23.457096+0000, chain.objs.size()=1 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.84LOBnEFJp4d1lMUol3sIkxwDblwDxs_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2474649278433799317', time=2024-09-05T03:44:23.759456+0000, chain.objs.size()=1 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wejAgKQT__o7M0xkajs8ZtimbYwQGoV_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13066274385245808595', time=2024-09-05T03:44:25.107496+0000, chain.objs.size()=1 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KFCtGzJKLrCiATwEMCm-R0kO7BtRJ-0_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5601241486110286721', time=2024-09-05T03:44:25.133668+0000, chain.objs.size()=1 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tY_TOCQCbGbI6_D6tsLQVHLW0_AO35x_0 2024-09-05T02:16:22.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14324808519554253385', time=2024-09-05T03:44:25.506347+0000, chain.objs.size()=1 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IoZR_uBZgiKPOUKRUEWt3jE_XTrsnvR_0 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6432798849267340927', time=2024-09-05T03:44:26.512723+0000, chain.objs.size()=1 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YT8AjdOv4Sy5ggjRAvsN4hvKdwHxC8V_0 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13766917582434430893', time=2024-09-05T03:44:28.583099+0000, chain.objs.size()=1 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1qtU5_Q04Mst5G9P8ZawCB60gcMUfzN_0 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1322409271821368125', time=2024-09-05T03:44:30.057174+0000, chain.objs.size()=1 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IsD0ryf99Q1MFgtT3sjP5Kr9IWr9utR_0 2024-09-05T02:16:22.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5333236384520090587', time=2024-09-05T03:44:30.684754+0000, chain.objs.size()=1 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oO6XAPfEE-53FrUU_bRnL_Q6wvv6Wgy_0 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9597168710232575768', time=2024-09-05T03:44:32.565798+0000, chain.objs.size()=1 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.h8o1JJzJBF8HdGYXgNn42OcEdondXkh_0 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.505956585031445867', time=2024-09-05T03:44:32.793570+0000, chain.objs.size()=1 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MYrQvPoUjkiKMa-tdl61SMZkGa6F4qf_0 2024-09-05T02:16:22.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5001484211606502578', time=2024-09-05T03:44:34.451928+0000, chain.objs.size()=1 2024-09-05T02:16:22.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.576+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bJI3HnlrhmUM0bnZlZ9lLg9katkTwgP_0 2024-09-05T02:16:22.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5125849096050506623', time=2024-09-05T03:44:35.793161+0000, chain.objs.size()=1 2024-09-05T02:16:22.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._gIU2oYmcVZsbKNEUZbIpVIhU_qOtNq_0 2024-09-05T02:16:22.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15599582503264370858', time=2024-09-05T03:44:36.606385+0000, chain.objs.size()=1 2024-09-05T02:16:22.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FQ-_0nOJyIPxJMj_K0wfR0V3qbyAlGu_0 2024-09-05T02:16:22.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9600805764245005012', time=2024-09-05T03:44:37.633378+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Zq_TQcW3TEFCrcoAzpHzLJ0LB_npFo7_0 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17060266906882368223', time=2024-09-05T03:44:38.149057+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.El2c0bK9fFIzxhxVOCrB5vCy3o-wzE1_0 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18429353011592723634', time=2024-09-05T03:44:38.538939+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LuSvhnJCBvQYXN-GhRk1CESc7rT5yRo_0 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4870800974951800378', time=2024-09-05T03:44:38.910331+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tcdncsewsqfnu6Fqxgf2JOiOOftxIhG_0 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10358310729689209959', time=2024-09-05T03:44:38.911971+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iesQy3gQV1w7__79EYomln8q0uUV_Bg_0 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2143963560687739691', time=2024-09-05T03:44:40.050227+0000, chain.objs.size()=1 2024-09-05T02:16:22.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9yPG7_TLWxv6UUyDchlRe-tKDD6E-GG_0 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17630656597289453598', time=2024-09-05T03:44:41.306714+0000, chain.objs.size()=1 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ogHxoTXP2qI7MPqF5FqQzyxv97Oz1VS_0 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.41017752579925090', time=2024-09-05T03:44:41.398825+0000, chain.objs.size()=1 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9MD4XkGZCjqMyGNwz6ay6aLhkAkUJa0_0 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5288256611716670128', time=2024-09-05T03:44:42.338737+0000, chain.objs.size()=1 2024-09-05T02:16:22.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.580+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lsgiAJe8--S4BDsM0DGMVjRCxvqw-2O_0 2024-09-05T02:16:22.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11300517042221165426', time=2024-09-05T03:44:42.466881+0000, chain.objs.size()=1 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9NGkDrt8wDU10zYK-8_zJSXjzfXVUe1_0 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.124079125148725147', time=2024-09-05T03:44:43.080028+0000, chain.objs.size()=1 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LDljI274B7VCEnVOLR3eE3NpFmjTDQ1_0 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6184918309433522105', time=2024-09-05T03:44:45.000530+0000, chain.objs.size()=1 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tdz0Ok-UOxUbIvgSYRAO6_cXQuI43YP_0 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9176582047872019881', time=2024-09-05T03:44:45.295929+0000, chain.objs.size()=1 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2mk8jqeQd9lSxErE-jaCeYFSYlx9r27_0 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10151819700533735963', time=2024-09-05T03:44:45.885318+0000, chain.objs.size()=1 2024-09-05T02:16:22.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1FOkuVwswfmQQFhp2sz0uuq5RxrYsxM_0 2024-09-05T02:16:22.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7983593611006492041', time=2024-09-05T03:44:45.958482+0000, chain.objs.size()=1 2024-09-05T02:16:22.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.584+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.elHXAzGsfKg-cIeJK1RJOcyX13tYRHm_0 2024-09-05T02:16:22.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15363363801431239960', time=2024-09-05T03:44:46.150223+0000, chain.objs.size()=1 2024-09-05T02:16:22.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.igsOb4PcgBqCZPionm2CzbVRTYk2IOE_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12583495291564901960', time=2024-09-05T03:44:46.241760+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xc3_h9orwVpzI1FcjknhjWs-O12dpeB_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161558488477016819', time=2024-09-05T03:44:46.982081+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MZJ8dzGuDJBZqiMbCxGBR4w85VX4tST_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8168882995258318445', time=2024-09-05T03:44:49.179598+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oC-XV4UUBcdBoFuf5ql4q8wWjToBOFd_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12577039915940299687', time=2024-09-05T03:44:49.555729+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JXN8Lh8DqC7Prq22RRepNYBGLPOJG4v_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16991221019925892626', time=2024-09-05T03:44:49.691193+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wCW3V8Mdzg0Lmp5st54_CSrjVOY1SKj_0 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1601659740206883728', time=2024-09-05T03:46:36.438160+0000, chain.objs.size()=1 2024-09-05T02:16:22.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SvsHY79d0ys-QDM4o7WTb163bXskOjX_0 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10562844374459153144', time=2024-09-05T03:46:38.205988+0000, chain.objs.size()=1 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5b7VUmwmtGpHczwIczOMsyyv-Xl0cbe_0 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14825564906468435002', time=2024-09-05T03:46:38.584259+0000, chain.objs.size()=1 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NZLVF7GMcMvEqb9eBwZurTCalYWZ2YE_0 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16734042211155098470', time=2024-09-05T03:46:40.357150+0000, chain.objs.size()=1 2024-09-05T02:16:22.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FLXVsRvO0s5ZYd7PYqs-XBYOf-4WLJX_0 2024-09-05T02:16:22.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7077274464164381409', time=2024-09-05T03:46:43.435208+0000, chain.objs.size()=1 2024-09-05T02:16:22.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.588+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sAhxDdSU5D5liV-TwUmeyNgYoJa_7ob_0 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15351827177739465107', time=2024-09-05T03:46:43.511503+0000, chain.objs.size()=1 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zMNdEvGIZVsZR4WGpH0i01lgD7Fb2gd_0 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3793049542721743627', time=2024-09-05T03:46:43.744178+0000, chain.objs.size()=1 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0KLm760ugcKxt7gwBEJcPInFnQ9XMXr_0 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.620936890347768055', time=2024-09-05T03:46:43.853050+0000, chain.objs.size()=1 2024-09-05T02:16:22.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vhLAXrQ3uqnYaWNqDnPu6fY73evVQ-__0 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7820636032426763051', time=2024-09-05T03:46:46.452448+0000, chain.objs.size()=1 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GeAOWx67ktpYsmiw9U14-YTKs-ezXUp_0 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14791300325548463760', time=2024-09-05T03:46:48.263388+0000, chain.objs.size()=1 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vHw7NlizFwFA7cNkkhjVK4MV0C026u1_0 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4905505926609681512', time=2024-09-05T03:46:50.167711+0000, chain.objs.size()=1 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5n2Ozm18JdQ-PLWyCm1tHLsNOSYdQk__0 2024-09-05T02:16:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12355968572045820918', time=2024-09-05T03:46:50.977936+0000, chain.objs.size()=1 2024-09-05T02:16:22.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.592+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.z--sKhFFEjf0Xqq-qZYrIdEFuIAG4t7_0 2024-09-05T02:16:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.596+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45431 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1167818030734479718', time=2024-09-05T03:46:52.425197+0000, chain.objs.size()=1 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kJwoPyqLFGWIb0MDuWIYrdUnPRyEUJY_0 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9382383091574412725', time=2024-09-05T03:46:54.129160+0000, chain.objs.size()=1 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ONc4cz9KVLpzgNs4nAoLUUsz5A7IBlb_0 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4337057999669798213', time=2024-09-05T03:46:57.010274+0000, chain.objs.size()=1 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.klj4zoQT0TLuyy1XW2vMH6f93MGvTPl_0 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16347556176644929088', time=2024-09-05T03:46:58.774266+0000, chain.objs.size()=1 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.w61s9qPWMyFbkOnpWfWpMKWdxKCMKGH_0 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4922792332439685081', time=2024-09-05T03:46:58.988410+0000, chain.objs.size()=1 2024-09-05T02:16:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.izybTbM97oPbjXI3Q-gQ2Nra_O4J2tu_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5448846257511749226', time=2024-09-05T03:46:59.235358+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4sJXPasL7u4VAZx8sOFB2aIUImXJzJE_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10504809388051038023', time=2024-09-05T03:46:59.277395+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XS9sbXu6T3XX3vcbe7Hdi9g-ntLRLd9_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5171688805345375008', time=2024-09-05T03:46:59.711513+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WnwJjOUn61F-b9XHBYNyjF3jvB05cEE_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13576210537726951294', time=2024-09-05T03:47:00.212061+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.g3uSPMxs9L7ATAD7T0OZ3licF-jc2Qp_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18281477936437966173', time=2024-09-05T03:47:01.164442+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qajUl3b5Z0kQvPpf0XBb-uWzZ9DzHk7_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6432474538043912967', time=2024-09-05T03:47:03.827147+0000, chain.objs.size()=1 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1158XybK0zpHMdBPiLOIfPP528rAMyl_0 2024-09-05T02:16:22.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11671970309416837953', time=2024-09-05T03:48:12.176128+0000, chain.objs.size()=1 2024-09-05T02:16:22.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.373__shadow_.sF5_OIfmn0oZNhpe20uTF0L4oYQbkq1_0 2024-09-05T02:16:22.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3468081199184576494', time=2024-09-05T03:48:14.791321+0000, chain.objs.size()=1 2024-09-05T02:16:22.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.374__shadow_.4HX4x5x44zsFG8Yj4gSqWRgzQMU8_4e_0 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4513735638667017006', time=2024-09-05T03:51:11.779857+0000, chain.objs.size()=1 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.484__shadow_.HCgCwc8bW-Cw-R1SFKyq9mIOj6JD6ua_0 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16730712221789959143', time=2024-09-05T03:54:18.456216+0000, chain.objs.size()=6 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.1 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.xrNSHf4mIQkVIdY2FfviPFPLAO3w4CCq.2 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.AQro9HIXGywCk3ZeiYL7bosdHoWSpJit.3 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.4 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.5 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~4tT8d5fzzSM-9eMDqoCx_cKcvbXayIk.6 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5250526040227871069', time=2024-09-05T03:56:23.958154+0000, chain.objs.size()=1 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.550__shadow_.2-qrUdZZXnvD1igjHPPfIJFYjT0zjWa_0 2024-09-05T02:16:22.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4882845053000652743', time=2024-09-05T03:56:38.126342+0000, chain.objs.size()=1 2024-09-05T02:16:22.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.600+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.554__shadow_.0XMcaJxCjb-q06sVIu6nEiskRZgOPTq_0 2024-09-05T02:16:22.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3701674755661283525', time=2024-09-05T03:57:25.201161+0000, chain.objs.size()=1 2024-09-05T02:16:22.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:PZxMyCkufl9EOyjRINm76yU9Jg5BD0q_.pUx5YAtfFVuvVe71PSrNh1mCt2x9FJw_0 2024-09-05T02:16:22.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10551669134291126390', time=2024-09-05T03:57:38.267861+0000, chain.objs.size()=1 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:cIWt7B7GVxVN2WNp60E7ldnNL.00Qm5_.iUoipXFT_1Yd2YfObL0GPOM6niTKCCO_0 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6835039174736724269', time=2024-09-05T03:57:41.490223+0000, chain.objs.size()=1 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:Yo2ZAYSviunNVUCM1hB2lHUPeg-O4T2_.58Da-PHFaTJCE5T9wCOr28cD-OXOQl5_0 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1793241221328869909', time=2024-09-05T03:57:48.737240+0000, chain.objs.size()=1 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.570__shadow:qE9WIukn6Xf0L928fASp-rO5t0CG37F_.eyK2dy1YdSpGXrrGdgeWdJGOJ6ViOoq_0 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15622197761816294260', time=2024-09-05T03:58:14.237795+0000, chain.objs.size()=1 2024-09-05T02:16:22.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.576__shadow:v9uZVXWkaVOSjNORqyyK4wvqZ9jW14a_.S_lZ--iWGV25AF29Jnzk4RJpYjigSjQ_0 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9083691183474153174', time=2024-09-05T03:58:41.518489+0000, chain.objs.size()=1 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:Agkmwa62q9ZobRvpXKmuWRxYzu9WiMM_.Ekb4fHjaBxr0JkaONJsEJgL9qyIeg6A_0 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18215311557676587287', time=2024-09-05T03:58:58.892224+0000, chain.objs.size()=1 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:ifhvuLTPWNeCX0.RYT-NkxEg280Ydgf_.Ri8MEKtra_pJsTfRZB-Proaz2wZKYMP_0 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10880015266258532530', time=2024-09-05T03:59:34.637095+0000, chain.objs.size()=1 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.583__shadow:AuXWFhbRjI8nA8SRMtJAAt3HEDnsDJb_.9L7HyDVYn_5GKzsR0d8jzNnxTbiP8bP_0 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3082381667387864703', time=2024-09-05T04:02:52.490019+0000, chain.objs.size()=1 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.617__shadow_.WXSiihFKw0cVdnqxyg1Nv8hkvCuQI0K_0 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18387276560616923203', time=2024-09-05T04:03:58.288947+0000, chain.objs.size()=1 2024-09-05T02:16:22.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.620__shadow_.NGHbL-LRRsc3tDfDzjy7vq1uaNtIjeo_0 2024-09-05T02:16:22.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7277056018999119201', time=2024-09-05T04:05:30.149718+0000, chain.objs.size()=1 2024-09-05T02:16:22.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.648__shadow_.tK-23or93m7bWKEwKR1eGT9PWureaxO_0 2024-09-05T02:16:22.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1385089625982176351', time=2024-09-05T04:06:55.428651+0000, chain.objs.size()=1 2024-09-05T02:16:22.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.604+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.690__shadow:3r9S7643S-NaNRw1VVdl70lMJA0d7sA_.znQVPrLH182qr440i1AAM4v9rhYBQhc_0 2024-09-05T02:16:22.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.612+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.616+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-05T02:16:22.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48328' 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8929277675967273212', time=2024-09-05T03:38:15.416699+0000, chain.objs.size()=1 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.257__shadow_.NDpxPaVl71JfrU039JwFadTG3UCZ_1o_0 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3634868475452388352', time=2024-09-05T03:38:20.780253+0000, chain.objs.size()=1 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.260__shadow_.2JBS_scDrDlsTHHlB7PYGy9gG_6z-5v_0 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.729111247033020273', time=2024-09-05T03:40:04.292288+0000, chain.objs.size()=1 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.0iCzH4bDr5q4c0hQVKyTzadnHjC4Sz0_0 2024-09-05T02:16:22.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17204005056491701665', time=2024-09-05T03:40:06.670846+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.v8DWqqiSSu4T-1h7SePycyA4lSK82Fg_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17527379888120144725', time=2024-09-05T03:40:07.321144+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.poDLZH_qD4cDu9DUthwpZnVpZMR-QH6_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11237745348423572945', time=2024-09-05T03:40:07.467094+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-GdSQFznWPz4kkbD1noiJ1eAY3F6Lqu_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16185347244640672205', time=2024-09-05T03:40:07.651705+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wiIm8pSoAatbDk28lqiwdLvndIZYJ2u_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11357138681271060909', time=2024-09-05T03:40:07.718531+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hnIcqpMMG4Ay68gxEW9Z70zV3ovkZYH_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.69110642685135359', time=2024-09-05T03:40:09.425942+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3RmXfJcleg8asVycgPHJlctunepl4Iu_0 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3285052145059685158', time=2024-09-05T03:40:09.879188+0000, chain.objs.size()=1 2024-09-05T02:16:22.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.olL8-_6Z9_-MtAY9GidlV6CGci7t1l-_0 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15281127573699065582', time=2024-09-05T03:40:10.421153+0000, chain.objs.size()=1 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2j4cLeXzfaNX5J6SrrkqpWKu9C1IeyD_0 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16840904159445906603', time=2024-09-05T03:40:13.380361+0000, chain.objs.size()=1 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.O9k0kIOG50v-1zC7AGoKhkgkDBsedLs_0 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15482567351073694502', time=2024-09-05T03:40:15.160442+0000, chain.objs.size()=1 2024-09-05T02:16:22.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.620+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BJVeucq2wYnVa9_Hy2yI6arFjtsaTEk_0 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4210564416139125735', time=2024-09-05T03:40:15.860016+0000, chain.objs.size()=1 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.qF9SrA-ZkzR9aq047oDAvbUNZe5UTtI_0 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8263190932927690745', time=2024-09-05T03:40:17.739033+0000, chain.objs.size()=1 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.q-n_kYYJUE9gmjirmQsTvtdtQ7NCmU1_0 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6488138883669323769', time=2024-09-05T03:40:17.962244+0000, chain.objs.size()=1 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zCwoGWCjqKMW2NPQZXk9HPXjS9h8wal_0 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15601975065731716207', time=2024-09-05T03:40:18.666310+0000, chain.objs.size()=1 2024-09-05T02:16:22.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.624+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.sMYSOU9AXCYeCLo11kzpOcLCQPWZNTA_0 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16354748958827632466', time=2024-09-05T03:40:18.876267+0000, chain.objs.size()=1 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NZal3TWmbLkLVr92yvLTGRTB0BpI3UB_0 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9623601687715038398', time=2024-09-05T03:40:19.019214+0000, chain.objs.size()=1 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fvkp7v-YxZwW_Io4yUOwMt5O03HVTA4_0 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14068072156006823525', time=2024-09-05T03:40:20.017242+0000, chain.objs.size()=1 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LQonJEs_n3ldKah0khIHUa5CnHvNMRF_0 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9929198486234738987', time=2024-09-05T03:40:20.159419+0000, chain.objs.size()=1 2024-09-05T02:16:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QbtAS7JlZM8JeMl5eLr-innSIGgl3cO_0 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15560265888873406454', time=2024-09-05T03:40:20.361989+0000, chain.objs.size()=1 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.9N_ph99-dxPlcyDC2rhieOOushR9KF__0 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4065891934180117476', time=2024-09-05T03:40:20.512286+0000, chain.objs.size()=1 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Wv_LPmY-KDhwhzGiggmpzvXJm_KShXu_0 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12075929367546376604', time=2024-09-05T03:40:20.748140+0000, chain.objs.size()=1 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EEX74yncDybnQXCQCpDPg9_WFh8PC43_0 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9829488816120573393', time=2024-09-05T03:40:22.624067+0000, chain.objs.size()=1 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1W7eI2XCOIoQ5AXTyrRs7aTg7044Ko6_0 2024-09-05T02:16:22.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6985710024896398712', time=2024-09-05T03:40:22.798056+0000, chain.objs.size()=1 2024-09-05T02:16:22.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5hdG1LOcEdpCZhOycTt7bA90-_0iLbr_0 2024-09-05T02:16:22.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17001801260733358064', time=2024-09-05T03:40:24.855504+0000, chain.objs.size()=1 2024-09-05T02:16:22.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.N5T_3dJ0MRPiqqYYRsjGAKfmVRS_w5o_0 2024-09-05T02:16:22.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12403392741535020787', time=2024-09-05T03:40:27.186073+0000, chain.objs.size()=1 2024-09-05T02:16:22.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.628+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QK8bTC0_F7998nQiOumm5eYtAV8qyZi_0 2024-09-05T02:16:22.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17435197445466764982', time=2024-09-05T03:40:27.762585+0000, chain.objs.size()=1 2024-09-05T02:16:22.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7AiHtaM4JO-OI9FV-ymA9psBdde7zyH_0 2024-09-05T02:16:22.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2415729541166485049', time=2024-09-05T03:40:28.476641+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yd9oB_B7tTz15rtJDmugxFz1drgQWBy_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3557064072322828053', time=2024-09-05T03:40:28.970803+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.W25h02JIAfwXBGxsJNPHdCb_g-fNkPN_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1299668328657932445', time=2024-09-05T03:40:30.411465+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.iqx9CRu3wuMGE4ta6xN8Z3U21vLH-Ns_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3691537215629719484', time=2024-09-05T03:40:32.165322+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3fnbFTcIIobWqe14IMd3GYxcnaU6I69_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14340144357165180771', time=2024-09-05T03:40:32.288888+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.gqcc8JLVRM77QwaTYRpmAvX_OoF2X2J_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.964223116395105482', time=2024-09-05T03:40:32.616863+0000, chain.objs.size()=1 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.EZSvHzU_IucLK4ndOPTy9kc_7I5cpNl_0 2024-09-05T02:16:22.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.339609353081491851', time=2024-09-05T03:40:32.755163+0000, chain.objs.size()=1 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jMwxqAFPGwvWtVcnq81du0i7VcG9Tfy_0 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3615694045206501772', time=2024-09-05T03:40:33.800343+0000, chain.objs.size()=1 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.632+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BRYOLQzLAWO2sq4bl8e_cedXQMQJ744_0 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6913495410826317723', time=2024-09-05T03:40:33.814521+0000, chain.objs.size()=1 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Bt1dY2SKrj2vp5h-uPHXeAe0n95IXwV_0 2024-09-05T02:16:22.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1329240676922824763', time=2024-09-05T03:40:35.263129+0000, chain.objs.size()=1 2024-09-05T02:16:22.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.htgmvhZqY1XRiLOOOIwLl6Kn7m4R9QR_0 2024-09-05T02:16:22.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7084190946791284548', time=2024-09-05T03:40:36.309584+0000, chain.objs.size()=1 2024-09-05T02:16:22.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hqw3F0IQ1_z4Z7g-g4-btIAUaflLQI-_0 2024-09-05T02:16:22.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4269517611463480937', time=2024-09-05T03:40:36.460485+0000, chain.objs.size()=1 2024-09-05T02:16:22.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.d36AxWyPCo_NhoI526BgR6LAPSjycXI_0 2024-09-05T02:16:22.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9337059924858538948', time=2024-09-05T03:40:48.891336+0000, chain.objs.size()=1 2024-09-05T02:16:22.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.269__shadow_.c3BSsLd5loZx-X7XE46SAxg_6uteM9-_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14642843881218536980', time=2024-09-05T03:41:03.117394+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.277__shadow_.WX0XGy_3IaipUNIBrjsn7_ELd2OA_DU_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18362467510092100485', time=2024-09-05T03:41:04.965180+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.278__shadow_.qEdxniMC4X1UuiTYG_rqFSEASflk7kN_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9307485744775760221', time=2024-09-05T03:41:34.719785+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.fXB_OGweji1hifYNhucJSE_mPW_u9yr_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11255728706198127199', time=2024-09-05T03:41:40.123827+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.NxCiggFrUc7190bS_vqie2oV-xw_4JT_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16451751466248073217', time=2024-09-05T03:41:40.125628+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.2nG-KuwE-vCsc429hf_RVQwljb7hHoz_0 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.891334341802764691', time=2024-09-05T03:41:44.045514+0000, chain.objs.size()=1 2024-09-05T02:16:22.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.295__shadow_.mKXXCuteOhWeoyqldWgsQcw3wZ8_tiM_0 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7352295705287502600', time=2024-09-05T03:41:47.788188+0000, chain.objs.size()=1 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.297__shadow_.sEaoZFyTce_OHOv1z-3Nfu_lyF-hTJd_0 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14216585058123659675', time=2024-09-05T03:41:59.206245+0000, chain.objs.size()=1 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.303__shadow_.XtP7HTrZPQ7eXCCDubi8NSyiY2ZNv3P_0 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1439288579575889060', time=2024-09-05T03:42:05.221314+0000, chain.objs.size()=1 2024-09-05T02:16:22.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.636+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.306__shadow_.T48cj1vfhf3M6m7JPLeoKbDgxsAJNoP_0 2024-09-05T02:16:22.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17982789782168532079', time=2024-09-05T03:42:08.072317+0000, chain.objs.size()=1 2024-09-05T02:16:22.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.307__shadow:YNn9KVhHpaoFj9AOzLB5v7.iIzcLaHQ_.c0mChtyDGLHTzi7Lcx758aK36vnBuN2_0 2024-09-05T02:16:22.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.640+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13289074709672604389', time=2024-09-05T03:44:20.116471+0000, chain.objs.size()=1 2024-09-05T02:16:22.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.640+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5kKydQ7yjVyan6j-gV6dGtrIoo9BaXh_0 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14736856717965643026', time=2024-09-05T03:44:21.003353+0000, chain.objs.size()=1 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.K786vg2z1-pSCRi2ruXl_Xz98UYK58T_0 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.881599621316189384', time=2024-09-05T03:44:21.535927+0000, chain.objs.size()=1 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.7BHrVCfZtfleA1Y1GlkyG0e1dTHw5Vy_0 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15669198500051140695', time=2024-09-05T03:44:22.408096+0000, chain.objs.size()=1 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yMOQRjvaKHNYGZg-4J9humZWCEMTacz_0 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7557483818000551577', time=2024-09-05T03:44:27.791181+0000, chain.objs.size()=1 2024-09-05T02:16:22.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.b3RZcgZM78X6Kx2KypEGQyzzyQttd55_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8665613329927997592', time=2024-09-05T03:44:28.873981+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Tz1QHOmJOuVFgkompqey7Z_0bxddIUQ_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1559784275945980020', time=2024-09-05T03:44:29.649567+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Oa9_0FQBfGxYBXbP73nYf4lt2in75kF_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4867494567289135444', time=2024-09-05T03:44:31.673854+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZaONDtnbCuZdOsG7egrKU_sykzC9wzx_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12252590449315102767', time=2024-09-05T03:44:31.832017+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Pqn10X9mbdc0hHsycqmABpSUmY8owgd_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15646210300128031148', time=2024-09-05T03:44:32.145969+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._VrpMRc49R8JJf2ioPkmM6OlLBaRWgt_0 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4551938681730514207', time=2024-09-05T03:44:32.268418+0000, chain.objs.size()=1 2024-09-05T02:16:22.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JG-XylTxzgEC6FekFrckE_zwzNI0Mev_0 2024-09-05T02:16:22.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5900996701142376944', time=2024-09-05T03:44:32.319631+0000, chain.objs.size()=1 2024-09-05T02:16:22.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YIgTypulTalHr6pg9oYKm8e0ZmjEp4x_0 2024-09-05T02:16:22.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9584975518342252089', time=2024-09-05T03:44:32.379262+0000, chain.objs.size()=1 2024-09-05T02:16:22.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.644+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZoAMbQYo-ZcQD0qwowhOQOROx1CfDTv_0 2024-09-05T02:16:22.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.947495657688041459', time=2024-09-05T03:44:32.467635+0000, chain.objs.size()=1 2024-09-05T02:16:22.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.E_c87KvUlEjrX5TnBhSF9J4UZmWMqvh_0 2024-09-05T02:16:22.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5524872401416097509', time=2024-09-05T03:44:34.032959+0000, chain.objs.size()=1 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DZhHOKUEQpsM1cMZSCCc37v8vCi93co_0 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11091389535349377082', time=2024-09-05T03:44:36.420996+0000, chain.objs.size()=1 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.R3M7bSaRJ_KOpSX5QtPWJV5ylWXivUq_0 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12544518622200663356', time=2024-09-05T03:44:37.695457+0000, chain.objs.size()=1 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.c3-tb5mT2WrqnGnLDXCStq_6moO6Izo_0 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12632664144109731190', time=2024-09-05T03:44:38.938119+0000, chain.objs.size()=1 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8hRMCZgQ2YlV3OxQYZ96Keq_QtDyUzi_0 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9413433678218712982', time=2024-09-05T03:44:39.792967+0000, chain.objs.size()=1 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Yr6gCHp2lJxmdRaq7Ia67rPysgNzJxj_0 2024-09-05T02:16:22.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7868497085113153946', time=2024-09-05T03:44:41.704628+0000, chain.objs.size()=1 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ytoSyn8sYy4Vnt3Vvs_eXYRVXYCH4oI_0 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15828492502987829085', time=2024-09-05T03:44:41.936871+0000, chain.objs.size()=1 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._GkHx9J54vocqQAGcggKUpUou3hgEUc_0 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11375618953470469351', time=2024-09-05T03:44:42.971185+0000, chain.objs.size()=1 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yOstxA1WR_vbi1zYlGijERq7gACKLBZ_0 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14009201353832331768', time=2024-09-05T03:44:44.181934+0000, chain.objs.size()=1 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.c4SippIMVzGmLJDMnE9tCLjSStwL9lr_0 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9998565997891575841', time=2024-09-05T03:44:44.453792+0000, chain.objs.size()=1 2024-09-05T02:16:22.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.648+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.YflZrLmA2Dh4IogodgvjkfKJ2STGSBz_0 2024-09-05T02:16:22.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17859352358072719639', time=2024-09-05T03:44:44.784184+0000, chain.objs.size()=1 2024-09-05T02:16:22.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._TVsvD3ZrUO0080gGL1NPpQx7Aueeqe_0 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13737227654224735919', time=2024-09-05T03:44:45.766090+0000, chain.objs.size()=1 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.f-5llH_FjDbccsdaFUnfKRcR5wtho_I_0 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15476374569656984616', time=2024-09-05T03:44:45.874383+0000, chain.objs.size()=1 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pswmKEr6-89hT9xjVSRuAQjN5-VmkNK_0 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13192386688661019123', time=2024-09-05T03:44:47.007175+0000, chain.objs.size()=1 2024-09-05T02:16:22.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ggZO8XWaDC5yZzYrRr1Vhs4bZbNZ85O_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4788955759807124140', time=2024-09-05T03:44:48.671293+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.S42pbhIL1OHPTlzn_a9IsDAsrKFNY3A_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4878626715713055494', time=2024-09-05T03:46:33.389039+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fSIEBScp1jkT9ilJihB9jaaTCq2Syrt_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9201630085132255157', time=2024-09-05T03:46:33.892675+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3EoBn6uLAdbZGUe4GeR2L3yrfNMIXcn_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17701753171083624691', time=2024-09-05T03:46:34.154195+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.t89byk8nJVr3xnz6LayLsVcCPccNeIy_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15739732637034136117', time=2024-09-05T03:46:35.293759+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.TXgWWdxx_o85xzqCkQhJjdvjO1WO_In_0 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6419027661159066100', time=2024-09-05T03:46:35.563896+0000, chain.objs.size()=1 2024-09-05T02:16:22.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ocbZkWLPkMDL3PGyK2jIdTpF-Ol5Zn4_0 2024-09-05T02:16:22.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8946037538308672552', time=2024-09-05T03:46:39.772945+0000, chain.objs.size()=1 2024-09-05T02:16:22.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ihVEeUYfzZD2ftStVg4ntYejRgZRB9K_0 2024-09-05T02:16:22.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8647912707768084412', time=2024-09-05T03:46:40.166311+0000, chain.objs.size()=1 2024-09-05T02:16:22.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.652+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CsHfnp7eYLWS4E_-lPR_HYuiSeZ06LV_0 2024-09-05T02:16:22.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11506670926690487528', time=2024-09-05T03:46:40.960900+0000, chain.objs.size()=1 2024-09-05T02:16:22.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0TQhY7qjTLoM-e__btR6N8fEVzmi_4P_0 2024-09-05T02:16:22.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13508580401181719048', time=2024-09-05T03:46:42.001045+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.91U4LhOnrY3KMIBcNcN-P8Bx5wk6NzG_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1919148973178431734', time=2024-09-05T03:46:42.973531+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.656+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.--9zNec2zw8-uqMTaJf55NW5uEC68A4_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11110200531208582948', time=2024-09-05T03:46:43.169982+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FzjD5a9myxF2JjwmzXxAINB0tIEMqd5_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17558413451528354051', time=2024-09-05T03:46:43.269475+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ASn5cShurIyhIVme-eq0qo7N95Y76Yw_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4467509987033203208', time=2024-09-05T03:46:43.848307+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lv2XWyBGgRcF7RqPXpBFl0FSow-8k31_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10336711253884125952', time=2024-09-05T03:46:44.618253+0000, chain.objs.size()=1 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.97Z_guRUTQZZCjYM7Xm20vc1B-ZQveL_0 2024-09-05T02:16:22.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17115606599831762232', time=2024-09-05T03:46:46.191734+0000, chain.objs.size()=1 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6sGZBkBIyK_p2hosRPHrkxZR8OPTcYY_0 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12395250272374420448', time=2024-09-05T03:46:46.397291+0000, chain.objs.size()=1 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jFE1FswRAt-rY1Qx44fPIXPtdt-3u0W_0 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.552841738349410483', time=2024-09-05T03:46:48.240814+0000, chain.objs.size()=1 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.DwkQvJGwieYVO3f-Pzoik3WS8hlRUVK_0 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4699631646699356816', time=2024-09-05T03:46:50.184220+0000, chain.objs.size()=1 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.G8QclUYDxDPwcTSWyd9LzvMBiHW353O_0 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10681061407490941775', time=2024-09-05T03:46:50.186283+0000, chain.objs.size()=1 2024-09-05T02:16:22.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.660+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b2V9EGKGewEH-1Oez1uasRM1EkIwVsW_0 2024-09-05T02:16:22.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48328 2024-09-05T02:16:22.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-05T02:16:22.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4200258570054541919', time=2024-09-05T03:46:52.944347+0000, chain.objs.size()=1 2024-09-05T02:16:22.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.226qBhs3h0McSi7kNqQL48KIlmnb8C7_0 2024-09-05T02:16:22.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11633345112861756853', time=2024-09-05T03:46:54.715490+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3G54J1bsaO27hyXf4PTMeaYDAZZu2ED_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6520766723496435242', time=2024-09-05T03:46:56.235452+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4Eim3qJCAHrLrSiXJt4-xddBOO7kYVC_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13080667504517809005', time=2024-09-05T03:46:56.354731+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ovLPlKhz7_AKy2kh35FZZRGhzYHk7I0_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2450909792657177732', time=2024-09-05T03:46:58.703861+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zxRSzbJZCivTQgk8_PL5zpXwq_HGLFh_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16066849958504749362', time=2024-09-05T03:46:59.194560+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Cabp8C37Dyhsn1X4m5BJMMlaoMlsQpv_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13319683308511136839', time=2024-09-05T03:46:59.597032+0000, chain.objs.size()=1 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QIAFITqHMsUOBfZYGE_ijfaDvalCzbU_0 2024-09-05T02:16:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16609172490157069120', time=2024-09-05T03:47:00.762551+0000, chain.objs.size()=1 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.70oxGe8cW65NPYXD5FlsYEiuT-0yEbC_0 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3453845380025757428', time=2024-09-05T03:47:01.102584+0000, chain.objs.size()=1 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PO9gcfOieQHnqytZCkmFcXQYbfgAqhD_0 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11515025036315731923', time=2024-09-05T03:47:01.241584+0000, chain.objs.size()=1 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.C1Yn7RNBnZngQA5rHdW9VbhjX-WOmyu_0 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18105997952000968151', time=2024-09-05T03:48:21.253378+0000, chain.objs.size()=1 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.378__shadow_.FFrkUJBTcSvSR2N1Ic3NaDH5LG9q2P-_0 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11733003429797589858', time=2024-09-05T03:48:27.898405+0000, chain.objs.size()=1 2024-09-05T02:16:22.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.664+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.382__shadow_.eYJJP_VGbpBNzXv4qE4CawPJSKraARL_0 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2507229742253417157', time=2024-09-05T03:48:40.436954+0000, chain.objs.size()=1 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.390__shadow_.PEGPUGYw9EFWRORuyzbYPoLPgZHxeJY_0 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3632724827615066586', time=2024-09-05T03:49:48.089264+0000, chain.objs.size()=1 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.435__shadow_.ZRcU87j3bCFHEQ2A1xqcezEb3jkWxpR_0 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4531575715211347100', time=2024-09-05T03:50:00.265626+0000, chain.objs.size()=1 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.442__shadow_.joMnBxVbZ9109kyR4WNGPt2rKzt-pEI_0 2024-09-05T02:16:22.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11964490653404846451', time=2024-09-05T03:50:29.894679+0000, chain.objs.size()=1 2024-09-05T02:16:22.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.458__shadow_.wuSUZ6UJ3mLfLSK6vlkNhs_v48Q0PLl_0 2024-09-05T02:16:22.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6719120407427389757', time=2024-09-05T03:51:46.291795+0000, chain.objs.size()=1 2024-09-05T02:16:22.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.503__shadow:3hLdZM1he306i41EubW4eAyoLLCZIZ9_.m2_sCTw1Gfoog7TuM1hkG92Hjt3-hXV_0 2024-09-05T02:16:22.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2064595530265759267', time=2024-09-05T03:54:38.274456+0000, chain.objs.size()=3 2024-09-05T02:16:22.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~NsDoIAzNWmp7zsIrZGxBVwSn_jXqyBN.1 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~NsDoIAzNWmp7zsIrZGxBVwSn_jXqyBN.2 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~NsDoIAzNWmp7zsIrZGxBVwSn_jXqyBN.3 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2543724526016468330', time=2024-09-05T03:56:31.461210+0000, chain.objs.size()=1 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.552__shadow_.m-235XpJgMIJtuohD8ERjIk-Zdnad73_0 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16076164290745113136', time=2024-09-05T03:57:30.737151+0000, chain.objs.size()=1 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:15OQ4GktbkA0LShKmC2GBiCBge9q9a2_.qHIUWdLEUdJiOrUWcoJ35wKy4KbxgoQ_0 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10874531299578892507', time=2024-09-05T03:59:24.988180+0000, chain.objs.size()=1 2024-09-05T02:16:22.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.668+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:CC4hsQMIxmnGHloznfkomwRHNV6r2s2_.5xdMMzN5ugdREFexF-F0rhG0gAcbL4B_0 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9141069309623691473', time=2024-09-05T04:02:52.810740+0000, chain.objs.size()=1 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.617__shadow_.cuSB3V7fKtkcbwont_N3bvzxJhIaibL_0 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13027128548680868563', time=2024-09-05T04:06:40.811904+0000, chain.objs.size()=1 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.679__shadow_.qEm-mB-n1qnVVooFssdqFTNL6TPq5bu_0 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10751062444666449959', time=2024-09-05T04:08:26.508196+0000, chain.objs.size()=1 2024-09-05T02:16:22.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.734__shadow_.HRLkw_F0AqydQavqSr9xBB3p0Zza9xx_0 2024-09-05T02:16:22.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.672+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.676+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-05T02:16:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45225' 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_P0eLo90y-ChuENYqHNQnSNMxcirpIhZ', time=2024-09-05T03:32:56.695898+0000, chain.objs.size()=2 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.n_ibPQn7h4UdMDulc7JbHDyMIIjI_MQ_0 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.n_ibPQn7h4UdMDulc7JbHDyMIIjI_MQ_1 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1952580796372688218', time=2024-09-05T03:37:19.930185+0000, chain.objs.size()=1 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.228__shadow_.qOITPpXYGg6217vuoOVtO58thDsyWWQ_0 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18370135188377513442', time=2024-09-05T03:38:17.124034+0000, chain.objs.size()=1 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.258__shadow_.uSecN04Pv87XSNAoDfOssc86MP1ccJE_0 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7627810386179761831', time=2024-09-05T03:38:18.928116+0000, chain.objs.size()=1 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.259__shadow_.lw0ylk38_aCTmVdpEBAC_tf0fz9ZY4e_0 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13234955110515630936', time=2024-09-05T03:40:07.745105+0000, chain.objs.size()=1 2024-09-05T02:16:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.U8K3zRv4cODFPdzg01XQHFBE4s2SK5X_0 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3692238904960286293', time=2024-09-05T03:40:08.781501+0000, chain.objs.size()=1 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KXciDqglfEPxjNhEevvKq9I7yGBTVrI_0 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12300603242236002189', time=2024-09-05T03:40:08.857151+0000, chain.objs.size()=1 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.NQieWPRDGdPhwE3GPWmPOsmcLXApeV0_0 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15062269207546533231', time=2024-09-05T03:40:09.693919+0000, chain.objs.size()=1 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.t9O4QlJ9X-uotdtV4--EEcZPky-4-vq_0 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15392598940584983600', time=2024-09-05T03:40:11.030535+0000, chain.objs.size()=1 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LR5Yqypjv77zclaCRfO7VpIMRtmQrsV_0 2024-09-05T02:16:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6260686688858463186', time=2024-09-05T03:40:11.299801+0000, chain.objs.size()=1 2024-09-05T02:16:22.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.A-765BvndNFyvzsHhTOJw4cHP0jYd5h_0 2024-09-05T02:16:22.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14712039792556675963', time=2024-09-05T03:40:16.350992+0000, chain.objs.size()=1 2024-09-05T02:16:22.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.680+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.R3y8mMFQ1QTyiwgaFouEyadZ4bzOK3O_0 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17485094511120256024', time=2024-09-05T03:40:17.982672+0000, chain.objs.size()=1 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.f9hmqlVxjBdNrTHii5UXC_SQNV9c0xN_0 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11535132733751051826', time=2024-09-05T03:40:18.597033+0000, chain.objs.size()=1 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TYOnZI3-iq0-Gw7Z9u5C4tz5n9XIj1j_0 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9958496779081804451', time=2024-09-05T03:40:18.600004+0000, chain.objs.size()=1 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hAeeFZmllGTI0PHHqfBfDjqnSYl31Zc_0 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.770970306537946708', time=2024-09-05T03:40:19.029247+0000, chain.objs.size()=1 2024-09-05T02:16:22.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Y1Go-9Eqhw9cmpx6K-cMhDOobzn2Da__0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6199325340213473855', time=2024-09-05T03:40:19.519373+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.4x5DzgqAYiMxWsLyK_3a1akIF7UtrTg_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14143645329788070553', time=2024-09-05T03:40:20.005065+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Q-OHh4MMOdgMNIcMQkUzlTmYbFlT5vd_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8030145968326738894', time=2024-09-05T03:40:21.777476+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SGQPgM9L86PW5qLuV5sBTXsdD3liHGz_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1436095755359683749', time=2024-09-05T03:40:25.008073+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2qmjoRoFy9reMkiiN1_pXy5KCp23xFl_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6720080219869905807', time=2024-09-05T03:40:25.859331+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FQEHU7eepeLgi-_L6W-P0DIgvwLgZJC_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16134275543484332905', time=2024-09-05T03:40:26.772184+0000, chain.objs.size()=1 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3HkvKB5M7E4malADK-Ae93fIeKW-JnF_0 2024-09-05T02:16:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5556552031745623685', time=2024-09-05T03:40:26.863965+0000, chain.objs.size()=1 2024-09-05T02:16:22.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.684+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.2lIUUBrdKie66Z-GzlbpsxHLdN0DFFH_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16018726461935497790', time=2024-09-05T03:40:27.092385+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.G9s39atzOVtvXIGC6BVknjDo_yia11x_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4065357631772376558', time=2024-09-05T03:40:31.547202+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RET_RNlnWtV7FfU_WK72ndqEjE-3rfg_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2796847144521385808', time=2024-09-05T03:40:32.071507+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cQHAEAIjmNAeBcIta1hXVuAJyMzRlks_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6181959051661602786', time=2024-09-05T03:40:36.328735+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cx4Mx9HXQ0EJyu1W29XFCHEa2X0cpuQ_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7713852972565095873', time=2024-09-05T03:41:16.221205+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.284__shadow_.sMy-vvn2XFBhi103sq0lXL16R2OPYTo_0 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16666717101279209438', time=2024-09-05T03:41:16.249078+0000, chain.objs.size()=1 2024-09-05T02:16:22.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.284__shadow_.64Ik83Xrm2Qhxd91GLiaOqJLW9SSK-5_0 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17755238585439270937', time=2024-09-05T03:41:34.607440+0000, chain.objs.size()=1 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.kXc1jNPHcKWexXyyFOhMV8ubpaPf57R_0 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6376434858731811378', time=2024-09-05T03:41:39.991725+0000, chain.objs.size()=1 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.MqtRE54hJFiuu7GuIyNJm52l4u6O87F_0 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16411373164140586090', time=2024-09-05T03:44:19.132574+0000, chain.objs.size()=1 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cquiN8kR0jf0D7RPBZ2irt_AWhD5JcG_0 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5610212972050812692', time=2024-09-05T03:44:19.359940+0000, chain.objs.size()=1 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6s6-QCXStQPWpm-Q1Dx37f1srPLbXyl_0 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3861163171813998811', time=2024-09-05T03:44:19.687596+0000, chain.objs.size()=1 2024-09-05T02:16:22.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.mRh32osz_q3gQ4juuwIrsxWoeZk_7xx_0 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6376344483322747326', time=2024-09-05T03:44:20.735930+0000, chain.objs.size()=1 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.83lF3NdPYdx6_7UzapRivaMKUlcew7A_0 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16628675477234779241', time=2024-09-05T03:44:21.101196+0000, chain.objs.size()=1 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G1qP39_mGf3EsiCPJovCLi3lxHlcNM9_0 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.779784215337716092', time=2024-09-05T03:44:21.113244+0000, chain.objs.size()=1 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0QoEO_MkDNUM0qxsLOBN20S-yGqsEyP_0 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5971145941619164370', time=2024-09-05T03:44:21.659086+0000, chain.objs.size()=1 2024-09-05T02:16:22.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.688+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OS1cu4yAq4wUnzrND6FBEZdOzkYSsqL_0 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18276926201852541127', time=2024-09-05T03:44:21.994461+0000, chain.objs.size()=1 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bvIVuB4VvqKsmY4nl4Kl8su1LWxypak_0 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4916697642401183682', time=2024-09-05T03:44:24.473811+0000, chain.objs.size()=1 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GK_HFmLaU9dMH3ciZJlN2YgjWHJGQqs_0 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10150430946350704081', time=2024-09-05T03:44:24.584036+0000, chain.objs.size()=1 2024-09-05T02:16:22.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FMQlIbY0IgqH8zMOVlFt3aX8bxvd9iT_0 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17705688764166562248', time=2024-09-05T03:44:25.140666+0000, chain.objs.size()=1 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1WWl-A4qHLkhcEO7FeCISO4utfaJHu5_0 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7394855665990346399', time=2024-09-05T03:44:25.338678+0000, chain.objs.size()=1 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8jHidvHXLMNCQw5bFShskWX8geUMlKj_0 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2541109871199757368', time=2024-09-05T03:44:25.695071+0000, chain.objs.size()=1 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jYPiqIPFb0EpwSabqHgSISPfMBkrFz1_0 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8612848275271839731', time=2024-09-05T03:44:25.814329+0000, chain.objs.size()=1 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.AKjDqlMCLq8Wd7_p2ubdm5lKmV7wevZ_0 2024-09-05T02:16:22.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13343517213440192281', time=2024-09-05T03:44:26.158897+0000, chain.objs.size()=1 2024-09-05T02:16:22.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wgQ8alEayVNV9NZZT6317glwmrOpcI2_0 2024-09-05T02:16:22.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2406540940782660325', time=2024-09-05T03:44:29.111838+0000, chain.objs.size()=1 2024-09-05T02:16:22.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.EZTw7iHY2PjMSjLOmcYlcaRXzGV7wI3_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11410639512532459242', time=2024-09-05T03:44:29.505693+0000, chain.objs.size()=1 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4ww2CioZU-0vexrZlb6lShz82hg4ojC_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6249070946954998907', time=2024-09-05T03:44:29.813150+0000, chain.objs.size()=1 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Z8mvCRAj6uxwPr9RwUnTR4sSQc-E1-8_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1034709269627962266', time=2024-09-05T03:44:29.924255+0000, chain.objs.size()=1 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cXMEBHWB0APKJeF5Dv2A1uUx_86A1wr_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7084956966645421425', time=2024-09-05T03:44:31.728223+0000, chain.objs.size()=1 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.v2wLoe35cwMvZrDYeUfaup6fQQn5iW-_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5976876355450807479', time=2024-09-05T03:44:32.709616+0000, chain.objs.size()=1 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ORC9bX_TJUgcHnI8eQmmjp9DngibMMA_0 2024-09-05T02:16:22.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16822348381130553875', time=2024-09-05T03:44:32.926761+0000, chain.objs.size()=1 2024-09-05T02:16:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.692+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5vYqxQCgbzmvcSjOpw6NzqQRwK4tLxI_0 2024-09-05T02:16:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12114477129530123430', time=2024-09-05T03:44:33.266856+0000, chain.objs.size()=1 2024-09-05T02:16:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pdtGqEZB12U5U-gvSkC4M_dR7x1Iqft_0 2024-09-05T02:16:22.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7222255954258589550', time=2024-09-05T03:44:34.452351+0000, chain.objs.size()=1 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.aAkb4bWaM1WmTXi1M7_FfxiAPOSdYvx_0 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4531010806627133220', time=2024-09-05T03:44:35.913610+0000, chain.objs.size()=1 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.E1FgkPBxc2nq_MdDPuthwg1p8ACxogn_0 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14685695158947848847', time=2024-09-05T03:44:37.115942+0000, chain.objs.size()=1 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OJ2KKN1YUhcyhZglqdaMoZ6De6qvuMc_0 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16875193681436138987', time=2024-09-05T03:44:37.307973+0000, chain.objs.size()=1 2024-09-05T02:16:22.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vKK6b3hkUK0jXrq-txv0p51SencEfrb_0 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17975546497217658694', time=2024-09-05T03:44:38.474699+0000, chain.objs.size()=1 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.5qNK3Bdbs5BhcconM7gVHyfbNeQ2HEX_0 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2715200231716056849', time=2024-09-05T03:44:40.031530+0000, chain.objs.size()=1 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.tcQfnm07xlxeEXJVl6manbXKKp2pGDD_0 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12583036082953018352', time=2024-09-05T03:44:40.736210+0000, chain.objs.size()=1 2024-09-05T02:16:22.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.irn4a1c-_F7ge_ptQ1QA7aNc5um--oa_0 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10620368979467090120', time=2024-09-05T03:44:40.890630+0000, chain.objs.size()=1 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Qbm8Vi3YDL8KzNZGHFzUZx2oli6ZQP3_0 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.114552557586075030', time=2024-09-05T03:44:41.307672+0000, chain.objs.size()=1 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vnk5rIOdw-4rgVFyWpNggZYNTAynkA2_0 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8066340029011337859', time=2024-09-05T03:44:42.691034+0000, chain.objs.size()=1 2024-09-05T02:16:22.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.696+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.cXM15drGqhvJvZZZCBVu3sdNFXgFH7i_0 2024-09-05T02:16:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17809042639469648770', time=2024-09-05T03:44:46.000724+0000, chain.objs.size()=1 2024-09-05T02:16:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.StzuMm7OgVIlRnhI6wDLXax566RPgye_0 2024-09-05T02:16:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11818971379804679885', time=2024-09-05T03:44:49.854203+0000, chain.objs.size()=1 2024-09-05T02:16:22.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-UpMNxIoR-7vJEVpOeMXVPy_2rQNooy_0 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13761111821401893826', time=2024-09-05T03:46:34.273612+0000, chain.objs.size()=1 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OTgBiLTftenQOLHjBmEspCSb0KxkzQi_0 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10395721504000533264', time=2024-09-05T03:46:34.593499+0000, chain.objs.size()=1 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Rt4MtT_ppa1EiyK7l7eb3Plbix3ZMda_0 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1699347145651832475', time=2024-09-05T03:46:36.029332+0000, chain.objs.size()=1 2024-09-05T02:16:22.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.O6_wq4zPv1zREldxz1bJwzU3LIBCi4r_0 2024-09-05T02:16:22.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8486300677809773397', time=2024-09-05T03:46:36.536135+0000, chain.objs.size()=1 2024-09-05T02:16:22.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.220gymGciVlLrGOnxDs25ROUEHxayaQ_0 2024-09-05T02:16:22.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3698310822903984080', time=2024-09-05T03:46:39.521728+0000, chain.objs.size()=1 2024-09-05T02:16:22.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5Ekl4ezvnozw3OQ0urLp_v2urUQtIED_0 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.627128505671731962', time=2024-09-05T03:46:40.375243+0000, chain.objs.size()=1 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hXn3AMiFrPk7C3iDtFzWbEzkw72J1aJ_0 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7294529719081147971', time=2024-09-05T03:46:42.251703+0000, chain.objs.size()=1 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.RqGAtzMliUnyMvwtqXWbSCO4aMupbTL_0 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2049686136852304068', time=2024-09-05T03:46:42.322445+0000, chain.objs.size()=1 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kk2tCgeOESPf60TCO7j7tLi-lHgVAsq_0 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7657558125101651565', time=2024-09-05T03:46:43.005271+0000, chain.objs.size()=1 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.L5bL8siAFOb5NnHo7bLNhRbhprbRyNd_0 2024-09-05T02:16:22.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3399555533475371494', time=2024-09-05T03:46:43.853619+0000, chain.objs.size()=1 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1txx2C7_P_1HH_AH7yugMmwKIuVIQBN_0 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7730771728465029489', time=2024-09-05T03:46:44.088185+0000, chain.objs.size()=1 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.I1vTFp5sT9TGiY6_jHcHO3kVRT4zKoU_0 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6914237088762819845', time=2024-09-05T03:46:44.090430+0000, chain.objs.size()=1 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LwMEpAD_iB1rAnL6c3kEnMOl-u9K64K_0 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4866847710087635084', time=2024-09-05T03:46:47.825186+0000, chain.objs.size()=1 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.maDEHTMRtms7MkxQ4CBvzhTqS9W_ROQ_0 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17129137516999353607', time=2024-09-05T03:46:48.068003+0000, chain.objs.size()=1 2024-09-05T02:16:22.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.700+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.GE_9rq5oYwvvr0cYq0Rm8s5u-UGNwOA_0 2024-09-05T02:16:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3498084280205345640', time=2024-09-05T03:46:48.183839+0000, chain.objs.size()=1 2024-09-05T02:16:22.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.9TBB5Us0NHou--7JFSscK9oCUALS9A3_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17895724420774866868', time=2024-09-05T03:46:49.001134+0000, chain.objs.size()=1 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jQoQBA4E7b9R_Ke-lj8ulLGzb9edpxJ_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13773864297572711366', time=2024-09-05T03:46:51.320812+0000, chain.objs.size()=1 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zJ4jYRNgTm6ECUkX_GR8qLcps2rnmhx_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13870394380663480748', time=2024-09-05T03:46:52.039315+0000, chain.objs.size()=1 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.3d6az7z4RiPagaTvJYP-Z-DY1FO8oqo_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13737676930647041208', time=2024-09-05T03:46:53.151584+0000, chain.objs.size()=1 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.92OB6pVTiyzwhvVjDnIiVgGI1AEV7AE_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14896833746306461202', time=2024-09-05T03:46:54.546727+0000, chain.objs.size()=1 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.n-g5IIE7SDUsfTjZ3mzUueBqeUX984D_0 2024-09-05T02:16:22.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5952957909871418786', time=2024-09-05T03:46:54.551664+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.R5blqIup3GwVN0bBklo22vKg2t_NViG_0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7632739790932387334', time=2024-09-05T03:46:55.892036+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.lIXu0Nx8Hp-ORi83wKOGme7SHpYo1M__0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1182396593113114843', time=2024-09-05T03:46:56.300079+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W1Nt9TNhcBCGoA2400VVOqIT3QkG16q_0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13013382151317823168', time=2024-09-05T03:46:56.874063+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.O5eI-j9KDDQ6eFiOgRp-UJEDQdhr0w4_0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1907219133563677157', time=2024-09-05T03:46:56.876231+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fRUEgu6HUfVif1OOm1d2yWiIGgiEHCj_0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3652586653428488001', time=2024-09-05T03:46:56.965412+0000, chain.objs.size()=1 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.704+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_._e-y2GqoiZ2I2DZ1c1BrckbQRoxUbqA_0 2024-09-05T02:16:22.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17532907547844001486', time=2024-09-05T03:46:57.117074+0000, chain.objs.size()=1 2024-09-05T02:16:22.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0eBKD6wdOHcDHlVWXFsxuw0d0jx5tcO_0 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12603011088482814226', time=2024-09-05T03:46:58.498902+0000, chain.objs.size()=1 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7zNBfN69G1YfXEOn6bBGP2om2SvqjhW_0 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18407883405877551608', time=2024-09-05T03:47:02.789116+0000, chain.objs.size()=1 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6hkTVe0ymx8UIIRix_im9L5TpoS_x2c_0 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2525795787768435678', time=2024-09-05T03:47:10.369596+0000, chain.objs.size()=1 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.328__shadow_.VEG8bQg7HtkpB-1LrHU_XFcB4y2NWQa_0 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9595846562923594134', time=2024-09-05T03:47:27.007788+0000, chain.objs.size()=1 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.339__shadow_.Li3jQrona_fVIxjKzz_iAjcD9ANdxu__0 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4580836190863003575', time=2024-09-05T03:49:10.870209+0000, chain.objs.size()=1 2024-09-05T02:16:22.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.410__shadow_.adyTLJxMqqFg7qkcKi40aUS3nZs7_pD_0 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14375160447278727969', time=2024-09-05T03:50:48.290797+0000, chain.objs.size()=1 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.466__shadow_.HSPtQTd6F2ZrAZIi2TQVH6x1sab8pPY_0 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11807939238329355592', time=2024-09-05T03:52:27.754201+0000, chain.objs.size()=1 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.708+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.518__multipart_mymultipart.2~DRny1j4Ngs4Sm1FE9PNCRq0gkAkf_hG.1 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.712+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16183163140042316372', time=2024-09-05T03:57:31.828833+0000, chain.objs.size()=1 2024-09-05T02:16:22.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.712+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:9OEqeCCARRvO5kIeLUDdtHKdsGV1AyY_.AhpDUdY6Frd6XKzJ6ajahBcCLq_-pXD_0 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.716+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45225 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6426272079990178669', time=2024-09-05T03:58:29.166205+0000, chain.objs.size()=1 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:JR9aLCSCAoIGy6Ub9lfLl8Fx0lozW10_.EjbQs1YY1M2-MLzDXZdW6wO4Wae6ins_0 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10266148690437634169', time=2024-09-05T03:59:24.474990+0000, chain.objs.size()=1 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.579__shadow:YnKMZ5Rt6PgCp.0nOzy5nXG-RGmBqaV_.SHPpg5SPiAzyfrtrCysW18cTOockB6m_0 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8599298885305368456', time=2024-09-05T03:59:29.840725+0000, chain.objs.size()=1 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:J0EMe5gH2m-XKS-H2M2VksViLu9ps5T_.Ybp0OdjWfmzQWJmH_Sdx_luz6KuQQCZ_0 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13810377917062252608', time=2024-09-05T04:04:57.258260+0000, chain.objs.size()=1 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.632__shadow_.AwRfUDlzAC6zeG8EXDW5Da9qCkO385P_0 2024-09-05T02:16:22.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17756119683400199531', time=2024-09-05T04:08:37.972461+0000, chain.objs.size()=10 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.1 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.2 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.3 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.4 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.5 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.6 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.7 2024-09-05T02:16:22.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.720+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.8 2024-09-05T02:16:22.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.9 2024-09-05T02:16:22.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.724+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.735__multipart_foo.2~-36JNiBY6hHheQqhBK1bDz0hky0ZOf7.10 2024-09-05T02:16:22.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.728+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.732+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-05T02:16:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51096' 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_kscvX778I_ZqjEE_E_PTC7XBEtmjqAw', time=2024-09-05T03:33:07.625148+0000, chain.objs.size()=2 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.Vo4lnb8hV5IITOiPS22WXO_m-78frQU_0 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.161__shadow_.Vo4lnb8hV5IITOiPS22WXO_m-78frQU_1 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_sD1qtBjm-U1hQe35DG52nQdyJJensFy', time=2024-09-05T03:33:11.462125+0000, chain.objs.size()=1 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.163__shadow_.qScW3JRbPniOzGX8yArRr27cQvMF2zl_0 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6386356570672831207', time=2024-09-05T03:37:45.709087+0000, chain.objs.size()=1 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.242__shadow_.O4XEBABi36bWLT77jHR9vZO6oomt_ly_0 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7177125688918406951', time=2024-09-05T03:38:22.629385+0000, chain.objs.size()=1 2024-09-05T02:16:22.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.261__shadow_.KZRq_kSQjjz50Zpzjx3EzRcv8ysva6U_0 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6220135259559439299', time=2024-09-05T03:40:04.349295+0000, chain.objs.size()=1 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pAGEiT1pNQ-G-alSUS_L9u6XX6B3bfF_0 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3569303237902849556', time=2024-09-05T03:40:04.716862+0000, chain.objs.size()=1 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VF_KKV_cRxKFs_FDY1JzQiEVcp_1_NY_0 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8834249417253403875', time=2024-09-05T03:40:05.187202+0000, chain.objs.size()=1 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.C6sLCLw3nKDHDgIqXZcqkQuVrra3x6U_0 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16119670032122513083', time=2024-09-05T03:40:06.373526+0000, chain.objs.size()=1 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SoYmjnKQ1OxVV_wOooRsfbfZM9u0vny_0 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11144373772491769935', time=2024-09-05T03:40:06.551586+0000, chain.objs.size()=1 2024-09-05T02:16:22.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.H-8OMATSZllq2rYhfGTs-JBJ9uUGlEN_0 2024-09-05T02:16:22.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11039972015752573027', time=2024-09-05T03:40:06.908347+0000, chain.objs.size()=1 2024-09-05T02:16:22.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.83Bq0fBkodChubDFOXOXGJ1tV5DMjDy_0 2024-09-05T02:16:22.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8759414105300353988', time=2024-09-05T03:40:07.006316+0000, chain.objs.size()=1 2024-09-05T02:16:22.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.736+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kZllxPBKc2zZWVJIt79mwzKZlFM_UJL_0 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10428368630529213130', time=2024-09-05T03:40:09.281107+0000, chain.objs.size()=1 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.L--r-ISAdOX4JDIg0O6C6eX6A7PAzhz_0 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14153410957101165436', time=2024-09-05T03:40:10.425525+0000, chain.objs.size()=1 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.WRNgUgoqqQ1vRh7QT6Lbaj7j9hAXH-x_0 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11023182337514884235', time=2024-09-05T03:40:10.766270+0000, chain.objs.size()=1 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zupBXXB3W5jHHOF2D0n8a5UJZZiu8ro_0 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11077415902373381139', time=2024-09-05T03:40:13.273790+0000, chain.objs.size()=1 2024-09-05T02:16:22.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XLWiX9_k6vyFL2M4o5z7Hu3bXQylCnG_0 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16544445827911972259', time=2024-09-05T03:40:13.372719+0000, chain.objs.size()=1 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5BTuTcU5mNB-4PTdLks_4t85XHRjwFI_0 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15969250942030945642', time=2024-09-05T03:40:14.894312+0000, chain.objs.size()=1 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RifUddy5pyaatNNAvt-yPQTlWmuZV7T_0 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11737029482042092328', time=2024-09-05T03:40:17.494364+0000, chain.objs.size()=1 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.IArnGgHPz7RnDaubRyJvPvcDTsJ4AIG_0 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.919219057509062046', time=2024-09-05T03:40:17.496401+0000, chain.objs.size()=1 2024-09-05T02:16:22.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6WGIhKuc12y4IkeMQSnS6v4q9FhlkM6_0 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9174950467222748671', time=2024-09-05T03:40:17.614077+0000, chain.objs.size()=1 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SnbK6kKLdn3rTmvqBXtGM2PVscuriya_0 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1634020040132542749', time=2024-09-05T03:40:18.167936+0000, chain.objs.size()=1 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ecJtQqjA5da1wc7TSBqb4PI2vM-a7dI_0 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4300535968420999376', time=2024-09-05T03:40:20.173730+0000, chain.objs.size()=1 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.kL470ZphRa3EvNzhhSZupgLoRIMs7df_0 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16973754694360419458', time=2024-09-05T03:40:20.687813+0000, chain.objs.size()=1 2024-09-05T02:16:22.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.740+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5jkWzLkoeDPrCoxl4SK88RyvmwOcnAg_0 2024-09-05T02:16:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7184729872057926057', time=2024-09-05T03:40:23.155388+0000, chain.objs.size()=1 2024-09-05T02:16:22.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vMyq0ARjLzHciqKTPbHr9W2q-ewGI4p_0 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.879224436422526517', time=2024-09-05T03:40:24.747043+0000, chain.objs.size()=1 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.SlhzX3WAvFv8szpu9_3kNvY-iM-N7Bw_0 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244379111212515599', time=2024-09-05T03:40:26.073854+0000, chain.objs.size()=1 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oPm96oR2Ihv-XIZ7tkSCablBSvTV8oM_0 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18225354002093091582', time=2024-09-05T03:40:27.906794+0000, chain.objs.size()=1 2024-09-05T02:16:22.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vVzajp2x8La3gMVQjSDJeJLBpN61C7m_0 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4744788803040211881', time=2024-09-05T03:40:28.133750+0000, chain.objs.size()=1 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LaE7NdJtE0OfWqzB410y6KoEOqgsNJx_0 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15214514306535885143', time=2024-09-05T03:40:28.344345+0000, chain.objs.size()=1 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.FSjzyFQzT39FDeabFlYP95zn_VnXhbU_0 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10267381873245332566', time=2024-09-05T03:40:29.193994+0000, chain.objs.size()=1 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.phyoJxly-b_LMjdRcTm02mQR_YRfVx4_0 2024-09-05T02:16:22.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17278506329044288308', time=2024-09-05T03:40:30.433145+0000, chain.objs.size()=1 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.z2HmXLo_IUkYTV-OEXS_Q4lECzTXJHS_0 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7173188979135250640', time=2024-09-05T03:40:32.620503+0000, chain.objs.size()=1 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bmvyd0LIVgqnvgLzcKW9uGmr-0KwL73_0 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17664275759833244796', time=2024-09-05T03:40:35.139345+0000, chain.objs.size()=1 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.lEm5_amd0EUDHcIxAZ10C3epnZDIv32_0 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13688889514985190191', time=2024-09-05T03:40:35.471924+0000, chain.objs.size()=1 2024-09-05T02:16:22.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.m5FFnQDCxcdLQsmJ-_Al2KLPfW7OiNk_0 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7720208545253645424', time=2024-09-05T03:40:36.206434+0000, chain.objs.size()=1 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.urXUiLO_oIsvNBSphism5x8CwE9C7FY_0 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4246242649362380941', time=2024-09-05T03:40:57.511584+0000, chain.objs.size()=1 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.274__shadow_.9oNBVnO4xwJWSviSUuaZCZjjkzbNS7F_0 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2356767156687691460', time=2024-09-05T03:41:34.619886+0000, chain.objs.size()=1 2024-09-05T02:16:22.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.AzAoeuEml3fZ2fjVa7HltvpPLMrdxx6_0 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.572592778909462534', time=2024-09-05T03:41:40.342537+0000, chain.objs.size()=1 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.CrjO7pk29TS-bYwxXqNj0RH3waj0B_0_0 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2977921230198772764', time=2024-09-05T03:44:21.115474+0000, chain.objs.size()=1 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.R84m0jwGIFZ2wlosgs5D4baVjFAVCN4_0 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6588649751842530027', time=2024-09-05T03:44:21.401972+0000, chain.objs.size()=1 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.bdLdp23hjPQ5cwBH1N-pLLtlHrfR7z3_0 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16600768208478724480', time=2024-09-05T03:44:23.407145+0000, chain.objs.size()=1 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.-MC6bTtwyUlSIUiC91FCAFiWVezgO9f_0 2024-09-05T02:16:22.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2886075365291425323', time=2024-09-05T03:44:24.021798+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ZIX-KO1QZ09wevMFkEU7b55Xs-dl8vF_0 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2204984502593405827', time=2024-09-05T03:44:24.040539+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._tO1wJhQvyN48j4294nnfQgoQrlb3Ap_0 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18136146350082407707', time=2024-09-05T03:44:25.503215+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iWmCMmYNECO0nk5XQZ5bbqusWGvAqa2_0 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17540859142869321473', time=2024-09-05T03:44:25.941857+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.748+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0o28y-Um37IJA7kuXn1Qp2XFJrGbiI5_0 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12166124850438003626', time=2024-09-05T03:44:27.741882+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.a-iRl4qVtnM5F38EPxkEXxI6QZDZ-h4_0 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17450665543335591732', time=2024-09-05T03:44:27.743540+0000, chain.objs.size()=1 2024-09-05T02:16:22.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.qGTTtpw3M2avnxRF_y0LMU0Gavw5yEm_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3328225099029352348', time=2024-09-05T03:44:27.745740+0000, chain.objs.size()=1 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rR-Bbls-LarnjSwcirY_BVXefL2IEQu_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6517956051280875799', time=2024-09-05T03:44:27.748503+0000, chain.objs.size()=1 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pANkDYEr9w2s9FTHej7dUQDm6Fk4xF5_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5502905005095869665', time=2024-09-05T03:44:28.517291+0000, chain.objs.size()=1 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CNL6QfPnpWWJq9UCGxisBSNlZMGessK_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5556088100780227124', time=2024-09-05T03:44:28.586341+0000, chain.objs.size()=1 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HkxtKuvrS1OtPHi7gIxxowyaAW9lhuv_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8130439745679134576', time=2024-09-05T03:44:29.642754+0000, chain.objs.size()=1 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RjoU3sq6ssiz1mDOtOb2wgOUnM_LSsi_0 2024-09-05T02:16:22.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6038725966241325861', time=2024-09-05T03:44:29.644781+0000, chain.objs.size()=1 2024-09-05T02:16:22.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.snv1OIrHve4DmBDqD1HIb5K-WVvybw5_0 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16007007543372752320', time=2024-09-05T03:44:31.846498+0000, chain.objs.size()=1 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6CrIfxpJysZoenzhcP7Q9BK6B-IHAbl_0 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1162489873802706657', time=2024-09-05T03:44:33.163682+0000, chain.objs.size()=1 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2bxJcQqcBpO2YJrrbGovNgU4PbnWEnA_0 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15370882026570126835', time=2024-09-05T03:44:36.168083+0000, chain.objs.size()=1 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.p6PpBpetBCGaH4ruqykQjuJe6fAP6dT_0 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2169389804990288674', time=2024-09-05T03:44:37.237743+0000, chain.objs.size()=1 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.752+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.gsI8UmpyCIbvfz1vVCsAlel02-20xl2_0 2024-09-05T02:16:22.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7696896401329685380', time=2024-09-05T03:44:38.025786+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.G-QEHxM52NlPvUiYmdtk5rE0hJRpAuM_0 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18179786091193073948', time=2024-09-05T03:44:39.797796+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.49WLx0Qhh4pJIx-9m0UKuUd8jcfGAlU_0 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13196109303386513599', time=2024-09-05T03:44:41.575462+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.a8epwt1CofCFJoLJqoc_kYl23VaudJL_0 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8296467302859138659', time=2024-09-05T03:44:41.938836+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Inniui6zMFsm_nfiNAIGyzC1zqE6mpb_0 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8992283425839238163', time=2024-09-05T03:44:43.819261+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.JQOuXXaWwfG88vD3Mtfbvf9nC1SwNf5_0 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9822842761783231991', time=2024-09-05T03:44:44.522418+0000, chain.objs.size()=1 2024-09-05T02:16:22.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6E7-EqRKZI7R6pfEMBSN7j3y2m1sw_n_0 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17712221290892455805', time=2024-09-05T03:44:44.951839+0000, chain.objs.size()=1 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0HHDTWJqKhv2vHe1fWFvk3yqsJsziAb_0 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4018366381194531477', time=2024-09-05T03:44:45.309149+0000, chain.objs.size()=1 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.K1gEnnGNDw5HU2bnLrniQwVfDvOJAxh_0 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4479627266929996984', time=2024-09-05T03:44:45.513623+0000, chain.objs.size()=1 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2pMze2qV3n-mRaxtdTtAlxcr9eMm32M_0 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7175312848493383470', time=2024-09-05T03:44:45.587387+0000, chain.objs.size()=1 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GwAkT5_exPGG2-MTHlWLqS3kSFoARSu_0 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3246107473452196254', time=2024-09-05T03:44:46.586038+0000, chain.objs.size()=1 2024-09-05T02:16:22.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._oCP_gMPBlRo3zyu8MWPVRK9DcVZb4g_0 2024-09-05T02:16:22.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13065879073362386743', time=2024-09-05T03:44:47.832534+0000, chain.objs.size()=1 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rUJcsSBA56QmffPNgotCBNKqctAftni_0 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9966849411226737182', time=2024-09-05T03:44:48.147262+0000, chain.objs.size()=1 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9mp9sibRJtueM0C_Gyw3xskwZp53OSJ_0 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11162839448130616142', time=2024-09-05T03:44:48.862480+0000, chain.objs.size()=1 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.756+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Rq5pzUAtw4Lz1AQUkpu4myRQTfHwv4w_0 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4263944053212442207', time=2024-09-05T03:44:49.180304+0000, chain.objs.size()=1 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.FcAzDDIUmqwDHqqD1hOmIljP1omjskd_0 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3682372242045878666', time=2024-09-05T03:44:49.688986+0000, chain.objs.size()=1 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TJazBacePw-bqHAv1GCajfmZ6C-ub8Y_0 2024-09-05T02:16:22.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11623041214560100714', time=2024-09-05T03:44:50.236283+0000, chain.objs.size()=1 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8trlrYbWPWkQEx27x8C96Wta9m0ZFIL_0 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15200890151341125867', time=2024-09-05T03:46:34.172246+0000, chain.objs.size()=1 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.n6sgrOdHEtvShLztlk_TPJ6GQMRBywv_0 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7088844356933174138', time=2024-09-05T03:46:35.107768+0000, chain.objs.size()=1 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qrDCbrOTSWLWDnr8cGItj35uNbigA4e_0 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17923862283834580669', time=2024-09-05T03:46:35.920925+0000, chain.objs.size()=1 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.j7y9NNUsmBEoQeQw5CpapxDCvJyxpAb_0 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2396556012870805535', time=2024-09-05T03:46:36.291599+0000, chain.objs.size()=1 2024-09-05T02:16:22.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.voOHb7tOprDRQTblE9UvUaJ990eE5iN_0 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13026431957516393982', time=2024-09-05T03:46:36.535079+0000, chain.objs.size()=1 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.760+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.76lXSFbIZaGQb94t6JtVvy_CljbR95B_0 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8325774578700599022', time=2024-09-05T03:46:38.796153+0000, chain.objs.size()=1 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gQ24cyAegUC7_R67_78g1LY8ELyJ8_6_0 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12642519685119292730', time=2024-09-05T03:46:39.229913+0000, chain.objs.size()=1 2024-09-05T02:16:22.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.I5p6_SGZ99S8ePjQHd2fzlYjQAeM7rq_0 2024-09-05T02:16:22.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15605236927792484562', time=2024-09-05T03:46:39.232126+0000, chain.objs.size()=1 2024-09-05T02:16:22.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.U-sTRaV3OMiB0ea_YyAIPju_cSA1ok__0 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1375921291560126588', time=2024-09-05T03:46:40.155424+0000, chain.objs.size()=1 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1-oFPlGmv7Rd-mpaHFRVIT0yCtQgsEc_0 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1224822951370242541', time=2024-09-05T03:46:40.815611+0000, chain.objs.size()=1 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hV-Lv8H1Q1221Zw4eY6lGaz9PPBbysS_0 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1742234580846254697', time=2024-09-05T03:46:42.710513+0000, chain.objs.size()=1 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UmLmZOgQFVB2ThHDnFwBSSOrczhpC4W_0 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6545250760565165063', time=2024-09-05T03:46:43.371963+0000, chain.objs.size()=1 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.v72J6lMj4JKLWKGbxxctp1ft3JPGqju_0 2024-09-05T02:16:22.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6155462254760677902', time=2024-09-05T03:46:43.673173+0000, chain.objs.size()=1 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zRO9Bw1Od2kZdLp6tzpcD-gFSw-SJdD_0 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12391326035273895161', time=2024-09-05T03:46:43.924090+0000, chain.objs.size()=1 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Ov0h7Ondv81c3my786yOwb1_8X2kzPT_0 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11478749694886487361', time=2024-09-05T03:46:46.069808+0000, chain.objs.size()=1 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IrSWr_rwhnEASQzcNWYwZfqsmrr7HRW_0 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14634132633677940067', time=2024-09-05T03:46:47.022580+0000, chain.objs.size()=1 2024-09-05T02:16:22.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.764+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.MM2BFje6uuUm9Ew5VMt4pp0Q2lm9zuC_0 2024-09-05T02:16:22.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13610340577743542086', time=2024-09-05T03:46:47.589481+0000, chain.objs.size()=1 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vHNLlB_Pb6DXl_RPAEs-0wPi2Sd1Teb_0 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12529659190385264008', time=2024-09-05T03:46:48.243312+0000, chain.objs.size()=1 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.vmgr2U5Kqwtpts-01KeTyQIBEJYLdlB_0 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14361503907777137453', time=2024-09-05T03:46:50.165325+0000, chain.objs.size()=1 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Mr9I3a4IaT6b4nsOPRtT-cNo9KhjZJi_0 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1334269339146387926', time=2024-09-05T03:46:51.929117+0000, chain.objs.size()=1 2024-09-05T02:16:22.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rEW53LtiEIPhvpeZd9WY5SlEfSgDmJD_0 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10994174352369073929', time=2024-09-05T03:46:52.941466+0000, chain.objs.size()=1 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UL4zVp1L3WcjS_KUSswyQM7khFpaamQ_0 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3509643250786834411', time=2024-09-05T03:46:53.273051+0000, chain.objs.size()=1 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.FPgKPAjvchHxwMuEYQDqENrs0xx6P4U_0 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6388746908329707248', time=2024-09-05T03:46:54.142439+0000, chain.objs.size()=1 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CVDYF4ipQCcwuK_Kh-OWPs3wcKNKz9J_0 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9164344720552386146', time=2024-09-05T03:46:56.436615+0000, chain.objs.size()=1 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2jv1ZlWCTSZh0mFK9V2_UcUtRNtxRYo_0 2024-09-05T02:16:22.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9640105814964975427', time=2024-09-05T03:46:56.616293+0000, chain.objs.size()=1 2024-09-05T02:16:22.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ddMQHNJYXH3R3gbFD74R4TRpGGROTdU_0 2024-09-05T02:16:22.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10940864887020559685', time=2024-09-05T03:46:58.690558+0000, chain.objs.size()=1 2024-09-05T02:16:22.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.768+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AAYqQB94_Z1LrHeJJCo4gELZK2z9mIa_0 2024-09-05T02:16:22.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.772+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51096 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5774298733551091097', time=2024-09-05T03:46:59.161042+0000, chain.objs.size()=1 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.LJJtoYQMW-FFKKwHGsnBKeTs4pshFhW_0 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16093119519792740504', time=2024-09-05T03:46:59.868111+0000, chain.objs.size()=1 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.bj8IoTDr2GRnoaexzxHtfEAfLq9Itb2_0 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8701727887998309238', time=2024-09-05T03:47:00.234089+0000, chain.objs.size()=1 2024-09-05T02:16:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mVHpGPlEYVcTmPRShi6N_S7cnNV8g-d_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10669413375770666188', time=2024-09-05T03:47:00.442203+0000, chain.objs.size()=1 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nVF505nUChcbcoj5UySz6hMu2vUdo4y_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12411906799141521881', time=2024-09-05T03:47:02.287080+0000, chain.objs.size()=1 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.N0G88rtuRQs7FcI7Afhu_yOWeXfwt3T_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11873745436167240059', time=2024-09-05T03:47:02.332545+0000, chain.objs.size()=1 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mS1cSr31Y6ZvIZ4-t4MGZK8U1A8TB8V_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3018856162276227456', time=2024-09-05T03:47:02.610324+0000, chain.objs.size()=1 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.CrGwK7HWlomEIuOIoNDYPTXc8dLTmL4_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13431770992994613104', time=2024-09-05T03:47:03.360968+0000, chain.objs.size()=1 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ez0WAarajUehQK__5c9U1Qj_9hcJOHI_0 2024-09-05T02:16:22.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4812554837709127679', time=2024-09-05T03:47:15.056755+0000, chain.objs.size()=1 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.331__shadow_.HOlttG1zQ2C0KV8PbtPxs3Ol3dCYsNh_0 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12295501401787002598', time=2024-09-05T03:47:32.980088+0000, chain.objs.size()=1 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.343__shadow_.LlhK6O6zg__Jg43-MGLj5_yqAWYWfNX_0 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17887009277668448213', time=2024-09-05T03:50:36.583469+0000, chain.objs.size()=1 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.461__shadow_.alzI9gsffTIncQIXju0tea1lW2cjPCT_0 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17545770394800617767', time=2024-09-05T03:50:43.455004+0000, chain.objs.size()=1 2024-09-05T02:16:22.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464__shadow_.G6ixsp-tACAltV0CM73_b3qJDD1DrQ3_0 2024-09-05T02:16:22.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16194028556024971104', time=2024-09-05T03:50:48.265548+0000, chain.objs.size()=1 2024-09-05T02:16:22.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.466__shadow_.BHofiQ_XnVmNbywDrSYQQcxCUPfL__g_0 2024-09-05T02:16:22.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1200599723936545470', time=2024-09-05T03:51:36.217906+0000, chain.objs.size()=1 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.497__shadow_.Tt2i3BGWWY6nj-yC5FKP_0dI47XMBzK_0 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.982918467207400039', time=2024-09-05T03:54:59.180491+0000, chain.objs.size()=2 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~8LNia937WmfeBdKZVDPDTZd3xfxf1XQ.1 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.525__multipart_mymultipart.2~8LNia937WmfeBdKZVDPDTZd3xfxf1XQ.2 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10686802324747300507', time=2024-09-05T03:55:48.130939+0000, chain.objs.size()=4 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.535__multipart_mymultipart.2~xIyjlTMs01x_ffESJN3sTEb7oc39R3u.1 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.535__multipart_mymultipart.2~xIyjlTMs01x_ffESJN3sTEb7oc39R3u.2 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.535__multipart_mymultipart.ZisIPqrIPB3n73gTdUlqobB6QuGP8w2g.3 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.535__multipart_mymultipart.2~xIyjlTMs01x_ffESJN3sTEb7oc39R3u.4 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6229495973514603773', time=2024-09-05T03:57:41.974115+0000, chain.objs.size()=1 2024-09-05T02:16:22.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:iGo1xlcIXuASYGRWFhUq8clEaEZ4pXz_.FKjsUJALtHf8kmTdE6FAguhEZXHlCJQ_0 2024-09-05T02:16:22.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11153829225576918957', time=2024-09-05T03:57:49.036132+0000, chain.objs.size()=1 2024-09-05T02:16:22.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.570__shadow:cL99KAoE0QG6I3ereUPK5XbD9-GNndK_.6I_ABye813G1-_5Tw5fl0CrhzmfSvcs_0 2024-09-05T02:16:22.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16643150263801506788', time=2024-09-05T03:57:50.653443+0000, chain.objs.size()=1 2024-09-05T02:16:22.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.776+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.571__shadow_.Rd6YTmhRu3fLvJQhLmfi3iuSkzFmX-Y_0 2024-09-05T02:16:22.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9133044931513001604', time=2024-09-05T03:59:29.682448+0000, chain.objs.size()=1 2024-09-05T02:16:22.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:J0EMe5gH2m-XKS-H2M2VksViLu9ps5T_.Ybp0OdjWfmzQWJmH_Sdx_luz6KuQQCZ_0 2024-09-05T02:16:22.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10127776356328000790', time=2024-09-05T03:59:34.701147+0000, chain.objs.size()=1 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.583__shadow:N6ZrERgJZJBVG393HyyotCxYCWaq0uo_.TwadgEb8iZryO3QfGra482E8aJw3KWy_0 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15370995904224148519', time=2024-09-05T04:05:37.467358+0000, chain.objs.size()=1 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.780+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.651__shadow_.ZgPpXHClF3kp2rIBRttdJFWPOwe6ugy_0 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13081391036075483277', time=2024-09-05T04:06:22.666031+0000, chain.objs.size()=1 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.666__shadow_.uujv0q9vY4UquBDJM5US2Yz4xMMkDYd_0 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.784+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16069079139137613665', time=2024-09-05T04:07:23.570155+0000, chain.objs.size()=1 2024-09-05T02:16:22.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.706__shadow_.rZc-2DCSRSMNh6h8KV_KJiP3HaKdFoo_0 2024-09-05T02:16:22.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.784+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-05T02:16:22.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45586' 2024-09-05T02:16:22.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.155275462648770514', time=2024-09-05T03:32:41.085414+0000, chain.objs.size()=2 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.158__shadow_.0phTLNeJgvAauprbfSwvZW-9ZuwHeJF_0 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.158__shadow_.0phTLNeJgvAauprbfSwvZW-9ZuwHeJF_1 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.138128247060644946', time=2024-09-05T03:32:47.935882+0000, chain.objs.size()=3 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-LUKEWARM.2~dH2quEtgMNvHDsdw6FUUObBAIweTsAc.1 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-LUKEWARM.2~dH2quEtgMNvHDsdw6FUUObBAIweTsAc.2 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.159__multipart_mymultipart-LUKEWARM.2~dH2quEtgMNvHDsdw6FUUObBAIweTsAc.3 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1025687673911882799', time=2024-09-05T03:33:39.663209+0000, chain.objs.size()=1 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.177__shadow_.ppqIHNoRwMqv8sCHrOp3u_n4YQlHMEq_0 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15737996213265248994', time=2024-09-05T03:37:22.292723+0000, chain.objs.size()=1 2024-09-05T02:16:22.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.230__shadow_.RdnFtTukc5hfn1dCOcJEi5fIhIKDZOA_0 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17892268884238244255', time=2024-09-05T03:37:24.134746+0000, chain.objs.size()=1 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.231__shadow_.BnRTSEdey8qJllecpk__I2miiGwvPVM_0 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9600114277689107212', time=2024-09-05T03:38:00.473565+0000, chain.objs.size()=1 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.249__shadow_.hA6aPo6AjYkNjk6J2OtGqz5hXXBTf7b_0 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2370725181630378193', time=2024-09-05T03:38:04.202683+0000, chain.objs.size()=1 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.251__shadow_.cQs7e43yRoXOj_KKKev28TATBK25XTr_0 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.321222555134301140', time=2024-09-05T03:38:18.917293+0000, chain.objs.size()=1 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.259__shadow_.AAFTJdmz_2z8Hy7s51V93WEAYY9KS8G_0 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15975365339681121028', time=2024-09-05T03:40:05.366004+0000, chain.objs.size()=1 2024-09-05T02:16:22.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.788+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ROcVl4flEM7qsFt6VcTUqfuc-COPIGs_0 2024-09-05T02:16:22.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8560568532095605305', time=2024-09-05T03:40:10.691640+0000, chain.objs.size()=1 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AyeEMkeF3UFg5o3Bg5wK7mfWV2YmiEw_0 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13008794768224861516', time=2024-09-05T03:40:11.374704+0000, chain.objs.size()=1 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.rV2L679Y1Kyped2-XISyKN-eSnFex8e_0 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10363727151037084967', time=2024-09-05T03:40:13.372025+0000, chain.objs.size()=1 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Yir91tN9MnwuxT7apL7doKlhUXUmrBD_0 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5614847939458795112', time=2024-09-05T03:40:14.548312+0000, chain.objs.size()=1 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.VrQS9oq5vT5Ze_ALTUEJ2k0IFaetTJT_0 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1772898855781548431', time=2024-09-05T03:40:14.905849+0000, chain.objs.size()=1 2024-09-05T02:16:22.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.1ONeHFZ8Pzh9D0VzCPA-kR_j86xZ1fL_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2410682638074074104', time=2024-09-05T03:40:15.180741+0000, chain.objs.size()=1 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ZmUBl67txwNPfvSV80WxqC9XL8n4GWR_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8107237143605798415', time=2024-09-05T03:40:15.306378+0000, chain.objs.size()=1 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_._0bD1icLtgKUNQt9KDwZeBYgeYqrMmi_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6387213453418634967', time=2024-09-05T03:40:15.499308+0000, chain.objs.size()=1 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.OKKmtc5wQrNQy8BngH_ubVUpSTkb_RN_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.810898657908003110', time=2024-09-05T03:40:15.500728+0000, chain.objs.size()=1 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.DN-exIuDt30nPoM438ks-tx4SNWmVDA_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11974389399976021898', time=2024-09-05T03:40:15.968197+0000, chain.objs.size()=1 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.V0wqig-GQPAbvlWhUNSROe-sk-ShNum_0 2024-09-05T02:16:22.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11773924531972110424', time=2024-09-05T03:40:18.068201+0000, chain.objs.size()=1 2024-09-05T02:16:22.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.792+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.P7rQJwQthUk_36zCYOB-HvdmUrn8bSv_0 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13411483377971340861', time=2024-09-05T03:40:19.650773+0000, chain.objs.size()=1 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RgfgZc2ejqo3JVH-avSWslltmyJ-voP_0 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16773105278757562170', time=2024-09-05T03:40:20.505189+0000, chain.objs.size()=1 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cHtO7Z7FO8JwU0Nlt3QRAT5Y6sq0Tnt_0 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6541918376737020641', time=2024-09-05T03:40:22.199309+0000, chain.objs.size()=1 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oUjUDE_cCAf7MS1EPeskWw6Y7--T1_r_0 2024-09-05T02:16:22.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17133964984200459300', time=2024-09-05T03:40:22.516173+0000, chain.objs.size()=1 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Z1ObrHnhrqVqmw2NWhT3DwmhwVFBRQd_0 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18149250329127389093', time=2024-09-05T03:40:22.801611+0000, chain.objs.size()=1 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yv8qj8bR9F9c0i-J6XcUKNO6Yz1ekx6_0 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14514457694801032501', time=2024-09-05T03:40:23.028167+0000, chain.objs.size()=1 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.V2JhAAJSl40tYk2bxGDEXwQMLMyg0Xc_0 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18342927270324032173', time=2024-09-05T03:40:23.678052+0000, chain.objs.size()=1 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ojJFhAT4wBGAjgWUrllfOoB4fi2Klyq_0 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15621118825376133041', time=2024-09-05T03:40:26.654780+0000, chain.objs.size()=1 2024-09-05T02:16:22.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-aAfsx2rJ60-WgUUaR9J0fFUBbNMQsk_0 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9147129059829822562', time=2024-09-05T03:40:26.657951+0000, chain.objs.size()=1 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TM-BsG-yhaRS_zQ0R5q6sSguH9t5vN-_0 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6416967411501853395', time=2024-09-05T03:40:30.436775+0000, chain.objs.size()=1 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.zxHWMoLdXqPwFhF9vzfBtgo8dNUpKdC_0 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8094660002256966513', time=2024-09-05T03:40:30.576439+0000, chain.objs.size()=1 2024-09-05T02:16:22.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.796+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PcKZHAu0dRJ3VR1N2ap--3lsRvNs-dE_0 2024-09-05T02:16:22.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6422158740442246755', time=2024-09-05T03:40:32.949555+0000, chain.objs.size()=1 2024-09-05T02:16:22.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Y_kVm1Uqrn_EhbOTBm9BHKRwwf_G0VC_0 2024-09-05T02:16:22.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1485101359215076825', time=2024-09-05T03:40:33.836994+0000, chain.objs.size()=1 2024-09-05T02:16:22.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.KchqsOv9o3gSnaEz3c2DS_sRaE6v4Z9_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15649399209450910640', time=2024-09-05T03:40:33.838502+0000, chain.objs.size()=1 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.xZL_k3u4MwAX1twjUgryFBbWYEtQ4av_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7187306952059194072', time=2024-09-05T03:40:34.883145+0000, chain.objs.size()=1 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.wKoUaF1INKI4fsMA1T1bI_mzAaPkfGJ_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14403613501127445839', time=2024-09-05T03:40:36.538257+0000, chain.objs.size()=1 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XZPECzqUEHk1HhLpd1YSTUzbVZQ7yAK_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14445345836630640744', time=2024-09-05T03:40:43.653102+0000, chain.objs.size()=1 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.266__shadow_.MgKwhkSe37yBIYIk6uBNpAjrgmQInzH_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5098176697271512825', time=2024-09-05T03:40:54.013691+0000, chain.objs.size()=1 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.272__shadow_.Uc4SXT4sCjkuxPC2YygG46TSZgf-5fT_0 2024-09-05T02:16:22.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7431141641841834217', time=2024-09-05T03:40:57.503754+0000, chain.objs.size()=1 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.274__shadow_.4RXH9Xol5SwpOQC2mdcfyq6crCMc3yR_0 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12011580854361081219', time=2024-09-05T03:40:57.508474+0000, chain.objs.size()=1 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.274__shadow_.PeUe4yg7CK_GSE3zMtcn2JlWjhYtq9W_0 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10049746134935788923', time=2024-09-05T03:41:03.088957+0000, chain.objs.size()=1 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.277__shadow_.EXE34KopfwBpjqGUjui2q266jOJo0Oa_0 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15607702075775141311', time=2024-09-05T03:41:59.198764+0000, chain.objs.size()=1 2024-09-05T02:16:22.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.303__shadow_.J39GZhfB5Ndt5DVpOGz6o2Ux_O3clw0_0 2024-09-05T02:16:22.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9875057373418244186', time=2024-09-05T03:42:33.339665+0000, chain.objs.size()=1 2024-09-05T02:16:22.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.321__shadow_.p186Oa1ydVcLbOm5tBv5NGrlVXBRXf0_0 2024-09-05T02:16:22.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5483874034322761650', time=2024-09-05T03:44:20.749104+0000, chain.objs.size()=1 2024-09-05T02:16:22.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.IzY7j2fZieDtvx1lUSazoPpkOFSEhFG_0 2024-09-05T02:16:22.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2444515066740352279', time=2024-09-05T03:44:21.555218+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8sp_CFUS0a-4ArHKW9eAU3xZ5FEoKRq_0 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5280354037684190772', time=2024-09-05T03:44:24.879549+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.md8yOWOV21ecELVd4Vez8LeVy7TH2qJ_0 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16911862595273438471', time=2024-09-05T03:44:25.242303+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.800+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pczhQTLUsHyKOyj6S1dTu0xpco37pnE_0 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15645690557773361570', time=2024-09-05T03:44:25.888459+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.KZDmUOKCyHkINmrau4xVfVRJ11sXbvg_0 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.410986783427424449', time=2024-09-05T03:44:26.372376+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4MylqJ37y1SBCZWvs1g3odjxU10IWMl_0 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9558891419488399739', time=2024-09-05T03:44:29.059608+0000, chain.objs.size()=1 2024-09-05T02:16:22.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nwHsdfjWkP5bj3-Oh9ISrrJ_lUAYrjF_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.762312439416110016', time=2024-09-05T03:44:34.356639+0000, chain.objs.size()=1 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._1jZFDCoAFYIkeq3U5kUv3Bg5Fz_HM1_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8159389252240109239', time=2024-09-05T03:44:37.770436+0000, chain.objs.size()=1 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6oOOAsU6vq1Qp7IQFxMaKszTwvFieVJ_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10076324691473977229', time=2024-09-05T03:44:37.772174+0000, chain.objs.size()=1 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XaS-Frw-JseMN-xMWT8Glz401mYQfFV_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14534678243385140748', time=2024-09-05T03:44:39.917572+0000, chain.objs.size()=1 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.RKWGvAMwhUUj27ChioxZiQgXEWaQ0Ga_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13019789077184705308', time=2024-09-05T03:44:41.736373+0000, chain.objs.size()=1 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.kEbRGztGKBD9pyinlzvaSzi0J34j9rw_0 2024-09-05T02:16:22.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6383418790052942341', time=2024-09-05T03:44:42.398688+0000, chain.objs.size()=1 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q1QN74oPCKBrTLk3t98BkXKqUQqZG5k_0 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16849517255478315957', time=2024-09-05T03:44:42.769800+0000, chain.objs.size()=1 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.SOWoNI1y6aYrGnia8nsw4gZZNKALx89_0 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10486878513040037830', time=2024-09-05T03:44:44.194623+0000, chain.objs.size()=1 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.W-HuswU95Dq5ok8Z4eNycsq6zhRSWoR_0 2024-09-05T02:16:22.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11498177328320802165', time=2024-09-05T03:44:44.453261+0000, chain.objs.size()=1 2024-09-05T02:16:22.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DGrwl6BamNmjuQxNDUViKzVzLmmaHGk_0 2024-09-05T02:16:22.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11378277118793858546', time=2024-09-05T03:44:45.444710+0000, chain.objs.size()=1 2024-09-05T02:16:22.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CjG0Q-rx-z_em-ZkGUT-9V1jc-sGF8v_0 2024-09-05T02:16:22.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6239849367406700656', time=2024-09-05T03:44:47.789492+0000, chain.objs.size()=1 2024-09-05T02:16:22.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oiSd1RWQ2hnyLYCZgwckoD3E--zP6Mk_0 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18346109011290399551', time=2024-09-05T03:44:47.918260+0000, chain.objs.size()=1 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.804+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9FaQ03P6TRJ7AJcbwv9BZwJFZjpH97I_0 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14400489098423173561', time=2024-09-05T03:44:49.306588+0000, chain.objs.size()=1 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.fRItc-UlwRUesZw7gLg3TNVlre6WM8W_0 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.260017385607256687', time=2024-09-05T03:46:34.375261+0000, chain.objs.size()=1 2024-09-05T02:16:22.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kVxU1A0_uXpoxd_XCcssywGJVSnZq9n_0 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1668179990535426119', time=2024-09-05T03:46:34.808489+0000, chain.objs.size()=1 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.YjC0_aPOEJukF9ohB9pwUnDm8ebjj2t_0 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6168440175529068188', time=2024-09-05T03:46:36.236123+0000, chain.objs.size()=1 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.2BqM_Rq1768dCM9wJvn6h4MWylAnXUx_0 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2408968586964906335', time=2024-09-05T03:46:37.847116+0000, chain.objs.size()=1 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.XBc4-l1JkTh75FE6WvxIpE-NOk1sIyD_0 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.303323783107589650', time=2024-09-05T03:46:38.420868+0000, chain.objs.size()=1 2024-09-05T02:16:22.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.h3iDmN_G8R4YJ5BIOivJyNu6x7cZY1t_0 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.199680388235897415', time=2024-09-05T03:46:38.975496+0000, chain.objs.size()=1 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Pr1JhL3dgTvMdiswAT7xXY5F0TUWLRs_0 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10833417384076182530', time=2024-09-05T03:46:39.085303+0000, chain.objs.size()=1 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.NYCCF9htKQdNz4pSqFAyfnbbXdS8rpy_0 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9013506988132509073', time=2024-09-05T03:46:39.334730+0000, chain.objs.size()=1 2024-09-05T02:16:22.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ulpTMeh3o-5XkMu5zf2bQWjIbrHtLyk_0 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9417293185360583943', time=2024-09-05T03:46:39.336280+0000, chain.objs.size()=1 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.0XMk9uPsGc4G0lnf-n-YbP-uu7qVNXZ_0 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3528162686952021020', time=2024-09-05T03:46:40.473961+0000, chain.objs.size()=1 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SDCVzzcHk0vcRc0jDAccqXsp9ZEJk4__0 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4929418657690364772', time=2024-09-05T03:46:41.916580+0000, chain.objs.size()=1 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.y5rAMo20_JgCLuNaFytBig6m18w-_Tt_0 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14150220445742948006', time=2024-09-05T03:46:43.872992+0000, chain.objs.size()=1 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ybObkK_8HuhqAH__g-iPcpJWi4ukNa7_0 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3450795398949700671', time=2024-09-05T03:46:44.435038+0000, chain.objs.size()=1 2024-09-05T02:16:22.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PAWUED_JUv8n5q_716Ihfx0tpmoYPgd_0 2024-09-05T02:16:22.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5978466955348934090', time=2024-09-05T03:46:46.509265+0000, chain.objs.size()=1 2024-09-05T02:16:22.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.808+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V0F7hv80BdzBpF-t_GwKGhgYMQRsuMT_0 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3205972053645943427', time=2024-09-05T03:46:47.459300+0000, chain.objs.size()=1 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.npcMuuLlFrxuj3mZ1afV44yxWJ9dp4F_0 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17769527559529302659', time=2024-09-05T03:46:47.822501+0000, chain.objs.size()=1 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.o-EjkB-qiJXnfwkST_uPdmRLbwJkCTc_0 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7057453855327154423', time=2024-09-05T03:46:48.606636+0000, chain.objs.size()=1 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IgIrGI_aOoPJekioM2xxLR0jPRkuHVc_0 2024-09-05T02:16:22.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4476725164882651066', time=2024-09-05T03:46:49.017399+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.V0ObMYrXOZUJBSwo5LvdTlBvSzNxVwj_0 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8362141341371645053', time=2024-09-05T03:46:50.178343+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.6XhB0o16n2IkVULXFNNp2q7uiaTCxBN_0 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10793758829630571489', time=2024-09-05T03:46:50.180395+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rg3f7fiSkpl392OS3ARFyulGquM17_S_0 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2803528473701184994', time=2024-09-05T03:46:50.516810+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Y0jsmIdtkc8tnxmfmSwmd3yUOQwrQcl_0 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13455345473426427981', time=2024-09-05T03:46:50.749062+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4v6hQdZkE_-PFCQfDU1pjKWXG4z-1O-_0 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.46139420900624036', time=2024-09-05T03:46:52.171756+0000, chain.objs.size()=1 2024-09-05T02:16:22.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.fKr7izI7094vw0UrPNUZJqyMD8TR1Sw_0 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7876232231420298804', time=2024-09-05T03:46:52.283161+0000, chain.objs.size()=1 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.a5yodgpnnN55BhYmzKTcquK_9j259MX_0 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7545774378504822455', time=2024-09-05T03:46:52.539681+0000, chain.objs.size()=1 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.sHd75sJEG4DHr2JwrcrGOXBe8InZ6pc_0 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5106535728967812302', time=2024-09-05T03:46:55.456827+0000, chain.objs.size()=1 2024-09-05T02:16:22.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.mGtnF0B1MwLiX7rCnLWUnfSVSogfnpt_0 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12947679231071741183', time=2024-09-05T03:46:55.851165+0000, chain.objs.size()=1 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Mzb6J0bulfP5baIAWSN1L-dl_l07uyl_0 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7871530541173224868', time=2024-09-05T03:46:59.593888+0000, chain.objs.size()=1 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dt92e4orK0nzTIh3_KgcuhMz2gMZP8q_0 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5161780925454772952', time=2024-09-05T03:47:03.631257+0000, chain.objs.size()=1 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.812+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WO24qDkNVLCudNq35nYY1jXoeEwF18q_0 2024-09-05T02:16:22.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14568556899146187007', time=2024-09-05T03:47:03.632795+0000, chain.objs.size()=1 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.yois9DggGyMlZNk2mseLdomadGxUk2u_0 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13876912856293910326', time=2024-09-05T03:49:46.409009+0000, chain.objs.size()=1 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.434__shadow_.110qYfgcgM2b0mgVlliXDTSnknHJiUf_0 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9802190565608037132', time=2024-09-05T03:50:42.871814+0000, chain.objs.size()=1 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464__shadow_.y9XHm7wYiDdW_EXj_vPIBZxkHveYWfH_0 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15130169572663785085', time=2024-09-05T03:50:47.407924+0000, chain.objs.size()=1 2024-09-05T02:16:22.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.466__shadow_.O0kLuQRM53hYiv7a--6z32woguLITEJ_0 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15797756346917372535', time=2024-09-05T03:51:09.670934+0000, chain.objs.size()=1 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_.Sv6lZrzpCWgs50eLLsC9lP6GZ_WyMxQ_0 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10725086637817941040', time=2024-09-05T03:52:06.063684+0000, chain.objs.size()=6 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:22.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:22.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:22.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:22.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15514546551273929625', time=2024-09-05T03:52:06.064727+0000, chain.objs.size()=6 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:22.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:22.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD', time=2024-09-05T03:53:31.023419+0000, chain.objs.size()=1 2024-09-05T02:16:22.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.816+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~BNboy-Zp6KEdvwq_RIaE_2IDsN1eKGD.2 2024-09-05T02:16:22.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.820+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45586 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu', time=2024-09-05T03:53:44.381610+0000, chain.objs.size()=1 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.522__multipart_mymultipart.2~tI2Dl9X0hnPrk5-EIi2cHRHPpemhcOu.3 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12018779802017585160', time=2024-09-05T03:56:44.686477+0000, chain.objs.size()=1 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.555__shadow_.J8RrHHEX069xiOGy0CuiNDCwm1Me4pf_0 2024-09-05T02:16:22.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9684270291368864471', time=2024-09-05T03:56:50.013167+0000, chain.objs.size()=1 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.557__shadow_.dmIVW1AmcJ7yBNzEuMVZVifCVXTWhRc_0 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12632120165064949054', time=2024-09-05T03:57:28.931169+0000, chain.objs.size()=1 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:JLKIuIHFpE4tQFaofj8AcfyP8AsofGm_.JJAhOxqvD4IvGntcRd1QC8q3eEZ-RfD_0 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14222731045505481885', time=2024-09-05T03:57:48.876236+0000, chain.objs.size()=1 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.570__shadow:P--27AAjhtGeB.11GboozpQnu51aD12_.T9IvpPgRScakaty5hwJsRpsF8cJxd0S_0 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4588086957705438406', time=2024-09-05T03:58:31.299445+0000, chain.objs.size()=1 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:QlW2bZZL7SWJFkB9SOARyDp4L0CPZ2M_.3CqV_kxTLwIYhlNYQ8-t7xOKHN-xqrs_0 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11014955776531545322', time=2024-09-05T03:59:18.803276+0000, chain.objs.size()=4 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~_69xQOb7y8MxIU1ca3B4f9nMJ8Kp1J9.1 2024-09-05T02:16:22.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~_69xQOb7y8MxIU1ca3B4f9nMJ8Kp1J9.2 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~_69xQOb7y8MxIU1ca3B4f9nMJ8Kp1J9.3 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~_69xQOb7y8MxIU1ca3B4f9nMJ8Kp1J9.4 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6874267569809079433', time=2024-09-05T03:59:30.541133+0000, chain.objs.size()=1 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:J0EMe5gH2m-XKS-H2M2VksViLu9ps5T_.Ybp0OdjWfmzQWJmH_Sdx_luz6KuQQCZ_0 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17690870068287255857', time=2024-09-05T03:59:30.554413+0000, chain.objs.size()=1 2024-09-05T02:16:22.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.580__shadow:wFaiSQf83oY.r4gERgNWcH.cOFcLQXS_.yakIQvLeUHVGHB6aX6MM9h25fywvEdx_0 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1442946041285123163', time=2024-09-05T04:05:05.717916+0000, chain.objs.size()=1 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.824+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.637__shadow_.3q0nP0AJxThSbgMOS6uE9QyeCaKqzqm_0 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6263290657712920020', time=2024-09-05T04:05:07.775685+0000, chain.objs.size()=1 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.638__shadow_.D2y0QZkHqZA4NNrO3h-ZfVgyXNQ2yGn_0 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8104034595507541920', time=2024-09-05T04:06:17.579943+0000, chain.objs.size()=1 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.664__shadow_.vpEZP5Pal_ml2kZrpnoxsjWbnu9lqYW_0 2024-09-05T02:16:22.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15374031473424665193', time=2024-09-05T04:06:22.657146+0000, chain.objs.size()=1 2024-09-05T02:16:22.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.666__shadow_.-OyCLshZVyR2aU2kGiBVDTcUIIa7Jar_0 2024-09-05T02:16:22.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13210962926213187582', time=2024-09-05T04:07:25.206422+0000, chain.objs.size()=1 2024-09-05T02:16:22.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.707__shadow:wpnoZQBLXRSCOV3Lxe6jGJ8MgTbXCeW_.CeP1cWwQd4ql9ddgRhb4_nKbezqUyWr_0 2024-09-05T02:16:22.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.828+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-05T02:16:22.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45222' 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5931661643950311561', time=2024-09-05T03:34:35.120561+0000, chain.objs.size()=1 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.204__shadow_.in3-eVojwycytEDDfA0iX-QW9XSdZUD_0 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10050217266470204393', time=2024-09-05T03:37:45.735142+0000, chain.objs.size()=1 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.242__shadow_.28Ir59t1og-9KcAnkgpRIxkssesCijF_0 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12762209626434381760', time=2024-09-05T03:38:00.482280+0000, chain.objs.size()=1 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.249__shadow_.cbWvzCCsvowHz4vcxL49Yu5uflGwRvd_0 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8685263680634293026', time=2024-09-05T03:38:17.126341+0000, chain.objs.size()=1 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.258__shadow_.FgWLoDcK2Si7nrx5nvxemb2p4uQXxQ6_0 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15529301668254824498', time=2024-09-05T03:40:04.292372+0000, chain.objs.size()=1 2024-09-05T02:16:22.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oIqdC9s4YmJ69ftkpngfvZqsWmPNB3K_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9560425503617104749', time=2024-09-05T03:40:04.294218+0000, chain.objs.size()=1 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.grnPW7QC6zAc_TrPDB-jEq5zNQiF64v_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1813922559085211978', time=2024-09-05T03:40:04.377557+0000, chain.objs.size()=1 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.hZ_pCWF1nF97Q2WWzJo7CEf4t_PYQkG_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4429891246630494124', time=2024-09-05T03:40:09.745015+0000, chain.objs.size()=1 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Q-FOaLUHkVdR6pqLPs-kt76miWey4dH_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17984987132549682016', time=2024-09-05T03:40:10.275374+0000, chain.objs.size()=1 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jlOqZFAq4fSjlrMBluN9DjqsloxfrdA_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12406558202300437166', time=2024-09-05T03:40:10.317416+0000, chain.objs.size()=1 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.I8VdyzAS0tQWCjMuzCPjseZeNYQPk17_0 2024-09-05T02:16:22.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3521593369248366667', time=2024-09-05T03:40:10.421217+0000, chain.objs.size()=1 2024-09-05T02:16:22.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.XpbEjvx957jzKYdaD7SeZSo7iVbPWbU_0 2024-09-05T02:16:22.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12635434108306720371', time=2024-09-05T03:40:10.747644+0000, chain.objs.size()=1 2024-09-05T02:16:22.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.832+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eGs0XhSJEoF52J_pihsnm4T3fci6Gzq_0 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4177950270922403043', time=2024-09-05T03:40:11.491528+0000, chain.objs.size()=1 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JaTLnzhMKyM1yONjv_DUX7lbnGL13uw_0 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7061391020380406770', time=2024-09-05T03:40:11.736487+0000, chain.objs.size()=1 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.89wHevPQCiO07TB0zyiAgS30EnWAROP_0 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8590869961059325641', time=2024-09-05T03:40:12.154200+0000, chain.objs.size()=1 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.U9Ul4m6QyAT3yz_x1sG9bvMc2I_eBJH_0 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18060230596291362242', time=2024-09-05T03:40:12.181912+0000, chain.objs.size()=1 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.burTQ2Nhx-VEYyiY8EvBjqio3wvItq__0 2024-09-05T02:16:22.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2180543752691307127', time=2024-09-05T03:40:14.239802+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MfO5PIrnTaKvvzzx-NDQqpTnXDSczbe_0 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17812311510973257', time=2024-09-05T03:40:15.770571+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Dt8HpCyxJ9hbXCyzciZXgBAIsk-3tJO_0 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8040943014337454659', time=2024-09-05T03:40:18.524465+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mcufpIRFAuvOnxzA1OM5MkJw05Jc-eJ_0 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15661132703099230621', time=2024-09-05T03:40:19.835060+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RTo2UJk5O15EpgMJiUESmgqaYtz8t1L_0 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16997345001870572945', time=2024-09-05T03:40:22.174576+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7xGw9djwanJRHqMyBq7QqEszmFbY955_0 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11867651590096399883', time=2024-09-05T03:40:22.176300+0000, chain.objs.size()=1 2024-09-05T02:16:22.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.pMefXdM-DsZ2Cu-nO7zXAvAa-fg7_Nh_0 2024-09-05T02:16:22.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4623717986721253026', time=2024-09-05T03:40:22.624020+0000, chain.objs.size()=1 2024-09-05T02:16:22.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.5hvXBb7bEYMpvdgTy1ezSOMKS0nTOb3_0 2024-09-05T02:16:22.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10106656271344074491', time=2024-09-05T03:40:22.904798+0000, chain.objs.size()=1 2024-09-05T02:16:22.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.an2DoN-yBOvE5KF1VhQ2kf0J57rlA4I_0 2024-09-05T02:16:22.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10157485627074275935', time=2024-09-05T03:40:23.261193+0000, chain.objs.size()=1 2024-09-05T02:16:22.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cE_d9OSc2oCuLrU11CGKqZOvdRGX7cM_0 2024-09-05T02:16:22.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7619749279368824303', time=2024-09-05T03:40:23.829069+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.RazVwI4Suva47DztyR7q3312fGR2k5c_0 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12680733386227554976', time=2024-09-05T03:40:23.944941+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.MVmhfcGj_Kw1U4PgXXJaBD7TtVSyxBq_0 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13533259837169183692', time=2024-09-05T03:40:24.311952+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.3ysEA6YvQrBsww382lQU-RSKeyfLSEt_0 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1981436021221258016', time=2024-09-05T03:40:26.799942+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.-qB0iTXxetmZlFY8N_R2utPA-hPRZBE_0 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11112754620070001145', time=2024-09-05T03:40:26.802002+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.836+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.7bK0abOQN3lR29okVnt8E_LTsjWV1H9_0 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2666002929085226275', time=2024-09-05T03:40:26.989673+0000, chain.objs.size()=1 2024-09-05T02:16:22.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LR5i5HLO0AagnKKxtL5JJVHVUlkqOLc_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15085745283065090289', time=2024-09-05T03:40:27.305963+0000, chain.objs.size()=1 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Vq6yyhbV11LrMP__SgTWDBGMXCiI673_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16639427984086099786', time=2024-09-05T03:40:28.161468+0000, chain.objs.size()=1 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.bvWJqObuY7cVxEDsaANSadxZCQ_AFmu_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9912561920484348189', time=2024-09-05T03:40:28.163057+0000, chain.objs.size()=1 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Ubh-dCRZdrYWlY2MmbxJAQ3-mayY_IL_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15172443147001200904', time=2024-09-05T03:40:28.604137+0000, chain.objs.size()=1 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JMLz9b9ztPWgLv3sAu1_IXKgQCb6w9n_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14587470214811976511', time=2024-09-05T03:40:29.924895+0000, chain.objs.size()=1 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.JL3y0RWL-2MC_HOQxkR9IqoauLCVWis_0 2024-09-05T02:16:22.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3926170997703421956', time=2024-09-05T03:40:30.411463+0000, chain.objs.size()=1 2024-09-05T02:16:22.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.6neV9Iztkz5xcoeb0SZU-An1NVVrS-o_0 2024-09-05T02:16:22.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12383174196568818383', time=2024-09-05T03:40:31.051131+0000, chain.objs.size()=1 2024-09-05T02:16:22.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.WPUCPWpuAtaidow15_ybW4rr0eWKMhw_0 2024-09-05T02:16:22.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.277162299074913445', time=2024-09-05T03:40:31.385361+0000, chain.objs.size()=1 2024-09-05T02:16:22.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.QgRukRQn375vu76nQAHtM_5yhg9BMJJ_0 2024-09-05T02:16:22.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6743859835987509409', time=2024-09-05T03:40:32.165315+0000, chain.objs.size()=1 2024-09-05T02:16:22.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jQarYrrEaEu1w5OUcwUpUdp0DjkQ57Z_0 2024-09-05T02:16:22.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15478248886577476128', time=2024-09-05T03:40:32.551279+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.840+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mtvXpBfF4BaDavOwXznbbV7U9eNbFv-_0 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15969542825997533302', time=2024-09-05T03:40:32.755240+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.puL4oiiV8rOX8Nya3SuN7jtSKNci51Z_0 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7370331337518100586', time=2024-09-05T03:40:36.372044+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.z9qW3ga0p_6TxFumgCrM2dpCKYykuit_0 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3730625883585100203', time=2024-09-05T03:40:45.399034+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.267__shadow_.A7lTdGCQ_2x4E5aoUXDe9d4sNv-D4Kd_0 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8832057564473413618', time=2024-09-05T03:41:10.540369+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.281__shadow_.oG2fe6Ff_e5ug1ZWx5sDxcY8_-gM6Fw_0 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2839256114467362371', time=2024-09-05T03:41:22.059360+0000, chain.objs.size()=1 2024-09-05T02:16:22.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.287__shadow_.HsSFb4uMqDBQY1VT2IV6G0eQg8OsnzO_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11902874192443526179', time=2024-09-05T03:41:40.014106+0000, chain.objs.size()=1 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.TKuiF_VGp41YbuhvMHXpUBPlw7SYv2f_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5925319310602054755', time=2024-09-05T03:41:40.124145+0000, chain.objs.size()=1 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.293__shadow_.Bg8R8aFuFq7wFh93-hHqyrW5F49f3jq_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8562520558467489075', time=2024-09-05T03:41:49.790154+0000, chain.objs.size()=1 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.298__shadow_.CSyKpwWquILVtUyUmcY8GghZUdvbdfq_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6583632939526466518', time=2024-09-05T03:44:19.832886+0000, chain.objs.size()=1 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nFf_ysPu0fGJI7ZPEl_L1kfQalB3dco_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4920571024543481476', time=2024-09-05T03:44:19.834602+0000, chain.objs.size()=1 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4mnDGAs2TRv5n14CQ4xRdzyNHO0gzBp_0 2024-09-05T02:16:22.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11547426115127492961', time=2024-09-05T03:44:21.003429+0000, chain.objs.size()=1 2024-09-05T02:16:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.OfITMkMYkKzHhwwkCdcBnu_Yzrp8HIq_0 2024-09-05T02:16:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4604991016112271690', time=2024-09-05T03:44:27.673110+0000, chain.objs.size()=1 2024-09-05T02:16:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.elfCZwOmOmUrXVlr1l4no5Hxgdx1Q0V_0 2024-09-05T02:16:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2530381233815971918', time=2024-09-05T03:44:28.508730+0000, chain.objs.size()=1 2024-09-05T02:16:22.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.GbKJab4ozJZj9B9zGONXNxSxpSfZ91U_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16278370972744065569', time=2024-09-05T03:44:29.988532+0000, chain.objs.size()=1 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vv955upSf5GtAayVnVi_zKR8oD-zZxL_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10781466783999395314', time=2024-09-05T03:44:30.638855+0000, chain.objs.size()=1 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NjagM8q9D0nFB_YYc18dgcm2c7j3EFK_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13473599545108104221', time=2024-09-05T03:44:30.640528+0000, chain.objs.size()=1 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jx7EUYOk9ulzV4dkuTWIt5RbFqlnfcy_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16579078849042180158', time=2024-09-05T03:44:31.830423+0000, chain.objs.size()=1 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DD73Nk3CJubg2tLnHx_R_nSG5oy2RTz_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6872996249540836209', time=2024-09-05T03:44:33.452592+0000, chain.objs.size()=1 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2zl9KTonz_iEhtG_FbZ-Fc4CyzRCOBZ_0 2024-09-05T02:16:22.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3569091805745732635', time=2024-09-05T03:44:33.583475+0000, chain.objs.size()=1 2024-09-05T02:16:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.844+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.QlQIPTf1ih0riT76c1_JFPdkGAgvb6x_0 2024-09-05T02:16:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3290509362473682613', time=2024-09-05T03:44:33.735275+0000, chain.objs.size()=1 2024-09-05T02:16:22.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._K2VDBCtL0BH8F5N4TKAn_Ei2DvC9D6_0 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14633973976344455621', time=2024-09-05T03:44:36.318517+0000, chain.objs.size()=1 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.86B5936FQa8HDo4ORzERO8JIJjLiRmP_0 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6631630354196622007', time=2024-09-05T03:44:37.012613+0000, chain.objs.size()=1 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.2K9d4K6Es_udsh5sGRtnePCLtAMeLRJ_0 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15670145296493411112', time=2024-09-05T03:44:37.511844+0000, chain.objs.size()=1 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.rb7NgkiUonjt78tXSQ_Rh6H9ZC5ohpB_0 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8786689609488092073', time=2024-09-05T03:44:38.777678+0000, chain.objs.size()=1 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1MxwcyMK0zvf5aI4u2yQkW496MYlN70_0 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8188497931534660262', time=2024-09-05T03:44:38.937966+0000, chain.objs.size()=1 2024-09-05T02:16:22.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.jprWvgLrHpA3jzSEabYUuC5ayqMEc30_0 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1027408002164874687', time=2024-09-05T03:44:40.840605+0000, chain.objs.size()=1 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oD_S677ifkKwR_XYoQKUlC64bCl_xQj_0 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15920475554519148684', time=2024-09-05T03:44:41.476564+0000, chain.objs.size()=1 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Q_-4EctDR4Pa6fc7EZ25-px0XO5fPiw_0 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15934227750133417179', time=2024-09-05T03:44:41.704753+0000, chain.objs.size()=1 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9SLKVQ3F_11lpPR-aDQFyuo70rE6B0V_0 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17381851077470466386', time=2024-09-05T03:44:41.862094+0000, chain.objs.size()=1 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.CoRpOfiUPYqj7tTOVbKQnZqm2nBmzC7_0 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6277291213902095224', time=2024-09-05T03:44:43.856808+0000, chain.objs.size()=1 2024-09-05T02:16:22.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.848+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Nn7A6b83vWho5RyMaLVlI6_PakF3Uj1_0 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11339721539908462800', time=2024-09-05T03:44:44.344506+0000, chain.objs.size()=1 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.eazPKt9fYyZanVFO7XhLUXjE6Pvq4KC_0 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6812749827296083118', time=2024-09-05T03:44:45.210127+0000, chain.objs.size()=1 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4M0gd4IyWrGuKMSCugYRFBrRhRaety-_0 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2653359511577413887', time=2024-09-05T03:44:46.371138+0000, chain.objs.size()=1 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.HifNphmeenTvivmn-DulhTEtxIbY7us_0 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5499544587796811781', time=2024-09-05T03:44:49.575484+0000, chain.objs.size()=1 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Zv_WzcbPP-ddtkWCqq81I0N3Snj4m4G_0 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17959965814490066160', time=2024-09-05T03:44:50.102305+0000, chain.objs.size()=1 2024-09-05T02:16:22.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4gUw1BDAsqtO6Z57meJitoks0Jxg5v6_0 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16410025227498664379', time=2024-09-05T03:46:35.649119+0000, chain.objs.size()=1 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Yxt4UXiJ7lYFhdOCIOoKPxVU1tOtffV_0 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7669190752801177783', time=2024-09-05T03:46:37.798468+0000, chain.objs.size()=1 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gkXCLNAuLjPpvKopC8YgH7P_YD33_Xp_0 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7824268707685785434', time=2024-09-05T03:46:39.418875+0000, chain.objs.size()=1 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.q1bs9mFr3OY5YKiLHGz-SPgKBD9DH45_0 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9073183727899541265', time=2024-09-05T03:46:40.254381+0000, chain.objs.size()=1 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.HuJ0KWslc6dvdhMntrchyp5MpiHRFQ5_0 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2772281807380506313', time=2024-09-05T03:46:40.614057+0000, chain.objs.size()=1 2024-09-05T02:16:22.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b37UjFOJBiLD87zwpWRqco2uN5dBNI9_0 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7221331506853516698', time=2024-09-05T03:46:40.899857+0000, chain.objs.size()=1 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.BFWjNU-4c2AFGHHzAdtgHv9s_NQFnlW_0 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15087415417789994208', time=2024-09-05T03:46:42.755202+0000, chain.objs.size()=1 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.dU8QTIndGdZzsBZGtfNSBUPZrmE5FkK_0 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8116576921579029786', time=2024-09-05T03:46:42.818039+0000, chain.objs.size()=1 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WKNcXGlpTLJeHId5of6Wlbu_iurmadO_0 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17531180573077107563', time=2024-09-05T03:46:42.973699+0000, chain.objs.size()=1 2024-09-05T02:16:22.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.kP95q2vvHeYe_wkugWByt7iIm_1U-_N_0 2024-09-05T02:16:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10168021515554885564', time=2024-09-05T03:46:43.169848+0000, chain.objs.size()=1 2024-09-05T02:16:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wnrV7N6U97RjEK8iRMLyshv9sMeZuRn_0 2024-09-05T02:16:22.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1537399661090226077', time=2024-09-05T03:46:43.363726+0000, chain.objs.size()=1 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.852+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.VSmKsQIASItxDY_hJSZmK4vlYNZUHov_0 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10448490879427585755', time=2024-09-05T03:46:43.692470+0000, chain.objs.size()=1 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.Hdc8WQBGZrPD_cUFvNKZixDHIcfdJOW_0 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8506120255846799749', time=2024-09-05T03:46:50.184186+0000, chain.objs.size()=1 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.gVJDW3BpUuxwj0eYfjhz5E3XafQ5bGv_0 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2876125085151862429', time=2024-09-05T03:46:50.610105+0000, chain.objs.size()=1 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ihmgYscPOhKp6TrQ1QnuHnioMI6mkgA_0 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1674796815244101738', time=2024-09-05T03:46:51.648833+0000, chain.objs.size()=1 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.1V_38ifW1hx4OIj7YYljVM40HKnLAlc_0 2024-09-05T02:16:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17645969469530536602', time=2024-09-05T03:46:51.808493+0000, chain.objs.size()=1 2024-09-05T02:16:22.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.7NYLDQw_g4ysN6QjHGrHzveOI5M9Slo_0 2024-09-05T02:16:22.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17385192873793096307', time=2024-09-05T03:46:52.065404+0000, chain.objs.size()=1 2024-09-05T02:16:22.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ZCf9haOu83B6d05Yl_-qz1HhLkQCWpS_0 2024-09-05T02:16:22.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1265357524938210831', time=2024-09-05T03:46:52.191585+0000, chain.objs.size()=1 2024-09-05T02:16:22.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.IXbLNsHgSS9evBeAm_4BARJ8mg3CzHR_0 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10800236159152304781', time=2024-09-05T03:46:52.437402+0000, chain.objs.size()=1 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.cApgrqaFjekpy6XARITlv9RP48J54D5_0 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1603598681858507369', time=2024-09-05T03:46:54.715424+0000, chain.objs.size()=1 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.jItI9-ho82CYbz1SuGEonl0th1GwMQk_0 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12371296274925032340', time=2024-09-05T03:46:56.058155+0000, chain.objs.size()=1 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.OP75KFTLmu5UqbIPVPK8ZvD8kR5SPdS_0 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1826834072697094145', time=2024-09-05T03:46:56.484912+0000, chain.objs.size()=1 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.-fZRHguyqlf6F-98h8Fvutq8qJ166NV_0 2024-09-05T02:16:22.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17339163089233116086', time=2024-09-05T03:46:57.293546+0000, chain.objs.size()=1 2024-09-05T02:16:22.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.W1qGqfr_WoRkbO4bkGPPloljHArVOeg_0 2024-09-05T02:16:22.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8649013293160312324', time=2024-09-05T03:46:59.195012+0000, chain.objs.size()=1 2024-09-05T02:16:22.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.856+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hSekQxHn7ZBcHOgX-RiDqqYVQc2xV86_0 2024-09-05T02:16:22.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45222 2024-09-05T02:16:22.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-05T02:16:22.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14102399815457600736', time=2024-09-05T03:47:00.258224+0000, chain.objs.size()=1 2024-09-05T02:16:22.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.N8-Z1FeMNsUWILJAdb2nioN7I2cFcZZ_0 2024-09-05T02:16:22.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12023945285790026665', time=2024-09-05T03:47:00.589726+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.4R5ZULQlGuKWm5BD8pj5QxtDrXw1HIc_0 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14700654541876832174', time=2024-09-05T03:47:00.803663+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ICWqwYd-au-OlUeXEO3hoGiiSJx9IEx_0 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9452279944912944067', time=2024-09-05T03:47:02.519098+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.5cpDxYEtR3tcVXTgtg9OPfD7OUvqNDC_0 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13186135664884540230', time=2024-09-05T03:47:03.873100+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.b9CA_ccs-kT3JXew8iZFdB1pN0zNJfB_0 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2581798027557639665', time=2024-09-05T03:47:34.390173+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.344__shadow_.owbJJzXgY4LC36sbqbZgsjaMZ-sPYkI_0 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6059966571098191779', time=2024-09-05T03:50:34.399100+0000, chain.objs.size()=1 2024-09-05T02:16:22.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.460__shadow_.gk2FF6WsdnAtmLBrD0Wseb0eDEun0ol_0 2024-09-05T02:16:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3058782003218237495', time=2024-09-05T03:50:38.851335+0000, chain.objs.size()=1 2024-09-05T02:16:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.462__shadow_.ljiSphkhsB03YU0LzfFumwpAgQG152S_0 2024-09-05T02:16:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8571625221648607841', time=2024-09-05T03:50:43.453630+0000, chain.objs.size()=1 2024-09-05T02:16:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.464__shadow_.P8QtmUaumq_ZsSH29ftl-VnORx09jHs_0 2024-09-05T02:16:22.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9548546048657995264', time=2024-09-05T03:51:09.617021+0000, chain.objs.size()=1 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.483__shadow_._1MYAT7skRlphbkzWGeJIIK2DZHbCgs_0 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5922381366772131461', time=2024-09-05T03:51:11.784353+0000, chain.objs.size()=1 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.484__shadow_.gTpL0IXlBj61ctHlGuQVfqQ3rSMMMPH_0 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2077700647485997549', time=2024-09-05T03:51:18.529648+0000, chain.objs.size()=3 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.860+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_0 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_1 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.486__shadow_.MUwoxVEzPsoqFse6XrNiRUMxOZpZIQm_2 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15488182038253409088', time=2024-09-05T03:51:36.823802+0000, chain.objs.size()=1 2024-09-05T02:16:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.498__shadow_.CLniGJ4o2cvU7PxoJmCkMwsdIrihrNV_0 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.834084165877733391', time=2024-09-05T03:51:39.958002+0000, chain.objs.size()=1 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.500__shadow_.YefWNBVz_q9stY24u-xQzhToGFI20al_0 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7137279277575652023', time=2024-09-05T03:52:04.719663+0000, chain.objs.size()=6 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.1 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.2 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.3 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.4 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.5 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.507__multipart_srcmultipart.2~Fjjzp7Sm35VoqUmbPfTFpUELSg-VY2q.6 2024-09-05T02:16:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4333094916433561803', time=2024-09-05T03:53:08.617447+0000, chain.objs.size()=1 2024-09-05T02:16:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.864+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.520__shadow:6srBVjrJv5.x8jIvpGO2hZcHZ0au9TS_.vG2ONmc2Ih01w0lA0NKc4_x7TGdn2RQ_0 2024-09-05T02:16:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11846691171771170940', time=2024-09-05T03:56:27.281909+0000, chain.objs.size()=1 2024-09-05T02:16:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.551__shadow_.YJ4xSAtb-beqV4lWFRd6NO-rGqpjDs0_0 2024-09-05T02:16:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12084195698090621430', time=2024-09-05T03:57:01.630837+0000, chain.objs.size()=1 2024-09-05T02:16:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.559__shadow_.ifZOY6b57lAP4hghGy8swK5gQJzNiEZ_0 2024-09-05T02:16:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8995002887268057337', time=2024-09-05T03:57:03.381676+0000, chain.objs.size()=1 2024-09-05T02:16:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.560__shadow_.Or88z8D7EhDLTA5iQvlWz5bvL0Jgugu_0 2024-09-05T02:16:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15303098251399968804', time=2024-09-05T03:57:29.642193+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:QDGS7eiG8RIw6nxni99ptzG4HG4Tquk_.yqYp9E1wz_zkbQejpDg7U55LMozxOWH_0 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15349209902972218291', time=2024-09-05T03:57:35.591455+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:M60Z0Br9rKsQqpPGJi0FGl2YOa0UKIB_.cRV_ps9ussiQt3HRHtC6qSW4NBR1q2J_0 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8771653790575468311', time=2024-09-05T03:57:55.513897+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.573__shadow_.P-evNeTN6fYrsMOZ7Kyc_rvS3KgQbZ7_0 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6843087946305059765', time=2024-09-05T03:58:33.495835+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:Z.skP9cBbT5skHLYL0dmKBNsGSLZzbY_.4zVjDvd2bnVCy_x9EVhKAiCM6wNbb92_0 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2770540440065576384', time=2024-09-05T03:58:48.644958+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:hK94ggmyxc9wFf6B.YgIcG4q0gtNZhu_.75_b5-WbOrInWwMpffFRhT9hiL9660G_0 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1584013351023410610', time=2024-09-05T03:59:46.164395+0000, chain.objs.size()=1 2024-09-05T02:16:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.587__shadow:uYNrSobim3SJxq0Wk1EooNoeCsWndDe_.3jD24V2KAS7fDH3coxmaUq-RzTsX3ca_0 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15340424427078446627', time=2024-09-05T04:04:52.660034+0000, chain.objs.size()=1 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.629__shadow_.Dhyd1KRJayMFHdBQIFmfjMqvjKC868a_0 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11666369336175016225', time=2024-09-05T04:06:20.052350+0000, chain.objs.size()=1 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.665__shadow_.KxlEhWH-0jK3AeapARjajoCyaF8FxqF_0 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18211602979014070425', time=2024-09-05T04:06:23.366563+0000, chain.objs.size()=1 2024-09-05T02:16:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.868+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.666__shadow_.uujv0q9vY4UquBDJM5US2Yz4xMMkDYd_0 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17875893220465405686', time=2024-09-05T04:06:27.788633+0000, chain.objs.size()=1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.670__shadow_.T7j7cJTpXwDlMVwLhrrkX_MYvQAQMrp_0 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2556362862538208920', time=2024-09-05T04:06:57.132461+0000, chain.objs.size()=1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.691__shadow_.Y4Y252H_C8zqGSxM6_friXmVXY7zkd1_0 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12208541201343037150', time=2024-09-05T04:07:12.543814+0000, chain.objs.size()=1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.700__shadow:tu88nHyBv7eGrKhS7ASuxC7e0toxEBX_.yWuZbocDAZARnjTUIsofHLcwnPF6m_R_0 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13063996428435138497', time=2024-09-05T04:07:16.197323+0000, chain.objs.size()=1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.702__multipart_file1.2~yS46TaYsvQaO0WNvw3GD2JXrzcDqSj4.1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4601655651553498504', time=2024-09-05T04:15:43.691681+0000, chain.objs.size()=1 2024-09-05T02:16:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.782__shadow_.UTE_kQjtDm5HQa41AMaEO8L6uz-hekl_0 2024-09-05T02:16:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.872+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-05T02:16:22.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-05T02:16:22.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47373' 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5132020694522748117', time=2024-09-05T03:32:41.013060+0000, chain.objs.size()=2 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.158__shadow_.2D03gcqEQJz-aD5h2ANYGsakpCs103B_0 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.158__shadow_.2D03gcqEQJz-aD5h2ANYGsakpCs103B_1 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='_BAGg97IcNUgh262gk9v2wq34hUjdQ8U', time=2024-09-05T03:32:53.172775+0000, chain.objs.size()=2 2024-09-05T02:16:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.DBXfBIVJIJZdN22UNwy4RoQ1fS0qccx_0 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.160__shadow_.DBXfBIVJIJZdN22UNwy4RoQ1fS0qccx_1 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17471463754509104226', time=2024-09-05T03:37:33.559790+0000, chain.objs.size()=1 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.236__shadow_.3QCbZ9-f_Ubl6svYalJNxyffR-EhvQ-_0 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3556400101690234542', time=2024-09-05T03:37:51.064173+0000, chain.objs.size()=1 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.244__shadow_.dhiGLXX1r2D4MnJ5aD-b1dgf6OmQl0X_0 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17365102229658890483', time=2024-09-05T03:37:52.947557+0000, chain.objs.size()=1 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.245__shadow_.iBMyU6FDfWKocaI1XUe-rfKn4z4PDnd_0 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18050614550974837427', time=2024-09-05T03:37:58.613098+0000, chain.objs.size()=1 2024-09-05T02:16:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.248__shadow_.gb0-tBM3vpwPwdoTakZOlWv9ciHYoDS_0 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9714264574080294482', time=2024-09-05T03:40:04.398726+0000, chain.objs.size()=1 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.BIndMU3eAEy1a0PXwe1Yh9Ca55ffyKm_0 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6342895130082293003', time=2024-09-05T03:40:04.648981+0000, chain.objs.size()=1 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.AGYr7B2tRmfbgKEHKN_1CgSgxLjeSH-_0 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9068387528305031252', time=2024-09-05T03:40:09.002311+0000, chain.objs.size()=1 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o9I5bYqr6f21UC6PKyS1tjOCN_G3JBU_0 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5841761891198583522', time=2024-09-05T03:40:11.296691+0000, chain.objs.size()=1 2024-09-05T02:16:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.876+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.norbuopdMeGb8CV3gLcWYLVdPaXTGOG_0 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8857965935512697431', time=2024-09-05T03:40:14.567435+0000, chain.objs.size()=1 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.aPcVHvvC0mL9mfvy8IejPMaje8rhnFK_0 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12240754586467688729', time=2024-09-05T03:40:15.314788+0000, chain.objs.size()=1 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jj_jl7Q-BJS_uRjEY4-WCOt2mqV__RQ_0 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10143998673535975182', time=2024-09-05T03:40:15.368003+0000, chain.objs.size()=1 2024-09-05T02:16:22.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.I0CzlWotP1sCC673IC7KLgyt39X9Poe_0 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15467083365996499652', time=2024-09-05T03:40:16.188164+0000, chain.objs.size()=1 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PmQBqymLTIZtk3Th6NMmLdUWfBrEIg0_0 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16710467488055732404', time=2024-09-05T03:40:16.434524+0000, chain.objs.size()=1 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.cOWo0piEZna7Jtlov1kiLVrRORx7ZHJ_0 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14806367156515129295', time=2024-09-05T03:40:17.982709+0000, chain.objs.size()=1 2024-09-05T02:16:22.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ixKxs9IdX6b_A_ZyDWO78xsx0iYBP5I_0 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4687780510828721042', time=2024-09-05T03:40:18.151533+0000, chain.objs.size()=1 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.vlw92WuwXbSNFu0bn8KOqGtIMJh5Y4S_0 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10588964441798092791', time=2024-09-05T03:40:18.596065+0000, chain.objs.size()=1 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.oejEeyYuMlyrRDCArIeLDKxVKd88nZX_0 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14770719437125810766', time=2024-09-05T03:40:18.743612+0000, chain.objs.size()=1 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.Kr28UxOeNtlfmGGU8r6Et8Sj7bxEYxB_0 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3825257823237818425', time=2024-09-05T03:40:19.172856+0000, chain.objs.size()=1 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.o_cpui7DqkrmBPnS1mBXixNhMEllTST_0 2024-09-05T02:16:22.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16689326881557477237', time=2024-09-05T03:40:19.905851+0000, chain.objs.size()=1 2024-09-05T02:16:22.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.880+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.luX6aIh_3bkk8hUI5NkeIqeEH6gSxNt_0 2024-09-05T02:16:22.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14682521621433211929', time=2024-09-05T03:40:22.653754+0000, chain.objs.size()=1 2024-09-05T02:16:22.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ckzLontSNr8QdqOy8hPAgRce4tX4rDc_0 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.495806585202253520', time=2024-09-05T03:40:23.213336+0000, chain.objs.size()=1 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.TQTOfKy_eLO1Dggfji4Ozw_3W7XDF7j_0 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8482927942448117105', time=2024-09-05T03:40:23.805189+0000, chain.objs.size()=1 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.fkVQ7o7qKBeaMJ2vMBVqm5s4Fz-kIWq_0 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14082880073581356309', time=2024-09-05T03:40:24.376956+0000, chain.objs.size()=1 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.INO7Oi6DqGf-xFJBv2VKKTCQf4WqohC_0 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1628425837959632524', time=2024-09-05T03:40:24.562894+0000, chain.objs.size()=1 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.mYsd9bVFamsF6S_b6HDX_EQa1D8N012_0 2024-09-05T02:16:22.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3503459332104510862', time=2024-09-05T03:40:28.822680+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.LdG3PuC9Te3pulzZPBdX-iJ2hdtaFS0_0 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9218601298025754204', time=2024-09-05T03:40:29.149553+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.May--Qv7oZ19aJ7my7ypx7fULrjVOGR_0 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9459433442869860716', time=2024-09-05T03:40:29.983446+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.ek_PQwB2pQADBOyRFKdSBn5pVx_zxal_0 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3787186619522148606', time=2024-09-05T03:40:31.408029+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.a8dW2Dkn6dGnLekvshLhcySDrhsF3-7_0 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11161199535179587292', time=2024-09-05T03:40:31.817863+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.jMyZJuikjEWEa4KTn9A5g5rUBPFjezg_0 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7365268607347351031', time=2024-09-05T03:40:33.948929+0000, chain.objs.size()=1 2024-09-05T02:16:22.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.HIF3FHcL1A0uujKBlTIn4nPVtBEw-W2_0 2024-09-05T02:16:22.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5791404414332955192', time=2024-09-05T03:40:34.637142+0000, chain.objs.size()=1 2024-09-05T02:16:22.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.eYk0BhjhAaNF9JM1Va_qjMaeWeGvk8x_0 2024-09-05T02:16:22.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16983691460279614817', time=2024-09-05T03:40:35.041814+0000, chain.objs.size()=1 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.884+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.yLM4j5ecZs06qx1S32WPefsP6ncAmvY_0 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16043330235039485079', time=2024-09-05T03:40:35.826134+0000, chain.objs.size()=1 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.PqOOKhYHoHoPblLSOVY3KOY674QJWxB_0 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2907292266038274221', time=2024-09-05T03:40:36.261813+0000, chain.objs.size()=1 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.262__shadow_.isbNbM5jvF2k0cBxvwDdhIo_2hOFd3a_0 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13858192950961436167', time=2024-09-05T03:40:55.784685+0000, chain.objs.size()=1 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.273__shadow_.HeH5iQcHqR4nm2Lpk9HKUasGA1kGAmV_0 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6945100443432608038', time=2024-09-05T03:41:08.659505+0000, chain.objs.size()=1 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.280__shadow_.vJcGfVjH7SOHbQKYtX09i-Y7QO2TeKg_0 2024-09-05T02:16:22.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6528042979021763536', time=2024-09-05T03:41:34.769340+0000, chain.objs.size()=1 2024-09-05T02:16:22.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.eq6_fcJ46Z3qA6-la5oW_a64iwiuCnZ_0 2024-09-05T02:16:22.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5629708895999532896', time=2024-09-05T03:41:35.023452+0000, chain.objs.size()=1 2024-09-05T02:16:22.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.6cK1nTm44hOpPDjlVDILB6yM80UWDrr_0 2024-09-05T02:16:22.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5704704617646436877', time=2024-09-05T03:41:35.047298+0000, chain.objs.size()=1 2024-09-05T02:16:22.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.292__shadow_.9bLQuQQ7AxWsYFzeHz3y_2ZiYT1UXe__0 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8101789912068907410', time=2024-09-05T03:41:44.030692+0000, chain.objs.size()=1 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.295__shadow_.Br7BrvZ1_tg8aC7UCU3ysmndhkBz63C_0 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10894831773834877314', time=2024-09-05T03:41:45.894505+0000, chain.objs.size()=1 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.296__shadow_.xDjJDCD9979Rul7LTGA23uHIh_8gXtF_0 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.194413787257125952', time=2024-09-05T03:41:57.382392+0000, chain.objs.size()=1 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.302__shadow_.MYbUyZtyTysE9lBhup7aPWEsdgiWFia_0 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9921212885539745745', time=2024-09-05T03:44:19.276278+0000, chain.objs.size()=1 2024-09-05T02:16:22.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.iYvJOSP7VgOc6Fm0MkcDn4boxV0Xoim_0 2024-09-05T02:16:22.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11820900902519316668', time=2024-09-05T03:44:19.356522+0000, chain.objs.size()=1 2024-09-05T02:16:22.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.sWUQcY1Z24ilJRRG64YJxh7Lxm6XVJ4_0 2024-09-05T02:16:22.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17204071972605833951', time=2024-09-05T03:44:19.669882+0000, chain.objs.size()=1 2024-09-05T02:16:22.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LnB5fVrOqH9bfqTyvDWUveY0AnExUQt_0 2024-09-05T02:16:22.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.4876308991489013548', time=2024-09-05T03:44:19.762448+0000, chain.objs.size()=1 2024-09-05T02:16:22.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4eoJaiKSyd-k4ptFGYoeaRTu3Pg--Pp_0 2024-09-05T02:16:22.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.18172336261796114670', time=2024-09-05T03:44:19.876252+0000, chain.objs.size()=1 2024-09-05T02:16:22.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MRo0hgcjQItYtpkTZ16oWIlgumMtv2w_0 2024-09-05T02:16:22.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9357267650717442332', time=2024-09-05T03:44:21.520182+0000, chain.objs.size()=1 2024-09-05T02:16:22.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.8LZXbJylp2LgDlQxELqu6bU7zeCTxHD_0 2024-09-05T02:16:22.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15094535620899887545', time=2024-09-05T03:44:21.521707+0000, chain.objs.size()=1 2024-09-05T02:16:22.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.T9q9tO2MDpKX0YVOsWB_PZyeYD-ArHh_0 2024-09-05T02:16:22.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3950421090367802863', time=2024-09-05T03:44:22.093020+0000, chain.objs.size()=1 2024-09-05T02:16:22.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.888+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.afNV-96fl7y2RQorl8qUTdrEZQ6l9tJ_0 2024-09-05T02:16:22.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7584252374641335864', time=2024-09-05T03:44:23.558180+0000, chain.objs.size()=1 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.DEW5w_fznET2MyoobM5yrgLYISJSynx_0 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.674728119505457378', time=2024-09-05T03:44:24.049511+0000, chain.objs.size()=1 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.F8u649ePzv8l4uRx8-I_FiuhdxZLLpy_0 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1118998224323296102', time=2024-09-05T03:44:24.438013+0000, chain.objs.size()=1 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.45HceZdpUwLEyAMqaimaMjRo8iptQRL_0 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17269143948628789112', time=2024-09-05T03:44:25.416647+0000, chain.objs.size()=1 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.yO8XnYle-2-29b_NPQ0dmrOKIvxdO74_0 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.589083778489130374', time=2024-09-05T03:44:26.250820+0000, chain.objs.size()=1 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.U668GEAYYsXber6XkZLTIdIagcXrku0_0 2024-09-05T02:16:22.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14922538590137795587', time=2024-09-05T03:44:26.314334+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LHdZCkUcaXm3armBJs5wAAhQlckXpRU_0 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12566070485773203900', time=2024-09-05T03:44:29.111332+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.27mrnslAbm_JkhGbSzJtYdmPcjEObGl_0 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7959437233114396407', time=2024-09-05T03:44:29.276560+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6YiXjXZHsURI2_aMUnspSPQCYRjmtbb_0 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13038328530201614330', time=2024-09-05T03:44:30.112543+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.lk-cgnb6uIxH_22tqBuRl91x_ynDHIC_0 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17222484671555988295', time=2024-09-05T03:44:30.113931+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.6cav7ZntGmMDgSJtrJsAEa-KOSCW7E__0 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15482502726342562373', time=2024-09-05T03:44:30.781797+0000, chain.objs.size()=1 2024-09-05T02:16:22.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.WeWKXPh4Rym4j46obNHzyQwJtGCx6zU_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5173073270970002249', time=2024-09-05T03:44:31.829957+0000, chain.objs.size()=1 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.NfD1kLyxVezRB64hXMqlK-STO2XiSq-_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7838916415284006253', time=2024-09-05T03:44:33.564811+0000, chain.objs.size()=1 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vZ7vDt2XwsfWHU0q8gMki-I4uHBfcdd_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13600513168989914846', time=2024-09-05T03:44:33.907220+0000, chain.objs.size()=1 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.xCDVfU0-PRRnC74j4dwoG9RRsXQJUI2_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5448927847496476861', time=2024-09-05T03:44:34.389418+0000, chain.objs.size()=1 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.wOwGp6Z2ssm4-oabzYPe02KLeO9x3Ln_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5641059103766967825', time=2024-09-05T03:44:34.392922+0000, chain.objs.size()=1 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.4DX_zOoVMTB7bYLpvyQmAiSV6eoez8U_0 2024-09-05T02:16:22.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6921460552284495234', time=2024-09-05T03:44:34.901811+0000, chain.objs.size()=1 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.9vLJO2A1MPkXB3IhkIH9YG5e4uqZos__0 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.17727432313629537572', time=2024-09-05T03:44:36.556663+0000, chain.objs.size()=1 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.892+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.oYOPfNteH2JVsoqiTBvfaVz4eHCEbGO_0 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12768913792133981342', time=2024-09-05T03:44:37.115381+0000, chain.objs.size()=1 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.krLDUMwS_Qg0NiLmnbRAc7KMqOkAub4_0 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9192663931435370791', time=2024-09-05T03:44:37.173544+0000, chain.objs.size()=1 2024-09-05T02:16:22.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.vaWbqgYqnRvCMFkLYskCyo5CwM4XpoY_0 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5302080136558501824', time=2024-09-05T03:44:37.575587+0000, chain.objs.size()=1 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.LLyU2w0QWD_CrotHCOTXYVfdeFsF1kn_0 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10006571795828329548', time=2024-09-05T03:44:37.736188+0000, chain.objs.size()=1 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.Uc8JMf0Xglf4IaY7mXWiY7k_5RbvVqh_0 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8612453498116047482', time=2024-09-05T03:44:38.472070+0000, chain.objs.size()=1 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.pOH5mHgl-s_pBdJC6aNQWD_UPDXeoIA_0 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15084252035804999527', time=2024-09-05T03:44:38.508176+0000, chain.objs.size()=1 2024-09-05T02:16:22.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.896+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.BbhiFnRFs64o20m9yXG3IPVkVYvuiLS_0 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13388799916952530632', time=2024-09-05T03:44:38.510190+0000, chain.objs.size()=1 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.nBhUUn6rmXYQvmNZ42nP3zsSqkzg-mb_0 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.845846590652156188', time=2024-09-05T03:44:38.616916+0000, chain.objs.size()=1 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.99Ob_InzRjlr4AargIX_CbKOb2qHZ6N_0 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6039764115205383251', time=2024-09-05T03:44:38.990902+0000, chain.objs.size()=1 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.uodwv6DO8h7Cfr7IW9EgO-QdGVVS2cF_0 2024-09-05T02:16:22.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5189840505680473544', time=2024-09-05T03:44:40.031223+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.TyWMuXwb9zNDFSdtMEHzAYEL0HvGj0q_0 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11305586766800890402', time=2024-09-05T03:44:40.574934+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.1F82nFZqyvmCe8BNQUs0jN5hyAhWc3G_0 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1234957405443655621', time=2024-09-05T03:44:41.051291+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0cSC4WmlF7mfnHOp0JXIMH5GAsIkC-D_0 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12122092949974597343', time=2024-09-05T03:44:41.873207+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.ipn4yzacFRBNFJO_XuQCR-7wBBh3dFg_0 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7864208324843201468', time=2024-09-05T03:44:41.874986+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.0ra-RNrf2xGC9IobNA_oIi1IoGHMzLH_0 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14779969698690159285', time=2024-09-05T03:44:42.778889+0000, chain.objs.size()=1 2024-09-05T02:16:22.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.MTi_Cc-pdcSdFmDrv3zLs_HYm5dk5Ae_0 2024-09-05T02:16:22.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11660291308592529653', time=2024-09-05T03:44:45.274787+0000, chain.objs.size()=1 2024-09-05T02:16:22.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.900+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_._SL2IclP0ErvCNeb-hLgNhG6GTNblw3_0 2024-09-05T02:16:22.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2490096944983333031', time=2024-09-05T03:44:45.348082+0000, chain.objs.size()=1 2024-09-05T02:16:22.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.XauerHTtJZKbYIWUr_Oy0H0ibO-o2x1_0 2024-09-05T02:16:22.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10860482158339468631', time=2024-09-05T03:44:49.033970+0000, chain.objs.size()=1 2024-09-05T02:16:22.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.323__shadow_.L59nOVnvwuxh476H4ymDvaTuUtYgwVi_0 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.36165421618557757', time=2024-09-05T03:46:33.397018+0000, chain.objs.size()=1 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.VmnBPpbYP0GNT8fVC97aFV5g6gYIqmN_0 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13948599445100074516', time=2024-09-05T03:46:33.589750+0000, chain.objs.size()=1 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nZxckXX2G9dHErUGbvchaCoApvXyo7u_0 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.605436876327208819', time=2024-09-05T03:46:34.085940+0000, chain.objs.size()=1 2024-09-05T02:16:22.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.WG6lTquczT9HIs_9neCu4f9np0RKKdg_0 2024-09-05T02:16:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12155601292904995123', time=2024-09-05T03:46:34.274782+0000, chain.objs.size()=1 2024-09-05T02:16:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.QH62LWfKwlAZoIRolm9pUnO3mJCNxgV_0 2024-09-05T02:16:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8461338390242626411', time=2024-09-05T03:46:35.347844+0000, chain.objs.size()=1 2024-09-05T02:16:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.I14XllzbrYFnEGO7oVk-fyTt-vWl_AP_0 2024-09-05T02:16:22.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6624225602981688458', time=2024-09-05T03:46:36.607378+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.rTe3IDmgimem2hYulQ29d1cKoBXUawu_0 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11061570737784998031', time=2024-09-05T03:46:37.791952+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nPwOU_cE_Dn-dChW_CdFRjuTyc7IUmj_0 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.712755512064385544', time=2024-09-05T03:46:37.793329+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nsjkA99U2qqVcDtqb-Dmf57WMDs2Q4G_0 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14265926107992329516', time=2024-09-05T03:46:38.624229+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.AHW7BNneATJ-NE66pDOoBXz8sIX0OKJ_0 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8186601534014511004', time=2024-09-05T03:46:39.781370+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wSilebVx3-rY4lrYvq_SHIu0ieydXac_0 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10502663764513299497', time=2024-09-05T03:46:40.518410+0000, chain.objs.size()=1 2024-09-05T02:16:22.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.904+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.eBEPpAOJ7cCYDbdBDY4LnMNoo9AKLjb_0 2024-09-05T02:16:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.908+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12049608949152674322', time=2024-09-05T03:46:41.991519+0000, chain.objs.size()=1 2024-09-05T02:16:22.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.908+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ns4ywqqoDxz-kWPF-PPUitEmn9S7biv_0 2024-09-05T02:16:22.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47373 2024-09-05T02:16:22.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1811001462396359275', time=2024-09-05T03:46:42.322496+0000, chain.objs.size()=1 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.i-9Lu5JGaWu6ISjav5TXFTV002N72Hg_0 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2833355174067231085', time=2024-09-05T03:46:45.062038+0000, chain.objs.size()=1 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.hV3dEHVxm4vlxu3gwdvsYLpB1BzTl_4_0 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2216620643603689959', time=2024-09-05T03:46:46.537904+0000, chain.objs.size()=1 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.SKwEaiF3OV4BQnFMJJ5LzCoCqImPvbb_0 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14032312139523799914', time=2024-09-05T03:46:46.762743+0000, chain.objs.size()=1 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wBbOkmxUqACsp3jLOPoW5eNoikXGBPR_0 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12076587033117656913', time=2024-09-05T03:46:46.929371+0000, chain.objs.size()=1 2024-09-05T02:16:22.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.17iVUdeFnanbAKCLRJD4xqSQcesQqjn_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1532711006170901851', time=2024-09-05T03:46:48.193658+0000, chain.objs.size()=1 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.zyHgfsVBUYx52F7LSe_dXEu_WiD-4_U_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5242225018961308481', time=2024-09-05T03:46:48.611630+0000, chain.objs.size()=1 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nI5vWnwnDF9dfh9QStqQxpYtznbmcHJ_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.2034129976432401147', time=2024-09-05T03:46:49.240687+0000, chain.objs.size()=1 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.UlHvpw-bDA17FkzZbLAbQhQ8xkqcQFB_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3893850643433689188', time=2024-09-05T03:46:51.809663+0000, chain.objs.size()=1 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.uBC7mLT1QOBGUnm3rhaxxYCgZFWdvo8_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.10192663698851992017', time=2024-09-05T03:46:52.167120+0000, chain.objs.size()=1 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.wkBiwWLRJykRV5FUnBZGAXvnx3gNcNN_0 2024-09-05T02:16:22.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.13331959520621473045', time=2024-09-05T03:46:52.573764+0000, chain.objs.size()=1 2024-09-05T02:16:22.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.PzIvCOQqZaTZEgjsNrygwKmngdo1NPh_0 2024-09-05T02:16:22.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5338528525721749579', time=2024-09-05T03:46:55.067117+0000, chain.objs.size()=1 2024-09-05T02:16:22.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.912+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.qobfsZLjW364XxIluyh9l_7wQtWNZBg_0 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9179139422409131168', time=2024-09-05T03:46:56.300136+0000, chain.objs.size()=1 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.K6fHrTgxUu_YRDceMoR-hUiW-5v_7ah_0 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1663630190847892420', time=2024-09-05T03:46:57.992516+0000, chain.objs.size()=1 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.U0_6DNhP--NqYTh-Bj5ZgH3jzAAg-NG_0 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3704484979049248291', time=2024-09-05T03:46:59.686242+0000, chain.objs.size()=1 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.8UtUpWRAq0BM13gEUs9UhIb4YKYHVla_0 2024-09-05T02:16:22.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.12349081469372615272', time=2024-09-05T03:47:01.253393+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.JcJtUmPz1FQnlLr_Sjhh9zpgi2yeIt5_0 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11576749653989883893', time=2024-09-05T03:47:01.986825+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.nc4cQSlPLQT3qqT9Q7RdTQYLp-KR9tw_0 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.15139305801954079304', time=2024-09-05T03:47:02.203361+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.n_Ua8AoZU5M_R5HBMgWSdRQlqyTYkG8_0 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8103693969723172519', time=2024-09-05T03:47:03.473449+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.ED76-IpqjE9jeRuDySwpGJElt_BUCJ0_0 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11516621045767499641', time=2024-09-05T03:47:04.584011+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.324__shadow_.xESiUDLKwAgfkMezH4wKIcyr74IOBxH_0 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1657575852342902891', time=2024-09-05T03:47:11.663155+0000, chain.objs.size()=1 2024-09-05T02:16:22.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.329__shadow_.phUSTurl7BACFAkBjDEDP4rH2mK4zLA_0 2024-09-05T02:16:22.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11376334481293955292', time=2024-09-05T03:48:09.175917+0000, chain.objs.size()=1 2024-09-05T02:16:22.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.371__shadow_.rP5FMir3HLbzb19iJWYvdJzpHIK7Kug_0 2024-09-05T02:16:22.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8979701733936946354', time=2024-09-05T03:50:04.022246+0000, chain.objs.size()=1 2024-09-05T02:16:22.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.444__shadow_.TO043c2mB6MXQg02-b7jmTt7P8aZj1E_0 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3465424934399088204', time=2024-09-05T03:51:11.761928+0000, chain.objs.size()=1 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.484__shadow_.GxQveZtag3OjysgEche8RqJ8gLplGo-_0 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.5513635616032588228', time=2024-09-05T03:51:33.788045+0000, chain.objs.size()=1 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.496__shadow_.sB0gJpRHmsncO9PhHbB6MLT8ZiSwsFt_0 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.9122236664812418914', time=2024-09-05T03:53:06.580963+0000, chain.objs.size()=3 2024-09-05T02:16:22.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~EptTk0no7PhgR3Hh-OJVXngU6hzI5-j.1 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~EptTk0no7PhgR3Hh-OJVXngU6hzI5-j.2 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.521__multipart_mymultipart.2~EptTk0no7PhgR3Hh-OJVXngU6hzI5-j.3 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1297041617773678341', time=2024-09-05T03:54:36.339403+0000, chain.objs.size()=3 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~tiIA2bubTDo2nucmDjGWmd1huefQd3N.1 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~tiIA2bubTDo2nucmDjGWmd1huefQd3N.2 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.523__multipart_mymultipart.2~tiIA2bubTDo2nucmDjGWmd1huefQd3N.3 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.16050293829531342938', time=2024-09-05T03:57:15.921477+0000, chain.objs.size()=1 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.564__shadow_.bJOsULHvEdKNgIvWc_Bj1c1HERONBHi_0 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.7844053105370373934', time=2024-09-05T03:57:40.190549+0000, chain.objs.size()=1 2024-09-05T02:16:22.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.569__shadow:4kk90GNtrJYrKFmyu2EsKL58.cbgOr-_.VB2sVkuEc3Pulgcm0Nm50Z8KC7Ai5CT_0 2024-09-05T02:16:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8767701139896449381', time=2024-09-05T03:58:47.540349+0000, chain.objs.size()=1 2024-09-05T02:16:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.920+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.577__shadow:nq6p-MMqHVAF8LnPqQa1115KZMaGYZs_.NmjmnvEOhwwupXTntlpLVsfC4k2FglP_0 2024-09-05T02:16:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.14690008151612896171', time=2024-09-05T03:59:17.575461+0000, chain.objs.size()=4 2024-09-05T02:16:22.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~Jzbkymp-z_n_PS0DJ9vczKXrlNDOudD.1 2024-09-05T02:16:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~Jzbkymp-z_n_PS0DJ9vczKXrlNDOudD.2 2024-09-05T02:16:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~Jzbkymp-z_n_PS0DJ9vczKXrlNDOudD.3 2024-09-05T02:16:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.578__multipart_testobj.2~Jzbkymp-z_n_PS0DJ9vczKXrlNDOudD.4 2024-09-05T02:16:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.8343502772618828269', time=2024-09-05T04:05:33.027785+0000, chain.objs.size()=1 2024-09-05T02:16:22.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.924+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.649__shadow_.f4HHjofqZVN_XwunfJ5WGPrVLWwQCzj_0 2024-09-05T02:16:22.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.1643547413007845935', time=2024-09-05T04:05:35.882277+0000, chain.objs.size()=1 2024-09-05T02:16:22.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.650__shadow_.OZHPZjn_0AFFhYAJheSgUkWx-UWuBPI_0 2024-09-05T02:16:22.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.6999403486373277657', time=2024-09-05T04:05:46.154277+0000, chain.objs.size()=2 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.655__shadow_.kuq1UcGUS8ENoJ1r_lFQ4Uotn5SwhIx_0 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.655__shadow_.kuq1UcGUS8ENoJ1r_lFQ4Uotn5SwhIx_1 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.3070603260915070680', time=2024-09-05T04:06:22.680712+0000, chain.objs.size()=1 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.666__shadow_.lI_cUGq5kPSRcI5TJghysCOgfxs-lXr_0 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 20 garbage collection: RGWGC::process iterating over entry tag='029be2ba-89f5-4a66-997f-b36b11292c2c.4561.11240165139049161881', time=2024-09-05T04:07:07.270626+0000, chain.objs.size()=1 2024-09-05T02:16:22.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.928+0000 7f57676149c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:029be2ba-89f5-4a66-997f-b36b11292c2c.4561.697__shadow:exdoJiLbKeLtnZ8KUSxbu5RW7h4Snpp_.BYh6Nhh84Zcv7Slg3NxvCIY-OoAswPh_0 2024-09-05T02:16:22.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.932+0000 7f57676149c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-05T02:16:22.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.936+0000 7f561b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-05T02:16:22.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.940+0000 7f57676149c0 20 remove_watcher() i=0 2024-09-05T02:16:22.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.940+0000 7f57676149c0 2 removed watcher, disabling cache 2024-09-05T02:16:22.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.940+0000 7f57676149c0 20 remove_watcher() i=1 2024-09-05T02:16:22.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.940+0000 7f57676149c0 20 remove_watcher() i=2 2024-09-05T02:16:22.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.944+0000 7f57676149c0 20 remove_watcher() i=3 2024-09-05T02:16:22.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.944+0000 7f57676149c0 20 remove_watcher() i=4 2024-09-05T02:16:22.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.944+0000 7f57676149c0 20 remove_watcher() i=5 2024-09-05T02:16:22.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.944+0000 7f57676149c0 20 remove_watcher() i=6 2024-09-05T02:16:22.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-05T02:16:22.948+0000 7f57676149c0 20 remove_watcher() i=7 2024-09-05T02:16:22.961 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-05T02:16:22.971 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-05T02:16:23.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T02:16:23.017 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:16:23.377 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:23.389 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:16:23.396 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2872,"stamp":"2024-09-05T02:16:22.502599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":621034432,"num_objects":4225,"num_object_clones":0,"num_object_copies":8450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4225,"num_whiteouts":0,"num_read":288801,"num_read_kb":2645314,"num_write":159268,"num_write_kb":2503539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13749,"ondisk_log_size":13749,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2904772,"kb_used_data":1458824,"kb_used_omap":12,"kb_used_meta":1445683,"kb_avail":752069948,"statfs":{"total":773094113280,"available":770119626752,"internally_reserved":0,"allocated":1493835776,"data_stored":1449641121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1480379952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-107280603,"num_objects":-698,"num_object_clones":0,"num_object_copies":-1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-698,"num_whiteouts":0,"num_read":804,"num_read_kb":850,"num_write":752,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008088"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200116+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:12:00.200116+0000","last_peered":"2024-09-05T02:12:00.200116+0000","last_clean":"2024-09-05T02:12:00.200116+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:12:00.200116+0000","last_undegraded":"2024-09-05T02:12:00.200116+0000","last_fullsized":"2024-09-05T02:12:00.200116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:56.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459278+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:11:56.459278+0000","last_peered":"2024-09-05T02:11:56.459278+0000","last_clean":"2024-09-05T02:11:56.459278+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:11:56.459278+0000","last_undegraded":"2024-09-05T02:11:56.459278+0000","last_fullsized":"2024-09-05T02:11:56.459278+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:52:17.217061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375602+0000","last_change":"2024-09-05T01:30:15.667346+0000","last_active":"2024-09-05T02:12:46.375602+0000","last_peered":"2024-09-05T02:12:46.375602+0000","last_clean":"2024-09-05T02:12:46.375602+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:12:46.375602+0000","last_undegraded":"2024-09-05T02:12:46.375602+0000","last_fullsized":"2024-09-05T02:12:46.375602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:40.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.202821+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:11:56.202821+0000","last_peered":"2024-09-05T02:11:56.202821+0000","last_clean":"2024-09-05T02:11:56.202821+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:11:56.202821+0000","last_undegraded":"2024-09-05T02:11:56.202821+0000","last_fullsized":"2024-09-05T02:11:56.202821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:01.475308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766667+0000","last_change":"2024-09-05T01:09:22.194515+0000","last_active":"2024-09-05T02:11:51.766667+0000","last_peered":"2024-09-05T02:11:51.766667+0000","last_clean":"2024-09-05T02:11:51.766667+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:11:51.766667+0000","last_undegraded":"2024-09-05T02:11:51.766667+0000","last_fullsized":"2024-09-05T02:11:51.766667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:51.467116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.381829+0000","last_change":"2024-09-05T01:05:07.120154+0000","last_active":"2024-09-05T02:13:16.381829+0000","last_peered":"2024-09-05T02:13:16.381829+0000","last_clean":"2024-09-05T02:13:16.381829+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:13:16.381829+0000","last_undegraded":"2024-09-05T02:13:16.381829+0000","last_fullsized":"2024-09-05T02:13:16.381829+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:15.466155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468968+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:14:05.468968+0000","last_peered":"2024-09-05T02:14:05.468968+0000","last_clean":"2024-09-05T02:14:05.468968+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:14:05.468968+0000","last_undegraded":"2024-09-05T02:14:05.468968+0000","last_fullsized":"2024-09-05T02:14:05.468968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":53,"num_write":3,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.384719+0000","last_change":"2024-09-05T01:09:22.189240+0000","last_active":"2024-09-05T02:13:31.384719+0000","last_peered":"2024-09-05T02:13:31.384719+0000","last_clean":"2024-09-05T02:13:31.384719+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:13:31.384719+0000","last_undegraded":"2024-09-05T02:13:31.384719+0000","last_fullsized":"2024-09-05T02:13:31.384719+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:27.906635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448662+0000","last_change":"2024-09-05T01:05:07.099663+0000","last_active":"2024-09-05T02:12:40.448662+0000","last_peered":"2024-09-05T02:12:40.448662+0000","last_clean":"2024-09-05T02:12:40.448662+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:12:40.448662+0000","last_undegraded":"2024-09-05T02:12:40.448662+0000","last_fullsized":"2024-09-05T02:12:40.448662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:05.063618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467527+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:12:26.467527+0000","last_peered":"2024-09-05T02:12:26.467527+0000","last_clean":"2024-09-05T02:12:26.467527+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:12:26.467527+0000","last_undegraded":"2024-09-05T02:12:26.467527+0000","last_fullsized":"2024-09-05T02:12:26.467527+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209385+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:12:40.209385+0000","last_peered":"2024-09-05T02:12:40.209385+0000","last_clean":"2024-09-05T02:12:40.209385+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:12:40.209385+0000","last_undegraded":"2024-09-05T02:12:40.209385+0000","last_fullsized":"2024-09-05T02:12:40.209385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441829+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:12:15.441829+0000","last_peered":"2024-09-05T02:12:15.441829+0000","last_clean":"2024-09-05T02:12:15.441829+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:12:15.441829+0000","last_undegraded":"2024-09-05T02:12:15.441829+0000","last_fullsized":"2024-09-05T02:12:15.441829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:48.174424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390642+0000","last_change":"2024-09-05T01:09:26.324652+0000","last_active":"2024-09-05T02:12:16.390642+0000","last_peered":"2024-09-05T02:12:16.390642+0000","last_clean":"2024-09-05T02:12:16.390642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:12:16.390642+0000","last_undegraded":"2024-09-05T02:12:16.390642+0000","last_fullsized":"2024-09-05T02:12:16.390642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:50:46.559032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.209816+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:12:26.209816+0000","last_peered":"2024-09-05T02:12:26.209816+0000","last_clean":"2024-09-05T02:12:26.209816+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:12:26.209816+0000","last_undegraded":"2024-09-05T02:12:26.209816+0000","last_fullsized":"2024-09-05T02:12:26.209816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394840+0000","last_change":"2024-09-05T01:05:07.100070+0000","last_active":"2024-09-05T02:12:36.394840+0000","last_peered":"2024-09-05T02:12:36.394840+0000","last_clean":"2024-09-05T02:12:36.394840+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:12:36.394840+0000","last_undegraded":"2024-09-05T02:12:36.394840+0000","last_fullsized":"2024-09-05T02:12:36.394840+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:38.489253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.386284+0000","last_change":"2024-09-05T01:09:26.324239+0000","last_active":"2024-09-05T02:11:56.386284+0000","last_peered":"2024-09-05T02:11:56.386284+0000","last_clean":"2024-09-05T02:11:56.386284+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:11:56.386284+0000","last_undegraded":"2024-09-05T02:11:56.386284+0000","last_fullsized":"2024-09-05T02:11:56.386284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:27:56.884028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.201470+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:11:51.201470+0000","last_peered":"2024-09-05T02:11:51.201470+0000","last_clean":"2024-09-05T02:11:51.201470+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:11:51.201470+0000","last_undegraded":"2024-09-05T02:11:51.201470+0000","last_fullsized":"2024-09-05T02:11:51.201470+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:47:24.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:05.454470+0000","last_change":"2024-09-05T01:05:07.114198+0000","last_active":"2024-09-05T02:13:05.454470+0000","last_peered":"2024-09-05T02:13:05.454470+0000","last_clean":"2024-09-05T02:13:05.454470+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:13:05.454470+0000","last_undegraded":"2024-09-05T02:13:05.454470+0000","last_fullsized":"2024-09-05T02:13:05.454470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:21:32.703401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459157+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:11:56.459157+0000","last_peered":"2024-09-05T02:11:56.459157+0000","last_clean":"2024-09-05T02:11:56.459157+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:11:56.459157+0000","last_undegraded":"2024-09-05T02:11:56.459157+0000","last_fullsized":"2024-09-05T02:11:56.459157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:51:40.645794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'7","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:55.436882+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:11:55.436882+0000","last_peered":"2024-09-05T02:11:55.436882+0000","last_clean":"2024-09-05T02:11:55.436882+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:11:55.436882+0000","last_undegraded":"2024-09-05T02:11:55.436882+0000","last_fullsized":"2024-09-05T02:11:55.436882+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:46.829038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3196187,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":23604,"num_write":12,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779304+0000","last_change":"2024-09-05T01:05:07.107441+0000","last_active":"2024-09-05T02:12:46.779304+0000","last_peered":"2024-09-05T02:12:46.779304+0000","last_clean":"2024-09-05T02:12:46.779304+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:12:46.779304+0000","last_undegraded":"2024-09-05T02:12:46.779304+0000","last_fullsized":"2024-09-05T02:12:46.779304+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:28.771503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.772503+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:12:16.772503+0000","last_peered":"2024-09-05T02:12:16.772503+0000","last_clean":"2024-09-05T02:12:16.772503+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:12:16.772503+0000","last_undegraded":"2024-09-05T02:12:16.772503+0000","last_fullsized":"2024-09-05T02:12:16.772503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:13.638808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464948+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:12:16.464948+0000","last_peered":"2024-09-05T02:12:16.464948+0000","last_clean":"2024-09-05T02:12:16.464948+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:12:16.464948+0000","last_undegraded":"2024-09-05T02:12:16.464948+0000","last_fullsized":"2024-09-05T02:12:16.464948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:48.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.369336+0000","last_change":"2024-09-05T01:30:15.668869+0000","last_active":"2024-09-05T02:12:16.369336+0000","last_peered":"2024-09-05T02:12:16.369336+0000","last_clean":"2024-09-05T02:12:16.369336+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:12:16.369336+0000","last_undegraded":"2024-09-05T02:12:16.369336+0000","last_fullsized":"2024-09-05T02:12:16.369336+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:05.261577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.471304+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:12:41.471304+0000","last_peered":"2024-09-05T02:12:41.471304+0000","last_clean":"2024-09-05T02:12:41.471304+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:12:41.471304+0000","last_undegraded":"2024-09-05T02:12:41.471304+0000","last_fullsized":"2024-09-05T02:12:41.471304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":28674,"num_write":13,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.817097+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:12:11.817097+0000","last_peered":"2024-09-05T02:12:11.817097+0000","last_clean":"2024-09-05T02:12:11.817097+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:12:11.817097+0000","last_undegraded":"2024-09-05T02:12:11.817097+0000","last_fullsized":"2024-09-05T02:12:11.817097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:06.449467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818016+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:12:16.818016+0000","last_peered":"2024-09-05T02:12:16.818016+0000","last_clean":"2024-09-05T02:12:16.818016+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:12:16.818016+0000","last_undegraded":"2024-09-05T02:12:16.818016+0000","last_fullsized":"2024-09-05T02:12:16.818016+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:08:36.986922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.465067+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:12:16.465067+0000","last_peered":"2024-09-05T02:12:16.465067+0000","last_clean":"2024-09-05T02:12:16.465067+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:12:16.465067+0000","last_undegraded":"2024-09-05T02:12:16.465067+0000","last_fullsized":"2024-09-05T02:12:16.465067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:19:22.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.368114+0000","last_change":"2024-09-05T01:09:22.197361+0000","last_active":"2024-09-05T02:12:11.368114+0000","last_peered":"2024-09-05T02:12:11.368114+0000","last_clean":"2024-09-05T02:12:11.368114+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:12:11.368114+0000","last_undegraded":"2024-09-05T02:12:11.368114+0000","last_fullsized":"2024-09-05T02:12:11.368114+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:33:21.371226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375737+0000","last_change":"2024-09-05T01:05:07.119548+0000","last_active":"2024-09-05T02:12:46.375737+0000","last_peered":"2024-09-05T02:12:46.375737+0000","last_clean":"2024-09-05T02:12:46.375737+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:12:46.375737+0000","last_undegraded":"2024-09-05T02:12:46.375737+0000","last_fullsized":"2024-09-05T02:12:46.375737+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:35:04.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203655+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:12:15.203655+0000","last_peered":"2024-09-05T02:12:15.203655+0000","last_clean":"2024-09-05T02:12:15.203655+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:12:15.203655+0000","last_undegraded":"2024-09-05T02:12:15.203655+0000","last_fullsized":"2024-09-05T02:12:15.203655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:15.910872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207592+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:12:16.207592+0000","last_peered":"2024-09-05T02:12:16.207592+0000","last_clean":"2024-09-05T02:12:16.207592+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:12:16.207592+0000","last_undegraded":"2024-09-05T02:12:16.207592+0000","last_fullsized":"2024-09-05T02:12:16.207592+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:25.770411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442264+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:12:15.442264+0000","last_peered":"2024-09-05T02:12:15.442264+0000","last_clean":"2024-09-05T02:12:15.442264+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:12:15.442264+0000","last_undegraded":"2024-09-05T02:12:15.442264+0000","last_fullsized":"2024-09-05T02:12:15.442264+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:46:14.641983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774807+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:12:26.774807+0000","last_peered":"2024-09-05T02:12:26.774807+0000","last_clean":"2024-09-05T02:12:26.774807+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:12:26.774807+0000","last_undegraded":"2024-09-05T02:12:26.774807+0000","last_fullsized":"2024-09-05T02:12:26.774807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:09.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208586+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:12:21.208586+0000","last_peered":"2024-09-05T02:12:21.208586+0000","last_clean":"2024-09-05T02:12:21.208586+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:12:21.208586+0000","last_undegraded":"2024-09-05T02:12:21.208586+0000","last_fullsized":"2024-09-05T02:12:21.208586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:53.136374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774662+0000","last_change":"2024-09-05T01:09:26.327272+0000","last_active":"2024-09-05T02:12:26.774662+0000","last_peered":"2024-09-05T02:12:26.774662+0000","last_clean":"2024-09-05T02:12:26.774662+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:12:26.774662+0000","last_undegraded":"2024-09-05T02:12:26.774662+0000","last_fullsized":"2024-09-05T02:12:26.774662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:00.744251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467246+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:12:26.467246+0000","last_peered":"2024-09-05T02:12:26.467246+0000","last_clean":"2024-09-05T02:12:26.467246+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:12:26.467246+0000","last_undegraded":"2024-09-05T02:12:26.467246+0000","last_fullsized":"2024-09-05T02:12:26.467246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:36:00.381248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'116","reported_seq":469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450850+0000","last_change":"2024-09-05T01:05:07.106194+0000","last_active":"2024-09-05T02:12:50.450850+0000","last_peered":"2024-09-05T02:12:50.450850+0000","last_clean":"2024-09-05T02:12:50.450850+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:12:50.450850+0000","last_undegraded":"2024-09-05T02:12:50.450850+0000","last_fullsized":"2024-09-05T02:12:50.450850+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444865+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:12:25.444865+0000","last_peered":"2024-09-05T02:12:25.444865+0000","last_clean":"2024-09-05T02:12:25.444865+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:12:25.444865+0000","last_undegraded":"2024-09-05T02:12:25.444865+0000","last_fullsized":"2024-09-05T02:12:25.444865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:58:42.242758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467369+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:12:26.467369+0000","last_peered":"2024-09-05T02:12:26.467369+0000","last_clean":"2024-09-05T02:12:26.467369+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:12:26.467369+0000","last_undegraded":"2024-09-05T02:12:26.467369+0000","last_fullsized":"2024-09-05T02:12:26.467369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:39.545081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.391757+0000","last_change":"2024-09-05T01:09:22.204898+0000","last_active":"2024-09-05T02:12:21.391757+0000","last_peered":"2024-09-05T02:12:21.391757+0000","last_clean":"2024-09-05T02:12:21.391757+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:12:21.391757+0000","last_undegraded":"2024-09-05T02:12:21.391757+0000","last_fullsized":"2024-09-05T02:12:21.391757+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:48:27.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.392810+0000","last_change":"2024-09-05T01:09:26.329147+0000","last_active":"2024-09-05T02:12:26.392810+0000","last_peered":"2024-09-05T02:12:26.392810+0000","last_clean":"2024-09-05T02:12:26.392810+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:12:26.392810+0000","last_undegraded":"2024-09-05T02:12:26.392810+0000","last_fullsized":"2024-09-05T02:12:26.392810+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:07.238760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.206066+0000","last_change":"2024-09-05T01:09:22.187559+0000","last_active":"2024-09-05T02:12:25.206066+0000","last_peered":"2024-09-05T02:12:25.206066+0000","last_clean":"2024-09-05T02:12:25.206066+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:12:25.206066+0000","last_undegraded":"2024-09-05T02:12:25.206066+0000","last_fullsized":"2024-09-05T02:12:25.206066+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:07:59.966273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.386682+0000","last_change":"2024-09-05T01:30:15.669605+0000","last_active":"2024-09-05T02:13:41.386682+0000","last_peered":"2024-09-05T02:13:41.386682+0000","last_clean":"2024-09-05T02:13:41.386682+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:13:41.386682+0000","last_undegraded":"2024-09-05T02:13:41.386682+0000","last_fullsized":"2024-09-05T02:13:41.386682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:56.360434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467501+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:12:26.467501+0000","last_peered":"2024-09-05T02:12:26.467501+0000","last_clean":"2024-09-05T02:12:26.467501+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:12:26.467501+0000","last_undegraded":"2024-09-05T02:12:26.467501+0000","last_fullsized":"2024-09-05T02:12:26.467501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:48.846611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.819378+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:12:21.819378+0000","last_peered":"2024-09-05T02:12:21.819378+0000","last_clean":"2024-09-05T02:12:21.819378+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:12:21.819378+0000","last_undegraded":"2024-09-05T02:12:21.819378+0000","last_fullsized":"2024-09-05T02:12:21.819378+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:34.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467422+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:12:26.467422+0000","last_peered":"2024-09-05T02:12:26.467422+0000","last_clean":"2024-09-05T02:12:26.467422+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:12:26.467422+0000","last_undegraded":"2024-09-05T02:12:26.467422+0000","last_fullsized":"2024-09-05T02:12:26.467422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:59.970464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.370570+0000","last_change":"2024-09-05T01:09:22.173216+0000","last_active":"2024-09-05T02:12:21.370570+0000","last_peered":"2024-09-05T02:12:21.370570+0000","last_clean":"2024-09-05T02:12:21.370570+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:12:21.370570+0000","last_undegraded":"2024-09-05T02:12:21.370570+0000","last_fullsized":"2024-09-05T02:12:21.370570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:30:30.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209629+0000","last_change":"2024-09-05T01:05:07.097402+0000","last_active":"2024-09-05T02:12:40.209629+0000","last_peered":"2024-09-05T02:12:40.209629+0000","last_clean":"2024-09-05T02:12:40.209629+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:12:40.209629+0000","last_undegraded":"2024-09-05T02:12:40.209629+0000","last_fullsized":"2024-09-05T02:12:40.209629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:29.548612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407611+0000","last_change":"2024-09-05T01:30:15.659142+0000","last_active":"2024-09-05T02:13:36.407611+0000","last_peered":"2024-09-05T02:13:36.407611+0000","last_clean":"2024-09-05T02:13:36.407611+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:13:36.407611+0000","last_undegraded":"2024-09-05T02:13:36.407611+0000","last_fullsized":"2024-09-05T02:13:36.407611+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:28.741051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.805493+0000","last_change":"2024-09-05T01:09:26.328593+0000","last_active":"2024-09-05T02:14:51.805493+0000","last_peered":"2024-09-05T02:14:51.805493+0000","last_clean":"2024-09-05T02:14:51.805493+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:14:51.805493+0000","last_undegraded":"2024-09-05T02:14:51.805493+0000","last_fullsized":"2024-09-05T02:14:51.805493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:38.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444961+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:12:25.444961+0000","last_peered":"2024-09-05T02:12:25.444961+0000","last_clean":"2024-09-05T02:12:25.444961+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:12:25.444961+0000","last_undegraded":"2024-09-05T02:12:25.444961+0000","last_fullsized":"2024-09-05T02:12:25.444961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:22:24.610460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88572,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":88,"num_write":2,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394924+0000","last_change":"2024-09-05T01:05:07.108722+0000","last_active":"2024-09-05T02:12:36.394924+0000","last_peered":"2024-09-05T02:12:36.394924+0000","last_clean":"2024-09-05T02:12:36.394924+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:12:36.394924+0000","last_undegraded":"2024-09-05T02:12:36.394924+0000","last_fullsized":"2024-09-05T02:12:36.394924+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:28:14.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467549+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:12:26.467549+0000","last_peered":"2024-09-05T02:12:26.467549+0000","last_clean":"2024-09-05T02:12:26.467549+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:12:26.467549+0000","last_undegraded":"2024-09-05T02:12:26.467549+0000","last_fullsized":"2024-09-05T02:12:26.467549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:39.337140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:31.776137+0000","last_change":"2024-09-05T01:09:22.199397+0000","last_active":"2024-09-05T02:12:31.776137+0000","last_peered":"2024-09-05T02:12:31.776137+0000","last_clean":"2024-09-05T02:12:31.776137+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:12:31.776137+0000","last_undegraded":"2024-09-05T02:12:31.776137+0000","last_fullsized":"2024-09-05T02:12:31.776137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:09:58.963052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.373537+0000","last_change":"2024-09-05T01:05:07.107459+0000","last_active":"2024-09-05T02:12:36.373537+0000","last_peered":"2024-09-05T02:12:36.373537+0000","last_clean":"2024-09-05T02:12:36.373537+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:12:36.373537+0000","last_undegraded":"2024-09-05T02:12:36.373537+0000","last_fullsized":"2024-09-05T02:12:36.373537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:14.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207379+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:12:16.207379+0000","last_peered":"2024-09-05T02:12:16.207379+0000","last_clean":"2024-09-05T02:12:16.207379+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:12:16.207379+0000","last_undegraded":"2024-09-05T02:12:16.207379+0000","last_fullsized":"2024-09-05T02:12:16.207379+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:34:26.565026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441893+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:12:15.441893+0000","last_peered":"2024-09-05T02:12:15.441893+0000","last_clean":"2024-09-05T02:12:15.441893+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:12:15.441893+0000","last_undegraded":"2024-09-05T02:12:15.441893+0000","last_fullsized":"2024-09-05T02:12:15.441893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:26.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448523+0000","last_change":"2024-09-05T01:05:07.113278+0000","last_active":"2024-09-05T02:12:40.448523+0000","last_peered":"2024-09-05T02:12:40.448523+0000","last_clean":"2024-09-05T02:12:40.448523+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:12:40.448523+0000","last_undegraded":"2024-09-05T02:12:40.448523+0000","last_fullsized":"2024-09-05T02:12:40.448523+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:01.987557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818058+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:12:16.818058+0000","last_peered":"2024-09-05T02:12:16.818058+0000","last_clean":"2024-09-05T02:12:16.818058+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:12:16.818058+0000","last_undegraded":"2024-09-05T02:12:16.818058+0000","last_fullsized":"2024-09-05T02:12:16.818058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:29:50.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.771516+0000","last_change":"2024-09-05T01:09:22.205702+0000","last_active":"2024-09-05T02:12:11.771516+0000","last_peered":"2024-09-05T02:12:11.771516+0000","last_clean":"2024-09-05T02:12:11.771516+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:12:11.771516+0000","last_undegraded":"2024-09-05T02:12:11.771516+0000","last_fullsized":"2024-09-05T02:12:11.771516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:20.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820508+0000","last_change":"2024-09-05T01:05:07.107783+0000","last_active":"2024-09-05T02:12:26.820508+0000","last_peered":"2024-09-05T02:12:26.820508+0000","last_clean":"2024-09-05T02:12:26.820508+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:12:26.820508+0000","last_undegraded":"2024-09-05T02:12:26.820508+0000","last_fullsized":"2024-09-05T02:12:26.820508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:14.335901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774914+0000","last_change":"2024-09-05T01:09:26.335994+0000","last_active":"2024-09-05T02:12:26.774914+0000","last_peered":"2024-09-05T02:12:26.774914+0000","last_clean":"2024-09-05T02:12:26.774914+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:12:26.774914+0000","last_undegraded":"2024-09-05T02:12:26.774914+0000","last_fullsized":"2024-09-05T02:12:26.774914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:07.883192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:30.445993+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:12:30.445993+0000","last_peered":"2024-09-05T02:12:30.445993+0000","last_clean":"2024-09-05T02:12:30.445993+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:12:30.445993+0000","last_undegraded":"2024-09-05T02:12:30.445993+0000","last_fullsized":"2024-09-05T02:12:30.445993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:34.388590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464656+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:12:16.464656+0000","last_peered":"2024-09-05T02:12:16.464656+0000","last_clean":"2024-09-05T02:12:16.464656+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:12:16.464656+0000","last_undegraded":"2024-09-05T02:12:16.464656+0000","last_fullsized":"2024-09-05T02:12:16.464656+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:04.705416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820465+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:12:26.820465+0000","last_peered":"2024-09-05T02:12:26.820465+0000","last_clean":"2024-09-05T02:12:26.820465+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:12:26.820465+0000","last_undegraded":"2024-09-05T02:12:26.820465+0000","last_fullsized":"2024-09-05T02:12:26.820465+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.990596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208761+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:12:21.208761+0000","last_peered":"2024-09-05T02:12:21.208761+0000","last_clean":"2024-09-05T02:12:21.208761+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:12:21.208761+0000","last_undegraded":"2024-09-05T02:12:21.208761+0000","last_fullsized":"2024-09-05T02:12:21.208761+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:08.518794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390597+0000","last_change":"2024-09-05T01:05:07.108906+0000","last_active":"2024-09-05T02:12:16.390597+0000","last_peered":"2024-09-05T02:12:16.390597+0000","last_clean":"2024-09-05T02:12:16.390597+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:12:16.390597+0000","last_undegraded":"2024-09-05T02:12:16.390597+0000","last_fullsized":"2024-09-05T02:12:16.390597+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:30:18.560371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442141+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:12:15.442141+0000","last_peered":"2024-09-05T02:12:15.442141+0000","last_clean":"2024-09-05T02:12:15.442141+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:12:15.442141+0000","last_undegraded":"2024-09-05T02:12:15.442141+0000","last_fullsized":"2024-09-05T02:12:15.442141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:20.443723+0000","last_change":"2024-09-05T01:05:07.120976+0000","last_active":"2024-09-05T02:12:20.443723+0000","last_peered":"2024-09-05T02:12:20.443723+0000","last_clean":"2024-09-05T02:12:20.443723+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:12:20.443723+0000","last_undegraded":"2024-09-05T02:12:20.443723+0000","last_fullsized":"2024-09-05T02:12:20.443723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:22.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391904+0000","last_change":"2024-09-05T01:09:22.172712+0000","last_active":"2024-09-05T02:14:06.391904+0000","last_peered":"2024-09-05T02:14:06.391904+0000","last_clean":"2024-09-05T02:14:06.391904+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:14:06.391904+0000","last_undegraded":"2024-09-05T02:14:06.391904+0000","last_fullsized":"2024-09-05T02:14:06.391904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:20.436128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390757+0000","last_change":"2024-09-05T01:05:07.102945+0000","last_active":"2024-09-05T02:12:16.390757+0000","last_peered":"2024-09-05T02:12:16.390757+0000","last_clean":"2024-09-05T02:12:16.390757+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:12:16.390757+0000","last_undegraded":"2024-09-05T02:12:16.390757+0000","last_fullsized":"2024-09-05T02:12:16.390757+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:11:05.062597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774731+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:12:26.774731+0000","last_peered":"2024-09-05T02:12:26.774731+0000","last_clean":"2024-09-05T02:12:26.774731+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:12:26.774731+0000","last_undegraded":"2024-09-05T02:12:26.774731+0000","last_fullsized":"2024-09-05T02:12:26.774731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:07.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818258+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:12:16.818258+0000","last_peered":"2024-09-05T02:12:16.818258+0000","last_clean":"2024-09-05T02:12:16.818258+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:12:16.818258+0000","last_undegraded":"2024-09-05T02:12:16.818258+0000","last_fullsized":"2024-09-05T02:12:16.818258+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:39.015669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203874+0000","last_change":"2024-09-05T01:09:22.189533+0000","last_active":"2024-09-05T02:12:15.203874+0000","last_peered":"2024-09-05T02:12:15.203874+0000","last_clean":"2024-09-05T02:12:15.203874+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:12:15.203874+0000","last_undegraded":"2024-09-05T02:12:15.203874+0000","last_fullsized":"2024-09-05T02:12:15.203874+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:17.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.634124+0000","last_change":"2024-09-05T01:05:07.104648+0000","last_active":"2024-09-05T02:14:06.634124+0000","last_peered":"2024-09-05T02:14:06.634124+0000","last_clean":"2024-09-05T02:14:06.634124+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:14:06.634124+0000","last_undegraded":"2024-09-05T02:14:06.634124+0000","last_fullsized":"2024-09-05T02:14:06.634124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:02.121064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207620+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:12:16.207620+0000","last_peered":"2024-09-05T02:12:16.207620+0000","last_clean":"2024-09-05T02:12:16.207620+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:12:16.207620+0000","last_undegraded":"2024-09-05T02:12:16.207620+0000","last_fullsized":"2024-09-05T02:12:16.207620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:55.569114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.313397+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.313397+0000","last_peered":"2024-09-05T02:16:21.313397+0000","last_clean":"2024-09-05T02:16:21.313397+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.313397+0000","last_undegraded":"2024-09-05T02:16:21.313397+0000","last_fullsized":"2024-09-05T02:16:21.313397+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:52.383560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792699+0000","last_change":"2024-09-05T01:05:07.109781+0000","last_active":"2024-09-05T02:13:51.792699+0000","last_peered":"2024-09-05T02:13:51.792699+0000","last_clean":"2024-09-05T02:13:51.792699+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:13:51.792699+0000","last_undegraded":"2024-09-05T02:13:51.792699+0000","last_fullsized":"2024-09-05T02:13:51.792699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:11.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.385750+0000","last_change":"2024-09-05T01:30:15.670716+0000","last_active":"2024-09-05T02:13:36.385750+0000","last_peered":"2024-09-05T02:13:36.385750+0000","last_clean":"2024-09-05T02:13:36.385750+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:13:36.385750+0000","last_undegraded":"2024-09-05T02:13:36.385750+0000","last_fullsized":"2024-09-05T02:13:36.385750+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:30.214527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794558+0000","last_change":"2024-09-05T01:09:26.336791+0000","last_active":"2024-09-05T02:14:01.794558+0000","last_peered":"2024-09-05T02:14:01.794558+0000","last_clean":"2024-09-05T02:14:01.794558+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:14:01.794558+0000","last_undegraded":"2024-09-05T02:14:01.794558+0000","last_fullsized":"2024-09-05T02:14:01.794558+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:27:19.850660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":100,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227128+0000","last_change":"2024-09-05T01:05:07.103532+0000","last_active":"2024-09-05T02:13:55.227128+0000","last_peered":"2024-09-05T02:13:55.227128+0000","last_clean":"2024-09-05T02:13:55.227128+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:13:55.227128+0000","last_undegraded":"2024-09-05T02:13:55.227128+0000","last_fullsized":"2024-09-05T02:13:55.227128+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:09.868656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228540+0000","last_change":"2024-09-05T01:05:07.106167+0000","last_active":"2024-09-05T02:13:51.228540+0000","last_peered":"2024-09-05T02:13:51.228540+0000","last_clean":"2024-09-05T02:13:51.228540+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:13:51.228540+0000","last_undegraded":"2024-09-05T02:13:51.228540+0000","last_fullsized":"2024-09-05T02:13:51.228540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:44.638683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.413210+0000","last_change":"2024-09-05T01:09:26.348937+0000","last_active":"2024-09-05T02:14:01.413210+0000","last_peered":"2024-09-05T02:14:01.413210+0000","last_clean":"2024-09-05T02:14:01.413210+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:14:01.413210+0000","last_undegraded":"2024-09-05T02:14:01.413210+0000","last_fullsized":"2024-09-05T02:14:01.413210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.793654+0000","last_change":"2024-09-05T01:09:22.183966+0000","last_active":"2024-09-05T02:13:56.793654+0000","last_peered":"2024-09-05T02:13:56.793654+0000","last_clean":"2024-09-05T02:13:56.793654+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:13:56.793654+0000","last_undegraded":"2024-09-05T02:13:56.793654+0000","last_fullsized":"2024-09-05T02:13:56.793654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:52.065642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":216,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.410907+0000","last_change":"2024-09-05T01:05:07.105723+0000","last_active":"2024-09-05T02:13:51.410907+0000","last_peered":"2024-09-05T02:13:51.410907+0000","last_clean":"2024-09-05T02:13:51.410907+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:13:51.410907+0000","last_undegraded":"2024-09-05T02:13:51.410907+0000","last_fullsized":"2024-09-05T02:13:51.410907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:08.187510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.412152+0000","last_change":"2024-09-05T01:09:22.173186+0000","last_active":"2024-09-05T02:13:56.412152+0000","last_peered":"2024-09-05T02:13:56.412152+0000","last_clean":"2024-09-05T02:13:56.412152+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:13:56.412152+0000","last_undegraded":"2024-09-05T02:13:56.412152+0000","last_fullsized":"2024-09-05T02:13:56.412152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:45.178339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.832398+0000","last_change":"2024-09-05T01:05:07.103211+0000","last_active":"2024-09-05T02:13:16.832398+0000","last_peered":"2024-09-05T02:13:16.832398+0000","last_clean":"2024-09-05T02:13:16.832398+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:13:16.832398+0000","last_undegraded":"2024-09-05T02:13:16.832398+0000","last_fullsized":"2024-09-05T02:13:16.832398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:40.214831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'322","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.368995+0000","last_change":"2024-09-05T00:50:04.197760+0000","last_active":"2024-09-05T02:16:21.368995+0000","last_peered":"2024-09-05T02:16:21.368995+0000","last_clean":"2024-09-05T02:16:21.368995+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:21.368995+0000","last_undegraded":"2024-09-05T02:16:21.368995+0000","last_fullsized":"2024-09-05T02:16:21.368995+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:08.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16681512,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":567,"num_read_kb":47641,"num_write":1166,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'505","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844799+0000","last_change":"2024-09-05T00:49:29.902310+0000","last_active":"2024-09-05T02:13:40.844799+0000","last_peered":"2024-09-05T02:13:40.844799+0000","last_clean":"2024-09-05T02:13:40.844799+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:13:40.844799+0000","last_undegraded":"2024-09-05T02:13:40.844799+0000","last_fullsized":"2024-09-05T02:13:40.844799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:52.315609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'328","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.752985+0000","last_change":"2024-09-05T00:49:27.898633+0000","last_active":"2024-09-05T02:16:21.752985+0000","last_peered":"2024-09-05T02:16:21.752985+0000","last_clean":"2024-09-05T02:16:21.752985+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:21.752985+0000","last_undegraded":"2024-09-05T02:16:21.752985+0000","last_fullsized":"2024-09-05T02:16:21.752985+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:12:19.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487413,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":514,"num_read_kb":74892,"num_write":1128,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'444","reported_seq":2073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.060176+0000","last_change":"2024-09-05T00:50:04.184130+0000","last_active":"2024-09-05T02:13:56.060176+0000","last_peered":"2024-09-05T02:13:56.060176+0000","last_clean":"2024-09-05T02:13:56.060176+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:13:56.060176+0000","last_undegraded":"2024-09-05T02:13:56.060176+0000","last_fullsized":"2024-09-05T02:13:56.060176+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:41.824164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'320","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:04.720119+0000","last_change":"2024-09-05T00:49:27.878763+0000","last_active":"2024-09-05T02:13:04.720119+0000","last_peered":"2024-09-05T02:13:04.720119+0000","last_clean":"2024-09-05T02:13:04.720119+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:13:04.720119+0000","last_undegraded":"2024-09-05T02:13:04.720119+0000","last_fullsized":"2024-09-05T02:13:04.720119+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:40.061514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76785,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":521,"num_read_kb":741,"num_write":1072,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'852","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842642+0000","last_change":"2024-09-05T00:49:29.900944+0000","last_active":"2024-09-05T02:14:19.842642+0000","last_peered":"2024-09-05T02:14:19.842642+0000","last_clean":"2024-09-05T02:14:19.842642+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:14:19.842642+0000","last_undegraded":"2024-09-05T02:14:19.842642+0000","last_fullsized":"2024-09-05T02:14:19.842642+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:48.973383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'314","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227167+0000","last_change":"2024-09-05T00:49:27.891660+0000","last_active":"2024-09-05T02:13:55.227167+0000","last_peered":"2024-09-05T02:13:55.227167+0000","last_clean":"2024-09-05T02:13:55.227167+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:13:55.227167+0000","last_undegraded":"2024-09-05T02:13:55.227167+0000","last_fullsized":"2024-09-05T02:13:55.227167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:52:25.219927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495938,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":633,"num_read_kb":68500,"num_write":1247,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.840193+0000","last_change":"2024-09-05T00:49:29.919632+0000","last_active":"2024-09-05T02:13:40.840193+0000","last_peered":"2024-09-05T02:13:40.840193+0000","last_clean":"2024-09-05T02:13:40.840193+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:13:40.840193+0000","last_undegraded":"2024-09-05T02:13:40.840193+0000","last_fullsized":"2024-09-05T02:13:40.840193+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:31:42.074665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'321","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.603561+0000","last_change":"2024-09-05T00:49:27.904486+0000","last_active":"2024-09-05T02:16:21.603561+0000","last_peered":"2024-09-05T02:16:21.603561+0000","last_clean":"2024-09-05T02:16:21.603561+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:21.603561+0000","last_undegraded":"2024-09-05T02:16:21.603561+0000","last_fullsized":"2024-09-05T02:16:21.603561+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:22:56.989812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56400,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":422,"num_read_kb":9059,"num_write":1116,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'446","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.625924+0000","last_change":"2024-09-05T00:49:29.903354+0000","last_active":"2024-09-05T02:14:29.625924+0000","last_peered":"2024-09-05T02:14:29.625924+0000","last_clean":"2024-09-05T02:14:29.625924+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:14:29.625924+0000","last_undegraded":"2024-09-05T02:14:29.625924+0000","last_fullsized":"2024-09-05T02:14:29.625924+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:22.469137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'265","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200027+0000","last_change":"2024-09-05T00:49:27.899576+0000","last_active":"2024-09-05T02:12:00.200027+0000","last_peered":"2024-09-05T02:12:00.200027+0000","last_clean":"2024-09-05T02:12:00.200027+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:12:00.200027+0000","last_undegraded":"2024-09-05T02:12:00.200027+0000","last_fullsized":"2024-09-05T02:12:00.200027+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:56:44.824648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267473,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":472,"num_write":1032,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'503","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.906613+0000","last_change":"2024-09-05T00:49:29.900890+0000","last_active":"2024-09-05T02:13:45.906613+0000","last_peered":"2024-09-05T02:13:45.906613+0000","last_clean":"2024-09-05T02:13:45.906613+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:13:45.906613+0000","last_undegraded":"2024-09-05T02:13:45.906613+0000","last_fullsized":"2024-09-05T02:13:45.906613+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'308","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.630906+0000","last_change":"2024-09-05T00:49:27.905426+0000","last_active":"2024-09-05T02:16:21.630906+0000","last_peered":"2024-09-05T02:16:21.630906+0000","last_clean":"2024-09-05T02:16:21.630906+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:21.630906+0000","last_undegraded":"2024-09-05T02:16:21.630906+0000","last_fullsized":"2024-09-05T02:16:21.630906+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:05.030484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7518681,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":470,"num_read_kb":57163,"num_write":1075,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'473","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.607735+0000","last_change":"2024-09-05T00:49:29.918860+0000","last_active":"2024-09-05T02:15:48.607735+0000","last_peered":"2024-09-05T02:15:48.607735+0000","last_clean":"2024-09-05T02:15:48.607735+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:15:48.607735+0000","last_undegraded":"2024-09-05T02:15:48.607735+0000","last_fullsized":"2024-09-05T02:15:48.607735+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:36.131820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'308","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.482117+0000","last_change":"2024-09-05T00:49:27.894250+0000","last_active":"2024-09-05T02:16:21.482117+0000","last_peered":"2024-09-05T02:16:21.482117+0000","last_clean":"2024-09-05T02:16:21.482117+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:21.482117+0000","last_undegraded":"2024-09-05T02:16:21.482117+0000","last_fullsized":"2024-09-05T02:16:21.482117+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:55:18.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103081,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":776,"num_read_kb":7162,"num_write":1090,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'450","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:14.403614+0000","last_change":"2024-09-05T00:49:29.917227+0000","last_active":"2024-09-05T02:13:14.403614+0000","last_peered":"2024-09-05T02:13:14.403614+0000","last_clean":"2024-09-05T02:13:14.403614+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:13:14.403614+0000","last_undegraded":"2024-09-05T02:13:14.403614+0000","last_fullsized":"2024-09-05T02:13:14.403614+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:45.091417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'744","reported_seq":2208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.062464+0000","last_change":"2024-09-05T00:49:29.905360+0000","last_active":"2024-09-05T02:13:56.062464+0000","last_peered":"2024-09-05T02:13:56.062464+0000","last_clean":"2024-09-05T02:13:56.062464+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:13:56.062464+0000","last_undegraded":"2024-09-05T02:13:56.062464+0000","last_fullsized":"2024-09-05T02:13:56.062464+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:40.876830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'298","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.617515+0000","last_change":"2024-09-05T00:49:27.910019+0000","last_active":"2024-09-05T02:16:21.617515+0000","last_peered":"2024-09-05T02:16:21.617515+0000","last_clean":"2024-09-05T02:16:21.617515+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:21.617515+0000","last_undegraded":"2024-09-05T02:16:21.617515+0000","last_fullsized":"2024-09-05T02:16:21.617515+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:00.426807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7003989,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":436,"num_read_kb":16771,"num_write":1036,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'434","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697734+0000","last_change":"2024-09-05T00:49:29.924150+0000","last_active":"2024-09-05T02:15:48.697734+0000","last_peered":"2024-09-05T02:15:48.697734+0000","last_clean":"2024-09-05T02:15:48.697734+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:15:48.697734+0000","last_undegraded":"2024-09-05T02:15:48.697734+0000","last_fullsized":"2024-09-05T02:15:48.697734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:21.326911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'289","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.241639+0000","last_change":"2024-09-05T00:49:27.896351+0000","last_active":"2024-09-05T02:16:21.241639+0000","last_peered":"2024-09-05T02:16:21.241639+0000","last_clean":"2024-09-05T02:16:21.241639+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:21.241639+0000","last_undegraded":"2024-09-05T02:16:21.241639+0000","last_fullsized":"2024-09-05T02:16:21.241639+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:17:37.231288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604179,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":408,"num_read_kb":5849,"num_write":1001,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'460","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.696002+0000","last_change":"2024-09-05T00:49:29.910681+0000","last_active":"2024-09-05T02:15:48.696002+0000","last_peered":"2024-09-05T02:15:48.696002+0000","last_clean":"2024-09-05T02:15:48.696002+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:15:48.696002+0000","last_undegraded":"2024-09-05T02:15:48.696002+0000","last_fullsized":"2024-09-05T02:15:48.696002+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:22.606854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'300","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.161079+0000","last_change":"2024-09-05T00:49:27.894988+0000","last_active":"2024-09-05T02:16:21.161079+0000","last_peered":"2024-09-05T02:16:21.161079+0000","last_clean":"2024-09-05T02:16:21.161079+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:21.161079+0000","last_undegraded":"2024-09-05T02:16:21.161079+0000","last_fullsized":"2024-09-05T02:16:21.161079+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:21.825324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128211,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":479,"num_read_kb":7060,"num_write":1167,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'491","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:47.724900+0000","last_change":"2024-09-05T00:49:29.912607+0000","last_active":"2024-09-05T02:12:47.724900+0000","last_peered":"2024-09-05T02:12:47.724900+0000","last_clean":"2024-09-05T02:12:47.724900+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:12:47.724900+0000","last_undegraded":"2024-09-05T02:12:47.724900+0000","last_fullsized":"2024-09-05T02:12:47.724900+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:34.256983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'302","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.180001+0000","last_change":"2024-09-05T00:49:27.882843+0000","last_active":"2024-09-05T02:16:21.180001+0000","last_peered":"2024-09-05T02:16:21.180001+0000","last_clean":"2024-09-05T02:16:21.180001+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:21.180001+0000","last_undegraded":"2024-09-05T02:16:21.180001+0000","last_fullsized":"2024-09-05T02:16:21.180001+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:25.955814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5423612,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":501,"num_read_kb":17342,"num_write":1177,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'405","reported_seq":1862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.843762+0000","last_change":"2024-09-05T00:49:29.917744+0000","last_active":"2024-09-05T02:13:40.843762+0000","last_peered":"2024-09-05T02:13:40.843762+0000","last_clean":"2024-09-05T02:13:40.843762+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:13:40.843762+0000","last_undegraded":"2024-09-05T02:13:40.843762+0000","last_fullsized":"2024-09-05T02:13:40.843762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:26.837337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'303","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.436666+0000","last_change":"2024-09-05T00:49:27.879495+0000","last_active":"2024-09-05T02:16:21.436666+0000","last_peered":"2024-09-05T02:16:21.436666+0000","last_clean":"2024-09-05T02:16:21.436666+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:21.436666+0000","last_undegraded":"2024-09-05T02:16:21.436666+0000","last_fullsized":"2024-09-05T02:16:21.436666+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:13.251498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114681,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":1528,"num_write":1184,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'749","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.563397+0000","last_change":"2024-09-05T00:49:29.921148+0000","last_active":"2024-09-05T02:14:29.563397+0000","last_peered":"2024-09-05T02:14:29.563397+0000","last_clean":"2024-09-05T02:14:29.563397+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:14:29.563397+0000","last_undegraded":"2024-09-05T02:14:29.563397+0000","last_fullsized":"2024-09-05T02:14:29.563397+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:28.667675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'272","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465372+0000","last_change":"2024-09-05T00:49:27.893557+0000","last_active":"2024-09-05T02:13:50.465372+0000","last_peered":"2024-09-05T02:13:50.465372+0000","last_clean":"2024-09-05T02:13:50.465372+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:13:50.465372+0000","last_undegraded":"2024-09-05T02:13:50.465372+0000","last_fullsized":"2024-09-05T02:13:50.465372+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:16:58.696922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5690064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":439,"num_read_kb":32078,"num_write":1015,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'127","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.840852+0000","last_change":"2024-09-05T00:49:37.949792+0000","last_active":"2024-09-05T02:14:29.840852+0000","last_peered":"2024-09-05T02:14:29.840852+0000","last_clean":"2024-09-05T02:14:29.840852+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:14:29.840852+0000","last_undegraded":"2024-09-05T02:14:29.840852+0000","last_fullsized":"2024-09-05T02:14:29.840852+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:18.632196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'322","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:25.027490+0000","last_change":"2024-09-05T00:50:04.179604+0000","last_active":"2024-09-05T02:13:25.027490+0000","last_peered":"2024-09-05T02:13:25.027490+0000","last_clean":"2024-09-05T02:13:25.027490+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:13:25.027490+0000","last_undegraded":"2024-09-05T02:13:25.027490+0000","last_fullsized":"2024-09-05T02:13:25.027490+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:19.315200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646392+0000","last_change":"2024-09-05T00:49:27.908163+0000","last_active":"2024-09-05T02:16:21.646392+0000","last_peered":"2024-09-05T02:16:21.646392+0000","last_clean":"2024-09-05T02:16:21.646392+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:21.646392+0000","last_undegraded":"2024-09-05T02:16:21.646392+0000","last_fullsized":"2024-09-05T02:16:21.646392+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:26.321927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332538,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":414,"num_read_kb":5561,"num_write":1081,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196301+0000","last_change":"2024-09-05T00:49:31.911566+0000","last_active":"2024-09-05T02:11:45.196301+0000","last_peered":"2024-09-05T02:11:45.196301+0000","last_clean":"2024-09-05T02:11:45.196301+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:11:45.196301+0000","last_undegraded":"2024-09-05T02:11:45.196301+0000","last_fullsized":"2024-09-05T02:11:45.196301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:50.459772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'362","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.470202+0000","last_change":"2024-09-05T00:49:33.908342+0000","last_active":"2024-09-05T02:14:10.470202+0000","last_peered":"2024-09-05T02:14:10.470202+0000","last_clean":"2024-09-05T02:14:10.470202+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:14:10.470202+0000","last_undegraded":"2024-09-05T02:14:10.470202+0000","last_fullsized":"2024-09-05T02:14:10.470202+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:30:43.947001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51820,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":1066,"num_write":448,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.810732+0000","last_change":"2024-09-05T00:49:35.935224+0000","last_active":"2024-09-05T02:11:46.810732+0000","last_peered":"2024-09-05T02:11:46.810732+0000","last_clean":"2024-09-05T02:11:46.810732+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:11:46.810732+0000","last_undegraded":"2024-09-05T02:11:46.810732+0000","last_fullsized":"2024-09-05T02:11:46.810732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:50.276599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2467","reported_seq":4375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.838585+0000","last_change":"2024-09-05T00:49:37.940197+0000","last_active":"2024-09-05T02:14:27.838585+0000","last_peered":"2024-09-05T02:14:27.838585+0000","last_clean":"2024-09-05T02:14:27.838585+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:14:27.838585+0000","last_undegraded":"2024-09-05T02:14:27.838585+0000","last_fullsized":"2024-09-05T02:14:27.838585+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:21.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.634828+0000","last_change":"2024-09-05T00:49:29.904918+0000","last_active":"2024-09-05T02:14:27.634828+0000","last_peered":"2024-09-05T02:14:27.634828+0000","last_clean":"2024-09-05T02:14:27.634828+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:14:27.634828+0000","last_undegraded":"2024-09-05T02:14:27.634828+0000","last_fullsized":"2024-09-05T02:14:27.634828+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:01:06.117657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'248","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:30.460041+0000","last_change":"2024-09-05T00:49:27.905821+0000","last_active":"2024-09-05T02:13:30.460041+0000","last_peered":"2024-09-05T02:13:30.460041+0000","last_clean":"2024-09-05T02:13:30.460041+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:13:30.460041+0000","last_undegraded":"2024-09-05T02:13:30.460041+0000","last_fullsized":"2024-09-05T02:13:30.460041+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:56:59.762079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507262,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":366,"num_read_kb":61922,"num_write":840,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487978+0000","last_change":"2024-09-05T00:49:31.917103+0000","last_active":"2024-09-05T02:13:51.487978+0000","last_peered":"2024-09-05T02:13:51.487978+0000","last_clean":"2024-09-05T02:13:51.487978+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:13:51.487978+0000","last_undegraded":"2024-09-05T02:13:51.487978+0000","last_fullsized":"2024-09-05T02:13:51.487978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:08.039118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200339+0000","last_change":"2024-09-05T00:49:33.908801+0000","last_active":"2024-09-05T02:11:46.200339+0000","last_peered":"2024-09-05T02:11:46.200339+0000","last_clean":"2024-09-05T02:11:46.200339+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:11:46.200339+0000","last_undegraded":"2024-09-05T02:11:46.200339+0000","last_fullsized":"2024-09-05T02:11:46.200339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:32.220937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200292+0000","last_change":"2024-09-05T00:49:35.930182+0000","last_active":"2024-09-05T02:11:46.200292+0000","last_peered":"2024-09-05T02:11:46.200292+0000","last_clean":"2024-09-05T02:11:46.200292+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:11:46.200292+0000","last_undegraded":"2024-09-05T02:11:46.200292+0000","last_fullsized":"2024-09-05T02:11:46.200292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:35.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'106","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.066549+0000","last_change":"2024-09-05T00:49:37.932878+0000","last_active":"2024-09-05T02:14:26.066549+0000","last_peered":"2024-09-05T02:14:26.066549+0000","last_clean":"2024-09-05T02:14:26.066549+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:14:26.066549+0000","last_undegraded":"2024-09-05T02:14:26.066549+0000","last_fullsized":"2024-09-05T02:14:26.066549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:02.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1219","reported_seq":2904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.627360+0000","last_change":"2024-09-05T00:49:29.911068+0000","last_active":"2024-09-05T02:14:29.627360+0000","last_peered":"2024-09-05T02:14:29.627360+0000","last_clean":"2024-09-05T02:14:29.627360+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:14:29.627360+0000","last_undegraded":"2024-09-05T02:14:29.627360+0000","last_fullsized":"2024-09-05T02:14:29.627360+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:31.287838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'277","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646925+0000","last_change":"2024-09-05T00:49:27.904699+0000","last_active":"2024-09-05T02:16:21.646925+0000","last_peered":"2024-09-05T02:16:21.646925+0000","last_clean":"2024-09-05T02:16:21.646925+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:21.646925+0000","last_undegraded":"2024-09-05T02:16:21.646925+0000","last_fullsized":"2024-09-05T02:16:21.646925+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:24.274679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325261,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":473,"num_read_kb":6929,"num_write":973,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.455259+0000","last_change":"2024-09-05T00:49:31.914059+0000","last_active":"2024-09-05T02:11:41.455259+0000","last_peered":"2024-09-05T02:11:41.455259+0000","last_clean":"2024-09-05T02:11:41.455259+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:11:41.455259+0000","last_undegraded":"2024-09-05T02:11:41.455259+0000","last_fullsized":"2024-09-05T02:11:41.455259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:54.072194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'181","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.387691+0000","last_change":"2024-09-05T00:49:33.902480+0000","last_active":"2024-09-05T02:13:46.387691+0000","last_peered":"2024-09-05T02:13:46.387691+0000","last_clean":"2024-09-05T02:13:46.387691+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:13:46.387691+0000","last_undegraded":"2024-09-05T02:13:46.387691+0000","last_fullsized":"2024-09-05T02:13:46.387691+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:14.928690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'784","reported_seq":4948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.837971+0000","last_change":"2024-09-05T00:49:35.927429+0000","last_active":"2024-09-05T02:16:20.837971+0000","last_peered":"2024-09-05T02:16:20.837971+0000","last_clean":"2024-09-05T02:16:20.837971+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:20.837971+0000","last_undegraded":"2024-09-05T02:16:20.837971+0000","last_fullsized":"2024-09-05T02:16:20.837971+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:49.036040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'234","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.269828+0000","last_change":"2024-09-05T00:49:37.922161+0000","last_active":"2024-09-05T02:15:48.269828+0000","last_peered":"2024-09-05T02:15:48.269828+0000","last_clean":"2024-09-05T02:15:48.269828+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:15:48.269828+0000","last_undegraded":"2024-09-05T02:15:48.269828+0000","last_fullsized":"2024-09-05T02:15:48.269828+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:45.817026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'682","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:07.422737+0000","last_change":"2024-09-05T00:49:29.927852+0000","last_active":"2024-09-05T02:13:07.422737+0000","last_peered":"2024-09-05T02:13:07.422737+0000","last_clean":"2024-09-05T02:13:07.422737+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:13:07.422737+0000","last_undegraded":"2024-09-05T02:13:07.422737+0000","last_fullsized":"2024-09-05T02:13:07.422737+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:09.704012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'299","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.202645+0000","last_change":"2024-09-05T00:49:27.880796+0000","last_active":"2024-09-05T02:16:21.202645+0000","last_peered":"2024-09-05T02:16:21.202645+0000","last_clean":"2024-09-05T02:16:21.202645+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:21.202645+0000","last_undegraded":"2024-09-05T02:16:21.202645+0000","last_fullsized":"2024-09-05T02:16:21.202645+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:01.610874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509103,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":55829,"num_write":1056,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196390+0000","last_change":"2024-09-05T00:49:31.910341+0000","last_active":"2024-09-05T02:11:45.196390+0000","last_peered":"2024-09-05T02:11:45.196390+0000","last_clean":"2024-09-05T02:11:45.196390+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:11:45.196390+0000","last_undegraded":"2024-09-05T02:11:45.196390+0000","last_fullsized":"2024-09-05T02:11:45.196390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:21.538486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'326","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.255008+0000","last_change":"2024-09-05T00:49:34.055554+0000","last_active":"2024-09-05T02:16:21.255008+0000","last_peered":"2024-09-05T02:16:21.255008+0000","last_clean":"2024-09-05T02:16:21.255008+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:21.255008+0000","last_undegraded":"2024-09-05T02:16:21.255008+0000","last_fullsized":"2024-09-05T02:16:21.255008+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:03:22.138176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'798","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.846817+0000","last_change":"2024-09-05T00:49:35.938226+0000","last_active":"2024-09-05T02:16:20.846817+0000","last_peered":"2024-09-05T02:16:20.846817+0000","last_clean":"2024-09-05T02:16:20.846817+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:16:20.846817+0000","last_undegraded":"2024-09-05T02:16:20.846817+0000","last_fullsized":"2024-09-05T02:16:20.846817+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:56.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'744","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228164+0000","last_change":"2024-09-05T00:49:29.903992+0000","last_active":"2024-09-05T02:14:00.228164+0000","last_peered":"2024-09-05T02:14:00.228164+0000","last_clean":"2024-09-05T02:14:00.228164+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:14:00.228164+0000","last_undegraded":"2024-09-05T02:14:00.228164+0000","last_fullsized":"2024-09-05T02:14:00.228164+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:36.833935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'395","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.590878+0000","last_change":"2024-09-05T00:49:27.914055+0000","last_active":"2024-09-05T02:16:21.590878+0000","last_peered":"2024-09-05T02:16:21.590878+0000","last_clean":"2024-09-05T02:16:21.590878+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:21.590878+0000","last_undegraded":"2024-09-05T02:16:21.590878+0000","last_fullsized":"2024-09-05T02:16:21.590878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:52.269578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333761,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":784,"num_read_kb":4739,"num_write":1373,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632817+0000","last_change":"2024-09-05T00:49:31.919796+0000","last_active":"2024-09-05T02:14:01.632817+0000","last_peered":"2024-09-05T02:14:01.632817+0000","last_clean":"2024-09-05T02:14:01.632817+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:14:01.632817+0000","last_undegraded":"2024-09-05T02:14:01.632817+0000","last_fullsized":"2024-09-05T02:14:01.632817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:17.976816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'415","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.235437+0000","last_change":"2024-09-05T00:49:34.052466+0000","last_active":"2024-09-05T02:14:30.235437+0000","last_peered":"2024-09-05T02:14:30.235437+0000","last_clean":"2024-09-05T02:14:30.235437+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:14:30.235437+0000","last_undegraded":"2024-09-05T02:14:30.235437+0000","last_fullsized":"2024-09-05T02:14:30.235437+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:20.386465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":1255,"num_write":534,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.780250+0000","last_change":"2024-09-05T00:49:35.937335+0000","last_active":"2024-09-05T02:12:51.780250+0000","last_peered":"2024-09-05T02:12:51.780250+0000","last_clean":"2024-09-05T02:12:51.780250+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:12:51.780250+0000","last_undegraded":"2024-09-05T02:12:51.780250+0000","last_fullsized":"2024-09-05T02:12:51.780250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:11.123088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'584","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.668190+0000","last_change":"2024-09-05T00:49:37.946024+0000","last_active":"2024-09-05T02:15:49.668190+0000","last_peered":"2024-09-05T02:15:49.668190+0000","last_clean":"2024-09-05T02:15:49.668190+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:15:49.668190+0000","last_undegraded":"2024-09-05T02:15:49.668190+0000","last_fullsized":"2024-09-05T02:15:49.668190+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:47:31.597559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'438","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230841+0000","last_change":"2024-09-05T00:49:29.923948+0000","last_active":"2024-09-05T02:14:01.230841+0000","last_peered":"2024-09-05T02:14:01.230841+0000","last_clean":"2024-09-05T02:14:01.230841+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:14:01.230841+0000","last_undegraded":"2024-09-05T02:14:01.230841+0000","last_fullsized":"2024-09-05T02:14:01.230841+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:07.536362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'260","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.643889+0000","last_change":"2024-09-05T00:49:27.905783+0000","last_active":"2024-09-05T02:16:21.643889+0000","last_peered":"2024-09-05T02:16:21.643889+0000","last_clean":"2024-09-05T02:16:21.643889+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:21.643889+0000","last_undegraded":"2024-09-05T02:16:21.643889+0000","last_fullsized":"2024-09-05T02:16:21.643889+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:18.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":636638,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":359,"num_read_kb":6806,"num_write":830,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390543+0000","last_change":"2024-09-05T00:49:31.900583+0000","last_active":"2024-09-05T02:14:01.390543+0000","last_peered":"2024-09-05T02:14:01.390543+0000","last_clean":"2024-09-05T02:14:01.390543+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:14:01.390543+0000","last_undegraded":"2024-09-05T02:14:01.390543+0000","last_fullsized":"2024-09-05T02:14:01.390543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:18.073117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'294","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.596957+0000","last_change":"2024-09-05T00:49:33.925800+0000","last_active":"2024-09-05T02:15:49.596957+0000","last_peered":"2024-09-05T02:15:49.596957+0000","last_clean":"2024-09-05T02:15:49.596957+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:15:49.596957+0000","last_undegraded":"2024-09-05T02:15:49.596957+0000","last_fullsized":"2024-09-05T02:15:49.596957+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:21.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":989,"num_write":382,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464772+0000","last_change":"2024-09-05T00:49:35.934298+0000","last_active":"2024-09-05T02:12:16.464772+0000","last_peered":"2024-09-05T02:12:16.464772+0000","last_clean":"2024-09-05T02:12:16.464772+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:12:16.464772+0000","last_undegraded":"2024-09-05T02:12:16.464772+0000","last_fullsized":"2024-09-05T02:12:16.464772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:20.839555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:26.432127+0000","last_change":"2024-09-05T00:49:37.939432+0000","last_active":"2024-09-05T02:15:26.432127+0000","last_peered":"2024-09-05T02:15:26.432127+0000","last_clean":"2024-09-05T02:15:26.432127+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:15:26.432127+0000","last_undegraded":"2024-09-05T02:15:26.432127+0000","last_fullsized":"2024-09-05T02:15:26.432127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:10:08.494468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'478","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.850142+0000","last_change":"2024-09-05T00:49:29.896300+0000","last_active":"2024-09-05T02:13:32.850142+0000","last_peered":"2024-09-05T02:13:32.850142+0000","last_clean":"2024-09-05T02:13:32.850142+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:13:32.850142+0000","last_undegraded":"2024-09-05T02:13:32.850142+0000","last_fullsized":"2024-09-05T02:13:32.850142+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:52:46.379207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.555869+0000","last_change":"2024-09-05T00:49:27.907570+0000","last_active":"2024-09-05T02:16:21.555869+0000","last_peered":"2024-09-05T02:16:21.555869+0000","last_clean":"2024-09-05T02:16:21.555869+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:21.555869+0000","last_undegraded":"2024-09-05T02:16:21.555869+0000","last_fullsized":"2024-09-05T02:16:21.555869+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:05.915567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617206,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":414,"num_read_kb":11870,"num_write":1046,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375656+0000","last_change":"2024-09-05T00:49:31.902598+0000","last_active":"2024-09-05T02:12:46.375656+0000","last_peered":"2024-09-05T02:12:46.375656+0000","last_clean":"2024-09-05T02:12:46.375656+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:12:46.375656+0000","last_undegraded":"2024-09-05T02:12:46.375656+0000","last_fullsized":"2024-09-05T02:12:46.375656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:39.314352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'360","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:16.665940+0000","last_change":"2024-09-05T00:49:33.914287+0000","last_active":"2024-09-05T02:16:16.665940+0000","last_peered":"2024-09-05T02:16:16.665940+0000","last_clean":"2024-09-05T02:16:16.665940+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:16.665940+0000","last_undegraded":"2024-09-05T02:16:16.665940+0000","last_fullsized":"2024-09-05T02:16:16.665940+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:11.461929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53087,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1050,"num_write":436,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'799","reported_seq":2967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.566046+0000","last_change":"2024-09-05T00:49:35.943066+0000","last_active":"2024-09-05T02:15:53.566046+0000","last_peered":"2024-09-05T02:15:53.566046+0000","last_clean":"2024-09-05T02:15:53.566046+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:15:53.566046+0000","last_undegraded":"2024-09-05T02:15:53.566046+0000","last_fullsized":"2024-09-05T02:15:53.566046+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.083488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.657912+0000","last_change":"2024-09-05T00:49:37.930994+0000","last_active":"2024-09-05T02:15:48.657912+0000","last_peered":"2024-09-05T02:15:48.657912+0000","last_clean":"2024-09-05T02:15:48.657912+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:15:48.657912+0000","last_undegraded":"2024-09-05T02:15:48.657912+0000","last_fullsized":"2024-09-05T02:15:48.657912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:37:05.359031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'803","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844942+0000","last_change":"2024-09-05T00:49:29.920955+0000","last_active":"2024-09-05T02:14:19.844942+0000","last_peered":"2024-09-05T02:14:19.844942+0000","last_clean":"2024-09-05T02:14:19.844942+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:14:19.844942+0000","last_undegraded":"2024-09-05T02:14:19.844942+0000","last_fullsized":"2024-09-05T02:14:19.844942+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:44:52.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'257","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210767+0000","last_change":"2024-09-05T00:49:27.889887+0000","last_active":"2024-09-05T02:12:45.210767+0000","last_peered":"2024-09-05T02:12:45.210767+0000","last_clean":"2024-09-05T02:12:45.210767+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:12:45.210767+0000","last_undegraded":"2024-09-05T02:12:45.210767+0000","last_fullsized":"2024-09-05T02:12:45.210767+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:39.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19488382,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":486,"num_read_kb":126733,"num_write":908,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.392808+0000","last_change":"2024-09-05T00:49:31.918141+0000","last_active":"2024-09-05T02:14:11.392808+0000","last_peered":"2024-09-05T02:14:11.392808+0000","last_clean":"2024-09-05T02:14:11.392808+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:14:11.392808+0000","last_undegraded":"2024-09-05T02:14:11.392808+0000","last_fullsized":"2024-09-05T02:14:11.392808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:29.030370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'538","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.651757+0000","last_change":"2024-09-05T00:49:33.914174+0000","last_active":"2024-09-05T02:15:49.651757+0000","last_peered":"2024-09-05T02:15:49.651757+0000","last_clean":"2024-09-05T02:15:49.651757+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:15:49.651757+0000","last_undegraded":"2024-09-05T02:15:49.651757+0000","last_fullsized":"2024-09-05T02:15:49.651757+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:19.745942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":2142,"num_write":802,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391710+0000","last_change":"2024-09-05T00:49:35.924089+0000","last_active":"2024-09-05T02:14:06.391710+0000","last_peered":"2024-09-05T02:14:06.391710+0000","last_clean":"2024-09-05T02:14:06.391710+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:14:06.391710+0000","last_undegraded":"2024-09-05T02:14:06.391710+0000","last_fullsized":"2024-09-05T02:14:06.391710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.796632+0000","last_change":"2024-09-05T00:49:37.951943+0000","last_active":"2024-09-05T02:14:11.796632+0000","last_peered":"2024-09-05T02:14:11.796632+0000","last_clean":"2024-09-05T02:14:11.796632+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:14:11.796632+0000","last_undegraded":"2024-09-05T02:14:11.796632+0000","last_fullsized":"2024-09-05T02:14:11.796632+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:10:12.600724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'957","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844122+0000","last_change":"2024-09-05T00:49:29.916462+0000","last_active":"2024-09-05T02:13:40.844122+0000","last_peered":"2024-09-05T02:13:40.844122+0000","last_clean":"2024-09-05T02:13:40.844122+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:13:40.844122+0000","last_undegraded":"2024-09-05T02:13:40.844122+0000","last_fullsized":"2024-09-05T02:13:40.844122+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:54.951960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'527","reported_seq":1349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.477914+0000","last_change":"2024-09-05T00:49:27.882006+0000","last_active":"2024-09-05T02:16:21.477914+0000","last_peered":"2024-09-05T02:16:21.477914+0000","last_clean":"2024-09-05T02:16:21.477914+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:21.477914+0000","last_undegraded":"2024-09-05T02:16:21.477914+0000","last_fullsized":"2024-09-05T02:16:21.477914+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:30.493857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7940790,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1225,"num_read_kb":93814,"num_write":1725,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375772+0000","last_change":"2024-09-05T00:49:31.914002+0000","last_active":"2024-09-05T02:12:46.375772+0000","last_peered":"2024-09-05T02:12:46.375772+0000","last_clean":"2024-09-05T02:12:46.375772+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:12:46.375772+0000","last_undegraded":"2024-09-05T02:12:46.375772+0000","last_fullsized":"2024-09-05T02:12:46.375772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:51:45.528236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'313","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.604532+0000","last_change":"2024-09-05T00:49:33.912638+0000","last_active":"2024-09-05T02:15:49.604532+0000","last_peered":"2024-09-05T02:15:49.604532+0000","last_clean":"2024-09-05T02:15:49.604532+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:15:49.604532+0000","last_undegraded":"2024-09-05T02:15:49.604532+0000","last_fullsized":"2024-09-05T02:15:49.604532+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:18:34.630632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":966,"num_write":452,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455773+0000","last_change":"2024-09-05T00:49:35.943863+0000","last_active":"2024-09-05T02:13:10.455773+0000","last_peered":"2024-09-05T02:13:10.455773+0000","last_clean":"2024-09-05T02:13:10.455773+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:13:10.455773+0000","last_undegraded":"2024-09-05T02:13:10.455773+0000","last_fullsized":"2024-09-05T02:13:10.455773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:18:41.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'102","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:37.522963+0000","last_change":"2024-09-05T00:49:37.954493+0000","last_active":"2024-09-05T02:15:37.522963+0000","last_peered":"2024-09-05T02:15:37.522963+0000","last_clean":"2024-09-05T02:15:37.522963+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:15:37.522963+0000","last_undegraded":"2024-09-05T02:15:37.522963+0000","last_fullsized":"2024-09-05T02:15:37.522963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:55.189506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'494","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214294+0000","last_change":"2024-09-05T00:49:29.913611+0000","last_active":"2024-09-05T02:12:46.214294+0000","last_peered":"2024-09-05T02:12:46.214294+0000","last_clean":"2024-09-05T02:12:46.214294+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:12:46.214294+0000","last_undegraded":"2024-09-05T02:12:46.214294+0000","last_fullsized":"2024-09-05T02:12:46.214294+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:37:37.589615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'329","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.219682+0000","last_change":"2024-09-05T00:49:27.888513+0000","last_active":"2024-09-05T02:16:21.219682+0000","last_peered":"2024-09-05T02:16:21.219682+0000","last_clean":"2024-09-05T02:16:21.219682+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:21.219682+0000","last_undegraded":"2024-09-05T02:16:21.219682+0000","last_fullsized":"2024-09-05T02:16:21.219682+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:09.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252799,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":594,"num_read_kb":21238,"num_write":1176,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779463+0000","last_change":"2024-09-05T00:49:31.926052+0000","last_active":"2024-09-05T02:12:46.779463+0000","last_peered":"2024-09-05T02:12:46.779463+0000","last_clean":"2024-09-05T02:12:46.779463+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:12:46.779463+0000","last_undegraded":"2024-09-05T02:12:46.779463+0000","last_fullsized":"2024-09-05T02:12:46.779463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:30.427944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.665771+0000","last_change":"2024-09-05T00:49:33.923431+0000","last_active":"2024-09-05T02:15:49.665771+0000","last_peered":"2024-09-05T02:15:49.665771+0000","last_clean":"2024-09-05T02:15:49.665771+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:15:49.665771+0000","last_undegraded":"2024-09-05T02:15:49.665771+0000","last_fullsized":"2024-09-05T02:15:49.665771+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:01.776499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":969,"num_write":410,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'732","reported_seq":2782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.839462+0000","last_change":"2024-09-05T00:49:35.937729+0000","last_active":"2024-09-05T02:16:20.839462+0000","last_peered":"2024-09-05T02:16:20.839462+0000","last_clean":"2024-09-05T02:16:20.839462+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:20.839462+0000","last_undegraded":"2024-09-05T02:16:20.839462+0000","last_fullsized":"2024-09-05T02:16:20.839462+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:07:50.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.281544+0000","last_change":"2024-09-05T00:49:37.933620+0000","last_active":"2024-09-05T02:14:25.281544+0000","last_peered":"2024-09-05T02:14:25.281544+0000","last_clean":"2024-09-05T02:14:25.281544+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:14:25.281544+0000","last_undegraded":"2024-09-05T02:14:25.281544+0000","last_fullsized":"2024-09-05T02:14:25.281544+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:06.955650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'393","reported_seq":1887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214352+0000","last_change":"2024-09-05T00:49:29.914015+0000","last_active":"2024-09-05T02:12:46.214352+0000","last_peered":"2024-09-05T02:12:46.214352+0000","last_clean":"2024-09-05T02:12:46.214352+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:12:46.214352+0000","last_undegraded":"2024-09-05T02:12:46.214352+0000","last_fullsized":"2024-09-05T02:12:46.214352+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:02:56.335552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'265","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.185898+0000","last_change":"2024-09-05T00:49:27.875113+0000","last_active":"2024-09-05T02:16:21.185898+0000","last_peered":"2024-09-05T02:16:21.185898+0000","last_clean":"2024-09-05T02:16:21.185898+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:21.185898+0000","last_undegraded":"2024-09-05T02:16:21.185898+0000","last_fullsized":"2024-09-05T02:16:21.185898+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:27:05.251788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375261,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":455,"num_read_kb":32425,"num_write":1028,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.541606+0000","last_change":"2024-09-05T00:49:31.921867+0000","last_active":"2024-09-05T02:15:49.541606+0000","last_peered":"2024-09-05T02:15:49.541606+0000","last_clean":"2024-09-05T02:15:49.541606+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:15:49.541606+0000","last_undegraded":"2024-09-05T02:15:49.541606+0000","last_fullsized":"2024-09-05T02:15:49.541606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:12.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473659+0000","last_change":"2024-09-05T00:49:34.054334+0000","last_active":"2024-09-05T02:12:51.473659+0000","last_peered":"2024-09-05T02:12:51.473659+0000","last_clean":"2024-09-05T02:12:51.473659+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:12:51.473659+0000","last_undegraded":"2024-09-05T02:12:51.473659+0000","last_fullsized":"2024-09-05T02:12:51.473659+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:44:00.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'769","reported_seq":2806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.840171+0000","last_change":"2024-09-05T00:49:35.927090+0000","last_active":"2024-09-05T02:16:20.840171+0000","last_peered":"2024-09-05T02:16:20.840171+0000","last_clean":"2024-09-05T02:16:20.840171+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:20.840171+0000","last_undegraded":"2024-09-05T02:16:20.840171+0000","last_fullsized":"2024-09-05T02:16:20.840171+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:44.053640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.217672+0000","last_change":"2024-09-05T00:49:37.927836+0000","last_active":"2024-09-05T02:13:01.217672+0000","last_peered":"2024-09-05T02:13:01.217672+0000","last_clean":"2024-09-05T02:13:01.217672+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:13:01.217672+0000","last_undegraded":"2024-09-05T02:13:01.217672+0000","last_fullsized":"2024-09-05T02:13:01.217672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:55:13.858470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1289","reported_seq":3045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.644446+0000","last_change":"2024-09-05T00:49:29.920000+0000","last_active":"2024-09-05T02:15:48.644446+0000","last_peered":"2024-09-05T02:15:48.644446+0000","last_clean":"2024-09-05T02:15:48.644446+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:15:48.644446+0000","last_undegraded":"2024-09-05T02:15:48.644446+0000","last_fullsized":"2024-09-05T02:15:48.644446+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:23.678465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'296","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.284018+0000","last_change":"2024-09-05T00:49:27.884563+0000","last_active":"2024-09-05T02:16:21.284018+0000","last_peered":"2024-09-05T02:16:21.284018+0000","last_clean":"2024-09-05T02:16:21.284018+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:21.284018+0000","last_undegraded":"2024-09-05T02:16:21.284018+0000","last_fullsized":"2024-09-05T02:16:21.284018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:32.747613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6504318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":425,"num_read_kb":2332,"num_write":1126,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214330+0000","last_change":"2024-09-05T00:49:31.917398+0000","last_active":"2024-09-05T02:12:46.214330+0000","last_peered":"2024-09-05T02:12:46.214330+0000","last_clean":"2024-09-05T02:12:46.214330+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:12:46.214330+0000","last_undegraded":"2024-09-05T02:12:46.214330+0000","last_fullsized":"2024-09-05T02:12:46.214330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:04.120586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'448","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243657+0000","last_change":"2024-09-05T00:49:33.911807+0000","last_active":"2024-09-05T02:15:05.243657+0000","last_peered":"2024-09-05T02:15:05.243657+0000","last_clean":"2024-09-05T02:15:05.243657+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:15:05.243657+0000","last_undegraded":"2024-09-05T02:15:05.243657+0000","last_fullsized":"2024-09-05T02:15:05.243657+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:40:17.975347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52279,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1302,"num_read_kb":1773,"num_write":1870,"num_write_kb":1685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397943+0000","last_change":"2024-09-05T00:49:35.933208+0000","last_active":"2024-09-05T02:12:51.397943+0000","last_peered":"2024-09-05T02:12:51.397943+0000","last_clean":"2024-09-05T02:12:51.397943+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:12:51.397943+0000","last_undegraded":"2024-09-05T02:12:51.397943+0000","last_fullsized":"2024-09-05T02:12:51.397943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:18.752769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'152","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.782551+0000","last_change":"2024-09-05T00:49:37.945006+0000","last_active":"2024-09-05T02:13:01.782551+0000","last_peered":"2024-09-05T02:13:01.782551+0000","last_clean":"2024-09-05T02:13:01.782551+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:13:01.782551+0000","last_undegraded":"2024-09-05T02:13:01.782551+0000","last_fullsized":"2024-09-05T02:13:01.782551+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:03:44.203556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'892","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.845228+0000","last_change":"2024-09-05T00:49:29.900064+0000","last_active":"2024-09-05T02:14:19.845228+0000","last_peered":"2024-09-05T02:14:19.845228+0000","last_clean":"2024-09-05T02:14:19.845228+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:14:19.845228+0000","last_undegraded":"2024-09-05T02:14:19.845228+0000","last_fullsized":"2024-09-05T02:14:19.845228+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:13.462710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:26.834774+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T02:13:26.834774+0000","last_peered":"2024-09-05T02:13:26.834774+0000","last_clean":"2024-09-05T02:13:26.834774+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:13:26.834774+0000","last_undegraded":"2024-09-05T02:13:26.834774+0000","last_fullsized":"2024-09-05T02:13:26.834774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209522+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T02:12:40.209522+0000","last_peered":"2024-09-05T02:12:40.209522+0000","last_clean":"2024-09-05T02:12:40.209522+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:12:40.209522+0000","last_undegraded":"2024-09-05T02:12:40.209522+0000","last_fullsized":"2024-09-05T02:12:40.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.328352+0000","last_change":"2024-09-05T00:50:04.179246+0000","last_active":"2024-09-05T02:16:21.328352+0000","last_peered":"2024-09-05T02:16:21.328352+0000","last_clean":"2024-09-05T02:16:21.328352+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:21.328352+0000","last_undegraded":"2024-09-05T02:16:21.328352+0000","last_fullsized":"2024-09-05T02:16:21.328352+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:55.427090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355273,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":411,"num_read_kb":14472,"num_write":824,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826578+0000","last_change":"2024-09-05T00:49:31.913193+0000","last_active":"2024-09-05T02:12:51.826578+0000","last_peered":"2024-09-05T02:12:51.826578+0000","last_clean":"2024-09-05T02:12:51.826578+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:12:51.826578+0000","last_undegraded":"2024-09-05T02:12:51.826578+0000","last_fullsized":"2024-09-05T02:12:51.826578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:35.650327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'772","reported_seq":1490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.659667+0000","last_change":"2024-09-05T00:49:33.921799+0000","last_active":"2024-09-05T02:15:49.659667+0000","last_peered":"2024-09-05T02:15:49.659667+0000","last_clean":"2024-09-05T02:15:49.659667+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:15:49.659667+0000","last_undegraded":"2024-09-05T02:15:49.659667+0000","last_fullsized":"2024-09-05T02:15:49.659667+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:02.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1502,"num_read_kb":3214,"num_write":1434,"num_write_kb":1271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468924+0000","last_change":"2024-09-05T00:49:35.943449+0000","last_active":"2024-09-05T02:14:05.468924+0000","last_peered":"2024-09-05T02:14:05.468924+0000","last_clean":"2024-09-05T02:14:05.468924+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:14:05.468924+0000","last_undegraded":"2024-09-05T02:14:05.468924+0000","last_fullsized":"2024-09-05T02:14:05.468924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:59.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'201","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.696227+0000","last_change":"2024-09-05T00:49:37.942775+0000","last_active":"2024-09-05T02:14:29.696227+0000","last_peered":"2024-09-05T02:14:29.696227+0000","last_clean":"2024-09-05T02:14:29.696227+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:14:29.696227+0000","last_undegraded":"2024-09-05T02:14:29.696227+0000","last_fullsized":"2024-09-05T02:14:29.696227+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:04.497388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'782","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844939+0000","last_change":"2024-09-05T00:49:29.921333+0000","last_active":"2024-09-05T02:14:19.844939+0000","last_peered":"2024-09-05T02:14:19.844939+0000","last_clean":"2024-09-05T02:14:19.844939+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:14:19.844939+0000","last_undegraded":"2024-09-05T02:14:19.844939+0000","last_fullsized":"2024-09-05T02:14:19.844939+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:47.295103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836049+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T02:13:31.836049+0000","last_peered":"2024-09-05T02:13:31.836049+0000","last_clean":"2024-09-05T02:13:31.836049+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:13:31.836049+0000","last_undegraded":"2024-09-05T02:13:31.836049+0000","last_fullsized":"2024-09-05T02:13:31.836049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'256","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450783+0000","last_change":"2024-09-05T00:49:27.878156+0000","last_active":"2024-09-05T02:12:50.450783+0000","last_peered":"2024-09-05T02:12:50.450783+0000","last_clean":"2024-09-05T02:12:50.450783+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:12:50.450783+0000","last_undegraded":"2024-09-05T02:12:50.450783+0000","last_fullsized":"2024-09-05T02:12:50.450783+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:53:01.442424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6449287,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":364,"num_read_kb":5706,"num_write":1015,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229660+0000","last_change":"2024-09-05T00:49:31.908526+0000","last_active":"2024-09-05T02:14:05.229660+0000","last_peered":"2024-09-05T02:14:05.229660+0000","last_clean":"2024-09-05T02:14:05.229660+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:14:05.229660+0000","last_undegraded":"2024-09-05T02:14:05.229660+0000","last_fullsized":"2024-09-05T02:14:05.229660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:47.306493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1368","reported_seq":3378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.679194+0000","last_change":"2024-09-05T00:49:33.926295+0000","last_active":"2024-09-05T02:16:21.679194+0000","last_peered":"2024-09-05T02:16:21.679194+0000","last_clean":"2024-09-05T02:16:21.679194+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:21.679194+0000","last_undegraded":"2024-09-05T02:16:21.679194+0000","last_fullsized":"2024-09-05T02:16:21.679194+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:34:33.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150549,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":3812,"num_write":1224,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830253+0000","last_change":"2024-09-05T00:49:35.940367+0000","last_active":"2024-09-05T02:13:06.830253+0000","last_peered":"2024-09-05T02:13:06.830253+0000","last_clean":"2024-09-05T02:13:06.830253+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:13:06.830253+0000","last_undegraded":"2024-09-05T02:13:06.830253+0000","last_fullsized":"2024-09-05T02:13:06.830253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:41.127677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'248","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.066730+0000","last_change":"2024-09-05T00:49:37.939098+0000","last_active":"2024-09-05T02:14:27.066730+0000","last_peered":"2024-09-05T02:14:27.066730+0000","last_clean":"2024-09-05T02:14:27.066730+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:14:27.066730+0000","last_undegraded":"2024-09-05T02:14:27.066730+0000","last_fullsized":"2024-09-05T02:14:27.066730+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:24:16.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'409","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.699092+0000","last_change":"2024-09-05T00:49:29.900527+0000","last_active":"2024-09-05T02:15:48.699092+0000","last_peered":"2024-09-05T02:15:48.699092+0000","last_clean":"2024-09-05T02:15:48.699092+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:15:48.699092+0000","last_undegraded":"2024-09-05T02:15:48.699092+0000","last_fullsized":"2024-09-05T02:15:48.699092+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.374481+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T02:12:41.374481+0000","last_peered":"2024-09-05T02:12:41.374481+0000","last_clean":"2024-09-05T02:12:41.374481+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:12:41.374481+0000","last_undegraded":"2024-09-05T02:12:41.374481+0000","last_fullsized":"2024-09-05T02:12:41.374481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'278","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.789469+0000","last_change":"2024-09-05T00:49:27.883563+0000","last_active":"2024-09-05T02:16:21.789469+0000","last_peered":"2024-09-05T02:16:21.789469+0000","last_clean":"2024-09-05T02:16:21.789469+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:21.789469+0000","last_undegraded":"2024-09-05T02:16:21.789469+0000","last_fullsized":"2024-09-05T02:16:21.789469+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:39.304949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700033,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":578,"num_read_kb":23361,"num_write":857,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390702+0000","last_change":"2024-09-05T00:49:31.895357+0000","last_active":"2024-09-05T02:14:01.390702+0000","last_peered":"2024-09-05T02:14:01.390702+0000","last_clean":"2024-09-05T02:14:01.390702+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:14:01.390702+0000","last_undegraded":"2024-09-05T02:14:01.390702+0000","last_fullsized":"2024-09-05T02:14:01.390702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:42.106138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'346","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:46.508089+0000","last_change":"2024-09-05T00:49:34.055522+0000","last_active":"2024-09-05T02:15:46.508089+0000","last_peered":"2024-09-05T02:15:46.508089+0000","last_clean":"2024-09-05T02:15:46.508089+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:15:46.508089+0000","last_undegraded":"2024-09-05T02:15:46.508089+0000","last_fullsized":"2024-09-05T02:15:46.508089+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:45:16.964827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452179+0000","last_change":"2024-09-05T00:49:35.926479+0000","last_active":"2024-09-05T02:12:55.452179+0000","last_peered":"2024-09-05T02:12:55.452179+0000","last_clean":"2024-09-05T02:12:55.452179+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:12:55.452179+0000","last_undegraded":"2024-09-05T02:12:55.452179+0000","last_fullsized":"2024-09-05T02:12:55.452179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:15:53.424417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'243","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.151838+0000","last_change":"2024-09-05T00:49:37.952280+0000","last_active":"2024-09-05T02:14:30.151838+0000","last_peered":"2024-09-05T02:14:30.151838+0000","last_clean":"2024-09-05T02:14:30.151838+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:14:30.151838+0000","last_undegraded":"2024-09-05T02:14:30.151838+0000","last_fullsized":"2024-09-05T02:14:30.151838+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:26.910581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1276","reported_seq":2925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.706457+0000","last_change":"2024-09-05T00:49:29.908449+0000","last_active":"2024-09-05T02:14:27.706457+0000","last_peered":"2024-09-05T02:14:27.706457+0000","last_clean":"2024-09-05T02:14:27.706457+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:14:27.706457+0000","last_undegraded":"2024-09-05T02:14:27.706457+0000","last_fullsized":"2024-09-05T02:14:27.706457+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209438+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T02:12:40.209438+0000","last_peered":"2024-09-05T02:12:40.209438+0000","last_clean":"2024-09-05T02:12:40.209438+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:12:40.209438+0000","last_undegraded":"2024-09-05T02:12:40.209438+0000","last_fullsized":"2024-09-05T02:12:40.209438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'296","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.143992+0000","last_change":"2024-09-05T00:49:27.898358+0000","last_active":"2024-09-05T02:16:21.143992+0000","last_peered":"2024-09-05T02:16:21.143992+0000","last_clean":"2024-09-05T02:16:21.143992+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:21.143992+0000","last_undegraded":"2024-09-05T02:16:21.143992+0000","last_fullsized":"2024-09-05T02:16:21.143992+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:29.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21328244,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":488,"num_read_kb":46632,"num_write":1109,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.456748+0000","last_change":"2024-09-05T00:49:31.910432+0000","last_active":"2024-09-05T02:13:15.456748+0000","last_peered":"2024-09-05T02:13:15.456748+0000","last_clean":"2024-09-05T02:13:15.456748+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:13:15.456748+0000","last_undegraded":"2024-09-05T02:13:15.456748+0000","last_fullsized":"2024-09-05T02:13:15.456748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:21:42.078643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.928708+0000","last_change":"2024-09-05T00:49:33.929270+0000","last_active":"2024-09-05T02:15:49.928708+0000","last_peered":"2024-09-05T02:15:49.928708+0000","last_clean":"2024-09-05T02:15:49.928708+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:15:49.928708+0000","last_undegraded":"2024-09-05T02:15:49.928708+0000","last_fullsized":"2024-09-05T02:15:49.928708+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:24:30.946732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.414541+0000","last_change":"2024-09-05T00:49:35.948033+0000","last_active":"2024-09-05T02:14:06.414541+0000","last_peered":"2024-09-05T02:14:06.414541+0000","last_clean":"2024-09-05T02:14:06.414541+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:14:06.414541+0000","last_undegraded":"2024-09-05T02:14:06.414541+0000","last_fullsized":"2024-09-05T02:14:06.414541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:58.062174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'117","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230591+0000","last_change":"2024-09-05T00:49:37.953956+0000","last_active":"2024-09-05T02:14:10.230591+0000","last_peered":"2024-09-05T02:14:10.230591+0000","last_clean":"2024-09-05T02:14:10.230591+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:14:10.230591+0000","last_undegraded":"2024-09-05T02:14:10.230591+0000","last_fullsized":"2024-09-05T02:14:10.230591+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:12.611232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'541","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.617732+0000","last_change":"2024-09-05T00:49:29.907763+0000","last_active":"2024-09-05T02:15:48.617732+0000","last_peered":"2024-09-05T02:15:48.617732+0000","last_clean":"2024-09-05T02:15:48.617732+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:15:48.617732+0000","last_undegraded":"2024-09-05T02:15:48.617732+0000","last_fullsized":"2024-09-05T02:15:48.617732+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:22.730148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'233","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.217613+0000","last_change":"2024-09-05T00:49:27.889027+0000","last_active":"2024-09-05T02:13:15.217613+0000","last_peered":"2024-09-05T02:13:15.217613+0000","last_clean":"2024-09-05T02:13:15.217613+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:13:15.217613+0000","last_undegraded":"2024-09-05T02:13:15.217613+0000","last_fullsized":"2024-09-05T02:13:15.217613+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:37.525116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9458431,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":495,"num_read_kb":39042,"num_write":851,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.778371+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T02:12:41.778371+0000","last_peered":"2024-09-05T02:12:41.778371+0000","last_clean":"2024-09-05T02:12:41.778371+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:12:41.778371+0000","last_undegraded":"2024-09-05T02:12:41.778371+0000","last_fullsized":"2024-09-05T02:12:41.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452119+0000","last_change":"2024-09-05T00:49:31.917058+0000","last_active":"2024-09-05T02:12:55.452119+0000","last_peered":"2024-09-05T02:12:55.452119+0000","last_clean":"2024-09-05T02:12:55.452119+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:12:55.452119+0000","last_undegraded":"2024-09-05T02:12:55.452119+0000","last_fullsized":"2024-09-05T02:12:55.452119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:09:49.645261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'668","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.663651+0000","last_change":"2024-09-05T00:49:33.928573+0000","last_active":"2024-09-05T02:15:49.663651+0000","last_peered":"2024-09-05T02:15:49.663651+0000","last_clean":"2024-09-05T02:15:49.663651+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:15:49.663651+0000","last_undegraded":"2024-09-05T02:15:49.663651+0000","last_fullsized":"2024-09-05T02:15:49.663651+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:49:02.005394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130968,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":2239,"num_write":998,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216518+0000","last_change":"2024-09-05T00:49:35.938207+0000","last_active":"2024-09-05T02:12:56.216518+0000","last_peered":"2024-09-05T02:12:56.216518+0000","last_clean":"2024-09-05T02:12:56.216518+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:12:56.216518+0000","last_undegraded":"2024-09-05T02:12:56.216518+0000","last_fullsized":"2024-09-05T02:12:56.216518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:03.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.920772+0000","last_change":"2024-09-05T00:49:37.933639+0000","last_active":"2024-09-05T02:14:29.920772+0000","last_peered":"2024-09-05T02:14:29.920772+0000","last_clean":"2024-09-05T02:14:29.920772+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:14:29.920772+0000","last_undegraded":"2024-09-05T02:14:29.920772+0000","last_fullsized":"2024-09-05T02:14:29.920772+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:37.728081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'883","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701326+0000","last_change":"2024-09-05T00:49:29.913232+0000","last_active":"2024-09-05T02:14:27.701326+0000","last_peered":"2024-09-05T02:14:27.701326+0000","last_clean":"2024-09-05T02:14:27.701326+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:14:27.701326+0000","last_undegraded":"2024-09-05T02:14:27.701326+0000","last_fullsized":"2024-09-05T02:14:27.701326+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:24.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'286","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.811136+0000","last_change":"2024-09-05T00:49:27.879948+0000","last_active":"2024-09-05T02:16:21.811136+0000","last_peered":"2024-09-05T02:16:21.811136+0000","last_clean":"2024-09-05T02:16:21.811136+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:21.811136+0000","last_undegraded":"2024-09-05T02:16:21.811136+0000","last_fullsized":"2024-09-05T02:16:21.811136+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:21:52.199092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":491,"num_read_kb":37378,"num_write":1020,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826629+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T02:12:51.826629+0000","last_peered":"2024-09-05T02:12:51.826629+0000","last_clean":"2024-09-05T02:12:51.826629+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:12:51.826629+0000","last_undegraded":"2024-09-05T02:12:51.826629+0000","last_fullsized":"2024-09-05T02:12:51.826629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397897+0000","last_change":"2024-09-05T00:49:31.913143+0000","last_active":"2024-09-05T02:12:51.397897+0000","last_peered":"2024-09-05T02:12:51.397897+0000","last_clean":"2024-09-05T02:12:51.397897+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:12:51.397897+0000","last_undegraded":"2024-09-05T02:12:51.397897+0000","last_fullsized":"2024-09-05T02:12:51.397897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:26.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'204","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.781213+0000","last_change":"2024-09-05T00:49:34.054211+0000","last_active":"2024-09-05T02:12:56.781213+0000","last_peered":"2024-09-05T02:12:56.781213+0000","last_clean":"2024-09-05T02:12:56.781213+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:12:56.781213+0000","last_undegraded":"2024-09-05T02:12:56.781213+0000","last_fullsized":"2024-09-05T02:12:56.781213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:13.534123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'792","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.536994+0000","last_change":"2024-09-05T00:49:35.933822+0000","last_active":"2024-09-05T02:15:53.536994+0000","last_peered":"2024-09-05T02:15:53.536994+0000","last_clean":"2024-09-05T02:15:53.536994+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:15:53.536994+0000","last_undegraded":"2024-09-05T02:15:53.536994+0000","last_fullsized":"2024-09-05T02:15:53.536994+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'146","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:31.508344+0000","last_change":"2024-09-05T00:49:37.948757+0000","last_active":"2024-09-05T02:15:31.508344+0000","last_peered":"2024-09-05T02:15:31.508344+0000","last_clean":"2024-09-05T02:15:31.508344+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:15:31.508344+0000","last_undegraded":"2024-09-05T02:15:31.508344+0000","last_fullsized":"2024-09-05T02:15:31.508344+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:40.306605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'962","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487814+0000","last_change":"2024-09-05T00:49:29.927814+0000","last_active":"2024-09-05T02:13:51.487814+0000","last_peered":"2024-09-05T02:13:51.487814+0000","last_clean":"2024-09-05T02:13:51.487814+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:13:51.487814+0000","last_undegraded":"2024-09-05T02:13:51.487814+0000","last_fullsized":"2024-09-05T02:13:51.487814+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:53:13.267895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'362","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.500110+0000","last_change":"2024-09-05T00:49:27.910000+0000","last_active":"2024-09-05T02:16:21.500110+0000","last_peered":"2024-09-05T02:16:21.500110+0000","last_clean":"2024-09-05T02:16:21.500110+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:21.500110+0000","last_undegraded":"2024-09-05T02:16:21.500110+0000","last_fullsized":"2024-09-05T02:16:21.500110+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:27:09.939131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89265,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":704,"num_read_kb":36690,"num_write":1383,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792763+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T02:13:51.792763+0000","last_peered":"2024-09-05T02:13:51.792763+0000","last_clean":"2024-09-05T02:13:51.792763+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:13:51.792763+0000","last_undegraded":"2024-09-05T02:13:51.792763+0000","last_fullsized":"2024-09-05T02:13:51.792763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.215403+0000","last_change":"2024-09-05T00:49:31.916181+0000","last_active":"2024-09-05T02:12:51.215403+0000","last_peered":"2024-09-05T02:12:51.215403+0000","last_clean":"2024-09-05T02:12:51.215403+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:12:51.215403+0000","last_undegraded":"2024-09-05T02:12:51.215403+0000","last_fullsized":"2024-09-05T02:12:51.215403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:16:28.018466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'156","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216578+0000","last_change":"2024-09-05T00:49:33.919913+0000","last_active":"2024-09-05T02:12:56.216578+0000","last_peered":"2024-09-05T02:12:56.216578+0000","last_clean":"2024-09-05T02:12:56.216578+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:12:56.216578+0000","last_undegraded":"2024-09-05T02:12:56.216578+0000","last_fullsized":"2024-09-05T02:12:56.216578+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:48.393350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'799","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.844438+0000","last_change":"2024-09-05T00:49:35.938148+0000","last_active":"2024-09-05T02:16:20.844438+0000","last_peered":"2024-09-05T02:16:20.844438+0000","last_clean":"2024-09-05T02:16:20.844438+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:20.844438+0000","last_undegraded":"2024-09-05T02:16:20.844438+0000","last_fullsized":"2024-09-05T02:16:20.844438+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:27.051091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'174","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452197+0000","last_change":"2024-09-05T00:49:37.954318+0000","last_active":"2024-09-05T02:12:55.452197+0000","last_peered":"2024-09-05T02:12:55.452197+0000","last_clean":"2024-09-05T02:12:55.452197+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:12:55.452197+0000","last_undegraded":"2024-09-05T02:12:55.452197+0000","last_fullsized":"2024-09-05T02:12:55.452197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:51.538774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'563","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.707331+0000","last_change":"2024-09-05T00:49:29.906133+0000","last_active":"2024-09-05T02:14:27.707331+0000","last_peered":"2024-09-05T02:14:27.707331+0000","last_clean":"2024-09-05T02:14:27.707331+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:14:27.707331+0000","last_undegraded":"2024-09-05T02:14:27.707331+0000","last_fullsized":"2024-09-05T02:14:27.707331+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:44.863527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'295","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467748+0000","last_change":"2024-09-05T00:49:27.894589+0000","last_active":"2024-09-05T02:14:00.467748+0000","last_peered":"2024-09-05T02:14:00.467748+0000","last_clean":"2024-09-05T02:14:00.467748+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:14:00.467748+0000","last_undegraded":"2024-09-05T02:14:00.467748+0000","last_fullsized":"2024-09-05T02:14:00.467748+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:44.386284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11119831,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":428,"num_read_kb":1280,"num_write":986,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.411126+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T02:13:51.411126+0000","last_peered":"2024-09-05T02:13:51.411126+0000","last_clean":"2024-09-05T02:13:51.411126+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:13:51.411126+0000","last_undegraded":"2024-09-05T02:13:51.411126+0000","last_fullsized":"2024-09-05T02:13:51.411126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487854+0000","last_change":"2024-09-05T00:49:31.913300+0000","last_active":"2024-09-05T02:13:51.487854+0000","last_peered":"2024-09-05T02:13:51.487854+0000","last_clean":"2024-09-05T02:13:51.487854+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:13:51.487854+0000","last_undegraded":"2024-09-05T02:13:51.487854+0000","last_fullsized":"2024-09-05T02:13:51.487854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'755","reported_seq":1511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.487705+0000","last_change":"2024-09-05T00:49:34.054583+0000","last_active":"2024-09-05T02:16:21.487705+0000","last_peered":"2024-09-05T02:16:21.487705+0000","last_clean":"2024-09-05T02:16:21.487705+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:21.487705+0000","last_undegraded":"2024-09-05T02:16:21.487705+0000","last_fullsized":"2024-09-05T02:16:21.487705+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:41.332842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146628,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1309,"num_read_kb":2983,"num_write":1048,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.474955+0000","last_change":"2024-09-05T00:49:35.934315+0000","last_active":"2024-09-05T02:12:56.474955+0000","last_peered":"2024-09-05T02:12:56.474955+0000","last_clean":"2024-09-05T02:12:56.474955+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:12:56.474955+0000","last_undegraded":"2024-09-05T02:12:56.474955+0000","last_fullsized":"2024-09-05T02:12:56.474955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:47.877686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.213128+0000","last_change":"2024-09-05T00:49:37.942217+0000","last_active":"2024-09-05T02:12:55.213128+0000","last_peered":"2024-09-05T02:12:55.213128+0000","last_clean":"2024-09-05T02:12:55.213128+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:12:55.213128+0000","last_undegraded":"2024-09-05T02:12:55.213128+0000","last_fullsized":"2024-09-05T02:12:55.213128+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:07:48.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'136","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.069901+0000","last_change":"2024-09-05T00:49:37.943464+0000","last_active":"2024-09-05T02:14:30.069901+0000","last_peered":"2024-09-05T02:14:30.069901+0000","last_clean":"2024-09-05T02:14:30.069901+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:14:30.069901+0000","last_undegraded":"2024-09-05T02:14:30.069901+0000","last_fullsized":"2024-09-05T02:14:30.069901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:53.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'583","reported_seq":2215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.224203+0000","last_change":"2024-09-05T00:49:29.912807+0000","last_active":"2024-09-05T02:13:31.224203+0000","last_peered":"2024-09-05T02:13:31.224203+0000","last_clean":"2024-09-05T02:13:31.224203+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:13:31.224203+0000","last_undegraded":"2024-09-05T02:13:31.224203+0000","last_fullsized":"2024-09-05T02:13:31.224203+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'241","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.159306+0000","last_change":"2024-09-05T00:49:27.907668+0000","last_active":"2024-09-05T02:16:21.159306+0000","last_peered":"2024-09-05T02:16:21.159306+0000","last_clean":"2024-09-05T02:16:21.159306+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:21.159306+0000","last_undegraded":"2024-09-05T02:16:21.159306+0000","last_fullsized":"2024-09-05T02:16:21.159306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:40.897083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18373462,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":445,"num_read_kb":27235,"num_write":892,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.788861+0000","last_change":"2024-09-05T00:49:31.905642+0000","last_active":"2024-09-05T02:13:31.788861+0000","last_peered":"2024-09-05T02:13:31.788861+0000","last_clean":"2024-09-05T02:13:31.788861+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:13:31.788861+0000","last_undegraded":"2024-09-05T02:13:31.788861+0000","last_fullsized":"2024-09-05T02:13:31.788861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:00.091113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'311","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.513487+0000","last_change":"2024-09-05T00:49:33.930112+0000","last_active":"2024-09-05T02:15:56.513487+0000","last_peered":"2024-09-05T02:15:56.513487+0000","last_clean":"2024-09-05T02:15:56.513487+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:15:56.513487+0000","last_undegraded":"2024-09-05T02:15:56.513487+0000","last_fullsized":"2024-09-05T02:15:56.513487+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:14.000620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1061,"num_write":420,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.484298+0000","last_change":"2024-09-05T00:49:35.939413+0000","last_active":"2024-09-05T02:13:36.484298+0000","last_peered":"2024-09-05T02:13:36.484298+0000","last_clean":"2024-09-05T02:13:36.484298+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:13:36.484298+0000","last_undegraded":"2024-09-05T02:13:36.484298+0000","last_fullsized":"2024-09-05T02:13:36.484298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.914012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'371","reported_seq":1835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623686+0000","last_change":"2024-09-05T00:49:29.890020+0000","last_active":"2024-09-05T02:14:29.623686+0000","last_peered":"2024-09-05T02:14:29.623686+0000","last_clean":"2024-09-05T02:14:29.623686+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:14:29.623686+0000","last_undegraded":"2024-09-05T02:14:29.623686+0000","last_fullsized":"2024-09-05T02:14:29.623686+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:34.765894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'265","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.512786+0000","last_change":"2024-09-05T00:49:27.905154+0000","last_active":"2024-09-05T02:16:21.512786+0000","last_peered":"2024-09-05T02:16:21.512786+0000","last_clean":"2024-09-05T02:16:21.512786+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:21.512786+0000","last_undegraded":"2024-09-05T02:16:21.512786+0000","last_fullsized":"2024-09-05T02:16:21.512786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:44.309565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6345017,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":707,"num_read_kb":54962,"num_write":1000,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483453+0000","last_change":"2024-09-05T00:49:31.910668+0000","last_active":"2024-09-05T02:13:31.483453+0000","last_peered":"2024-09-05T02:13:31.483453+0000","last_clean":"2024-09-05T02:13:31.483453+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:13:31.483453+0000","last_undegraded":"2024-09-05T02:13:31.483453+0000","last_fullsized":"2024-09-05T02:13:31.483453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:49.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461072+0000","last_change":"2024-09-05T00:49:33.915459+0000","last_active":"2024-09-05T02:13:35.461072+0000","last_peered":"2024-09-05T02:13:35.461072+0000","last_clean":"2024-09-05T02:13:35.461072+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:13:35.461072+0000","last_undegraded":"2024-09-05T02:13:35.461072+0000","last_fullsized":"2024-09-05T02:13:35.461072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626911+0000","last_change":"2024-09-05T00:49:35.935530+0000","last_active":"2024-09-05T02:13:36.626911+0000","last_peered":"2024-09-05T02:13:36.626911+0000","last_clean":"2024-09-05T02:13:36.626911+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:13:36.626911+0000","last_undegraded":"2024-09-05T02:13:36.626911+0000","last_fullsized":"2024-09-05T02:13:36.626911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:22:34.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'228","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.905325+0000","last_change":"2024-09-05T00:49:37.926241+0000","last_active":"2024-09-05T02:14:29.905325+0000","last_peered":"2024-09-05T02:14:29.905325+0000","last_clean":"2024-09-05T02:14:29.905325+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:14:29.905325+0000","last_undegraded":"2024-09-05T02:14:29.905325+0000","last_fullsized":"2024-09-05T02:14:29.905325+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:25.119785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'412","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697308+0000","last_change":"2024-09-05T00:49:29.927723+0000","last_active":"2024-09-05T02:15:48.697308+0000","last_peered":"2024-09-05T02:15:48.697308+0000","last_clean":"2024-09-05T02:15:48.697308+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:15:48.697308+0000","last_undegraded":"2024-09-05T02:15:48.697308+0000","last_fullsized":"2024-09-05T02:15:48.697308+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:50.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'253","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.195218+0000","last_change":"2024-09-05T00:49:27.911758+0000","last_active":"2024-09-05T02:11:40.195218+0000","last_peered":"2024-09-05T02:11:40.195218+0000","last_clean":"2024-09-05T02:11:40.195218+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:11:40.195218+0000","last_undegraded":"2024-09-05T02:11:40.195218+0000","last_fullsized":"2024-09-05T02:11:40.195218+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:11:19.729173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":425,"num_read_kb":91576,"num_write":975,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836079+0000","last_change":"2024-09-05T00:49:31.926718+0000","last_active":"2024-09-05T02:13:31.836079+0000","last_peered":"2024-09-05T02:13:31.836079+0000","last_clean":"2024-09-05T02:13:31.836079+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:13:31.836079+0000","last_undegraded":"2024-09-05T02:13:31.836079+0000","last_fullsized":"2024-09-05T02:13:31.836079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:51:03.171626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.174204+0000","last_change":"2024-09-05T00:49:33.930627+0000","last_active":"2024-09-05T02:16:21.174204+0000","last_peered":"2024-09-05T02:16:21.174204+0000","last_clean":"2024-09-05T02:16:21.174204+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:21.174204+0000","last_undegraded":"2024-09-05T02:16:21.174204+0000","last_fullsized":"2024-09-05T02:16:21.174204+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:57:28.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407690+0000","last_change":"2024-09-05T00:49:35.948016+0000","last_active":"2024-09-05T02:13:36.407690+0000","last_peered":"2024-09-05T02:13:36.407690+0000","last_clean":"2024-09-05T02:13:36.407690+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:13:36.407690+0000","last_undegraded":"2024-09-05T02:13:36.407690+0000","last_fullsized":"2024-09-05T02:13:36.407690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.587514+0000","last_change":"2024-09-05T00:49:37.946851+0000","last_active":"2024-09-05T02:14:29.587514+0000","last_peered":"2024-09-05T02:14:29.587514+0000","last_clean":"2024-09-05T02:14:29.587514+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:14:29.587514+0000","last_undegraded":"2024-09-05T02:14:29.587514+0000","last_fullsized":"2024-09-05T02:14:29.587514+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:32.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483310+0000","last_change":"2024-09-05T00:49:29.924987+0000","last_active":"2024-09-05T02:13:31.483310+0000","last_peered":"2024-09-05T02:13:31.483310+0000","last_clean":"2024-09-05T02:13:31.483310+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:13:31.483310+0000","last_undegraded":"2024-09-05T02:13:31.483310+0000","last_fullsized":"2024-09-05T02:13:31.483310+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:54:10.390860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'273","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.433210+0000","last_change":"2024-09-05T00:49:27.894130+0000","last_active":"2024-09-05T02:11:40.433210+0000","last_peered":"2024-09-05T02:11:40.433210+0000","last_clean":"2024-09-05T02:11:40.433210+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:11:40.433210+0000","last_undegraded":"2024-09-05T02:11:40.433210+0000","last_fullsized":"2024-09-05T02:11:40.433210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:56.396000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345006,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":475,"num_read_kb":6648,"num_write":1049,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.406490+0000","last_change":"2024-09-05T00:49:31.923471+0000","last_active":"2024-09-05T02:13:31.406490+0000","last_peered":"2024-09-05T02:13:31.406490+0000","last_clean":"2024-09-05T02:13:31.406490+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:13:31.406490+0000","last_undegraded":"2024-09-05T02:13:31.406490+0000","last_fullsized":"2024-09-05T02:13:31.406490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:09.929132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'294","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.661206+0000","last_change":"2024-09-05T00:49:33.908585+0000","last_active":"2024-09-05T02:15:56.661206+0000","last_peered":"2024-09-05T02:15:56.661206+0000","last_clean":"2024-09-05T02:15:56.661206+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:15:56.661206+0000","last_undegraded":"2024-09-05T02:15:56.661206+0000","last_fullsized":"2024-09-05T02:15:56.661206+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:52.420648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1062,"num_write":410,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461188+0000","last_change":"2024-09-05T00:49:35.943952+0000","last_active":"2024-09-05T02:13:35.461188+0000","last_peered":"2024-09-05T02:13:35.461188+0000","last_clean":"2024-09-05T02:13:35.461188+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:13:35.461188+0000","last_undegraded":"2024-09-05T02:13:35.461188+0000","last_fullsized":"2024-09-05T02:13:35.461188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:48.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'398","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:28.052618+0000","last_change":"2024-09-05T00:49:29.903345+0000","last_active":"2024-09-05T02:13:28.052618+0000","last_peered":"2024-09-05T02:13:28.052618+0000","last_clean":"2024-09-05T02:13:28.052618+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:13:28.052618+0000","last_undegraded":"2024-09-05T02:13:28.052618+0000","last_fullsized":"2024-09-05T02:13:28.052618+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:55:40.567779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'286","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451596+0000","last_change":"2024-09-05T00:49:27.884147+0000","last_active":"2024-09-05T02:16:21.451596+0000","last_peered":"2024-09-05T02:16:21.451596+0000","last_clean":"2024-09-05T02:16:21.451596+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:21.451596+0000","last_undegraded":"2024-09-05T02:16:21.451596+0000","last_fullsized":"2024-09-05T02:16:21.451596+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:59:47.503408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291972,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":868,"num_read_kb":44981,"num_write":1031,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.544020+0000","last_change":"2024-09-05T00:49:31.915305+0000","last_active":"2024-09-05T02:15:49.544020+0000","last_peered":"2024-09-05T02:15:49.544020+0000","last_clean":"2024-09-05T02:15:49.544020+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:15:49.544020+0000","last_undegraded":"2024-09-05T02:15:49.544020+0000","last_fullsized":"2024-09-05T02:15:49.544020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:46.356538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'526","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.875587+0000","last_change":"2024-09-05T00:49:33.912309+0000","last_active":"2024-09-05T02:16:20.875587+0000","last_peered":"2024-09-05T02:16:20.875587+0000","last_clean":"2024-09-05T02:16:20.875587+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:20.875587+0000","last_undegraded":"2024-09-05T02:16:20.875587+0000","last_fullsized":"2024-09-05T02:16:20.875587+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:19:37.409372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":924,"num_read_kb":2006,"num_write":808,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.201299+0000","last_change":"2024-09-05T00:49:35.938332+0000","last_active":"2024-09-05T02:12:05.201299+0000","last_peered":"2024-09-05T02:12:05.201299+0000","last_clean":"2024-09-05T02:12:05.201299+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:12:05.201299+0000","last_undegraded":"2024-09-05T02:12:05.201299+0000","last_fullsized":"2024-09-05T02:12:05.201299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:56:14.582023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'181","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485412+0000","last_change":"2024-09-05T00:49:37.953067+0000","last_active":"2024-09-05T02:13:41.485412+0000","last_peered":"2024-09-05T02:13:41.485412+0000","last_clean":"2024-09-05T02:13:41.485412+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:13:41.485412+0000","last_undegraded":"2024-09-05T02:13:41.485412+0000","last_fullsized":"2024-09-05T02:13:41.485412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:56.679412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'420","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465509+0000","last_change":"2024-09-05T00:49:29.904429+0000","last_active":"2024-09-05T02:13:50.465509+0000","last_peered":"2024-09-05T02:13:50.465509+0000","last_clean":"2024-09-05T02:13:50.465509+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:13:50.465509+0000","last_undegraded":"2024-09-05T02:13:50.465509+0000","last_fullsized":"2024-09-05T02:13:50.465509+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:12.986135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'295","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.769909+0000","last_change":"2024-09-05T00:49:27.881769+0000","last_active":"2024-09-05T02:16:21.769909+0000","last_peered":"2024-09-05T02:16:21.769909+0000","last_clean":"2024-09-05T02:16:21.769909+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:21.769909+0000","last_undegraded":"2024-09-05T02:16:21.769909+0000","last_fullsized":"2024-09-05T02:16:21.769909+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:21.143493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8478999,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":516,"num_read_kb":27594,"num_write":980,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.398020+0000","last_change":"2024-09-05T00:49:31.923706+0000","last_active":"2024-09-05T02:12:51.398020+0000","last_peered":"2024-09-05T02:12:51.398020+0000","last_clean":"2024-09-05T02:12:51.398020+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:12:51.398020+0000","last_undegraded":"2024-09-05T02:12:51.398020+0000","last_fullsized":"2024-09-05T02:12:51.398020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:07:49.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'334","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.028866+0000","last_change":"2024-09-05T00:49:33.917339+0000","last_active":"2024-09-05T02:16:21.028866+0000","last_peered":"2024-09-05T02:16:21.028866+0000","last_clean":"2024-09-05T02:16:21.028866+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:21.028866+0000","last_undegraded":"2024-09-05T02:16:21.028866+0000","last_fullsized":"2024-09-05T02:16:21.028866+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:34.348566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.770357+0000","last_change":"2024-09-05T00:49:35.924621+0000","last_active":"2024-09-05T02:12:06.770357+0000","last_peered":"2024-09-05T02:12:06.770357+0000","last_clean":"2024-09-05T02:12:06.770357+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:12:06.770357+0000","last_undegraded":"2024-09-05T02:12:06.770357+0000","last_fullsized":"2024-09-05T02:12:06.770357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:29.284134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.408737+0000","last_change":"2024-09-05T00:49:37.931246+0000","last_active":"2024-09-05T02:13:41.408737+0000","last_peered":"2024-09-05T02:13:41.408737+0000","last_clean":"2024-09-05T02:13:41.408737+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:13:41.408737+0000","last_undegraded":"2024-09-05T02:13:41.408737+0000","last_fullsized":"2024-09-05T02:13:41.408737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:20.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'493","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709348+0000","last_change":"2024-09-05T00:49:29.925442+0000","last_active":"2024-09-05T02:14:27.709348+0000","last_peered":"2024-09-05T02:14:27.709348+0000","last_clean":"2024-09-05T02:14:27.709348+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:14:27.709348+0000","last_undegraded":"2024-09-05T02:14:27.709348+0000","last_fullsized":"2024-09-05T02:14:27.709348+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:04.486708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'261","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.129143+0000","last_change":"2024-09-05T00:49:27.883246+0000","last_active":"2024-09-05T02:16:21.129143+0000","last_peered":"2024-09-05T02:16:21.129143+0000","last_clean":"2024-09-05T02:16:21.129143+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:21.129143+0000","last_undegraded":"2024-09-05T02:16:21.129143+0000","last_fullsized":"2024-09-05T02:16:21.129143+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:38:45.620263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16796977,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":391,"num_read_kb":39348,"num_write":910,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.204119+0000","last_change":"2024-09-05T00:49:31.923994+0000","last_active":"2024-09-05T02:12:01.204119+0000","last_peered":"2024-09-05T02:12:01.204119+0000","last_clean":"2024-09-05T02:12:01.204119+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:12:01.204119+0000","last_undegraded":"2024-09-05T02:12:01.204119+0000","last_fullsized":"2024-09-05T02:12:01.204119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:56.251468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'316","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.653932+0000","last_change":"2024-09-05T00:49:34.055772+0000","last_active":"2024-09-05T02:15:49.653932+0000","last_peered":"2024-09-05T02:15:49.653932+0000","last_clean":"2024-09-05T02:15:49.653932+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:15:49.653932+0000","last_undegraded":"2024-09-05T02:15:49.653932+0000","last_fullsized":"2024-09-05T02:15:49.653932+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:58.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56876,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":1086,"num_write":426,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.792016+0000","last_change":"2024-09-05T00:49:35.935059+0000","last_active":"2024-09-05T02:13:46.792016+0000","last_peered":"2024-09-05T02:13:46.792016+0000","last_clean":"2024-09-05T02:13:46.792016+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:13:46.792016+0000","last_undegraded":"2024-09-05T02:13:46.792016+0000","last_fullsized":"2024-09-05T02:13:46.792016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:18:31.249785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'106","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.686139+0000","last_change":"2024-09-05T00:49:37.938971+0000","last_active":"2024-09-05T02:15:49.686139+0000","last_peered":"2024-09-05T02:15:49.686139+0000","last_clean":"2024-09-05T02:15:49.686139+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:15:49.686139+0000","last_undegraded":"2024-09-05T02:15:49.686139+0000","last_fullsized":"2024-09-05T02:15:49.686139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:26.724944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.621488+0000","last_change":"2024-09-05T00:49:29.900558+0000","last_active":"2024-09-05T02:15:48.621488+0000","last_peered":"2024-09-05T02:15:48.621488+0000","last_clean":"2024-09-05T02:15:48.621488+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:15:48.621488+0000","last_undegraded":"2024-09-05T02:15:48.621488+0000","last_fullsized":"2024-09-05T02:15:48.621488+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:58:48.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'327","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.822756+0000","last_change":"2024-09-05T00:49:27.876740+0000","last_active":"2024-09-05T02:13:36.822756+0000","last_peered":"2024-09-05T02:13:36.822756+0000","last_clean":"2024-09-05T02:13:36.822756+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:13:36.822756+0000","last_undegraded":"2024-09-05T02:13:36.822756+0000","last_fullsized":"2024-09-05T02:13:36.822756+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:04:11.453294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6975197,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":670,"num_read_kb":25028,"num_write":1187,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.769113+0000","last_change":"2024-09-05T00:49:31.926005+0000","last_active":"2024-09-05T02:12:01.769113+0000","last_peered":"2024-09-05T02:12:01.769113+0000","last_clean":"2024-09-05T02:12:01.769113+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:12:01.769113+0000","last_undegraded":"2024-09-05T02:12:01.769113+0000","last_fullsized":"2024-09-05T02:12:01.769113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:56.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228677+0000","last_change":"2024-09-05T00:49:34.053064+0000","last_active":"2024-09-05T02:13:51.228677+0000","last_peered":"2024-09-05T02:13:51.228677+0000","last_clean":"2024-09-05T02:13:51.228677+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:13:51.228677+0000","last_undegraded":"2024-09-05T02:13:51.228677+0000","last_fullsized":"2024-09-05T02:13:51.228677+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:16.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'769","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.829636+0000","last_change":"2024-09-05T00:49:35.932657+0000","last_active":"2024-09-05T02:16:20.829636+0000","last_peered":"2024-09-05T02:16:20.829636+0000","last_clean":"2024-09-05T02:16:20.829636+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:20.829636+0000","last_undegraded":"2024-09-05T02:16:20.829636+0000","last_fullsized":"2024-09-05T02:16:20.829636+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:55.080143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.628035+0000","last_change":"2024-09-05T00:49:37.942533+0000","last_active":"2024-09-05T02:13:41.628035+0000","last_peered":"2024-09-05T02:13:41.628035+0000","last_clean":"2024-09-05T02:13:41.628035+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:13:41.628035+0000","last_undegraded":"2024-09-05T02:13:41.628035+0000","last_fullsized":"2024-09-05T02:13:41.628035+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:02:29.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'867","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629749+0000","last_change":"2024-09-05T00:49:29.918570+0000","last_active":"2024-09-05T02:14:29.629749+0000","last_peered":"2024-09-05T02:14:29.629749+0000","last_clean":"2024-09-05T02:14:29.629749+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:14:29.629749+0000","last_undegraded":"2024-09-05T02:14:29.629749+0000","last_fullsized":"2024-09-05T02:14:29.629749+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:50.098868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'228","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:13.557049+0000","last_change":"2024-09-05T00:49:27.898399+0000","last_active":"2024-09-05T02:13:13.557049+0000","last_peered":"2024-09-05T02:13:13.557049+0000","last_clean":"2024-09-05T02:13:13.557049+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:13:13.557049+0000","last_undegraded":"2024-09-05T02:13:13.557049+0000","last_fullsized":"2024-09-05T02:13:13.557049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:30.481449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594706,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":6339,"num_write":813,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.814573+0000","last_change":"2024-09-05T00:49:31.924947+0000","last_active":"2024-09-05T02:12:01.814573+0000","last_peered":"2024-09-05T02:12:01.814573+0000","last_clean":"2024-09-05T02:12:01.814573+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:12:01.814573+0000","last_undegraded":"2024-09-05T02:12:01.814573+0000","last_fullsized":"2024-09-05T02:12:01.814573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:00:06.551471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'377","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:35.236621+0000","last_change":"2024-09-05T00:49:33.910494+0000","last_active":"2024-09-05T02:14:35.236621+0000","last_peered":"2024-09-05T02:14:35.236621+0000","last_clean":"2024-09-05T02:14:35.236621+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:14:35.236621+0000","last_undegraded":"2024-09-05T02:14:35.236621+0000","last_fullsized":"2024-09-05T02:14:35.236621+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:46.890368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":1163,"num_write":484,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.434154+0000","last_change":"2024-09-05T00:49:35.941463+0000","last_active":"2024-09-05T02:11:45.434154+0000","last_peered":"2024-09-05T02:11:45.434154+0000","last_clean":"2024-09-05T02:11:45.434154+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:11:45.434154+0000","last_undegraded":"2024-09-05T02:11:45.434154+0000","last_fullsized":"2024-09-05T02:11:45.434154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:14.296731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'194","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.273394+0000","last_change":"2024-09-05T00:49:37.946192+0000","last_active":"2024-09-05T02:14:25.273394+0000","last_peered":"2024-09-05T02:14:25.273394+0000","last_clean":"2024-09-05T02:14:25.273394+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:14:25.273394+0000","last_undegraded":"2024-09-05T02:14:25.273394+0000","last_fullsized":"2024-09-05T02:14:25.273394+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:46.109450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'731","reported_seq":2519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842408+0000","last_change":"2024-09-05T00:49:29.916165+0000","last_active":"2024-09-05T02:14:19.842408+0000","last_peered":"2024-09-05T02:14:19.842408+0000","last_clean":"2024-09-05T02:14:19.842408+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:14:19.842408+0000","last_undegraded":"2024-09-05T02:14:19.842408+0000","last_fullsized":"2024-09-05T02:14:19.842408+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:54:04.834607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'331","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:38.279130+0000","last_change":"2024-09-05T00:49:27.889993+0000","last_active":"2024-09-05T02:15:38.279130+0000","last_peered":"2024-09-05T02:15:38.279130+0000","last_clean":"2024-09-05T02:15:38.279130+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:15:38.279130+0000","last_undegraded":"2024-09-05T02:15:38.279130+0000","last_fullsized":"2024-09-05T02:15:38.279130+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:01.461692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33961747,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":573,"num_read_kb":137825,"num_write":1239,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"35'3","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.529188+0000","last_change":"2024-09-05T00:49:31.903883+0000","last_active":"2024-09-05T02:15:49.529188+0000","last_peered":"2024-09-05T02:15:49.529188+0000","last_clean":"2024-09-05T02:15:49.529188+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:15:49.529188+0000","last_undegraded":"2024-09-05T02:15:49.529188+0000","last_fullsized":"2024-09-05T02:15:49.529188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:46.830057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'295","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.469993+0000","last_change":"2024-09-05T00:49:33.909608+0000","last_active":"2024-09-05T02:14:10.469993+0000","last_peered":"2024-09-05T02:14:10.469993+0000","last_clean":"2024-09-05T02:14:10.469993+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:14:10.469993+0000","last_undegraded":"2024-09-05T02:14:10.469993+0000","last_fullsized":"2024-09-05T02:14:10.469993+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:02.770171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57219,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1019,"num_write":396,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.388458+0000","last_change":"2024-09-05T00:49:35.941006+0000","last_active":"2024-09-05T02:12:06.388458+0000","last_peered":"2024-09-05T02:12:06.388458+0000","last_clean":"2024-09-05T02:12:06.388458+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:12:06.388458+0000","last_undegraded":"2024-09-05T02:12:06.388458+0000","last_fullsized":"2024-09-05T02:12:06.388458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:09.389985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.457891+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:11:51.457891+0000","last_peered":"2024-09-05T02:11:51.457891+0000","last_clean":"2024-09-05T02:11:51.457891+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:11:51.457891+0000","last_undegraded":"2024-09-05T02:11:51.457891+0000","last_fullsized":"2024-09-05T02:11:51.457891+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:49.316615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'474","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709554+0000","last_change":"2024-09-05T00:49:29.913963+0000","last_active":"2024-09-05T02:14:27.709554+0000","last_peered":"2024-09-05T02:14:27.709554+0000","last_clean":"2024-09-05T02:14:27.709554+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:14:27.709554+0000","last_undegraded":"2024-09-05T02:14:27.709554+0000","last_fullsized":"2024-09-05T02:14:27.709554+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:53.563132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'268","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451565+0000","last_change":"2024-09-05T00:49:27.884322+0000","last_active":"2024-09-05T02:16:21.451565+0000","last_peered":"2024-09-05T02:16:21.451565+0000","last_clean":"2024-09-05T02:16:21.451565+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:21.451565+0000","last_undegraded":"2024-09-05T02:16:21.451565+0000","last_fullsized":"2024-09-05T02:16:21.451565+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:06.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564123,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":370,"num_read_kb":12831,"num_write":964,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.199016+0000","last_change":"2024-09-05T00:49:31.918942+0000","last_active":"2024-09-05T02:11:41.199016+0000","last_peered":"2024-09-05T02:11:41.199016+0000","last_clean":"2024-09-05T02:11:41.199016+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:11:41.199016+0000","last_undegraded":"2024-09-05T02:11:41.199016+0000","last_fullsized":"2024-09-05T02:11:41.199016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:32.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'261","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.648988+0000","last_change":"2024-09-05T00:49:33.927237+0000","last_active":"2024-09-05T02:15:49.648988+0000","last_peered":"2024-09-05T02:15:49.648988+0000","last_clean":"2024-09-05T02:15:49.648988+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:15:49.648988+0000","last_undegraded":"2024-09-05T02:15:49.648988+0000","last_fullsized":"2024-09-05T02:15:49.648988+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:38:43.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":954,"num_write":352,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.205283+0000","last_change":"2024-09-05T00:49:35.925928+0000","last_active":"2024-09-05T02:12:06.205283+0000","last_peered":"2024-09-05T02:12:06.205283+0000","last_clean":"2024-09-05T02:12:06.205283+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:12:06.205283+0000","last_undegraded":"2024-09-05T02:12:06.205283+0000","last_fullsized":"2024-09-05T02:12:06.205283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:21.943807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'165","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.053963+0000","last_change":"2024-09-05T00:49:37.943592+0000","last_active":"2024-09-05T02:14:29.053963+0000","last_peered":"2024-09-05T02:14:29.053963+0000","last_clean":"2024-09-05T02:14:29.053963+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:14:29.053963+0000","last_undegraded":"2024-09-05T02:14:29.053963+0000","last_fullsized":"2024-09-05T02:14:29.053963+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:04.586566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'343","reported_seq":1852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.232009+0000","last_change":"2024-09-05T00:49:29.916442+0000","last_active":"2024-09-05T02:14:06.232009+0000","last_peered":"2024-09-05T02:14:06.232009+0000","last_clean":"2024-09-05T02:14:06.232009+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:14:06.232009+0000","last_undegraded":"2024-09-05T02:14:06.232009+0000","last_fullsized":"2024-09-05T02:14:06.232009+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:01:17.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'279","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:40.213892+0000","last_change":"2024-09-05T00:49:27.894135+0000","last_active":"2024-09-05T02:15:40.213892+0000","last_peered":"2024-09-05T02:15:40.213892+0000","last_clean":"2024-09-05T02:15:40.213892+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:15:40.213892+0000","last_undegraded":"2024-09-05T02:15:40.213892+0000","last_fullsized":"2024-09-05T02:15:40.213892+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:13:02.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826177,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":431,"num_read_kb":8852,"num_write":1022,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766535+0000","last_change":"2024-09-05T00:49:31.903736+0000","last_active":"2024-09-05T02:11:51.766535+0000","last_peered":"2024-09-05T02:11:51.766535+0000","last_clean":"2024-09-05T02:11:51.766535+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:11:51.766535+0000","last_undegraded":"2024-09-05T02:11:51.766535+0000","last_fullsized":"2024-09-05T02:11:51.766535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:35.531703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'333","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.654924+0000","last_change":"2024-09-05T00:49:33.908269+0000","last_active":"2024-09-05T02:15:49.654924+0000","last_peered":"2024-09-05T02:15:49.654924+0000","last_clean":"2024-09-05T02:15:49.654924+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:15:49.654924+0000","last_undegraded":"2024-09-05T02:15:49.654924+0000","last_fullsized":"2024-09-05T02:15:49.654924+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:50.246291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":1037,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.439359+0000","last_change":"2024-09-05T00:49:35.940921+0000","last_active":"2024-09-05T02:12:05.439359+0000","last_peered":"2024-09-05T02:12:05.439359+0000","last_clean":"2024-09-05T02:12:05.439359+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:12:05.439359+0000","last_undegraded":"2024-09-05T02:12:05.439359+0000","last_fullsized":"2024-09-05T02:12:05.439359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:45:23.954287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.723417+0000","last_change":"2024-09-05T00:49:37.929472+0000","last_active":"2024-09-05T02:15:48.723417+0000","last_peered":"2024-09-05T02:15:48.723417+0000","last_clean":"2024-09-05T02:15:48.723417+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:15:48.723417+0000","last_undegraded":"2024-09-05T02:15:48.723417+0000","last_fullsized":"2024-09-05T02:15:48.723417+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:25.886624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'429","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.624104+0000","last_change":"2024-09-05T00:49:29.892206+0000","last_active":"2024-09-05T02:14:29.624104+0000","last_peered":"2024-09-05T02:14:29.624104+0000","last_clean":"2024-09-05T02:14:29.624104+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:14:29.624104+0000","last_undegraded":"2024-09-05T02:14:29.624104+0000","last_fullsized":"2024-09-05T02:14:29.624104+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:04.846605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'301","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.154241+0000","last_change":"2024-09-05T00:49:27.897228+0000","last_active":"2024-09-05T02:16:21.154241+0000","last_peered":"2024-09-05T02:16:21.154241+0000","last_clean":"2024-09-05T02:16:21.154241+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:21.154241+0000","last_undegraded":"2024-09-05T02:16:21.154241+0000","last_fullsized":"2024-09-05T02:16:21.154241+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:59.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353533,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":420,"num_read_kb":8853,"num_write":1067,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1142","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794691+0000","last_change":"2024-09-05T00:49:29.906381+0000","last_active":"2024-09-05T02:14:01.794691+0000","last_peered":"2024-09-05T02:14:01.794691+0000","last_clean":"2024-09-05T02:14:01.794691+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:14:01.794691+0000","last_undegraded":"2024-09-05T02:14:01.794691+0000","last_fullsized":"2024-09-05T02:14:01.794691+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:43.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'288","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.389582+0000","last_change":"2024-09-05T00:50:04.182383+0000","last_active":"2024-09-05T02:16:21.389582+0000","last_peered":"2024-09-05T02:16:21.389582+0000","last_clean":"2024-09-05T02:16:21.389582+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:21.389582+0000","last_undegraded":"2024-09-05T02:16:21.389582+0000","last_fullsized":"2024-09-05T02:16:21.389582+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:45.984207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12240060,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":464,"num_read_kb":102142,"num_write":1086,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228410+0000","last_change":"2024-09-05T00:49:29.905701+0000","last_active":"2024-09-05T02:14:00.228410+0000","last_peered":"2024-09-05T02:14:00.228410+0000","last_clean":"2024-09-05T02:14:00.228410+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:14:00.228410+0000","last_undegraded":"2024-09-05T02:14:00.228410+0000","last_fullsized":"2024-09-05T02:14:00.228410+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:35:29.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.211786+0000","last_change":"2024-09-05T00:49:27.894703+0000","last_active":"2024-09-05T02:12:50.211786+0000","last_peered":"2024-09-05T02:12:50.211786+0000","last_clean":"2024-09-05T02:12:50.211786+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:12:50.211786+0000","last_undegraded":"2024-09-05T02:12:50.211786+0000","last_fullsized":"2024-09-05T02:12:50.211786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:39.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":377,"num_read_kb":406,"num_write":922,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'414","reported_seq":1989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794636+0000","last_change":"2024-09-05T00:49:29.909413+0000","last_active":"2024-09-05T02:14:01.794636+0000","last_peered":"2024-09-05T02:14:01.794636+0000","last_clean":"2024-09-05T02:14:01.794636+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:14:01.794636+0000","last_undegraded":"2024-09-05T02:14:01.794636+0000","last_fullsized":"2024-09-05T02:14:01.794636+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:27.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'248","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455656+0000","last_change":"2024-09-05T00:49:27.869339+0000","last_active":"2024-09-05T02:13:10.455656+0000","last_peered":"2024-09-05T02:13:10.455656+0000","last_clean":"2024-09-05T02:13:10.455656+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:13:10.455656+0000","last_undegraded":"2024-09-05T02:13:10.455656+0000","last_fullsized":"2024-09-05T02:13:10.455656+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:57.416708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403003,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":671,"num_read_kb":8225,"num_write":936,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1680","reported_seq":3527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.613554+0000","last_change":"2024-09-05T00:49:29.928238+0000","last_active":"2024-09-05T02:15:48.613554+0000","last_peered":"2024-09-05T02:15:48.613554+0000","last_clean":"2024-09-05T02:15:48.613554+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:15:48.613554+0000","last_undegraded":"2024-09-05T02:15:48.613554+0000","last_fullsized":"2024-09-05T02:15:48.613554+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:49.778085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'311","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.470906+0000","last_change":"2024-09-05T00:49:27.883474+0000","last_active":"2024-09-05T02:16:21.470906+0000","last_peered":"2024-09-05T02:16:21.470906+0000","last_clean":"2024-09-05T02:16:21.470906+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:21.470906+0000","last_undegraded":"2024-09-05T02:16:21.470906+0000","last_fullsized":"2024-09-05T02:16:21.470906+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:51.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27293344,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":491,"num_read_kb":75262,"num_write":1022,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'622","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.857581+0000","last_change":"2024-09-05T00:49:29.911388+0000","last_active":"2024-09-05T02:13:32.857581+0000","last_peered":"2024-09-05T02:13:32.857581+0000","last_clean":"2024-09-05T02:13:32.857581+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:13:32.857581+0000","last_undegraded":"2024-09-05T02:13:32.857581+0000","last_fullsized":"2024-09-05T02:13:32.857581+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:27.266690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'314","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.730835+0000","last_change":"2024-09-05T00:49:27.884310+0000","last_active":"2024-09-05T02:16:21.730835+0000","last_peered":"2024-09-05T02:16:21.730835+0000","last_clean":"2024-09-05T02:16:21.730835+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:21.730835+0000","last_undegraded":"2024-09-05T02:16:21.730835+0000","last_fullsized":"2024-09-05T02:16:21.730835+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:03.108303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22777162,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":490,"num_read_kb":27141,"num_write":1080,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'683","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.629116+0000","last_change":"2024-09-05T00:49:29.925070+0000","last_active":"2024-09-05T02:15:48.629116+0000","last_peered":"2024-09-05T02:15:48.629116+0000","last_clean":"2024-09-05T02:15:48.629116+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:15:48.629116+0000","last_undegraded":"2024-09-05T02:15:48.629116+0000","last_fullsized":"2024-09-05T02:15:48.629116+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:33.562310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'323","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.208857+0000","last_change":"2024-09-05T00:49:27.909574+0000","last_active":"2024-09-05T02:16:21.208857+0000","last_peered":"2024-09-05T02:16:21.208857+0000","last_clean":"2024-09-05T02:16:21.208857+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:21.208857+0000","last_undegraded":"2024-09-05T02:16:21.208857+0000","last_fullsized":"2024-09-05T02:16:21.208857+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:51.020169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266199,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":540,"num_read_kb":10940,"num_write":1226,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'476","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.888825+0000","last_change":"2024-09-05T00:49:29.888887+0000","last_active":"2024-09-05T02:13:37.888825+0000","last_peered":"2024-09-05T02:13:37.888825+0000","last_clean":"2024-09-05T02:13:37.888825+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:13:37.888825+0000","last_undegraded":"2024-09-05T02:13:37.888825+0000","last_fullsized":"2024-09-05T02:13:37.888825+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:05.114720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'301","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.510833+0000","last_change":"2024-09-05T00:49:27.886848+0000","last_active":"2024-09-05T02:16:21.510833+0000","last_peered":"2024-09-05T02:16:21.510833+0000","last_clean":"2024-09-05T02:16:21.510833+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:21.510833+0000","last_undegraded":"2024-09-05T02:16:21.510833+0000","last_fullsized":"2024-09-05T02:16:21.510833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:26.738479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11790648,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":445,"num_read_kb":29009,"num_write":1154,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1109","reported_seq":2750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701677+0000","last_change":"2024-09-05T00:49:29.915871+0000","last_active":"2024-09-05T02:14:27.701677+0000","last_peered":"2024-09-05T02:14:27.701677+0000","last_clean":"2024-09-05T02:14:27.701677+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:14:27.701677+0000","last_undegraded":"2024-09-05T02:14:27.701677+0000","last_fullsized":"2024-09-05T02:14:27.701677+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:08:29.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'298","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:41.118507+0000","last_change":"2024-09-05T00:49:27.889044+0000","last_active":"2024-09-05T02:15:41.118507+0000","last_peered":"2024-09-05T02:15:41.118507+0000","last_clean":"2024-09-05T02:15:41.118507+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:15:41.118507+0000","last_undegraded":"2024-09-05T02:15:41.118507+0000","last_fullsized":"2024-09-05T02:15:41.118507+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:10.256222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706729,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":551,"num_read_kb":61900,"num_write":1086,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'619","reported_seq":2294,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.905447+0000","last_change":"2024-09-05T00:49:29.912552+0000","last_active":"2024-09-05T02:13:45.905447+0000","last_peered":"2024-09-05T02:13:45.905447+0000","last_clean":"2024-09-05T02:13:45.905447+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:13:45.905447+0000","last_undegraded":"2024-09-05T02:13:45.905447+0000","last_fullsized":"2024-09-05T02:13:45.905447+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":600,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:05.014550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'293","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.454721+0000","last_change":"2024-09-05T00:49:27.886360+0000","last_active":"2024-09-05T02:16:21.454721+0000","last_peered":"2024-09-05T02:16:21.454721+0000","last_clean":"2024-09-05T02:16:21.454721+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:21.454721+0000","last_undegraded":"2024-09-05T02:16:21.454721+0000","last_fullsized":"2024-09-05T02:16:21.454721+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:15:32.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7002703,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":440,"num_read_kb":25095,"num_write":1114,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'540","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.636487+0000","last_change":"2024-09-05T00:49:29.898543+0000","last_active":"2024-09-05T02:15:48.636487+0000","last_peered":"2024-09-05T02:15:48.636487+0000","last_clean":"2024-09-05T02:15:48.636487+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:15:48.636487+0000","last_undegraded":"2024-09-05T02:15:48.636487+0000","last_fullsized":"2024-09-05T02:15:48.636487+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:11.197697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'342","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.373973+0000","last_change":"2024-09-05T00:50:04.181293+0000","last_active":"2024-09-05T02:16:21.373973+0000","last_peered":"2024-09-05T02:16:21.373973+0000","last_clean":"2024-09-05T02:16:21.373973+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:21.373973+0000","last_undegraded":"2024-09-05T02:16:21.373973+0000","last_fullsized":"2024-09-05T02:16:21.373973+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:31.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10998355,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":580,"num_read_kb":5699,"num_write":1187,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1184","reported_seq":2835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.896967+0000","last_change":"2024-09-05T00:49:29.914676+0000","last_active":"2024-09-05T02:13:37.896967+0000","last_peered":"2024-09-05T02:13:37.896967+0000","last_clean":"2024-09-05T02:13:37.896967+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:13:37.896967+0000","last_undegraded":"2024-09-05T02:13:37.896967+0000","last_fullsized":"2024-09-05T02:13:37.896967+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:02.143783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449787+0000","last_change":"2024-09-05T00:49:27.905936+0000","last_active":"2024-09-05T02:12:45.449787+0000","last_peered":"2024-09-05T02:12:45.449787+0000","last_clean":"2024-09-05T02:12:45.449787+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:12:45.449787+0000","last_undegraded":"2024-09-05T02:12:45.449787+0000","last_fullsized":"2024-09-05T02:12:45.449787+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:06.100911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18301850,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":546,"num_read_kb":5076,"num_write":1140,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'490","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623799+0000","last_change":"2024-09-05T00:49:29.925901+0000","last_active":"2024-09-05T02:14:29.623799+0000","last_peered":"2024-09-05T02:14:29.623799+0000","last_clean":"2024-09-05T02:14:29.623799+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:14:29.623799+0000","last_undegraded":"2024-09-05T02:14:29.623799+0000","last_fullsized":"2024-09-05T02:14:29.623799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:36.737428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'316","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.210869+0000","last_change":"2024-09-05T00:49:27.888664+0000","last_active":"2024-09-05T02:16:21.210869+0000","last_peered":"2024-09-05T02:16:21.210869+0000","last_clean":"2024-09-05T02:16:21.210869+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:21.210869+0000","last_undegraded":"2024-09-05T02:16:21.210869+0000","last_fullsized":"2024-09-05T02:16:21.210869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:01.736837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6938143,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":31375,"num_write":1232,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'686","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449674+0000","last_change":"2024-09-05T00:49:29.922331+0000","last_active":"2024-09-05T02:12:45.449674+0000","last_peered":"2024-09-05T02:12:45.449674+0000","last_clean":"2024-09-05T02:12:45.449674+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:12:45.449674+0000","last_undegraded":"2024-09-05T02:12:45.449674+0000","last_fullsized":"2024-09-05T02:12:45.449674+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:17:15.909498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'299","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.655685+0000","last_change":"2024-09-05T00:49:27.912949+0000","last_active":"2024-09-05T02:16:21.655685+0000","last_peered":"2024-09-05T02:16:21.655685+0000","last_clean":"2024-09-05T02:16:21.655685+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:21.655685+0000","last_undegraded":"2024-09-05T02:16:21.655685+0000","last_fullsized":"2024-09-05T02:16:21.655685+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:24.446425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10555908,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":507,"num_read_kb":11102,"num_write":1089,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'522","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629988+0000","last_change":"2024-09-05T00:49:29.915489+0000","last_active":"2024-09-05T02:14:29.629988+0000","last_peered":"2024-09-05T02:14:29.629988+0000","last_clean":"2024-09-05T02:14:29.629988+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:14:29.629988+0000","last_undegraded":"2024-09-05T02:14:29.629988+0000","last_fullsized":"2024-09-05T02:14:29.629988+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:16.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.387890+0000","last_change":"2024-09-05T00:49:27.888381+0000","last_active":"2024-09-05T02:16:21.387890+0000","last_peered":"2024-09-05T02:16:21.387890+0000","last_clean":"2024-09-05T02:16:21.387890+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:21.387890+0000","last_undegraded":"2024-09-05T02:16:21.387890+0000","last_fullsized":"2024-09-05T02:16:21.387890+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:03.147163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471666,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":478,"num_read_kb":115088,"num_write":1004,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.061843+0000","last_change":"2024-09-05T00:49:29.922395+0000","last_active":"2024-09-05T02:13:56.061843+0000","last_peered":"2024-09-05T02:13:56.061843+0000","last_clean":"2024-09-05T02:13:56.061843+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:13:56.061843+0000","last_undegraded":"2024-09-05T02:13:56.061843+0000","last_fullsized":"2024-09-05T02:13:56.061843+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:27.332843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'246","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.798661+0000","last_change":"2024-09-05T00:49:27.915755+0000","last_active":"2024-09-05T02:13:36.798661+0000","last_peered":"2024-09-05T02:13:36.798661+0000","last_clean":"2024-09-05T02:13:36.798661+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:13:36.798661+0000","last_undegraded":"2024-09-05T02:13:36.798661+0000","last_fullsized":"2024-09-05T02:13:36.798661+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:24.744189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10995013,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":382,"num_read_kb":641,"num_write":977,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'351","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:42.970298+0000","last_change":"2024-09-05T00:49:27.900502+0000","last_active":"2024-09-05T02:13:42.970298+0000","last_peered":"2024-09-05T02:13:42.970298+0000","last_clean":"2024-09-05T02:13:42.970298+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:13:42.970298+0000","last_undegraded":"2024-09-05T02:13:42.970298+0000","last_fullsized":"2024-09-05T02:13:42.970298+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:21:36.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9688004,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":674,"num_read_kb":35469,"num_write":1219,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'402","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.580490+0000","last_change":"2024-09-05T00:49:29.916741+0000","last_active":"2024-09-05T02:14:29.580490+0000","last_peered":"2024-09-05T02:14:29.580490+0000","last_clean":"2024-09-05T02:14:29.580490+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:14:29.580490+0000","last_undegraded":"2024-09-05T02:14:29.580490+0000","last_fullsized":"2024-09-05T02:14:29.580490+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:48.147595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'321","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.790856+0000","last_change":"2024-09-05T00:49:27.885362+0000","last_active":"2024-09-05T02:16:21.790856+0000","last_peered":"2024-09-05T02:16:21.790856+0000","last_clean":"2024-09-05T02:16:21.790856+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:21.790856+0000","last_undegraded":"2024-09-05T02:16:21.790856+0000","last_fullsized":"2024-09-05T02:16:21.790856+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:17.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409052,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":434,"num_read_kb":26073,"num_write":1141,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'871","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844564+0000","last_change":"2024-09-05T00:49:29.908617+0000","last_active":"2024-09-05T02:13:40.844564+0000","last_peered":"2024-09-05T02:13:40.844564+0000","last_clean":"2024-09-05T02:13:40.844564+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:13:40.844564+0000","last_undegraded":"2024-09-05T02:13:40.844564+0000","last_fullsized":"2024-09-05T02:13:40.844564+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:37.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":642,"ondisk_log_size":642,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1787069,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19479,"num_read_kb":36985,"num_write":16369,"num_write_kb":12025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2686976,"data_stored":2216074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1729,"ondisk_log_size":1729,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4136,"ondisk_log_size":4136,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":511400498,"num_objects":3703,"num_object_clones":0,"num_object_copies":7406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3703,"num_whiteouts":0,"num_read":32753,"num_read_kb":2043732,"num_write":68457,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1010569216,"data_stored":983172905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4114,"ondisk_log_size":4114,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":57813924,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":117,"num_read_kb":174352,"num_write":137,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":111443968,"data_stored":111433544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49425316,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":117,"num_read_kb":174298,"num_write":139,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96710656,"data_stored":96703021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472292,"kb_used_data":198080,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93899548,"statfs":{"total":96636764160,"available":96153137152,"internally_reserved":0,"allocated":202833920,"data_stored":197035027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510492,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342692,"kb_used_data":122708,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94029148,"statfs":{"total":96636764160,"available":96285847552,"internally_reserved":0,"allocated":125652992,"data_stored":121198204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510489,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":233024,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":238616576,"data_stored":232309463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510493,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547560,"kb_used_data":273496,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93824280,"statfs":{"total":96636764160,"available":96076062720,"internally_reserved":0,"allocated":280059904,"data_stored":273792646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510491,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207432,"kb_used_data":118008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94164408,"statfs":{"total":96636764160,"available":96424353792,"internally_reserved":0,"allocated":120840192,"data_stored":116462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287660,"kb_used_data":135732,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94084180,"statfs":{"total":96636764160,"available":96342200320,"internally_reserved":0,"allocated":138989568,"data_stored":134977591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543195,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":177840,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":182108160,"data_stored":175714227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543196,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443472,"kb_used_data":199936,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93928368,"statfs":{"total":96636764160,"available":96182648832,"internally_reserved":0,"allocated":204734464,"data_stored":198151379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167403520,"data_stored":162409480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98988032,"data_stored":97079602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77041664,"data_stored":74827789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145481728,"data_stored":141924390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":198594560,"data_stored":194324063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":154648576,"data_stored":149855918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68902912,"data_stored":66308087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":99508224,"data_stored":96443576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":355649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":262269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":123211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":348292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":85782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":659456,"data_stored":554892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":307358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26357760,"data_stored":26353431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5337088,"data_stored":5334665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17870848,"data_stored":17869150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44130304,"data_stored":44128764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":9487643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:16:23.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:16:23.799 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:23.812 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:16:23.822 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2872,"stamp":"2024-09-05T02:16:22.502599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":621034432,"num_objects":4225,"num_object_clones":0,"num_object_copies":8450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4225,"num_whiteouts":0,"num_read":288801,"num_read_kb":2645314,"num_write":159268,"num_write_kb":2503539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13749,"ondisk_log_size":13749,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2904772,"kb_used_data":1458824,"kb_used_omap":12,"kb_used_meta":1445683,"kb_avail":752069948,"statfs":{"total":773094113280,"available":770119626752,"internally_reserved":0,"allocated":1493835776,"data_stored":1449641121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1480379952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-107280603,"num_objects":-698,"num_object_clones":0,"num_object_copies":-1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-698,"num_whiteouts":0,"num_read":804,"num_read_kb":850,"num_write":752,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008088"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200116+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:12:00.200116+0000","last_peered":"2024-09-05T02:12:00.200116+0000","last_clean":"2024-09-05T02:12:00.200116+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:12:00.200116+0000","last_undegraded":"2024-09-05T02:12:00.200116+0000","last_fullsized":"2024-09-05T02:12:00.200116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:56.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459278+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:11:56.459278+0000","last_peered":"2024-09-05T02:11:56.459278+0000","last_clean":"2024-09-05T02:11:56.459278+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:11:56.459278+0000","last_undegraded":"2024-09-05T02:11:56.459278+0000","last_fullsized":"2024-09-05T02:11:56.459278+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:52:17.217061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375602+0000","last_change":"2024-09-05T01:30:15.667346+0000","last_active":"2024-09-05T02:12:46.375602+0000","last_peered":"2024-09-05T02:12:46.375602+0000","last_clean":"2024-09-05T02:12:46.375602+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:12:46.375602+0000","last_undegraded":"2024-09-05T02:12:46.375602+0000","last_fullsized":"2024-09-05T02:12:46.375602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:40.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.202821+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:11:56.202821+0000","last_peered":"2024-09-05T02:11:56.202821+0000","last_clean":"2024-09-05T02:11:56.202821+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:11:56.202821+0000","last_undegraded":"2024-09-05T02:11:56.202821+0000","last_fullsized":"2024-09-05T02:11:56.202821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:01.475308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766667+0000","last_change":"2024-09-05T01:09:22.194515+0000","last_active":"2024-09-05T02:11:51.766667+0000","last_peered":"2024-09-05T02:11:51.766667+0000","last_clean":"2024-09-05T02:11:51.766667+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:11:51.766667+0000","last_undegraded":"2024-09-05T02:11:51.766667+0000","last_fullsized":"2024-09-05T02:11:51.766667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:51.467116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.381829+0000","last_change":"2024-09-05T01:05:07.120154+0000","last_active":"2024-09-05T02:13:16.381829+0000","last_peered":"2024-09-05T02:13:16.381829+0000","last_clean":"2024-09-05T02:13:16.381829+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:13:16.381829+0000","last_undegraded":"2024-09-05T02:13:16.381829+0000","last_fullsized":"2024-09-05T02:13:16.381829+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:15.466155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468968+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:14:05.468968+0000","last_peered":"2024-09-05T02:14:05.468968+0000","last_clean":"2024-09-05T02:14:05.468968+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:14:05.468968+0000","last_undegraded":"2024-09-05T02:14:05.468968+0000","last_fullsized":"2024-09-05T02:14:05.468968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":53,"num_write":3,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.384719+0000","last_change":"2024-09-05T01:09:22.189240+0000","last_active":"2024-09-05T02:13:31.384719+0000","last_peered":"2024-09-05T02:13:31.384719+0000","last_clean":"2024-09-05T02:13:31.384719+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:13:31.384719+0000","last_undegraded":"2024-09-05T02:13:31.384719+0000","last_fullsized":"2024-09-05T02:13:31.384719+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:27.906635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448662+0000","last_change":"2024-09-05T01:05:07.099663+0000","last_active":"2024-09-05T02:12:40.448662+0000","last_peered":"2024-09-05T02:12:40.448662+0000","last_clean":"2024-09-05T02:12:40.448662+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:12:40.448662+0000","last_undegraded":"2024-09-05T02:12:40.448662+0000","last_fullsized":"2024-09-05T02:12:40.448662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:05.063618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467527+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:12:26.467527+0000","last_peered":"2024-09-05T02:12:26.467527+0000","last_clean":"2024-09-05T02:12:26.467527+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:12:26.467527+0000","last_undegraded":"2024-09-05T02:12:26.467527+0000","last_fullsized":"2024-09-05T02:12:26.467527+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209385+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:12:40.209385+0000","last_peered":"2024-09-05T02:12:40.209385+0000","last_clean":"2024-09-05T02:12:40.209385+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:12:40.209385+0000","last_undegraded":"2024-09-05T02:12:40.209385+0000","last_fullsized":"2024-09-05T02:12:40.209385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441829+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:12:15.441829+0000","last_peered":"2024-09-05T02:12:15.441829+0000","last_clean":"2024-09-05T02:12:15.441829+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:12:15.441829+0000","last_undegraded":"2024-09-05T02:12:15.441829+0000","last_fullsized":"2024-09-05T02:12:15.441829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:48.174424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390642+0000","last_change":"2024-09-05T01:09:26.324652+0000","last_active":"2024-09-05T02:12:16.390642+0000","last_peered":"2024-09-05T02:12:16.390642+0000","last_clean":"2024-09-05T02:12:16.390642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:12:16.390642+0000","last_undegraded":"2024-09-05T02:12:16.390642+0000","last_fullsized":"2024-09-05T02:12:16.390642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:50:46.559032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.209816+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:12:26.209816+0000","last_peered":"2024-09-05T02:12:26.209816+0000","last_clean":"2024-09-05T02:12:26.209816+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:12:26.209816+0000","last_undegraded":"2024-09-05T02:12:26.209816+0000","last_fullsized":"2024-09-05T02:12:26.209816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394840+0000","last_change":"2024-09-05T01:05:07.100070+0000","last_active":"2024-09-05T02:12:36.394840+0000","last_peered":"2024-09-05T02:12:36.394840+0000","last_clean":"2024-09-05T02:12:36.394840+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:12:36.394840+0000","last_undegraded":"2024-09-05T02:12:36.394840+0000","last_fullsized":"2024-09-05T02:12:36.394840+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:38.489253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.386284+0000","last_change":"2024-09-05T01:09:26.324239+0000","last_active":"2024-09-05T02:11:56.386284+0000","last_peered":"2024-09-05T02:11:56.386284+0000","last_clean":"2024-09-05T02:11:56.386284+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:11:56.386284+0000","last_undegraded":"2024-09-05T02:11:56.386284+0000","last_fullsized":"2024-09-05T02:11:56.386284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:27:56.884028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.201470+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:11:51.201470+0000","last_peered":"2024-09-05T02:11:51.201470+0000","last_clean":"2024-09-05T02:11:51.201470+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:11:51.201470+0000","last_undegraded":"2024-09-05T02:11:51.201470+0000","last_fullsized":"2024-09-05T02:11:51.201470+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:47:24.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:05.454470+0000","last_change":"2024-09-05T01:05:07.114198+0000","last_active":"2024-09-05T02:13:05.454470+0000","last_peered":"2024-09-05T02:13:05.454470+0000","last_clean":"2024-09-05T02:13:05.454470+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:13:05.454470+0000","last_undegraded":"2024-09-05T02:13:05.454470+0000","last_fullsized":"2024-09-05T02:13:05.454470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:21:32.703401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459157+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:11:56.459157+0000","last_peered":"2024-09-05T02:11:56.459157+0000","last_clean":"2024-09-05T02:11:56.459157+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:11:56.459157+0000","last_undegraded":"2024-09-05T02:11:56.459157+0000","last_fullsized":"2024-09-05T02:11:56.459157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:51:40.645794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'7","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:55.436882+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:11:55.436882+0000","last_peered":"2024-09-05T02:11:55.436882+0000","last_clean":"2024-09-05T02:11:55.436882+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:11:55.436882+0000","last_undegraded":"2024-09-05T02:11:55.436882+0000","last_fullsized":"2024-09-05T02:11:55.436882+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:46.829038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3196187,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":23604,"num_write":12,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779304+0000","last_change":"2024-09-05T01:05:07.107441+0000","last_active":"2024-09-05T02:12:46.779304+0000","last_peered":"2024-09-05T02:12:46.779304+0000","last_clean":"2024-09-05T02:12:46.779304+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:12:46.779304+0000","last_undegraded":"2024-09-05T02:12:46.779304+0000","last_fullsized":"2024-09-05T02:12:46.779304+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:28.771503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.772503+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:12:16.772503+0000","last_peered":"2024-09-05T02:12:16.772503+0000","last_clean":"2024-09-05T02:12:16.772503+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:12:16.772503+0000","last_undegraded":"2024-09-05T02:12:16.772503+0000","last_fullsized":"2024-09-05T02:12:16.772503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:13.638808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464948+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:12:16.464948+0000","last_peered":"2024-09-05T02:12:16.464948+0000","last_clean":"2024-09-05T02:12:16.464948+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:12:16.464948+0000","last_undegraded":"2024-09-05T02:12:16.464948+0000","last_fullsized":"2024-09-05T02:12:16.464948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:48.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.369336+0000","last_change":"2024-09-05T01:30:15.668869+0000","last_active":"2024-09-05T02:12:16.369336+0000","last_peered":"2024-09-05T02:12:16.369336+0000","last_clean":"2024-09-05T02:12:16.369336+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:12:16.369336+0000","last_undegraded":"2024-09-05T02:12:16.369336+0000","last_fullsized":"2024-09-05T02:12:16.369336+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:05.261577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.471304+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:12:41.471304+0000","last_peered":"2024-09-05T02:12:41.471304+0000","last_clean":"2024-09-05T02:12:41.471304+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:12:41.471304+0000","last_undegraded":"2024-09-05T02:12:41.471304+0000","last_fullsized":"2024-09-05T02:12:41.471304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":28674,"num_write":13,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.817097+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:12:11.817097+0000","last_peered":"2024-09-05T02:12:11.817097+0000","last_clean":"2024-09-05T02:12:11.817097+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:12:11.817097+0000","last_undegraded":"2024-09-05T02:12:11.817097+0000","last_fullsized":"2024-09-05T02:12:11.817097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:06.449467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818016+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:12:16.818016+0000","last_peered":"2024-09-05T02:12:16.818016+0000","last_clean":"2024-09-05T02:12:16.818016+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:12:16.818016+0000","last_undegraded":"2024-09-05T02:12:16.818016+0000","last_fullsized":"2024-09-05T02:12:16.818016+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:08:36.986922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.465067+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:12:16.465067+0000","last_peered":"2024-09-05T02:12:16.465067+0000","last_clean":"2024-09-05T02:12:16.465067+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:12:16.465067+0000","last_undegraded":"2024-09-05T02:12:16.465067+0000","last_fullsized":"2024-09-05T02:12:16.465067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:19:22.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.368114+0000","last_change":"2024-09-05T01:09:22.197361+0000","last_active":"2024-09-05T02:12:11.368114+0000","last_peered":"2024-09-05T02:12:11.368114+0000","last_clean":"2024-09-05T02:12:11.368114+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:12:11.368114+0000","last_undegraded":"2024-09-05T02:12:11.368114+0000","last_fullsized":"2024-09-05T02:12:11.368114+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:33:21.371226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375737+0000","last_change":"2024-09-05T01:05:07.119548+0000","last_active":"2024-09-05T02:12:46.375737+0000","last_peered":"2024-09-05T02:12:46.375737+0000","last_clean":"2024-09-05T02:12:46.375737+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:12:46.375737+0000","last_undegraded":"2024-09-05T02:12:46.375737+0000","last_fullsized":"2024-09-05T02:12:46.375737+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:35:04.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203655+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:12:15.203655+0000","last_peered":"2024-09-05T02:12:15.203655+0000","last_clean":"2024-09-05T02:12:15.203655+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:12:15.203655+0000","last_undegraded":"2024-09-05T02:12:15.203655+0000","last_fullsized":"2024-09-05T02:12:15.203655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:15.910872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207592+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:12:16.207592+0000","last_peered":"2024-09-05T02:12:16.207592+0000","last_clean":"2024-09-05T02:12:16.207592+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:12:16.207592+0000","last_undegraded":"2024-09-05T02:12:16.207592+0000","last_fullsized":"2024-09-05T02:12:16.207592+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:25.770411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442264+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:12:15.442264+0000","last_peered":"2024-09-05T02:12:15.442264+0000","last_clean":"2024-09-05T02:12:15.442264+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:12:15.442264+0000","last_undegraded":"2024-09-05T02:12:15.442264+0000","last_fullsized":"2024-09-05T02:12:15.442264+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:46:14.641983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774807+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:12:26.774807+0000","last_peered":"2024-09-05T02:12:26.774807+0000","last_clean":"2024-09-05T02:12:26.774807+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:12:26.774807+0000","last_undegraded":"2024-09-05T02:12:26.774807+0000","last_fullsized":"2024-09-05T02:12:26.774807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:09.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208586+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:12:21.208586+0000","last_peered":"2024-09-05T02:12:21.208586+0000","last_clean":"2024-09-05T02:12:21.208586+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:12:21.208586+0000","last_undegraded":"2024-09-05T02:12:21.208586+0000","last_fullsized":"2024-09-05T02:12:21.208586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:53.136374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774662+0000","last_change":"2024-09-05T01:09:26.327272+0000","last_active":"2024-09-05T02:12:26.774662+0000","last_peered":"2024-09-05T02:12:26.774662+0000","last_clean":"2024-09-05T02:12:26.774662+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:12:26.774662+0000","last_undegraded":"2024-09-05T02:12:26.774662+0000","last_fullsized":"2024-09-05T02:12:26.774662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:00.744251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467246+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:12:26.467246+0000","last_peered":"2024-09-05T02:12:26.467246+0000","last_clean":"2024-09-05T02:12:26.467246+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:12:26.467246+0000","last_undegraded":"2024-09-05T02:12:26.467246+0000","last_fullsized":"2024-09-05T02:12:26.467246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:36:00.381248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'116","reported_seq":469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450850+0000","last_change":"2024-09-05T01:05:07.106194+0000","last_active":"2024-09-05T02:12:50.450850+0000","last_peered":"2024-09-05T02:12:50.450850+0000","last_clean":"2024-09-05T02:12:50.450850+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:12:50.450850+0000","last_undegraded":"2024-09-05T02:12:50.450850+0000","last_fullsized":"2024-09-05T02:12:50.450850+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444865+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:12:25.444865+0000","last_peered":"2024-09-05T02:12:25.444865+0000","last_clean":"2024-09-05T02:12:25.444865+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:12:25.444865+0000","last_undegraded":"2024-09-05T02:12:25.444865+0000","last_fullsized":"2024-09-05T02:12:25.444865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:58:42.242758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467369+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:12:26.467369+0000","last_peered":"2024-09-05T02:12:26.467369+0000","last_clean":"2024-09-05T02:12:26.467369+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:12:26.467369+0000","last_undegraded":"2024-09-05T02:12:26.467369+0000","last_fullsized":"2024-09-05T02:12:26.467369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:39.545081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.391757+0000","last_change":"2024-09-05T01:09:22.204898+0000","last_active":"2024-09-05T02:12:21.391757+0000","last_peered":"2024-09-05T02:12:21.391757+0000","last_clean":"2024-09-05T02:12:21.391757+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:12:21.391757+0000","last_undegraded":"2024-09-05T02:12:21.391757+0000","last_fullsized":"2024-09-05T02:12:21.391757+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:48:27.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.392810+0000","last_change":"2024-09-05T01:09:26.329147+0000","last_active":"2024-09-05T02:12:26.392810+0000","last_peered":"2024-09-05T02:12:26.392810+0000","last_clean":"2024-09-05T02:12:26.392810+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:12:26.392810+0000","last_undegraded":"2024-09-05T02:12:26.392810+0000","last_fullsized":"2024-09-05T02:12:26.392810+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:07.238760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.206066+0000","last_change":"2024-09-05T01:09:22.187559+0000","last_active":"2024-09-05T02:12:25.206066+0000","last_peered":"2024-09-05T02:12:25.206066+0000","last_clean":"2024-09-05T02:12:25.206066+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:12:25.206066+0000","last_undegraded":"2024-09-05T02:12:25.206066+0000","last_fullsized":"2024-09-05T02:12:25.206066+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:07:59.966273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.386682+0000","last_change":"2024-09-05T01:30:15.669605+0000","last_active":"2024-09-05T02:13:41.386682+0000","last_peered":"2024-09-05T02:13:41.386682+0000","last_clean":"2024-09-05T02:13:41.386682+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:13:41.386682+0000","last_undegraded":"2024-09-05T02:13:41.386682+0000","last_fullsized":"2024-09-05T02:13:41.386682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:56.360434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467501+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:12:26.467501+0000","last_peered":"2024-09-05T02:12:26.467501+0000","last_clean":"2024-09-05T02:12:26.467501+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:12:26.467501+0000","last_undegraded":"2024-09-05T02:12:26.467501+0000","last_fullsized":"2024-09-05T02:12:26.467501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:48.846611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.819378+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:12:21.819378+0000","last_peered":"2024-09-05T02:12:21.819378+0000","last_clean":"2024-09-05T02:12:21.819378+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:12:21.819378+0000","last_undegraded":"2024-09-05T02:12:21.819378+0000","last_fullsized":"2024-09-05T02:12:21.819378+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:34.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467422+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:12:26.467422+0000","last_peered":"2024-09-05T02:12:26.467422+0000","last_clean":"2024-09-05T02:12:26.467422+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:12:26.467422+0000","last_undegraded":"2024-09-05T02:12:26.467422+0000","last_fullsized":"2024-09-05T02:12:26.467422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:59.970464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.370570+0000","last_change":"2024-09-05T01:09:22.173216+0000","last_active":"2024-09-05T02:12:21.370570+0000","last_peered":"2024-09-05T02:12:21.370570+0000","last_clean":"2024-09-05T02:12:21.370570+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:12:21.370570+0000","last_undegraded":"2024-09-05T02:12:21.370570+0000","last_fullsized":"2024-09-05T02:12:21.370570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:30:30.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209629+0000","last_change":"2024-09-05T01:05:07.097402+0000","last_active":"2024-09-05T02:12:40.209629+0000","last_peered":"2024-09-05T02:12:40.209629+0000","last_clean":"2024-09-05T02:12:40.209629+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:12:40.209629+0000","last_undegraded":"2024-09-05T02:12:40.209629+0000","last_fullsized":"2024-09-05T02:12:40.209629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:29.548612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407611+0000","last_change":"2024-09-05T01:30:15.659142+0000","last_active":"2024-09-05T02:13:36.407611+0000","last_peered":"2024-09-05T02:13:36.407611+0000","last_clean":"2024-09-05T02:13:36.407611+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:13:36.407611+0000","last_undegraded":"2024-09-05T02:13:36.407611+0000","last_fullsized":"2024-09-05T02:13:36.407611+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:28.741051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.805493+0000","last_change":"2024-09-05T01:09:26.328593+0000","last_active":"2024-09-05T02:14:51.805493+0000","last_peered":"2024-09-05T02:14:51.805493+0000","last_clean":"2024-09-05T02:14:51.805493+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:14:51.805493+0000","last_undegraded":"2024-09-05T02:14:51.805493+0000","last_fullsized":"2024-09-05T02:14:51.805493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:38.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444961+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:12:25.444961+0000","last_peered":"2024-09-05T02:12:25.444961+0000","last_clean":"2024-09-05T02:12:25.444961+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:12:25.444961+0000","last_undegraded":"2024-09-05T02:12:25.444961+0000","last_fullsized":"2024-09-05T02:12:25.444961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:22:24.610460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88572,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":88,"num_write":2,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394924+0000","last_change":"2024-09-05T01:05:07.108722+0000","last_active":"2024-09-05T02:12:36.394924+0000","last_peered":"2024-09-05T02:12:36.394924+0000","last_clean":"2024-09-05T02:12:36.394924+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:12:36.394924+0000","last_undegraded":"2024-09-05T02:12:36.394924+0000","last_fullsized":"2024-09-05T02:12:36.394924+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:28:14.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467549+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:12:26.467549+0000","last_peered":"2024-09-05T02:12:26.467549+0000","last_clean":"2024-09-05T02:12:26.467549+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:12:26.467549+0000","last_undegraded":"2024-09-05T02:12:26.467549+0000","last_fullsized":"2024-09-05T02:12:26.467549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:39.337140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:31.776137+0000","last_change":"2024-09-05T01:09:22.199397+0000","last_active":"2024-09-05T02:12:31.776137+0000","last_peered":"2024-09-05T02:12:31.776137+0000","last_clean":"2024-09-05T02:12:31.776137+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:12:31.776137+0000","last_undegraded":"2024-09-05T02:12:31.776137+0000","last_fullsized":"2024-09-05T02:12:31.776137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:09:58.963052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.373537+0000","last_change":"2024-09-05T01:05:07.107459+0000","last_active":"2024-09-05T02:12:36.373537+0000","last_peered":"2024-09-05T02:12:36.373537+0000","last_clean":"2024-09-05T02:12:36.373537+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:12:36.373537+0000","last_undegraded":"2024-09-05T02:12:36.373537+0000","last_fullsized":"2024-09-05T02:12:36.373537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:14.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207379+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:12:16.207379+0000","last_peered":"2024-09-05T02:12:16.207379+0000","last_clean":"2024-09-05T02:12:16.207379+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:12:16.207379+0000","last_undegraded":"2024-09-05T02:12:16.207379+0000","last_fullsized":"2024-09-05T02:12:16.207379+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:34:26.565026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441893+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:12:15.441893+0000","last_peered":"2024-09-05T02:12:15.441893+0000","last_clean":"2024-09-05T02:12:15.441893+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:12:15.441893+0000","last_undegraded":"2024-09-05T02:12:15.441893+0000","last_fullsized":"2024-09-05T02:12:15.441893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:26.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448523+0000","last_change":"2024-09-05T01:05:07.113278+0000","last_active":"2024-09-05T02:12:40.448523+0000","last_peered":"2024-09-05T02:12:40.448523+0000","last_clean":"2024-09-05T02:12:40.448523+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:12:40.448523+0000","last_undegraded":"2024-09-05T02:12:40.448523+0000","last_fullsized":"2024-09-05T02:12:40.448523+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:01.987557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818058+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:12:16.818058+0000","last_peered":"2024-09-05T02:12:16.818058+0000","last_clean":"2024-09-05T02:12:16.818058+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:12:16.818058+0000","last_undegraded":"2024-09-05T02:12:16.818058+0000","last_fullsized":"2024-09-05T02:12:16.818058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:29:50.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.771516+0000","last_change":"2024-09-05T01:09:22.205702+0000","last_active":"2024-09-05T02:12:11.771516+0000","last_peered":"2024-09-05T02:12:11.771516+0000","last_clean":"2024-09-05T02:12:11.771516+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:12:11.771516+0000","last_undegraded":"2024-09-05T02:12:11.771516+0000","last_fullsized":"2024-09-05T02:12:11.771516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:20.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820508+0000","last_change":"2024-09-05T01:05:07.107783+0000","last_active":"2024-09-05T02:12:26.820508+0000","last_peered":"2024-09-05T02:12:26.820508+0000","last_clean":"2024-09-05T02:12:26.820508+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:12:26.820508+0000","last_undegraded":"2024-09-05T02:12:26.820508+0000","last_fullsized":"2024-09-05T02:12:26.820508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:14.335901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774914+0000","last_change":"2024-09-05T01:09:26.335994+0000","last_active":"2024-09-05T02:12:26.774914+0000","last_peered":"2024-09-05T02:12:26.774914+0000","last_clean":"2024-09-05T02:12:26.774914+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:12:26.774914+0000","last_undegraded":"2024-09-05T02:12:26.774914+0000","last_fullsized":"2024-09-05T02:12:26.774914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:07.883192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:30.445993+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:12:30.445993+0000","last_peered":"2024-09-05T02:12:30.445993+0000","last_clean":"2024-09-05T02:12:30.445993+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:12:30.445993+0000","last_undegraded":"2024-09-05T02:12:30.445993+0000","last_fullsized":"2024-09-05T02:12:30.445993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:34.388590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464656+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:12:16.464656+0000","last_peered":"2024-09-05T02:12:16.464656+0000","last_clean":"2024-09-05T02:12:16.464656+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:12:16.464656+0000","last_undegraded":"2024-09-05T02:12:16.464656+0000","last_fullsized":"2024-09-05T02:12:16.464656+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:04.705416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820465+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:12:26.820465+0000","last_peered":"2024-09-05T02:12:26.820465+0000","last_clean":"2024-09-05T02:12:26.820465+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:12:26.820465+0000","last_undegraded":"2024-09-05T02:12:26.820465+0000","last_fullsized":"2024-09-05T02:12:26.820465+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.990596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208761+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:12:21.208761+0000","last_peered":"2024-09-05T02:12:21.208761+0000","last_clean":"2024-09-05T02:12:21.208761+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:12:21.208761+0000","last_undegraded":"2024-09-05T02:12:21.208761+0000","last_fullsized":"2024-09-05T02:12:21.208761+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:08.518794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390597+0000","last_change":"2024-09-05T01:05:07.108906+0000","last_active":"2024-09-05T02:12:16.390597+0000","last_peered":"2024-09-05T02:12:16.390597+0000","last_clean":"2024-09-05T02:12:16.390597+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:12:16.390597+0000","last_undegraded":"2024-09-05T02:12:16.390597+0000","last_fullsized":"2024-09-05T02:12:16.390597+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:30:18.560371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442141+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:12:15.442141+0000","last_peered":"2024-09-05T02:12:15.442141+0000","last_clean":"2024-09-05T02:12:15.442141+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:12:15.442141+0000","last_undegraded":"2024-09-05T02:12:15.442141+0000","last_fullsized":"2024-09-05T02:12:15.442141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:20.443723+0000","last_change":"2024-09-05T01:05:07.120976+0000","last_active":"2024-09-05T02:12:20.443723+0000","last_peered":"2024-09-05T02:12:20.443723+0000","last_clean":"2024-09-05T02:12:20.443723+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:12:20.443723+0000","last_undegraded":"2024-09-05T02:12:20.443723+0000","last_fullsized":"2024-09-05T02:12:20.443723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:22.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391904+0000","last_change":"2024-09-05T01:09:22.172712+0000","last_active":"2024-09-05T02:14:06.391904+0000","last_peered":"2024-09-05T02:14:06.391904+0000","last_clean":"2024-09-05T02:14:06.391904+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:14:06.391904+0000","last_undegraded":"2024-09-05T02:14:06.391904+0000","last_fullsized":"2024-09-05T02:14:06.391904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:20.436128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390757+0000","last_change":"2024-09-05T01:05:07.102945+0000","last_active":"2024-09-05T02:12:16.390757+0000","last_peered":"2024-09-05T02:12:16.390757+0000","last_clean":"2024-09-05T02:12:16.390757+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:12:16.390757+0000","last_undegraded":"2024-09-05T02:12:16.390757+0000","last_fullsized":"2024-09-05T02:12:16.390757+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:11:05.062597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774731+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:12:26.774731+0000","last_peered":"2024-09-05T02:12:26.774731+0000","last_clean":"2024-09-05T02:12:26.774731+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:12:26.774731+0000","last_undegraded":"2024-09-05T02:12:26.774731+0000","last_fullsized":"2024-09-05T02:12:26.774731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:07.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818258+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:12:16.818258+0000","last_peered":"2024-09-05T02:12:16.818258+0000","last_clean":"2024-09-05T02:12:16.818258+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:12:16.818258+0000","last_undegraded":"2024-09-05T02:12:16.818258+0000","last_fullsized":"2024-09-05T02:12:16.818258+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:39.015669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203874+0000","last_change":"2024-09-05T01:09:22.189533+0000","last_active":"2024-09-05T02:12:15.203874+0000","last_peered":"2024-09-05T02:12:15.203874+0000","last_clean":"2024-09-05T02:12:15.203874+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:12:15.203874+0000","last_undegraded":"2024-09-05T02:12:15.203874+0000","last_fullsized":"2024-09-05T02:12:15.203874+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:17.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.634124+0000","last_change":"2024-09-05T01:05:07.104648+0000","last_active":"2024-09-05T02:14:06.634124+0000","last_peered":"2024-09-05T02:14:06.634124+0000","last_clean":"2024-09-05T02:14:06.634124+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:14:06.634124+0000","last_undegraded":"2024-09-05T02:14:06.634124+0000","last_fullsized":"2024-09-05T02:14:06.634124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:02.121064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207620+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:12:16.207620+0000","last_peered":"2024-09-05T02:12:16.207620+0000","last_clean":"2024-09-05T02:12:16.207620+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:12:16.207620+0000","last_undegraded":"2024-09-05T02:12:16.207620+0000","last_fullsized":"2024-09-05T02:12:16.207620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:55.569114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.313397+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.313397+0000","last_peered":"2024-09-05T02:16:21.313397+0000","last_clean":"2024-09-05T02:16:21.313397+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.313397+0000","last_undegraded":"2024-09-05T02:16:21.313397+0000","last_fullsized":"2024-09-05T02:16:21.313397+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:52.383560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792699+0000","last_change":"2024-09-05T01:05:07.109781+0000","last_active":"2024-09-05T02:13:51.792699+0000","last_peered":"2024-09-05T02:13:51.792699+0000","last_clean":"2024-09-05T02:13:51.792699+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:13:51.792699+0000","last_undegraded":"2024-09-05T02:13:51.792699+0000","last_fullsized":"2024-09-05T02:13:51.792699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:11.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.385750+0000","last_change":"2024-09-05T01:30:15.670716+0000","last_active":"2024-09-05T02:13:36.385750+0000","last_peered":"2024-09-05T02:13:36.385750+0000","last_clean":"2024-09-05T02:13:36.385750+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:13:36.385750+0000","last_undegraded":"2024-09-05T02:13:36.385750+0000","last_fullsized":"2024-09-05T02:13:36.385750+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:30.214527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794558+0000","last_change":"2024-09-05T01:09:26.336791+0000","last_active":"2024-09-05T02:14:01.794558+0000","last_peered":"2024-09-05T02:14:01.794558+0000","last_clean":"2024-09-05T02:14:01.794558+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:14:01.794558+0000","last_undegraded":"2024-09-05T02:14:01.794558+0000","last_fullsized":"2024-09-05T02:14:01.794558+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:27:19.850660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":100,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227128+0000","last_change":"2024-09-05T01:05:07.103532+0000","last_active":"2024-09-05T02:13:55.227128+0000","last_peered":"2024-09-05T02:13:55.227128+0000","last_clean":"2024-09-05T02:13:55.227128+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:13:55.227128+0000","last_undegraded":"2024-09-05T02:13:55.227128+0000","last_fullsized":"2024-09-05T02:13:55.227128+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:09.868656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228540+0000","last_change":"2024-09-05T01:05:07.106167+0000","last_active":"2024-09-05T02:13:51.228540+0000","last_peered":"2024-09-05T02:13:51.228540+0000","last_clean":"2024-09-05T02:13:51.228540+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:13:51.228540+0000","last_undegraded":"2024-09-05T02:13:51.228540+0000","last_fullsized":"2024-09-05T02:13:51.228540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:44.638683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.413210+0000","last_change":"2024-09-05T01:09:26.348937+0000","last_active":"2024-09-05T02:14:01.413210+0000","last_peered":"2024-09-05T02:14:01.413210+0000","last_clean":"2024-09-05T02:14:01.413210+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:14:01.413210+0000","last_undegraded":"2024-09-05T02:14:01.413210+0000","last_fullsized":"2024-09-05T02:14:01.413210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.793654+0000","last_change":"2024-09-05T01:09:22.183966+0000","last_active":"2024-09-05T02:13:56.793654+0000","last_peered":"2024-09-05T02:13:56.793654+0000","last_clean":"2024-09-05T02:13:56.793654+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:13:56.793654+0000","last_undegraded":"2024-09-05T02:13:56.793654+0000","last_fullsized":"2024-09-05T02:13:56.793654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:52.065642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":216,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.410907+0000","last_change":"2024-09-05T01:05:07.105723+0000","last_active":"2024-09-05T02:13:51.410907+0000","last_peered":"2024-09-05T02:13:51.410907+0000","last_clean":"2024-09-05T02:13:51.410907+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:13:51.410907+0000","last_undegraded":"2024-09-05T02:13:51.410907+0000","last_fullsized":"2024-09-05T02:13:51.410907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:08.187510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.412152+0000","last_change":"2024-09-05T01:09:22.173186+0000","last_active":"2024-09-05T02:13:56.412152+0000","last_peered":"2024-09-05T02:13:56.412152+0000","last_clean":"2024-09-05T02:13:56.412152+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:13:56.412152+0000","last_undegraded":"2024-09-05T02:13:56.412152+0000","last_fullsized":"2024-09-05T02:13:56.412152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:45.178339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.832398+0000","last_change":"2024-09-05T01:05:07.103211+0000","last_active":"2024-09-05T02:13:16.832398+0000","last_peered":"2024-09-05T02:13:16.832398+0000","last_clean":"2024-09-05T02:13:16.832398+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:13:16.832398+0000","last_undegraded":"2024-09-05T02:13:16.832398+0000","last_fullsized":"2024-09-05T02:13:16.832398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:40.214831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'322","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.368995+0000","last_change":"2024-09-05T00:50:04.197760+0000","last_active":"2024-09-05T02:16:21.368995+0000","last_peered":"2024-09-05T02:16:21.368995+0000","last_clean":"2024-09-05T02:16:21.368995+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:21.368995+0000","last_undegraded":"2024-09-05T02:16:21.368995+0000","last_fullsized":"2024-09-05T02:16:21.368995+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:08.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16681512,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":567,"num_read_kb":47641,"num_write":1166,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'505","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844799+0000","last_change":"2024-09-05T00:49:29.902310+0000","last_active":"2024-09-05T02:13:40.844799+0000","last_peered":"2024-09-05T02:13:40.844799+0000","last_clean":"2024-09-05T02:13:40.844799+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:13:40.844799+0000","last_undegraded":"2024-09-05T02:13:40.844799+0000","last_fullsized":"2024-09-05T02:13:40.844799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:52.315609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'328","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.752985+0000","last_change":"2024-09-05T00:49:27.898633+0000","last_active":"2024-09-05T02:16:21.752985+0000","last_peered":"2024-09-05T02:16:21.752985+0000","last_clean":"2024-09-05T02:16:21.752985+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:21.752985+0000","last_undegraded":"2024-09-05T02:16:21.752985+0000","last_fullsized":"2024-09-05T02:16:21.752985+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:12:19.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487413,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":514,"num_read_kb":74892,"num_write":1128,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'444","reported_seq":2073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.060176+0000","last_change":"2024-09-05T00:50:04.184130+0000","last_active":"2024-09-05T02:13:56.060176+0000","last_peered":"2024-09-05T02:13:56.060176+0000","last_clean":"2024-09-05T02:13:56.060176+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:13:56.060176+0000","last_undegraded":"2024-09-05T02:13:56.060176+0000","last_fullsized":"2024-09-05T02:13:56.060176+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:41.824164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'320","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:04.720119+0000","last_change":"2024-09-05T00:49:27.878763+0000","last_active":"2024-09-05T02:13:04.720119+0000","last_peered":"2024-09-05T02:13:04.720119+0000","last_clean":"2024-09-05T02:13:04.720119+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:13:04.720119+0000","last_undegraded":"2024-09-05T02:13:04.720119+0000","last_fullsized":"2024-09-05T02:13:04.720119+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:40.061514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76785,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":521,"num_read_kb":741,"num_write":1072,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'852","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842642+0000","last_change":"2024-09-05T00:49:29.900944+0000","last_active":"2024-09-05T02:14:19.842642+0000","last_peered":"2024-09-05T02:14:19.842642+0000","last_clean":"2024-09-05T02:14:19.842642+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:14:19.842642+0000","last_undegraded":"2024-09-05T02:14:19.842642+0000","last_fullsized":"2024-09-05T02:14:19.842642+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:48.973383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'314","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227167+0000","last_change":"2024-09-05T00:49:27.891660+0000","last_active":"2024-09-05T02:13:55.227167+0000","last_peered":"2024-09-05T02:13:55.227167+0000","last_clean":"2024-09-05T02:13:55.227167+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:13:55.227167+0000","last_undegraded":"2024-09-05T02:13:55.227167+0000","last_fullsized":"2024-09-05T02:13:55.227167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:52:25.219927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495938,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":633,"num_read_kb":68500,"num_write":1247,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.840193+0000","last_change":"2024-09-05T00:49:29.919632+0000","last_active":"2024-09-05T02:13:40.840193+0000","last_peered":"2024-09-05T02:13:40.840193+0000","last_clean":"2024-09-05T02:13:40.840193+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:13:40.840193+0000","last_undegraded":"2024-09-05T02:13:40.840193+0000","last_fullsized":"2024-09-05T02:13:40.840193+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:31:42.074665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'321","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.603561+0000","last_change":"2024-09-05T00:49:27.904486+0000","last_active":"2024-09-05T02:16:21.603561+0000","last_peered":"2024-09-05T02:16:21.603561+0000","last_clean":"2024-09-05T02:16:21.603561+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:21.603561+0000","last_undegraded":"2024-09-05T02:16:21.603561+0000","last_fullsized":"2024-09-05T02:16:21.603561+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:22:56.989812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56400,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":422,"num_read_kb":9059,"num_write":1116,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'446","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.625924+0000","last_change":"2024-09-05T00:49:29.903354+0000","last_active":"2024-09-05T02:14:29.625924+0000","last_peered":"2024-09-05T02:14:29.625924+0000","last_clean":"2024-09-05T02:14:29.625924+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:14:29.625924+0000","last_undegraded":"2024-09-05T02:14:29.625924+0000","last_fullsized":"2024-09-05T02:14:29.625924+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:22.469137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'265","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200027+0000","last_change":"2024-09-05T00:49:27.899576+0000","last_active":"2024-09-05T02:12:00.200027+0000","last_peered":"2024-09-05T02:12:00.200027+0000","last_clean":"2024-09-05T02:12:00.200027+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:12:00.200027+0000","last_undegraded":"2024-09-05T02:12:00.200027+0000","last_fullsized":"2024-09-05T02:12:00.200027+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:56:44.824648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267473,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":472,"num_write":1032,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'503","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.906613+0000","last_change":"2024-09-05T00:49:29.900890+0000","last_active":"2024-09-05T02:13:45.906613+0000","last_peered":"2024-09-05T02:13:45.906613+0000","last_clean":"2024-09-05T02:13:45.906613+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:13:45.906613+0000","last_undegraded":"2024-09-05T02:13:45.906613+0000","last_fullsized":"2024-09-05T02:13:45.906613+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'308","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.630906+0000","last_change":"2024-09-05T00:49:27.905426+0000","last_active":"2024-09-05T02:16:21.630906+0000","last_peered":"2024-09-05T02:16:21.630906+0000","last_clean":"2024-09-05T02:16:21.630906+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:21.630906+0000","last_undegraded":"2024-09-05T02:16:21.630906+0000","last_fullsized":"2024-09-05T02:16:21.630906+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:05.030484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7518681,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":470,"num_read_kb":57163,"num_write":1075,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'473","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.607735+0000","last_change":"2024-09-05T00:49:29.918860+0000","last_active":"2024-09-05T02:15:48.607735+0000","last_peered":"2024-09-05T02:15:48.607735+0000","last_clean":"2024-09-05T02:15:48.607735+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:15:48.607735+0000","last_undegraded":"2024-09-05T02:15:48.607735+0000","last_fullsized":"2024-09-05T02:15:48.607735+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:36.131820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'308","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.482117+0000","last_change":"2024-09-05T00:49:27.894250+0000","last_active":"2024-09-05T02:16:21.482117+0000","last_peered":"2024-09-05T02:16:21.482117+0000","last_clean":"2024-09-05T02:16:21.482117+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:21.482117+0000","last_undegraded":"2024-09-05T02:16:21.482117+0000","last_fullsized":"2024-09-05T02:16:21.482117+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:55:18.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103081,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":776,"num_read_kb":7162,"num_write":1090,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'450","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:14.403614+0000","last_change":"2024-09-05T00:49:29.917227+0000","last_active":"2024-09-05T02:13:14.403614+0000","last_peered":"2024-09-05T02:13:14.403614+0000","last_clean":"2024-09-05T02:13:14.403614+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:13:14.403614+0000","last_undegraded":"2024-09-05T02:13:14.403614+0000","last_fullsized":"2024-09-05T02:13:14.403614+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:45.091417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'744","reported_seq":2208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.062464+0000","last_change":"2024-09-05T00:49:29.905360+0000","last_active":"2024-09-05T02:13:56.062464+0000","last_peered":"2024-09-05T02:13:56.062464+0000","last_clean":"2024-09-05T02:13:56.062464+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:13:56.062464+0000","last_undegraded":"2024-09-05T02:13:56.062464+0000","last_fullsized":"2024-09-05T02:13:56.062464+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:40.876830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'298","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.617515+0000","last_change":"2024-09-05T00:49:27.910019+0000","last_active":"2024-09-05T02:16:21.617515+0000","last_peered":"2024-09-05T02:16:21.617515+0000","last_clean":"2024-09-05T02:16:21.617515+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:21.617515+0000","last_undegraded":"2024-09-05T02:16:21.617515+0000","last_fullsized":"2024-09-05T02:16:21.617515+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:00.426807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7003989,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":436,"num_read_kb":16771,"num_write":1036,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'434","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697734+0000","last_change":"2024-09-05T00:49:29.924150+0000","last_active":"2024-09-05T02:15:48.697734+0000","last_peered":"2024-09-05T02:15:48.697734+0000","last_clean":"2024-09-05T02:15:48.697734+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:15:48.697734+0000","last_undegraded":"2024-09-05T02:15:48.697734+0000","last_fullsized":"2024-09-05T02:15:48.697734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:21.326911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'289","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.241639+0000","last_change":"2024-09-05T00:49:27.896351+0000","last_active":"2024-09-05T02:16:21.241639+0000","last_peered":"2024-09-05T02:16:21.241639+0000","last_clean":"2024-09-05T02:16:21.241639+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:21.241639+0000","last_undegraded":"2024-09-05T02:16:21.241639+0000","last_fullsized":"2024-09-05T02:16:21.241639+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:17:37.231288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604179,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":408,"num_read_kb":5849,"num_write":1001,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'460","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.696002+0000","last_change":"2024-09-05T00:49:29.910681+0000","last_active":"2024-09-05T02:15:48.696002+0000","last_peered":"2024-09-05T02:15:48.696002+0000","last_clean":"2024-09-05T02:15:48.696002+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:15:48.696002+0000","last_undegraded":"2024-09-05T02:15:48.696002+0000","last_fullsized":"2024-09-05T02:15:48.696002+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:22.606854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'300","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.161079+0000","last_change":"2024-09-05T00:49:27.894988+0000","last_active":"2024-09-05T02:16:21.161079+0000","last_peered":"2024-09-05T02:16:21.161079+0000","last_clean":"2024-09-05T02:16:21.161079+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:21.161079+0000","last_undegraded":"2024-09-05T02:16:21.161079+0000","last_fullsized":"2024-09-05T02:16:21.161079+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:21.825324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128211,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":479,"num_read_kb":7060,"num_write":1167,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'491","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:47.724900+0000","last_change":"2024-09-05T00:49:29.912607+0000","last_active":"2024-09-05T02:12:47.724900+0000","last_peered":"2024-09-05T02:12:47.724900+0000","last_clean":"2024-09-05T02:12:47.724900+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:12:47.724900+0000","last_undegraded":"2024-09-05T02:12:47.724900+0000","last_fullsized":"2024-09-05T02:12:47.724900+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:34.256983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'302","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.180001+0000","last_change":"2024-09-05T00:49:27.882843+0000","last_active":"2024-09-05T02:16:21.180001+0000","last_peered":"2024-09-05T02:16:21.180001+0000","last_clean":"2024-09-05T02:16:21.180001+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:21.180001+0000","last_undegraded":"2024-09-05T02:16:21.180001+0000","last_fullsized":"2024-09-05T02:16:21.180001+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:25.955814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5423612,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":501,"num_read_kb":17342,"num_write":1177,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'405","reported_seq":1862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.843762+0000","last_change":"2024-09-05T00:49:29.917744+0000","last_active":"2024-09-05T02:13:40.843762+0000","last_peered":"2024-09-05T02:13:40.843762+0000","last_clean":"2024-09-05T02:13:40.843762+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:13:40.843762+0000","last_undegraded":"2024-09-05T02:13:40.843762+0000","last_fullsized":"2024-09-05T02:13:40.843762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:26.837337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'303","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.436666+0000","last_change":"2024-09-05T00:49:27.879495+0000","last_active":"2024-09-05T02:16:21.436666+0000","last_peered":"2024-09-05T02:16:21.436666+0000","last_clean":"2024-09-05T02:16:21.436666+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:21.436666+0000","last_undegraded":"2024-09-05T02:16:21.436666+0000","last_fullsized":"2024-09-05T02:16:21.436666+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:13.251498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114681,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":1528,"num_write":1184,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'749","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.563397+0000","last_change":"2024-09-05T00:49:29.921148+0000","last_active":"2024-09-05T02:14:29.563397+0000","last_peered":"2024-09-05T02:14:29.563397+0000","last_clean":"2024-09-05T02:14:29.563397+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:14:29.563397+0000","last_undegraded":"2024-09-05T02:14:29.563397+0000","last_fullsized":"2024-09-05T02:14:29.563397+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:28.667675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'272","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465372+0000","last_change":"2024-09-05T00:49:27.893557+0000","last_active":"2024-09-05T02:13:50.465372+0000","last_peered":"2024-09-05T02:13:50.465372+0000","last_clean":"2024-09-05T02:13:50.465372+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:13:50.465372+0000","last_undegraded":"2024-09-05T02:13:50.465372+0000","last_fullsized":"2024-09-05T02:13:50.465372+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:16:58.696922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5690064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":439,"num_read_kb":32078,"num_write":1015,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'127","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.840852+0000","last_change":"2024-09-05T00:49:37.949792+0000","last_active":"2024-09-05T02:14:29.840852+0000","last_peered":"2024-09-05T02:14:29.840852+0000","last_clean":"2024-09-05T02:14:29.840852+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:14:29.840852+0000","last_undegraded":"2024-09-05T02:14:29.840852+0000","last_fullsized":"2024-09-05T02:14:29.840852+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:18.632196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'322","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:25.027490+0000","last_change":"2024-09-05T00:50:04.179604+0000","last_active":"2024-09-05T02:13:25.027490+0000","last_peered":"2024-09-05T02:13:25.027490+0000","last_clean":"2024-09-05T02:13:25.027490+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:13:25.027490+0000","last_undegraded":"2024-09-05T02:13:25.027490+0000","last_fullsized":"2024-09-05T02:13:25.027490+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:19.315200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646392+0000","last_change":"2024-09-05T00:49:27.908163+0000","last_active":"2024-09-05T02:16:21.646392+0000","last_peered":"2024-09-05T02:16:21.646392+0000","last_clean":"2024-09-05T02:16:21.646392+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:21.646392+0000","last_undegraded":"2024-09-05T02:16:21.646392+0000","last_fullsized":"2024-09-05T02:16:21.646392+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:26.321927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332538,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":414,"num_read_kb":5561,"num_write":1081,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196301+0000","last_change":"2024-09-05T00:49:31.911566+0000","last_active":"2024-09-05T02:11:45.196301+0000","last_peered":"2024-09-05T02:11:45.196301+0000","last_clean":"2024-09-05T02:11:45.196301+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:11:45.196301+0000","last_undegraded":"2024-09-05T02:11:45.196301+0000","last_fullsized":"2024-09-05T02:11:45.196301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:50.459772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'362","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.470202+0000","last_change":"2024-09-05T00:49:33.908342+0000","last_active":"2024-09-05T02:14:10.470202+0000","last_peered":"2024-09-05T02:14:10.470202+0000","last_clean":"2024-09-05T02:14:10.470202+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:14:10.470202+0000","last_undegraded":"2024-09-05T02:14:10.470202+0000","last_fullsized":"2024-09-05T02:14:10.470202+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:30:43.947001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51820,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":1066,"num_write":448,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.810732+0000","last_change":"2024-09-05T00:49:35.935224+0000","last_active":"2024-09-05T02:11:46.810732+0000","last_peered":"2024-09-05T02:11:46.810732+0000","last_clean":"2024-09-05T02:11:46.810732+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:11:46.810732+0000","last_undegraded":"2024-09-05T02:11:46.810732+0000","last_fullsized":"2024-09-05T02:11:46.810732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:50.276599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2467","reported_seq":4375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.838585+0000","last_change":"2024-09-05T00:49:37.940197+0000","last_active":"2024-09-05T02:14:27.838585+0000","last_peered":"2024-09-05T02:14:27.838585+0000","last_clean":"2024-09-05T02:14:27.838585+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:14:27.838585+0000","last_undegraded":"2024-09-05T02:14:27.838585+0000","last_fullsized":"2024-09-05T02:14:27.838585+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:21.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.634828+0000","last_change":"2024-09-05T00:49:29.904918+0000","last_active":"2024-09-05T02:14:27.634828+0000","last_peered":"2024-09-05T02:14:27.634828+0000","last_clean":"2024-09-05T02:14:27.634828+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:14:27.634828+0000","last_undegraded":"2024-09-05T02:14:27.634828+0000","last_fullsized":"2024-09-05T02:14:27.634828+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:01:06.117657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'248","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:30.460041+0000","last_change":"2024-09-05T00:49:27.905821+0000","last_active":"2024-09-05T02:13:30.460041+0000","last_peered":"2024-09-05T02:13:30.460041+0000","last_clean":"2024-09-05T02:13:30.460041+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:13:30.460041+0000","last_undegraded":"2024-09-05T02:13:30.460041+0000","last_fullsized":"2024-09-05T02:13:30.460041+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:56:59.762079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507262,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":366,"num_read_kb":61922,"num_write":840,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487978+0000","last_change":"2024-09-05T00:49:31.917103+0000","last_active":"2024-09-05T02:13:51.487978+0000","last_peered":"2024-09-05T02:13:51.487978+0000","last_clean":"2024-09-05T02:13:51.487978+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:13:51.487978+0000","last_undegraded":"2024-09-05T02:13:51.487978+0000","last_fullsized":"2024-09-05T02:13:51.487978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:08.039118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200339+0000","last_change":"2024-09-05T00:49:33.908801+0000","last_active":"2024-09-05T02:11:46.200339+0000","last_peered":"2024-09-05T02:11:46.200339+0000","last_clean":"2024-09-05T02:11:46.200339+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:11:46.200339+0000","last_undegraded":"2024-09-05T02:11:46.200339+0000","last_fullsized":"2024-09-05T02:11:46.200339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:32.220937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200292+0000","last_change":"2024-09-05T00:49:35.930182+0000","last_active":"2024-09-05T02:11:46.200292+0000","last_peered":"2024-09-05T02:11:46.200292+0000","last_clean":"2024-09-05T02:11:46.200292+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:11:46.200292+0000","last_undegraded":"2024-09-05T02:11:46.200292+0000","last_fullsized":"2024-09-05T02:11:46.200292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:35.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'106","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.066549+0000","last_change":"2024-09-05T00:49:37.932878+0000","last_active":"2024-09-05T02:14:26.066549+0000","last_peered":"2024-09-05T02:14:26.066549+0000","last_clean":"2024-09-05T02:14:26.066549+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:14:26.066549+0000","last_undegraded":"2024-09-05T02:14:26.066549+0000","last_fullsized":"2024-09-05T02:14:26.066549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:02.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1219","reported_seq":2904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.627360+0000","last_change":"2024-09-05T00:49:29.911068+0000","last_active":"2024-09-05T02:14:29.627360+0000","last_peered":"2024-09-05T02:14:29.627360+0000","last_clean":"2024-09-05T02:14:29.627360+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:14:29.627360+0000","last_undegraded":"2024-09-05T02:14:29.627360+0000","last_fullsized":"2024-09-05T02:14:29.627360+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:31.287838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'277","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646925+0000","last_change":"2024-09-05T00:49:27.904699+0000","last_active":"2024-09-05T02:16:21.646925+0000","last_peered":"2024-09-05T02:16:21.646925+0000","last_clean":"2024-09-05T02:16:21.646925+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:21.646925+0000","last_undegraded":"2024-09-05T02:16:21.646925+0000","last_fullsized":"2024-09-05T02:16:21.646925+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:24.274679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325261,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":473,"num_read_kb":6929,"num_write":973,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.455259+0000","last_change":"2024-09-05T00:49:31.914059+0000","last_active":"2024-09-05T02:11:41.455259+0000","last_peered":"2024-09-05T02:11:41.455259+0000","last_clean":"2024-09-05T02:11:41.455259+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:11:41.455259+0000","last_undegraded":"2024-09-05T02:11:41.455259+0000","last_fullsized":"2024-09-05T02:11:41.455259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:54.072194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'181","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.387691+0000","last_change":"2024-09-05T00:49:33.902480+0000","last_active":"2024-09-05T02:13:46.387691+0000","last_peered":"2024-09-05T02:13:46.387691+0000","last_clean":"2024-09-05T02:13:46.387691+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:13:46.387691+0000","last_undegraded":"2024-09-05T02:13:46.387691+0000","last_fullsized":"2024-09-05T02:13:46.387691+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:14.928690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'784","reported_seq":4948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.837971+0000","last_change":"2024-09-05T00:49:35.927429+0000","last_active":"2024-09-05T02:16:20.837971+0000","last_peered":"2024-09-05T02:16:20.837971+0000","last_clean":"2024-09-05T02:16:20.837971+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:20.837971+0000","last_undegraded":"2024-09-05T02:16:20.837971+0000","last_fullsized":"2024-09-05T02:16:20.837971+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:49.036040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'234","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.269828+0000","last_change":"2024-09-05T00:49:37.922161+0000","last_active":"2024-09-05T02:15:48.269828+0000","last_peered":"2024-09-05T02:15:48.269828+0000","last_clean":"2024-09-05T02:15:48.269828+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:15:48.269828+0000","last_undegraded":"2024-09-05T02:15:48.269828+0000","last_fullsized":"2024-09-05T02:15:48.269828+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:45.817026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'682","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:07.422737+0000","last_change":"2024-09-05T00:49:29.927852+0000","last_active":"2024-09-05T02:13:07.422737+0000","last_peered":"2024-09-05T02:13:07.422737+0000","last_clean":"2024-09-05T02:13:07.422737+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:13:07.422737+0000","last_undegraded":"2024-09-05T02:13:07.422737+0000","last_fullsized":"2024-09-05T02:13:07.422737+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:09.704012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'299","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.202645+0000","last_change":"2024-09-05T00:49:27.880796+0000","last_active":"2024-09-05T02:16:21.202645+0000","last_peered":"2024-09-05T02:16:21.202645+0000","last_clean":"2024-09-05T02:16:21.202645+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:21.202645+0000","last_undegraded":"2024-09-05T02:16:21.202645+0000","last_fullsized":"2024-09-05T02:16:21.202645+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:01.610874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509103,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":55829,"num_write":1056,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196390+0000","last_change":"2024-09-05T00:49:31.910341+0000","last_active":"2024-09-05T02:11:45.196390+0000","last_peered":"2024-09-05T02:11:45.196390+0000","last_clean":"2024-09-05T02:11:45.196390+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:11:45.196390+0000","last_undegraded":"2024-09-05T02:11:45.196390+0000","last_fullsized":"2024-09-05T02:11:45.196390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:21.538486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'326","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.255008+0000","last_change":"2024-09-05T00:49:34.055554+0000","last_active":"2024-09-05T02:16:21.255008+0000","last_peered":"2024-09-05T02:16:21.255008+0000","last_clean":"2024-09-05T02:16:21.255008+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:21.255008+0000","last_undegraded":"2024-09-05T02:16:21.255008+0000","last_fullsized":"2024-09-05T02:16:21.255008+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:03:22.138176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'798","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.846817+0000","last_change":"2024-09-05T00:49:35.938226+0000","last_active":"2024-09-05T02:16:20.846817+0000","last_peered":"2024-09-05T02:16:20.846817+0000","last_clean":"2024-09-05T02:16:20.846817+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:16:20.846817+0000","last_undegraded":"2024-09-05T02:16:20.846817+0000","last_fullsized":"2024-09-05T02:16:20.846817+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:56.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'744","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228164+0000","last_change":"2024-09-05T00:49:29.903992+0000","last_active":"2024-09-05T02:14:00.228164+0000","last_peered":"2024-09-05T02:14:00.228164+0000","last_clean":"2024-09-05T02:14:00.228164+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:14:00.228164+0000","last_undegraded":"2024-09-05T02:14:00.228164+0000","last_fullsized":"2024-09-05T02:14:00.228164+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:36.833935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'395","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.590878+0000","last_change":"2024-09-05T00:49:27.914055+0000","last_active":"2024-09-05T02:16:21.590878+0000","last_peered":"2024-09-05T02:16:21.590878+0000","last_clean":"2024-09-05T02:16:21.590878+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:21.590878+0000","last_undegraded":"2024-09-05T02:16:21.590878+0000","last_fullsized":"2024-09-05T02:16:21.590878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:52.269578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333761,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":784,"num_read_kb":4739,"num_write":1373,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632817+0000","last_change":"2024-09-05T00:49:31.919796+0000","last_active":"2024-09-05T02:14:01.632817+0000","last_peered":"2024-09-05T02:14:01.632817+0000","last_clean":"2024-09-05T02:14:01.632817+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:14:01.632817+0000","last_undegraded":"2024-09-05T02:14:01.632817+0000","last_fullsized":"2024-09-05T02:14:01.632817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:17.976816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'415","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.235437+0000","last_change":"2024-09-05T00:49:34.052466+0000","last_active":"2024-09-05T02:14:30.235437+0000","last_peered":"2024-09-05T02:14:30.235437+0000","last_clean":"2024-09-05T02:14:30.235437+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:14:30.235437+0000","last_undegraded":"2024-09-05T02:14:30.235437+0000","last_fullsized":"2024-09-05T02:14:30.235437+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:20.386465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":1255,"num_write":534,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.780250+0000","last_change":"2024-09-05T00:49:35.937335+0000","last_active":"2024-09-05T02:12:51.780250+0000","last_peered":"2024-09-05T02:12:51.780250+0000","last_clean":"2024-09-05T02:12:51.780250+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:12:51.780250+0000","last_undegraded":"2024-09-05T02:12:51.780250+0000","last_fullsized":"2024-09-05T02:12:51.780250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:11.123088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'584","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.668190+0000","last_change":"2024-09-05T00:49:37.946024+0000","last_active":"2024-09-05T02:15:49.668190+0000","last_peered":"2024-09-05T02:15:49.668190+0000","last_clean":"2024-09-05T02:15:49.668190+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:15:49.668190+0000","last_undegraded":"2024-09-05T02:15:49.668190+0000","last_fullsized":"2024-09-05T02:15:49.668190+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:47:31.597559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'438","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230841+0000","last_change":"2024-09-05T00:49:29.923948+0000","last_active":"2024-09-05T02:14:01.230841+0000","last_peered":"2024-09-05T02:14:01.230841+0000","last_clean":"2024-09-05T02:14:01.230841+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:14:01.230841+0000","last_undegraded":"2024-09-05T02:14:01.230841+0000","last_fullsized":"2024-09-05T02:14:01.230841+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:07.536362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'260","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.643889+0000","last_change":"2024-09-05T00:49:27.905783+0000","last_active":"2024-09-05T02:16:21.643889+0000","last_peered":"2024-09-05T02:16:21.643889+0000","last_clean":"2024-09-05T02:16:21.643889+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:21.643889+0000","last_undegraded":"2024-09-05T02:16:21.643889+0000","last_fullsized":"2024-09-05T02:16:21.643889+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:18.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":636638,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":359,"num_read_kb":6806,"num_write":830,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390543+0000","last_change":"2024-09-05T00:49:31.900583+0000","last_active":"2024-09-05T02:14:01.390543+0000","last_peered":"2024-09-05T02:14:01.390543+0000","last_clean":"2024-09-05T02:14:01.390543+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:14:01.390543+0000","last_undegraded":"2024-09-05T02:14:01.390543+0000","last_fullsized":"2024-09-05T02:14:01.390543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:18.073117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'294","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.596957+0000","last_change":"2024-09-05T00:49:33.925800+0000","last_active":"2024-09-05T02:15:49.596957+0000","last_peered":"2024-09-05T02:15:49.596957+0000","last_clean":"2024-09-05T02:15:49.596957+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:15:49.596957+0000","last_undegraded":"2024-09-05T02:15:49.596957+0000","last_fullsized":"2024-09-05T02:15:49.596957+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:21.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":989,"num_write":382,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464772+0000","last_change":"2024-09-05T00:49:35.934298+0000","last_active":"2024-09-05T02:12:16.464772+0000","last_peered":"2024-09-05T02:12:16.464772+0000","last_clean":"2024-09-05T02:12:16.464772+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:12:16.464772+0000","last_undegraded":"2024-09-05T02:12:16.464772+0000","last_fullsized":"2024-09-05T02:12:16.464772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:20.839555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:26.432127+0000","last_change":"2024-09-05T00:49:37.939432+0000","last_active":"2024-09-05T02:15:26.432127+0000","last_peered":"2024-09-05T02:15:26.432127+0000","last_clean":"2024-09-05T02:15:26.432127+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:15:26.432127+0000","last_undegraded":"2024-09-05T02:15:26.432127+0000","last_fullsized":"2024-09-05T02:15:26.432127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:10:08.494468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'478","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.850142+0000","last_change":"2024-09-05T00:49:29.896300+0000","last_active":"2024-09-05T02:13:32.850142+0000","last_peered":"2024-09-05T02:13:32.850142+0000","last_clean":"2024-09-05T02:13:32.850142+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:13:32.850142+0000","last_undegraded":"2024-09-05T02:13:32.850142+0000","last_fullsized":"2024-09-05T02:13:32.850142+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:52:46.379207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.555869+0000","last_change":"2024-09-05T00:49:27.907570+0000","last_active":"2024-09-05T02:16:21.555869+0000","last_peered":"2024-09-05T02:16:21.555869+0000","last_clean":"2024-09-05T02:16:21.555869+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:21.555869+0000","last_undegraded":"2024-09-05T02:16:21.555869+0000","last_fullsized":"2024-09-05T02:16:21.555869+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:05.915567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617206,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":414,"num_read_kb":11870,"num_write":1046,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375656+0000","last_change":"2024-09-05T00:49:31.902598+0000","last_active":"2024-09-05T02:12:46.375656+0000","last_peered":"2024-09-05T02:12:46.375656+0000","last_clean":"2024-09-05T02:12:46.375656+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:12:46.375656+0000","last_undegraded":"2024-09-05T02:12:46.375656+0000","last_fullsized":"2024-09-05T02:12:46.375656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:39.314352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'360","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:16.665940+0000","last_change":"2024-09-05T00:49:33.914287+0000","last_active":"2024-09-05T02:16:16.665940+0000","last_peered":"2024-09-05T02:16:16.665940+0000","last_clean":"2024-09-05T02:16:16.665940+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:16.665940+0000","last_undegraded":"2024-09-05T02:16:16.665940+0000","last_fullsized":"2024-09-05T02:16:16.665940+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:11.461929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53087,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1050,"num_write":436,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'799","reported_seq":2967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.566046+0000","last_change":"2024-09-05T00:49:35.943066+0000","last_active":"2024-09-05T02:15:53.566046+0000","last_peered":"2024-09-05T02:15:53.566046+0000","last_clean":"2024-09-05T02:15:53.566046+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:15:53.566046+0000","last_undegraded":"2024-09-05T02:15:53.566046+0000","last_fullsized":"2024-09-05T02:15:53.566046+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.083488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.657912+0000","last_change":"2024-09-05T00:49:37.930994+0000","last_active":"2024-09-05T02:15:48.657912+0000","last_peered":"2024-09-05T02:15:48.657912+0000","last_clean":"2024-09-05T02:15:48.657912+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:15:48.657912+0000","last_undegraded":"2024-09-05T02:15:48.657912+0000","last_fullsized":"2024-09-05T02:15:48.657912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:37:05.359031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'803","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844942+0000","last_change":"2024-09-05T00:49:29.920955+0000","last_active":"2024-09-05T02:14:19.844942+0000","last_peered":"2024-09-05T02:14:19.844942+0000","last_clean":"2024-09-05T02:14:19.844942+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:14:19.844942+0000","last_undegraded":"2024-09-05T02:14:19.844942+0000","last_fullsized":"2024-09-05T02:14:19.844942+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:44:52.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'257","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210767+0000","last_change":"2024-09-05T00:49:27.889887+0000","last_active":"2024-09-05T02:12:45.210767+0000","last_peered":"2024-09-05T02:12:45.210767+0000","last_clean":"2024-09-05T02:12:45.210767+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:12:45.210767+0000","last_undegraded":"2024-09-05T02:12:45.210767+0000","last_fullsized":"2024-09-05T02:12:45.210767+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:39.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19488382,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":486,"num_read_kb":126733,"num_write":908,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.392808+0000","last_change":"2024-09-05T00:49:31.918141+0000","last_active":"2024-09-05T02:14:11.392808+0000","last_peered":"2024-09-05T02:14:11.392808+0000","last_clean":"2024-09-05T02:14:11.392808+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:14:11.392808+0000","last_undegraded":"2024-09-05T02:14:11.392808+0000","last_fullsized":"2024-09-05T02:14:11.392808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:29.030370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'538","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.651757+0000","last_change":"2024-09-05T00:49:33.914174+0000","last_active":"2024-09-05T02:15:49.651757+0000","last_peered":"2024-09-05T02:15:49.651757+0000","last_clean":"2024-09-05T02:15:49.651757+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:15:49.651757+0000","last_undegraded":"2024-09-05T02:15:49.651757+0000","last_fullsized":"2024-09-05T02:15:49.651757+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:19.745942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":2142,"num_write":802,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391710+0000","last_change":"2024-09-05T00:49:35.924089+0000","last_active":"2024-09-05T02:14:06.391710+0000","last_peered":"2024-09-05T02:14:06.391710+0000","last_clean":"2024-09-05T02:14:06.391710+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:14:06.391710+0000","last_undegraded":"2024-09-05T02:14:06.391710+0000","last_fullsized":"2024-09-05T02:14:06.391710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.796632+0000","last_change":"2024-09-05T00:49:37.951943+0000","last_active":"2024-09-05T02:14:11.796632+0000","last_peered":"2024-09-05T02:14:11.796632+0000","last_clean":"2024-09-05T02:14:11.796632+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:14:11.796632+0000","last_undegraded":"2024-09-05T02:14:11.796632+0000","last_fullsized":"2024-09-05T02:14:11.796632+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:10:12.600724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'957","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844122+0000","last_change":"2024-09-05T00:49:29.916462+0000","last_active":"2024-09-05T02:13:40.844122+0000","last_peered":"2024-09-05T02:13:40.844122+0000","last_clean":"2024-09-05T02:13:40.844122+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:13:40.844122+0000","last_undegraded":"2024-09-05T02:13:40.844122+0000","last_fullsized":"2024-09-05T02:13:40.844122+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:54.951960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'527","reported_seq":1349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.477914+0000","last_change":"2024-09-05T00:49:27.882006+0000","last_active":"2024-09-05T02:16:21.477914+0000","last_peered":"2024-09-05T02:16:21.477914+0000","last_clean":"2024-09-05T02:16:21.477914+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:21.477914+0000","last_undegraded":"2024-09-05T02:16:21.477914+0000","last_fullsized":"2024-09-05T02:16:21.477914+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:30.493857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7940790,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1225,"num_read_kb":93814,"num_write":1725,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375772+0000","last_change":"2024-09-05T00:49:31.914002+0000","last_active":"2024-09-05T02:12:46.375772+0000","last_peered":"2024-09-05T02:12:46.375772+0000","last_clean":"2024-09-05T02:12:46.375772+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:12:46.375772+0000","last_undegraded":"2024-09-05T02:12:46.375772+0000","last_fullsized":"2024-09-05T02:12:46.375772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:51:45.528236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'313","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.604532+0000","last_change":"2024-09-05T00:49:33.912638+0000","last_active":"2024-09-05T02:15:49.604532+0000","last_peered":"2024-09-05T02:15:49.604532+0000","last_clean":"2024-09-05T02:15:49.604532+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:15:49.604532+0000","last_undegraded":"2024-09-05T02:15:49.604532+0000","last_fullsized":"2024-09-05T02:15:49.604532+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:18:34.630632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":966,"num_write":452,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455773+0000","last_change":"2024-09-05T00:49:35.943863+0000","last_active":"2024-09-05T02:13:10.455773+0000","last_peered":"2024-09-05T02:13:10.455773+0000","last_clean":"2024-09-05T02:13:10.455773+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:13:10.455773+0000","last_undegraded":"2024-09-05T02:13:10.455773+0000","last_fullsized":"2024-09-05T02:13:10.455773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:18:41.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'102","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:37.522963+0000","last_change":"2024-09-05T00:49:37.954493+0000","last_active":"2024-09-05T02:15:37.522963+0000","last_peered":"2024-09-05T02:15:37.522963+0000","last_clean":"2024-09-05T02:15:37.522963+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:15:37.522963+0000","last_undegraded":"2024-09-05T02:15:37.522963+0000","last_fullsized":"2024-09-05T02:15:37.522963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:55.189506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'494","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214294+0000","last_change":"2024-09-05T00:49:29.913611+0000","last_active":"2024-09-05T02:12:46.214294+0000","last_peered":"2024-09-05T02:12:46.214294+0000","last_clean":"2024-09-05T02:12:46.214294+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:12:46.214294+0000","last_undegraded":"2024-09-05T02:12:46.214294+0000","last_fullsized":"2024-09-05T02:12:46.214294+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:37:37.589615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'329","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.219682+0000","last_change":"2024-09-05T00:49:27.888513+0000","last_active":"2024-09-05T02:16:21.219682+0000","last_peered":"2024-09-05T02:16:21.219682+0000","last_clean":"2024-09-05T02:16:21.219682+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:21.219682+0000","last_undegraded":"2024-09-05T02:16:21.219682+0000","last_fullsized":"2024-09-05T02:16:21.219682+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:09.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252799,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":594,"num_read_kb":21238,"num_write":1176,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779463+0000","last_change":"2024-09-05T00:49:31.926052+0000","last_active":"2024-09-05T02:12:46.779463+0000","last_peered":"2024-09-05T02:12:46.779463+0000","last_clean":"2024-09-05T02:12:46.779463+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:12:46.779463+0000","last_undegraded":"2024-09-05T02:12:46.779463+0000","last_fullsized":"2024-09-05T02:12:46.779463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:30.427944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.665771+0000","last_change":"2024-09-05T00:49:33.923431+0000","last_active":"2024-09-05T02:15:49.665771+0000","last_peered":"2024-09-05T02:15:49.665771+0000","last_clean":"2024-09-05T02:15:49.665771+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:15:49.665771+0000","last_undegraded":"2024-09-05T02:15:49.665771+0000","last_fullsized":"2024-09-05T02:15:49.665771+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:01.776499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":969,"num_write":410,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'732","reported_seq":2782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.839462+0000","last_change":"2024-09-05T00:49:35.937729+0000","last_active":"2024-09-05T02:16:20.839462+0000","last_peered":"2024-09-05T02:16:20.839462+0000","last_clean":"2024-09-05T02:16:20.839462+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:20.839462+0000","last_undegraded":"2024-09-05T02:16:20.839462+0000","last_fullsized":"2024-09-05T02:16:20.839462+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:07:50.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.281544+0000","last_change":"2024-09-05T00:49:37.933620+0000","last_active":"2024-09-05T02:14:25.281544+0000","last_peered":"2024-09-05T02:14:25.281544+0000","last_clean":"2024-09-05T02:14:25.281544+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:14:25.281544+0000","last_undegraded":"2024-09-05T02:14:25.281544+0000","last_fullsized":"2024-09-05T02:14:25.281544+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:06.955650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'393","reported_seq":1887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214352+0000","last_change":"2024-09-05T00:49:29.914015+0000","last_active":"2024-09-05T02:12:46.214352+0000","last_peered":"2024-09-05T02:12:46.214352+0000","last_clean":"2024-09-05T02:12:46.214352+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:12:46.214352+0000","last_undegraded":"2024-09-05T02:12:46.214352+0000","last_fullsized":"2024-09-05T02:12:46.214352+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:02:56.335552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'265","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.185898+0000","last_change":"2024-09-05T00:49:27.875113+0000","last_active":"2024-09-05T02:16:21.185898+0000","last_peered":"2024-09-05T02:16:21.185898+0000","last_clean":"2024-09-05T02:16:21.185898+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:21.185898+0000","last_undegraded":"2024-09-05T02:16:21.185898+0000","last_fullsized":"2024-09-05T02:16:21.185898+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:27:05.251788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375261,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":455,"num_read_kb":32425,"num_write":1028,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.541606+0000","last_change":"2024-09-05T00:49:31.921867+0000","last_active":"2024-09-05T02:15:49.541606+0000","last_peered":"2024-09-05T02:15:49.541606+0000","last_clean":"2024-09-05T02:15:49.541606+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:15:49.541606+0000","last_undegraded":"2024-09-05T02:15:49.541606+0000","last_fullsized":"2024-09-05T02:15:49.541606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:12.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473659+0000","last_change":"2024-09-05T00:49:34.054334+0000","last_active":"2024-09-05T02:12:51.473659+0000","last_peered":"2024-09-05T02:12:51.473659+0000","last_clean":"2024-09-05T02:12:51.473659+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:12:51.473659+0000","last_undegraded":"2024-09-05T02:12:51.473659+0000","last_fullsized":"2024-09-05T02:12:51.473659+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:44:00.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'769","reported_seq":2806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.840171+0000","last_change":"2024-09-05T00:49:35.927090+0000","last_active":"2024-09-05T02:16:20.840171+0000","last_peered":"2024-09-05T02:16:20.840171+0000","last_clean":"2024-09-05T02:16:20.840171+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:20.840171+0000","last_undegraded":"2024-09-05T02:16:20.840171+0000","last_fullsized":"2024-09-05T02:16:20.840171+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:44.053640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.217672+0000","last_change":"2024-09-05T00:49:37.927836+0000","last_active":"2024-09-05T02:13:01.217672+0000","last_peered":"2024-09-05T02:13:01.217672+0000","last_clean":"2024-09-05T02:13:01.217672+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:13:01.217672+0000","last_undegraded":"2024-09-05T02:13:01.217672+0000","last_fullsized":"2024-09-05T02:13:01.217672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:55:13.858470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1289","reported_seq":3045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.644446+0000","last_change":"2024-09-05T00:49:29.920000+0000","last_active":"2024-09-05T02:15:48.644446+0000","last_peered":"2024-09-05T02:15:48.644446+0000","last_clean":"2024-09-05T02:15:48.644446+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:15:48.644446+0000","last_undegraded":"2024-09-05T02:15:48.644446+0000","last_fullsized":"2024-09-05T02:15:48.644446+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:23.678465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'296","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.284018+0000","last_change":"2024-09-05T00:49:27.884563+0000","last_active":"2024-09-05T02:16:21.284018+0000","last_peered":"2024-09-05T02:16:21.284018+0000","last_clean":"2024-09-05T02:16:21.284018+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:21.284018+0000","last_undegraded":"2024-09-05T02:16:21.284018+0000","last_fullsized":"2024-09-05T02:16:21.284018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:32.747613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6504318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":425,"num_read_kb":2332,"num_write":1126,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214330+0000","last_change":"2024-09-05T00:49:31.917398+0000","last_active":"2024-09-05T02:12:46.214330+0000","last_peered":"2024-09-05T02:12:46.214330+0000","last_clean":"2024-09-05T02:12:46.214330+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:12:46.214330+0000","last_undegraded":"2024-09-05T02:12:46.214330+0000","last_fullsized":"2024-09-05T02:12:46.214330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:04.120586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'448","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243657+0000","last_change":"2024-09-05T00:49:33.911807+0000","last_active":"2024-09-05T02:15:05.243657+0000","last_peered":"2024-09-05T02:15:05.243657+0000","last_clean":"2024-09-05T02:15:05.243657+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:15:05.243657+0000","last_undegraded":"2024-09-05T02:15:05.243657+0000","last_fullsized":"2024-09-05T02:15:05.243657+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:40:17.975347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52279,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1302,"num_read_kb":1773,"num_write":1870,"num_write_kb":1685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397943+0000","last_change":"2024-09-05T00:49:35.933208+0000","last_active":"2024-09-05T02:12:51.397943+0000","last_peered":"2024-09-05T02:12:51.397943+0000","last_clean":"2024-09-05T02:12:51.397943+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:12:51.397943+0000","last_undegraded":"2024-09-05T02:12:51.397943+0000","last_fullsized":"2024-09-05T02:12:51.397943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:18.752769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'152","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.782551+0000","last_change":"2024-09-05T00:49:37.945006+0000","last_active":"2024-09-05T02:13:01.782551+0000","last_peered":"2024-09-05T02:13:01.782551+0000","last_clean":"2024-09-05T02:13:01.782551+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:13:01.782551+0000","last_undegraded":"2024-09-05T02:13:01.782551+0000","last_fullsized":"2024-09-05T02:13:01.782551+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:03:44.203556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'892","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.845228+0000","last_change":"2024-09-05T00:49:29.900064+0000","last_active":"2024-09-05T02:14:19.845228+0000","last_peered":"2024-09-05T02:14:19.845228+0000","last_clean":"2024-09-05T02:14:19.845228+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:14:19.845228+0000","last_undegraded":"2024-09-05T02:14:19.845228+0000","last_fullsized":"2024-09-05T02:14:19.845228+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:13.462710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:26.834774+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T02:13:26.834774+0000","last_peered":"2024-09-05T02:13:26.834774+0000","last_clean":"2024-09-05T02:13:26.834774+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:13:26.834774+0000","last_undegraded":"2024-09-05T02:13:26.834774+0000","last_fullsized":"2024-09-05T02:13:26.834774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209522+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T02:12:40.209522+0000","last_peered":"2024-09-05T02:12:40.209522+0000","last_clean":"2024-09-05T02:12:40.209522+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:12:40.209522+0000","last_undegraded":"2024-09-05T02:12:40.209522+0000","last_fullsized":"2024-09-05T02:12:40.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.328352+0000","last_change":"2024-09-05T00:50:04.179246+0000","last_active":"2024-09-05T02:16:21.328352+0000","last_peered":"2024-09-05T02:16:21.328352+0000","last_clean":"2024-09-05T02:16:21.328352+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:21.328352+0000","last_undegraded":"2024-09-05T02:16:21.328352+0000","last_fullsized":"2024-09-05T02:16:21.328352+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:55.427090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355273,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":411,"num_read_kb":14472,"num_write":824,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826578+0000","last_change":"2024-09-05T00:49:31.913193+0000","last_active":"2024-09-05T02:12:51.826578+0000","last_peered":"2024-09-05T02:12:51.826578+0000","last_clean":"2024-09-05T02:12:51.826578+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:12:51.826578+0000","last_undegraded":"2024-09-05T02:12:51.826578+0000","last_fullsized":"2024-09-05T02:12:51.826578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:35.650327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'772","reported_seq":1490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.659667+0000","last_change":"2024-09-05T00:49:33.921799+0000","last_active":"2024-09-05T02:15:49.659667+0000","last_peered":"2024-09-05T02:15:49.659667+0000","last_clean":"2024-09-05T02:15:49.659667+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:15:49.659667+0000","last_undegraded":"2024-09-05T02:15:49.659667+0000","last_fullsized":"2024-09-05T02:15:49.659667+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:02.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1502,"num_read_kb":3214,"num_write":1434,"num_write_kb":1271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468924+0000","last_change":"2024-09-05T00:49:35.943449+0000","last_active":"2024-09-05T02:14:05.468924+0000","last_peered":"2024-09-05T02:14:05.468924+0000","last_clean":"2024-09-05T02:14:05.468924+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:14:05.468924+0000","last_undegraded":"2024-09-05T02:14:05.468924+0000","last_fullsized":"2024-09-05T02:14:05.468924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:59.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'201","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.696227+0000","last_change":"2024-09-05T00:49:37.942775+0000","last_active":"2024-09-05T02:14:29.696227+0000","last_peered":"2024-09-05T02:14:29.696227+0000","last_clean":"2024-09-05T02:14:29.696227+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:14:29.696227+0000","last_undegraded":"2024-09-05T02:14:29.696227+0000","last_fullsized":"2024-09-05T02:14:29.696227+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:04.497388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'782","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844939+0000","last_change":"2024-09-05T00:49:29.921333+0000","last_active":"2024-09-05T02:14:19.844939+0000","last_peered":"2024-09-05T02:14:19.844939+0000","last_clean":"2024-09-05T02:14:19.844939+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:14:19.844939+0000","last_undegraded":"2024-09-05T02:14:19.844939+0000","last_fullsized":"2024-09-05T02:14:19.844939+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:47.295103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836049+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T02:13:31.836049+0000","last_peered":"2024-09-05T02:13:31.836049+0000","last_clean":"2024-09-05T02:13:31.836049+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:13:31.836049+0000","last_undegraded":"2024-09-05T02:13:31.836049+0000","last_fullsized":"2024-09-05T02:13:31.836049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'256","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450783+0000","last_change":"2024-09-05T00:49:27.878156+0000","last_active":"2024-09-05T02:12:50.450783+0000","last_peered":"2024-09-05T02:12:50.450783+0000","last_clean":"2024-09-05T02:12:50.450783+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:12:50.450783+0000","last_undegraded":"2024-09-05T02:12:50.450783+0000","last_fullsized":"2024-09-05T02:12:50.450783+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:53:01.442424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6449287,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":364,"num_read_kb":5706,"num_write":1015,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229660+0000","last_change":"2024-09-05T00:49:31.908526+0000","last_active":"2024-09-05T02:14:05.229660+0000","last_peered":"2024-09-05T02:14:05.229660+0000","last_clean":"2024-09-05T02:14:05.229660+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:14:05.229660+0000","last_undegraded":"2024-09-05T02:14:05.229660+0000","last_fullsized":"2024-09-05T02:14:05.229660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:47.306493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1368","reported_seq":3378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.679194+0000","last_change":"2024-09-05T00:49:33.926295+0000","last_active":"2024-09-05T02:16:21.679194+0000","last_peered":"2024-09-05T02:16:21.679194+0000","last_clean":"2024-09-05T02:16:21.679194+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:21.679194+0000","last_undegraded":"2024-09-05T02:16:21.679194+0000","last_fullsized":"2024-09-05T02:16:21.679194+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:34:33.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150549,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":3812,"num_write":1224,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830253+0000","last_change":"2024-09-05T00:49:35.940367+0000","last_active":"2024-09-05T02:13:06.830253+0000","last_peered":"2024-09-05T02:13:06.830253+0000","last_clean":"2024-09-05T02:13:06.830253+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:13:06.830253+0000","last_undegraded":"2024-09-05T02:13:06.830253+0000","last_fullsized":"2024-09-05T02:13:06.830253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:41.127677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'248","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.066730+0000","last_change":"2024-09-05T00:49:37.939098+0000","last_active":"2024-09-05T02:14:27.066730+0000","last_peered":"2024-09-05T02:14:27.066730+0000","last_clean":"2024-09-05T02:14:27.066730+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:14:27.066730+0000","last_undegraded":"2024-09-05T02:14:27.066730+0000","last_fullsized":"2024-09-05T02:14:27.066730+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:24:16.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'409","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.699092+0000","last_change":"2024-09-05T00:49:29.900527+0000","last_active":"2024-09-05T02:15:48.699092+0000","last_peered":"2024-09-05T02:15:48.699092+0000","last_clean":"2024-09-05T02:15:48.699092+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:15:48.699092+0000","last_undegraded":"2024-09-05T02:15:48.699092+0000","last_fullsized":"2024-09-05T02:15:48.699092+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.374481+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T02:12:41.374481+0000","last_peered":"2024-09-05T02:12:41.374481+0000","last_clean":"2024-09-05T02:12:41.374481+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:12:41.374481+0000","last_undegraded":"2024-09-05T02:12:41.374481+0000","last_fullsized":"2024-09-05T02:12:41.374481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'278","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.789469+0000","last_change":"2024-09-05T00:49:27.883563+0000","last_active":"2024-09-05T02:16:21.789469+0000","last_peered":"2024-09-05T02:16:21.789469+0000","last_clean":"2024-09-05T02:16:21.789469+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:21.789469+0000","last_undegraded":"2024-09-05T02:16:21.789469+0000","last_fullsized":"2024-09-05T02:16:21.789469+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:39.304949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700033,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":578,"num_read_kb":23361,"num_write":857,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390702+0000","last_change":"2024-09-05T00:49:31.895357+0000","last_active":"2024-09-05T02:14:01.390702+0000","last_peered":"2024-09-05T02:14:01.390702+0000","last_clean":"2024-09-05T02:14:01.390702+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:14:01.390702+0000","last_undegraded":"2024-09-05T02:14:01.390702+0000","last_fullsized":"2024-09-05T02:14:01.390702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:42.106138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'346","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:46.508089+0000","last_change":"2024-09-05T00:49:34.055522+0000","last_active":"2024-09-05T02:15:46.508089+0000","last_peered":"2024-09-05T02:15:46.508089+0000","last_clean":"2024-09-05T02:15:46.508089+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:15:46.508089+0000","last_undegraded":"2024-09-05T02:15:46.508089+0000","last_fullsized":"2024-09-05T02:15:46.508089+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:45:16.964827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452179+0000","last_change":"2024-09-05T00:49:35.926479+0000","last_active":"2024-09-05T02:12:55.452179+0000","last_peered":"2024-09-05T02:12:55.452179+0000","last_clean":"2024-09-05T02:12:55.452179+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:12:55.452179+0000","last_undegraded":"2024-09-05T02:12:55.452179+0000","last_fullsized":"2024-09-05T02:12:55.452179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:15:53.424417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'243","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.151838+0000","last_change":"2024-09-05T00:49:37.952280+0000","last_active":"2024-09-05T02:14:30.151838+0000","last_peered":"2024-09-05T02:14:30.151838+0000","last_clean":"2024-09-05T02:14:30.151838+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:14:30.151838+0000","last_undegraded":"2024-09-05T02:14:30.151838+0000","last_fullsized":"2024-09-05T02:14:30.151838+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:26.910581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1276","reported_seq":2925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.706457+0000","last_change":"2024-09-05T00:49:29.908449+0000","last_active":"2024-09-05T02:14:27.706457+0000","last_peered":"2024-09-05T02:14:27.706457+0000","last_clean":"2024-09-05T02:14:27.706457+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:14:27.706457+0000","last_undegraded":"2024-09-05T02:14:27.706457+0000","last_fullsized":"2024-09-05T02:14:27.706457+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209438+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T02:12:40.209438+0000","last_peered":"2024-09-05T02:12:40.209438+0000","last_clean":"2024-09-05T02:12:40.209438+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:12:40.209438+0000","last_undegraded":"2024-09-05T02:12:40.209438+0000","last_fullsized":"2024-09-05T02:12:40.209438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'296","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.143992+0000","last_change":"2024-09-05T00:49:27.898358+0000","last_active":"2024-09-05T02:16:21.143992+0000","last_peered":"2024-09-05T02:16:21.143992+0000","last_clean":"2024-09-05T02:16:21.143992+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:21.143992+0000","last_undegraded":"2024-09-05T02:16:21.143992+0000","last_fullsized":"2024-09-05T02:16:21.143992+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:29.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21328244,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":488,"num_read_kb":46632,"num_write":1109,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.456748+0000","last_change":"2024-09-05T00:49:31.910432+0000","last_active":"2024-09-05T02:13:15.456748+0000","last_peered":"2024-09-05T02:13:15.456748+0000","last_clean":"2024-09-05T02:13:15.456748+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:13:15.456748+0000","last_undegraded":"2024-09-05T02:13:15.456748+0000","last_fullsized":"2024-09-05T02:13:15.456748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:21:42.078643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.928708+0000","last_change":"2024-09-05T00:49:33.929270+0000","last_active":"2024-09-05T02:15:49.928708+0000","last_peered":"2024-09-05T02:15:49.928708+0000","last_clean":"2024-09-05T02:15:49.928708+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:15:49.928708+0000","last_undegraded":"2024-09-05T02:15:49.928708+0000","last_fullsized":"2024-09-05T02:15:49.928708+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:24:30.946732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.414541+0000","last_change":"2024-09-05T00:49:35.948033+0000","last_active":"2024-09-05T02:14:06.414541+0000","last_peered":"2024-09-05T02:14:06.414541+0000","last_clean":"2024-09-05T02:14:06.414541+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:14:06.414541+0000","last_undegraded":"2024-09-05T02:14:06.414541+0000","last_fullsized":"2024-09-05T02:14:06.414541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:58.062174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'117","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230591+0000","last_change":"2024-09-05T00:49:37.953956+0000","last_active":"2024-09-05T02:14:10.230591+0000","last_peered":"2024-09-05T02:14:10.230591+0000","last_clean":"2024-09-05T02:14:10.230591+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:14:10.230591+0000","last_undegraded":"2024-09-05T02:14:10.230591+0000","last_fullsized":"2024-09-05T02:14:10.230591+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:12.611232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'541","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.617732+0000","last_change":"2024-09-05T00:49:29.907763+0000","last_active":"2024-09-05T02:15:48.617732+0000","last_peered":"2024-09-05T02:15:48.617732+0000","last_clean":"2024-09-05T02:15:48.617732+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:15:48.617732+0000","last_undegraded":"2024-09-05T02:15:48.617732+0000","last_fullsized":"2024-09-05T02:15:48.617732+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:22.730148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'233","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.217613+0000","last_change":"2024-09-05T00:49:27.889027+0000","last_active":"2024-09-05T02:13:15.217613+0000","last_peered":"2024-09-05T02:13:15.217613+0000","last_clean":"2024-09-05T02:13:15.217613+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:13:15.217613+0000","last_undegraded":"2024-09-05T02:13:15.217613+0000","last_fullsized":"2024-09-05T02:13:15.217613+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:37.525116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9458431,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":495,"num_read_kb":39042,"num_write":851,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.778371+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T02:12:41.778371+0000","last_peered":"2024-09-05T02:12:41.778371+0000","last_clean":"2024-09-05T02:12:41.778371+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:12:41.778371+0000","last_undegraded":"2024-09-05T02:12:41.778371+0000","last_fullsized":"2024-09-05T02:12:41.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452119+0000","last_change":"2024-09-05T00:49:31.917058+0000","last_active":"2024-09-05T02:12:55.452119+0000","last_peered":"2024-09-05T02:12:55.452119+0000","last_clean":"2024-09-05T02:12:55.452119+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:12:55.452119+0000","last_undegraded":"2024-09-05T02:12:55.452119+0000","last_fullsized":"2024-09-05T02:12:55.452119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:09:49.645261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'668","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.663651+0000","last_change":"2024-09-05T00:49:33.928573+0000","last_active":"2024-09-05T02:15:49.663651+0000","last_peered":"2024-09-05T02:15:49.663651+0000","last_clean":"2024-09-05T02:15:49.663651+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:15:49.663651+0000","last_undegraded":"2024-09-05T02:15:49.663651+0000","last_fullsized":"2024-09-05T02:15:49.663651+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:49:02.005394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130968,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":2239,"num_write":998,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216518+0000","last_change":"2024-09-05T00:49:35.938207+0000","last_active":"2024-09-05T02:12:56.216518+0000","last_peered":"2024-09-05T02:12:56.216518+0000","last_clean":"2024-09-05T02:12:56.216518+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:12:56.216518+0000","last_undegraded":"2024-09-05T02:12:56.216518+0000","last_fullsized":"2024-09-05T02:12:56.216518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:03.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.920772+0000","last_change":"2024-09-05T00:49:37.933639+0000","last_active":"2024-09-05T02:14:29.920772+0000","last_peered":"2024-09-05T02:14:29.920772+0000","last_clean":"2024-09-05T02:14:29.920772+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:14:29.920772+0000","last_undegraded":"2024-09-05T02:14:29.920772+0000","last_fullsized":"2024-09-05T02:14:29.920772+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:37.728081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'883","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701326+0000","last_change":"2024-09-05T00:49:29.913232+0000","last_active":"2024-09-05T02:14:27.701326+0000","last_peered":"2024-09-05T02:14:27.701326+0000","last_clean":"2024-09-05T02:14:27.701326+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:14:27.701326+0000","last_undegraded":"2024-09-05T02:14:27.701326+0000","last_fullsized":"2024-09-05T02:14:27.701326+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:24.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'286","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.811136+0000","last_change":"2024-09-05T00:49:27.879948+0000","last_active":"2024-09-05T02:16:21.811136+0000","last_peered":"2024-09-05T02:16:21.811136+0000","last_clean":"2024-09-05T02:16:21.811136+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:21.811136+0000","last_undegraded":"2024-09-05T02:16:21.811136+0000","last_fullsized":"2024-09-05T02:16:21.811136+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:21:52.199092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":491,"num_read_kb":37378,"num_write":1020,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826629+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T02:12:51.826629+0000","last_peered":"2024-09-05T02:12:51.826629+0000","last_clean":"2024-09-05T02:12:51.826629+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:12:51.826629+0000","last_undegraded":"2024-09-05T02:12:51.826629+0000","last_fullsized":"2024-09-05T02:12:51.826629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397897+0000","last_change":"2024-09-05T00:49:31.913143+0000","last_active":"2024-09-05T02:12:51.397897+0000","last_peered":"2024-09-05T02:12:51.397897+0000","last_clean":"2024-09-05T02:12:51.397897+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:12:51.397897+0000","last_undegraded":"2024-09-05T02:12:51.397897+0000","last_fullsized":"2024-09-05T02:12:51.397897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:26.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'204","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.781213+0000","last_change":"2024-09-05T00:49:34.054211+0000","last_active":"2024-09-05T02:12:56.781213+0000","last_peered":"2024-09-05T02:12:56.781213+0000","last_clean":"2024-09-05T02:12:56.781213+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:12:56.781213+0000","last_undegraded":"2024-09-05T02:12:56.781213+0000","last_fullsized":"2024-09-05T02:12:56.781213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:13.534123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'792","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.536994+0000","last_change":"2024-09-05T00:49:35.933822+0000","last_active":"2024-09-05T02:15:53.536994+0000","last_peered":"2024-09-05T02:15:53.536994+0000","last_clean":"2024-09-05T02:15:53.536994+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:15:53.536994+0000","last_undegraded":"2024-09-05T02:15:53.536994+0000","last_fullsized":"2024-09-05T02:15:53.536994+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'146","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:31.508344+0000","last_change":"2024-09-05T00:49:37.948757+0000","last_active":"2024-09-05T02:15:31.508344+0000","last_peered":"2024-09-05T02:15:31.508344+0000","last_clean":"2024-09-05T02:15:31.508344+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:15:31.508344+0000","last_undegraded":"2024-09-05T02:15:31.508344+0000","last_fullsized":"2024-09-05T02:15:31.508344+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:40.306605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'962","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487814+0000","last_change":"2024-09-05T00:49:29.927814+0000","last_active":"2024-09-05T02:13:51.487814+0000","last_peered":"2024-09-05T02:13:51.487814+0000","last_clean":"2024-09-05T02:13:51.487814+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:13:51.487814+0000","last_undegraded":"2024-09-05T02:13:51.487814+0000","last_fullsized":"2024-09-05T02:13:51.487814+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:53:13.267895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'362","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.500110+0000","last_change":"2024-09-05T00:49:27.910000+0000","last_active":"2024-09-05T02:16:21.500110+0000","last_peered":"2024-09-05T02:16:21.500110+0000","last_clean":"2024-09-05T02:16:21.500110+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:21.500110+0000","last_undegraded":"2024-09-05T02:16:21.500110+0000","last_fullsized":"2024-09-05T02:16:21.500110+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:27:09.939131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89265,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":704,"num_read_kb":36690,"num_write":1383,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792763+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T02:13:51.792763+0000","last_peered":"2024-09-05T02:13:51.792763+0000","last_clean":"2024-09-05T02:13:51.792763+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:13:51.792763+0000","last_undegraded":"2024-09-05T02:13:51.792763+0000","last_fullsized":"2024-09-05T02:13:51.792763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.215403+0000","last_change":"2024-09-05T00:49:31.916181+0000","last_active":"2024-09-05T02:12:51.215403+0000","last_peered":"2024-09-05T02:12:51.215403+0000","last_clean":"2024-09-05T02:12:51.215403+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:12:51.215403+0000","last_undegraded":"2024-09-05T02:12:51.215403+0000","last_fullsized":"2024-09-05T02:12:51.215403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:16:28.018466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'156","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216578+0000","last_change":"2024-09-05T00:49:33.919913+0000","last_active":"2024-09-05T02:12:56.216578+0000","last_peered":"2024-09-05T02:12:56.216578+0000","last_clean":"2024-09-05T02:12:56.216578+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:12:56.216578+0000","last_undegraded":"2024-09-05T02:12:56.216578+0000","last_fullsized":"2024-09-05T02:12:56.216578+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:48.393350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'799","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.844438+0000","last_change":"2024-09-05T00:49:35.938148+0000","last_active":"2024-09-05T02:16:20.844438+0000","last_peered":"2024-09-05T02:16:20.844438+0000","last_clean":"2024-09-05T02:16:20.844438+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:20.844438+0000","last_undegraded":"2024-09-05T02:16:20.844438+0000","last_fullsized":"2024-09-05T02:16:20.844438+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:27.051091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'174","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452197+0000","last_change":"2024-09-05T00:49:37.954318+0000","last_active":"2024-09-05T02:12:55.452197+0000","last_peered":"2024-09-05T02:12:55.452197+0000","last_clean":"2024-09-05T02:12:55.452197+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:12:55.452197+0000","last_undegraded":"2024-09-05T02:12:55.452197+0000","last_fullsized":"2024-09-05T02:12:55.452197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:51.538774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'563","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.707331+0000","last_change":"2024-09-05T00:49:29.906133+0000","last_active":"2024-09-05T02:14:27.707331+0000","last_peered":"2024-09-05T02:14:27.707331+0000","last_clean":"2024-09-05T02:14:27.707331+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:14:27.707331+0000","last_undegraded":"2024-09-05T02:14:27.707331+0000","last_fullsized":"2024-09-05T02:14:27.707331+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:44.863527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'295","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467748+0000","last_change":"2024-09-05T00:49:27.894589+0000","last_active":"2024-09-05T02:14:00.467748+0000","last_peered":"2024-09-05T02:14:00.467748+0000","last_clean":"2024-09-05T02:14:00.467748+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:14:00.467748+0000","last_undegraded":"2024-09-05T02:14:00.467748+0000","last_fullsized":"2024-09-05T02:14:00.467748+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:44.386284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11119831,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":428,"num_read_kb":1280,"num_write":986,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.411126+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T02:13:51.411126+0000","last_peered":"2024-09-05T02:13:51.411126+0000","last_clean":"2024-09-05T02:13:51.411126+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:13:51.411126+0000","last_undegraded":"2024-09-05T02:13:51.411126+0000","last_fullsized":"2024-09-05T02:13:51.411126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487854+0000","last_change":"2024-09-05T00:49:31.913300+0000","last_active":"2024-09-05T02:13:51.487854+0000","last_peered":"2024-09-05T02:13:51.487854+0000","last_clean":"2024-09-05T02:13:51.487854+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:13:51.487854+0000","last_undegraded":"2024-09-05T02:13:51.487854+0000","last_fullsized":"2024-09-05T02:13:51.487854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'755","reported_seq":1511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.487705+0000","last_change":"2024-09-05T00:49:34.054583+0000","last_active":"2024-09-05T02:16:21.487705+0000","last_peered":"2024-09-05T02:16:21.487705+0000","last_clean":"2024-09-05T02:16:21.487705+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:21.487705+0000","last_undegraded":"2024-09-05T02:16:21.487705+0000","last_fullsized":"2024-09-05T02:16:21.487705+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:41.332842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146628,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1309,"num_read_kb":2983,"num_write":1048,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.474955+0000","last_change":"2024-09-05T00:49:35.934315+0000","last_active":"2024-09-05T02:12:56.474955+0000","last_peered":"2024-09-05T02:12:56.474955+0000","last_clean":"2024-09-05T02:12:56.474955+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:12:56.474955+0000","last_undegraded":"2024-09-05T02:12:56.474955+0000","last_fullsized":"2024-09-05T02:12:56.474955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:47.877686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.213128+0000","last_change":"2024-09-05T00:49:37.942217+0000","last_active":"2024-09-05T02:12:55.213128+0000","last_peered":"2024-09-05T02:12:55.213128+0000","last_clean":"2024-09-05T02:12:55.213128+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:12:55.213128+0000","last_undegraded":"2024-09-05T02:12:55.213128+0000","last_fullsized":"2024-09-05T02:12:55.213128+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:07:48.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'136","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.069901+0000","last_change":"2024-09-05T00:49:37.943464+0000","last_active":"2024-09-05T02:14:30.069901+0000","last_peered":"2024-09-05T02:14:30.069901+0000","last_clean":"2024-09-05T02:14:30.069901+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:14:30.069901+0000","last_undegraded":"2024-09-05T02:14:30.069901+0000","last_fullsized":"2024-09-05T02:14:30.069901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:53.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'583","reported_seq":2215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.224203+0000","last_change":"2024-09-05T00:49:29.912807+0000","last_active":"2024-09-05T02:13:31.224203+0000","last_peered":"2024-09-05T02:13:31.224203+0000","last_clean":"2024-09-05T02:13:31.224203+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:13:31.224203+0000","last_undegraded":"2024-09-05T02:13:31.224203+0000","last_fullsized":"2024-09-05T02:13:31.224203+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'241","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.159306+0000","last_change":"2024-09-05T00:49:27.907668+0000","last_active":"2024-09-05T02:16:21.159306+0000","last_peered":"2024-09-05T02:16:21.159306+0000","last_clean":"2024-09-05T02:16:21.159306+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:21.159306+0000","last_undegraded":"2024-09-05T02:16:21.159306+0000","last_fullsized":"2024-09-05T02:16:21.159306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:40.897083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18373462,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":445,"num_read_kb":27235,"num_write":892,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.788861+0000","last_change":"2024-09-05T00:49:31.905642+0000","last_active":"2024-09-05T02:13:31.788861+0000","last_peered":"2024-09-05T02:13:31.788861+0000","last_clean":"2024-09-05T02:13:31.788861+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:13:31.788861+0000","last_undegraded":"2024-09-05T02:13:31.788861+0000","last_fullsized":"2024-09-05T02:13:31.788861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:00.091113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'311","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.513487+0000","last_change":"2024-09-05T00:49:33.930112+0000","last_active":"2024-09-05T02:15:56.513487+0000","last_peered":"2024-09-05T02:15:56.513487+0000","last_clean":"2024-09-05T02:15:56.513487+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:15:56.513487+0000","last_undegraded":"2024-09-05T02:15:56.513487+0000","last_fullsized":"2024-09-05T02:15:56.513487+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:14.000620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1061,"num_write":420,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.484298+0000","last_change":"2024-09-05T00:49:35.939413+0000","last_active":"2024-09-05T02:13:36.484298+0000","last_peered":"2024-09-05T02:13:36.484298+0000","last_clean":"2024-09-05T02:13:36.484298+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:13:36.484298+0000","last_undegraded":"2024-09-05T02:13:36.484298+0000","last_fullsized":"2024-09-05T02:13:36.484298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.914012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'371","reported_seq":1835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623686+0000","last_change":"2024-09-05T00:49:29.890020+0000","last_active":"2024-09-05T02:14:29.623686+0000","last_peered":"2024-09-05T02:14:29.623686+0000","last_clean":"2024-09-05T02:14:29.623686+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:14:29.623686+0000","last_undegraded":"2024-09-05T02:14:29.623686+0000","last_fullsized":"2024-09-05T02:14:29.623686+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:34.765894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'265","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.512786+0000","last_change":"2024-09-05T00:49:27.905154+0000","last_active":"2024-09-05T02:16:21.512786+0000","last_peered":"2024-09-05T02:16:21.512786+0000","last_clean":"2024-09-05T02:16:21.512786+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:21.512786+0000","last_undegraded":"2024-09-05T02:16:21.512786+0000","last_fullsized":"2024-09-05T02:16:21.512786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:44.309565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6345017,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":707,"num_read_kb":54962,"num_write":1000,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483453+0000","last_change":"2024-09-05T00:49:31.910668+0000","last_active":"2024-09-05T02:13:31.483453+0000","last_peered":"2024-09-05T02:13:31.483453+0000","last_clean":"2024-09-05T02:13:31.483453+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:13:31.483453+0000","last_undegraded":"2024-09-05T02:13:31.483453+0000","last_fullsized":"2024-09-05T02:13:31.483453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:49.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461072+0000","last_change":"2024-09-05T00:49:33.915459+0000","last_active":"2024-09-05T02:13:35.461072+0000","last_peered":"2024-09-05T02:13:35.461072+0000","last_clean":"2024-09-05T02:13:35.461072+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:13:35.461072+0000","last_undegraded":"2024-09-05T02:13:35.461072+0000","last_fullsized":"2024-09-05T02:13:35.461072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626911+0000","last_change":"2024-09-05T00:49:35.935530+0000","last_active":"2024-09-05T02:13:36.626911+0000","last_peered":"2024-09-05T02:13:36.626911+0000","last_clean":"2024-09-05T02:13:36.626911+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:13:36.626911+0000","last_undegraded":"2024-09-05T02:13:36.626911+0000","last_fullsized":"2024-09-05T02:13:36.626911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:22:34.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'228","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.905325+0000","last_change":"2024-09-05T00:49:37.926241+0000","last_active":"2024-09-05T02:14:29.905325+0000","last_peered":"2024-09-05T02:14:29.905325+0000","last_clean":"2024-09-05T02:14:29.905325+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:14:29.905325+0000","last_undegraded":"2024-09-05T02:14:29.905325+0000","last_fullsized":"2024-09-05T02:14:29.905325+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:25.119785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'412","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697308+0000","last_change":"2024-09-05T00:49:29.927723+0000","last_active":"2024-09-05T02:15:48.697308+0000","last_peered":"2024-09-05T02:15:48.697308+0000","last_clean":"2024-09-05T02:15:48.697308+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:15:48.697308+0000","last_undegraded":"2024-09-05T02:15:48.697308+0000","last_fullsized":"2024-09-05T02:15:48.697308+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:50.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'253","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.195218+0000","last_change":"2024-09-05T00:49:27.911758+0000","last_active":"2024-09-05T02:11:40.195218+0000","last_peered":"2024-09-05T02:11:40.195218+0000","last_clean":"2024-09-05T02:11:40.195218+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:11:40.195218+0000","last_undegraded":"2024-09-05T02:11:40.195218+0000","last_fullsized":"2024-09-05T02:11:40.195218+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:11:19.729173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":425,"num_read_kb":91576,"num_write":975,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836079+0000","last_change":"2024-09-05T00:49:31.926718+0000","last_active":"2024-09-05T02:13:31.836079+0000","last_peered":"2024-09-05T02:13:31.836079+0000","last_clean":"2024-09-05T02:13:31.836079+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:13:31.836079+0000","last_undegraded":"2024-09-05T02:13:31.836079+0000","last_fullsized":"2024-09-05T02:13:31.836079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:51:03.171626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.174204+0000","last_change":"2024-09-05T00:49:33.930627+0000","last_active":"2024-09-05T02:16:21.174204+0000","last_peered":"2024-09-05T02:16:21.174204+0000","last_clean":"2024-09-05T02:16:21.174204+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:21.174204+0000","last_undegraded":"2024-09-05T02:16:21.174204+0000","last_fullsized":"2024-09-05T02:16:21.174204+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:57:28.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407690+0000","last_change":"2024-09-05T00:49:35.948016+0000","last_active":"2024-09-05T02:13:36.407690+0000","last_peered":"2024-09-05T02:13:36.407690+0000","last_clean":"2024-09-05T02:13:36.407690+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:13:36.407690+0000","last_undegraded":"2024-09-05T02:13:36.407690+0000","last_fullsized":"2024-09-05T02:13:36.407690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.587514+0000","last_change":"2024-09-05T00:49:37.946851+0000","last_active":"2024-09-05T02:14:29.587514+0000","last_peered":"2024-09-05T02:14:29.587514+0000","last_clean":"2024-09-05T02:14:29.587514+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:14:29.587514+0000","last_undegraded":"2024-09-05T02:14:29.587514+0000","last_fullsized":"2024-09-05T02:14:29.587514+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:32.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483310+0000","last_change":"2024-09-05T00:49:29.924987+0000","last_active":"2024-09-05T02:13:31.483310+0000","last_peered":"2024-09-05T02:13:31.483310+0000","last_clean":"2024-09-05T02:13:31.483310+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:13:31.483310+0000","last_undegraded":"2024-09-05T02:13:31.483310+0000","last_fullsized":"2024-09-05T02:13:31.483310+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:54:10.390860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'273","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.433210+0000","last_change":"2024-09-05T00:49:27.894130+0000","last_active":"2024-09-05T02:11:40.433210+0000","last_peered":"2024-09-05T02:11:40.433210+0000","last_clean":"2024-09-05T02:11:40.433210+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:11:40.433210+0000","last_undegraded":"2024-09-05T02:11:40.433210+0000","last_fullsized":"2024-09-05T02:11:40.433210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:56.396000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345006,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":475,"num_read_kb":6648,"num_write":1049,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.406490+0000","last_change":"2024-09-05T00:49:31.923471+0000","last_active":"2024-09-05T02:13:31.406490+0000","last_peered":"2024-09-05T02:13:31.406490+0000","last_clean":"2024-09-05T02:13:31.406490+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:13:31.406490+0000","last_undegraded":"2024-09-05T02:13:31.406490+0000","last_fullsized":"2024-09-05T02:13:31.406490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:09.929132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'294","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.661206+0000","last_change":"2024-09-05T00:49:33.908585+0000","last_active":"2024-09-05T02:15:56.661206+0000","last_peered":"2024-09-05T02:15:56.661206+0000","last_clean":"2024-09-05T02:15:56.661206+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:15:56.661206+0000","last_undegraded":"2024-09-05T02:15:56.661206+0000","last_fullsized":"2024-09-05T02:15:56.661206+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:52.420648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1062,"num_write":410,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461188+0000","last_change":"2024-09-05T00:49:35.943952+0000","last_active":"2024-09-05T02:13:35.461188+0000","last_peered":"2024-09-05T02:13:35.461188+0000","last_clean":"2024-09-05T02:13:35.461188+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:13:35.461188+0000","last_undegraded":"2024-09-05T02:13:35.461188+0000","last_fullsized":"2024-09-05T02:13:35.461188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:48.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'398","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:28.052618+0000","last_change":"2024-09-05T00:49:29.903345+0000","last_active":"2024-09-05T02:13:28.052618+0000","last_peered":"2024-09-05T02:13:28.052618+0000","last_clean":"2024-09-05T02:13:28.052618+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:13:28.052618+0000","last_undegraded":"2024-09-05T02:13:28.052618+0000","last_fullsized":"2024-09-05T02:13:28.052618+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:55:40.567779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'286","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451596+0000","last_change":"2024-09-05T00:49:27.884147+0000","last_active":"2024-09-05T02:16:21.451596+0000","last_peered":"2024-09-05T02:16:21.451596+0000","last_clean":"2024-09-05T02:16:21.451596+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:21.451596+0000","last_undegraded":"2024-09-05T02:16:21.451596+0000","last_fullsized":"2024-09-05T02:16:21.451596+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:59:47.503408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291972,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":868,"num_read_kb":44981,"num_write":1031,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.544020+0000","last_change":"2024-09-05T00:49:31.915305+0000","last_active":"2024-09-05T02:15:49.544020+0000","last_peered":"2024-09-05T02:15:49.544020+0000","last_clean":"2024-09-05T02:15:49.544020+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:15:49.544020+0000","last_undegraded":"2024-09-05T02:15:49.544020+0000","last_fullsized":"2024-09-05T02:15:49.544020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:46.356538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'526","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.875587+0000","last_change":"2024-09-05T00:49:33.912309+0000","last_active":"2024-09-05T02:16:20.875587+0000","last_peered":"2024-09-05T02:16:20.875587+0000","last_clean":"2024-09-05T02:16:20.875587+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:20.875587+0000","last_undegraded":"2024-09-05T02:16:20.875587+0000","last_fullsized":"2024-09-05T02:16:20.875587+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:19:37.409372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":924,"num_read_kb":2006,"num_write":808,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.201299+0000","last_change":"2024-09-05T00:49:35.938332+0000","last_active":"2024-09-05T02:12:05.201299+0000","last_peered":"2024-09-05T02:12:05.201299+0000","last_clean":"2024-09-05T02:12:05.201299+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:12:05.201299+0000","last_undegraded":"2024-09-05T02:12:05.201299+0000","last_fullsized":"2024-09-05T02:12:05.201299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:56:14.582023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'181","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485412+0000","last_change":"2024-09-05T00:49:37.953067+0000","last_active":"2024-09-05T02:13:41.485412+0000","last_peered":"2024-09-05T02:13:41.485412+0000","last_clean":"2024-09-05T02:13:41.485412+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:13:41.485412+0000","last_undegraded":"2024-09-05T02:13:41.485412+0000","last_fullsized":"2024-09-05T02:13:41.485412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:56.679412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'420","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465509+0000","last_change":"2024-09-05T00:49:29.904429+0000","last_active":"2024-09-05T02:13:50.465509+0000","last_peered":"2024-09-05T02:13:50.465509+0000","last_clean":"2024-09-05T02:13:50.465509+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:13:50.465509+0000","last_undegraded":"2024-09-05T02:13:50.465509+0000","last_fullsized":"2024-09-05T02:13:50.465509+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:12.986135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'295","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.769909+0000","last_change":"2024-09-05T00:49:27.881769+0000","last_active":"2024-09-05T02:16:21.769909+0000","last_peered":"2024-09-05T02:16:21.769909+0000","last_clean":"2024-09-05T02:16:21.769909+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:21.769909+0000","last_undegraded":"2024-09-05T02:16:21.769909+0000","last_fullsized":"2024-09-05T02:16:21.769909+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:21.143493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8478999,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":516,"num_read_kb":27594,"num_write":980,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.398020+0000","last_change":"2024-09-05T00:49:31.923706+0000","last_active":"2024-09-05T02:12:51.398020+0000","last_peered":"2024-09-05T02:12:51.398020+0000","last_clean":"2024-09-05T02:12:51.398020+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:12:51.398020+0000","last_undegraded":"2024-09-05T02:12:51.398020+0000","last_fullsized":"2024-09-05T02:12:51.398020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:07:49.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'334","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.028866+0000","last_change":"2024-09-05T00:49:33.917339+0000","last_active":"2024-09-05T02:16:21.028866+0000","last_peered":"2024-09-05T02:16:21.028866+0000","last_clean":"2024-09-05T02:16:21.028866+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:21.028866+0000","last_undegraded":"2024-09-05T02:16:21.028866+0000","last_fullsized":"2024-09-05T02:16:21.028866+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:34.348566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.770357+0000","last_change":"2024-09-05T00:49:35.924621+0000","last_active":"2024-09-05T02:12:06.770357+0000","last_peered":"2024-09-05T02:12:06.770357+0000","last_clean":"2024-09-05T02:12:06.770357+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:12:06.770357+0000","last_undegraded":"2024-09-05T02:12:06.770357+0000","last_fullsized":"2024-09-05T02:12:06.770357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:29.284134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.408737+0000","last_change":"2024-09-05T00:49:37.931246+0000","last_active":"2024-09-05T02:13:41.408737+0000","last_peered":"2024-09-05T02:13:41.408737+0000","last_clean":"2024-09-05T02:13:41.408737+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:13:41.408737+0000","last_undegraded":"2024-09-05T02:13:41.408737+0000","last_fullsized":"2024-09-05T02:13:41.408737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:20.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'493","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709348+0000","last_change":"2024-09-05T00:49:29.925442+0000","last_active":"2024-09-05T02:14:27.709348+0000","last_peered":"2024-09-05T02:14:27.709348+0000","last_clean":"2024-09-05T02:14:27.709348+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:14:27.709348+0000","last_undegraded":"2024-09-05T02:14:27.709348+0000","last_fullsized":"2024-09-05T02:14:27.709348+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:04.486708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'261","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.129143+0000","last_change":"2024-09-05T00:49:27.883246+0000","last_active":"2024-09-05T02:16:21.129143+0000","last_peered":"2024-09-05T02:16:21.129143+0000","last_clean":"2024-09-05T02:16:21.129143+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:21.129143+0000","last_undegraded":"2024-09-05T02:16:21.129143+0000","last_fullsized":"2024-09-05T02:16:21.129143+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:38:45.620263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16796977,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":391,"num_read_kb":39348,"num_write":910,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.204119+0000","last_change":"2024-09-05T00:49:31.923994+0000","last_active":"2024-09-05T02:12:01.204119+0000","last_peered":"2024-09-05T02:12:01.204119+0000","last_clean":"2024-09-05T02:12:01.204119+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:12:01.204119+0000","last_undegraded":"2024-09-05T02:12:01.204119+0000","last_fullsized":"2024-09-05T02:12:01.204119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:56.251468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'316","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.653932+0000","last_change":"2024-09-05T00:49:34.055772+0000","last_active":"2024-09-05T02:15:49.653932+0000","last_peered":"2024-09-05T02:15:49.653932+0000","last_clean":"2024-09-05T02:15:49.653932+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:15:49.653932+0000","last_undegraded":"2024-09-05T02:15:49.653932+0000","last_fullsized":"2024-09-05T02:15:49.653932+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:58.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56876,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":1086,"num_write":426,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.792016+0000","last_change":"2024-09-05T00:49:35.935059+0000","last_active":"2024-09-05T02:13:46.792016+0000","last_peered":"2024-09-05T02:13:46.792016+0000","last_clean":"2024-09-05T02:13:46.792016+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:13:46.792016+0000","last_undegraded":"2024-09-05T02:13:46.792016+0000","last_fullsized":"2024-09-05T02:13:46.792016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:18:31.249785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'106","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.686139+0000","last_change":"2024-09-05T00:49:37.938971+0000","last_active":"2024-09-05T02:15:49.686139+0000","last_peered":"2024-09-05T02:15:49.686139+0000","last_clean":"2024-09-05T02:15:49.686139+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:15:49.686139+0000","last_undegraded":"2024-09-05T02:15:49.686139+0000","last_fullsized":"2024-09-05T02:15:49.686139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:26.724944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.621488+0000","last_change":"2024-09-05T00:49:29.900558+0000","last_active":"2024-09-05T02:15:48.621488+0000","last_peered":"2024-09-05T02:15:48.621488+0000","last_clean":"2024-09-05T02:15:48.621488+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:15:48.621488+0000","last_undegraded":"2024-09-05T02:15:48.621488+0000","last_fullsized":"2024-09-05T02:15:48.621488+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:58:48.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'327","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.822756+0000","last_change":"2024-09-05T00:49:27.876740+0000","last_active":"2024-09-05T02:13:36.822756+0000","last_peered":"2024-09-05T02:13:36.822756+0000","last_clean":"2024-09-05T02:13:36.822756+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:13:36.822756+0000","last_undegraded":"2024-09-05T02:13:36.822756+0000","last_fullsized":"2024-09-05T02:13:36.822756+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:04:11.453294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6975197,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":670,"num_read_kb":25028,"num_write":1187,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.769113+0000","last_change":"2024-09-05T00:49:31.926005+0000","last_active":"2024-09-05T02:12:01.769113+0000","last_peered":"2024-09-05T02:12:01.769113+0000","last_clean":"2024-09-05T02:12:01.769113+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:12:01.769113+0000","last_undegraded":"2024-09-05T02:12:01.769113+0000","last_fullsized":"2024-09-05T02:12:01.769113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:56.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228677+0000","last_change":"2024-09-05T00:49:34.053064+0000","last_active":"2024-09-05T02:13:51.228677+0000","last_peered":"2024-09-05T02:13:51.228677+0000","last_clean":"2024-09-05T02:13:51.228677+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:13:51.228677+0000","last_undegraded":"2024-09-05T02:13:51.228677+0000","last_fullsized":"2024-09-05T02:13:51.228677+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:16.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'769","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.829636+0000","last_change":"2024-09-05T00:49:35.932657+0000","last_active":"2024-09-05T02:16:20.829636+0000","last_peered":"2024-09-05T02:16:20.829636+0000","last_clean":"2024-09-05T02:16:20.829636+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:20.829636+0000","last_undegraded":"2024-09-05T02:16:20.829636+0000","last_fullsized":"2024-09-05T02:16:20.829636+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:55.080143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.628035+0000","last_change":"2024-09-05T00:49:37.942533+0000","last_active":"2024-09-05T02:13:41.628035+0000","last_peered":"2024-09-05T02:13:41.628035+0000","last_clean":"2024-09-05T02:13:41.628035+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:13:41.628035+0000","last_undegraded":"2024-09-05T02:13:41.628035+0000","last_fullsized":"2024-09-05T02:13:41.628035+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:02:29.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'867","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629749+0000","last_change":"2024-09-05T00:49:29.918570+0000","last_active":"2024-09-05T02:14:29.629749+0000","last_peered":"2024-09-05T02:14:29.629749+0000","last_clean":"2024-09-05T02:14:29.629749+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:14:29.629749+0000","last_undegraded":"2024-09-05T02:14:29.629749+0000","last_fullsized":"2024-09-05T02:14:29.629749+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:50.098868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'228","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:13.557049+0000","last_change":"2024-09-05T00:49:27.898399+0000","last_active":"2024-09-05T02:13:13.557049+0000","last_peered":"2024-09-05T02:13:13.557049+0000","last_clean":"2024-09-05T02:13:13.557049+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:13:13.557049+0000","last_undegraded":"2024-09-05T02:13:13.557049+0000","last_fullsized":"2024-09-05T02:13:13.557049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:30.481449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594706,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":6339,"num_write":813,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.814573+0000","last_change":"2024-09-05T00:49:31.924947+0000","last_active":"2024-09-05T02:12:01.814573+0000","last_peered":"2024-09-05T02:12:01.814573+0000","last_clean":"2024-09-05T02:12:01.814573+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:12:01.814573+0000","last_undegraded":"2024-09-05T02:12:01.814573+0000","last_fullsized":"2024-09-05T02:12:01.814573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:00:06.551471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'377","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:35.236621+0000","last_change":"2024-09-05T00:49:33.910494+0000","last_active":"2024-09-05T02:14:35.236621+0000","last_peered":"2024-09-05T02:14:35.236621+0000","last_clean":"2024-09-05T02:14:35.236621+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:14:35.236621+0000","last_undegraded":"2024-09-05T02:14:35.236621+0000","last_fullsized":"2024-09-05T02:14:35.236621+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:46.890368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":1163,"num_write":484,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.434154+0000","last_change":"2024-09-05T00:49:35.941463+0000","last_active":"2024-09-05T02:11:45.434154+0000","last_peered":"2024-09-05T02:11:45.434154+0000","last_clean":"2024-09-05T02:11:45.434154+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:11:45.434154+0000","last_undegraded":"2024-09-05T02:11:45.434154+0000","last_fullsized":"2024-09-05T02:11:45.434154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:14.296731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'194","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.273394+0000","last_change":"2024-09-05T00:49:37.946192+0000","last_active":"2024-09-05T02:14:25.273394+0000","last_peered":"2024-09-05T02:14:25.273394+0000","last_clean":"2024-09-05T02:14:25.273394+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:14:25.273394+0000","last_undegraded":"2024-09-05T02:14:25.273394+0000","last_fullsized":"2024-09-05T02:14:25.273394+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:46.109450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'731","reported_seq":2519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842408+0000","last_change":"2024-09-05T00:49:29.916165+0000","last_active":"2024-09-05T02:14:19.842408+0000","last_peered":"2024-09-05T02:14:19.842408+0000","last_clean":"2024-09-05T02:14:19.842408+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:14:19.842408+0000","last_undegraded":"2024-09-05T02:14:19.842408+0000","last_fullsized":"2024-09-05T02:14:19.842408+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:54:04.834607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'331","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:38.279130+0000","last_change":"2024-09-05T00:49:27.889993+0000","last_active":"2024-09-05T02:15:38.279130+0000","last_peered":"2024-09-05T02:15:38.279130+0000","last_clean":"2024-09-05T02:15:38.279130+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:15:38.279130+0000","last_undegraded":"2024-09-05T02:15:38.279130+0000","last_fullsized":"2024-09-05T02:15:38.279130+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:01.461692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33961747,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":573,"num_read_kb":137825,"num_write":1239,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"35'3","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.529188+0000","last_change":"2024-09-05T00:49:31.903883+0000","last_active":"2024-09-05T02:15:49.529188+0000","last_peered":"2024-09-05T02:15:49.529188+0000","last_clean":"2024-09-05T02:15:49.529188+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:15:49.529188+0000","last_undegraded":"2024-09-05T02:15:49.529188+0000","last_fullsized":"2024-09-05T02:15:49.529188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:46.830057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'295","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.469993+0000","last_change":"2024-09-05T00:49:33.909608+0000","last_active":"2024-09-05T02:14:10.469993+0000","last_peered":"2024-09-05T02:14:10.469993+0000","last_clean":"2024-09-05T02:14:10.469993+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:14:10.469993+0000","last_undegraded":"2024-09-05T02:14:10.469993+0000","last_fullsized":"2024-09-05T02:14:10.469993+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:02.770171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57219,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1019,"num_write":396,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.388458+0000","last_change":"2024-09-05T00:49:35.941006+0000","last_active":"2024-09-05T02:12:06.388458+0000","last_peered":"2024-09-05T02:12:06.388458+0000","last_clean":"2024-09-05T02:12:06.388458+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:12:06.388458+0000","last_undegraded":"2024-09-05T02:12:06.388458+0000","last_fullsized":"2024-09-05T02:12:06.388458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:09.389985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.457891+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:11:51.457891+0000","last_peered":"2024-09-05T02:11:51.457891+0000","last_clean":"2024-09-05T02:11:51.457891+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:11:51.457891+0000","last_undegraded":"2024-09-05T02:11:51.457891+0000","last_fullsized":"2024-09-05T02:11:51.457891+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:49.316615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'474","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709554+0000","last_change":"2024-09-05T00:49:29.913963+0000","last_active":"2024-09-05T02:14:27.709554+0000","last_peered":"2024-09-05T02:14:27.709554+0000","last_clean":"2024-09-05T02:14:27.709554+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:14:27.709554+0000","last_undegraded":"2024-09-05T02:14:27.709554+0000","last_fullsized":"2024-09-05T02:14:27.709554+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:53.563132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'268","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451565+0000","last_change":"2024-09-05T00:49:27.884322+0000","last_active":"2024-09-05T02:16:21.451565+0000","last_peered":"2024-09-05T02:16:21.451565+0000","last_clean":"2024-09-05T02:16:21.451565+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:21.451565+0000","last_undegraded":"2024-09-05T02:16:21.451565+0000","last_fullsized":"2024-09-05T02:16:21.451565+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:06.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564123,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":370,"num_read_kb":12831,"num_write":964,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.199016+0000","last_change":"2024-09-05T00:49:31.918942+0000","last_active":"2024-09-05T02:11:41.199016+0000","last_peered":"2024-09-05T02:11:41.199016+0000","last_clean":"2024-09-05T02:11:41.199016+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:11:41.199016+0000","last_undegraded":"2024-09-05T02:11:41.199016+0000","last_fullsized":"2024-09-05T02:11:41.199016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:32.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'261","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.648988+0000","last_change":"2024-09-05T00:49:33.927237+0000","last_active":"2024-09-05T02:15:49.648988+0000","last_peered":"2024-09-05T02:15:49.648988+0000","last_clean":"2024-09-05T02:15:49.648988+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:15:49.648988+0000","last_undegraded":"2024-09-05T02:15:49.648988+0000","last_fullsized":"2024-09-05T02:15:49.648988+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:38:43.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":954,"num_write":352,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.205283+0000","last_change":"2024-09-05T00:49:35.925928+0000","last_active":"2024-09-05T02:12:06.205283+0000","last_peered":"2024-09-05T02:12:06.205283+0000","last_clean":"2024-09-05T02:12:06.205283+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:12:06.205283+0000","last_undegraded":"2024-09-05T02:12:06.205283+0000","last_fullsized":"2024-09-05T02:12:06.205283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:21.943807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'165","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.053963+0000","last_change":"2024-09-05T00:49:37.943592+0000","last_active":"2024-09-05T02:14:29.053963+0000","last_peered":"2024-09-05T02:14:29.053963+0000","last_clean":"2024-09-05T02:14:29.053963+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:14:29.053963+0000","last_undegraded":"2024-09-05T02:14:29.053963+0000","last_fullsized":"2024-09-05T02:14:29.053963+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:04.586566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'343","reported_seq":1852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.232009+0000","last_change":"2024-09-05T00:49:29.916442+0000","last_active":"2024-09-05T02:14:06.232009+0000","last_peered":"2024-09-05T02:14:06.232009+0000","last_clean":"2024-09-05T02:14:06.232009+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:14:06.232009+0000","last_undegraded":"2024-09-05T02:14:06.232009+0000","last_fullsized":"2024-09-05T02:14:06.232009+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:01:17.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'279","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:40.213892+0000","last_change":"2024-09-05T00:49:27.894135+0000","last_active":"2024-09-05T02:15:40.213892+0000","last_peered":"2024-09-05T02:15:40.213892+0000","last_clean":"2024-09-05T02:15:40.213892+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:15:40.213892+0000","last_undegraded":"2024-09-05T02:15:40.213892+0000","last_fullsized":"2024-09-05T02:15:40.213892+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:13:02.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826177,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":431,"num_read_kb":8852,"num_write":1022,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766535+0000","last_change":"2024-09-05T00:49:31.903736+0000","last_active":"2024-09-05T02:11:51.766535+0000","last_peered":"2024-09-05T02:11:51.766535+0000","last_clean":"2024-09-05T02:11:51.766535+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:11:51.766535+0000","last_undegraded":"2024-09-05T02:11:51.766535+0000","last_fullsized":"2024-09-05T02:11:51.766535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:35.531703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'333","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.654924+0000","last_change":"2024-09-05T00:49:33.908269+0000","last_active":"2024-09-05T02:15:49.654924+0000","last_peered":"2024-09-05T02:15:49.654924+0000","last_clean":"2024-09-05T02:15:49.654924+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:15:49.654924+0000","last_undegraded":"2024-09-05T02:15:49.654924+0000","last_fullsized":"2024-09-05T02:15:49.654924+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:50.246291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":1037,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.439359+0000","last_change":"2024-09-05T00:49:35.940921+0000","last_active":"2024-09-05T02:12:05.439359+0000","last_peered":"2024-09-05T02:12:05.439359+0000","last_clean":"2024-09-05T02:12:05.439359+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:12:05.439359+0000","last_undegraded":"2024-09-05T02:12:05.439359+0000","last_fullsized":"2024-09-05T02:12:05.439359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:45:23.954287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.723417+0000","last_change":"2024-09-05T00:49:37.929472+0000","last_active":"2024-09-05T02:15:48.723417+0000","last_peered":"2024-09-05T02:15:48.723417+0000","last_clean":"2024-09-05T02:15:48.723417+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:15:48.723417+0000","last_undegraded":"2024-09-05T02:15:48.723417+0000","last_fullsized":"2024-09-05T02:15:48.723417+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:25.886624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'429","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.624104+0000","last_change":"2024-09-05T00:49:29.892206+0000","last_active":"2024-09-05T02:14:29.624104+0000","last_peered":"2024-09-05T02:14:29.624104+0000","last_clean":"2024-09-05T02:14:29.624104+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:14:29.624104+0000","last_undegraded":"2024-09-05T02:14:29.624104+0000","last_fullsized":"2024-09-05T02:14:29.624104+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:04.846605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'301","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.154241+0000","last_change":"2024-09-05T00:49:27.897228+0000","last_active":"2024-09-05T02:16:21.154241+0000","last_peered":"2024-09-05T02:16:21.154241+0000","last_clean":"2024-09-05T02:16:21.154241+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:21.154241+0000","last_undegraded":"2024-09-05T02:16:21.154241+0000","last_fullsized":"2024-09-05T02:16:21.154241+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:59.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353533,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":420,"num_read_kb":8853,"num_write":1067,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1142","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794691+0000","last_change":"2024-09-05T00:49:29.906381+0000","last_active":"2024-09-05T02:14:01.794691+0000","last_peered":"2024-09-05T02:14:01.794691+0000","last_clean":"2024-09-05T02:14:01.794691+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:14:01.794691+0000","last_undegraded":"2024-09-05T02:14:01.794691+0000","last_fullsized":"2024-09-05T02:14:01.794691+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:43.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'288","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.389582+0000","last_change":"2024-09-05T00:50:04.182383+0000","last_active":"2024-09-05T02:16:21.389582+0000","last_peered":"2024-09-05T02:16:21.389582+0000","last_clean":"2024-09-05T02:16:21.389582+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:21.389582+0000","last_undegraded":"2024-09-05T02:16:21.389582+0000","last_fullsized":"2024-09-05T02:16:21.389582+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:45.984207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12240060,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":464,"num_read_kb":102142,"num_write":1086,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228410+0000","last_change":"2024-09-05T00:49:29.905701+0000","last_active":"2024-09-05T02:14:00.228410+0000","last_peered":"2024-09-05T02:14:00.228410+0000","last_clean":"2024-09-05T02:14:00.228410+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:14:00.228410+0000","last_undegraded":"2024-09-05T02:14:00.228410+0000","last_fullsized":"2024-09-05T02:14:00.228410+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:35:29.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.211786+0000","last_change":"2024-09-05T00:49:27.894703+0000","last_active":"2024-09-05T02:12:50.211786+0000","last_peered":"2024-09-05T02:12:50.211786+0000","last_clean":"2024-09-05T02:12:50.211786+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:12:50.211786+0000","last_undegraded":"2024-09-05T02:12:50.211786+0000","last_fullsized":"2024-09-05T02:12:50.211786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:39.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":377,"num_read_kb":406,"num_write":922,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'414","reported_seq":1989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794636+0000","last_change":"2024-09-05T00:49:29.909413+0000","last_active":"2024-09-05T02:14:01.794636+0000","last_peered":"2024-09-05T02:14:01.794636+0000","last_clean":"2024-09-05T02:14:01.794636+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:14:01.794636+0000","last_undegraded":"2024-09-05T02:14:01.794636+0000","last_fullsized":"2024-09-05T02:14:01.794636+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:27.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'248","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455656+0000","last_change":"2024-09-05T00:49:27.869339+0000","last_active":"2024-09-05T02:13:10.455656+0000","last_peered":"2024-09-05T02:13:10.455656+0000","last_clean":"2024-09-05T02:13:10.455656+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:13:10.455656+0000","last_undegraded":"2024-09-05T02:13:10.455656+0000","last_fullsized":"2024-09-05T02:13:10.455656+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:57.416708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403003,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":671,"num_read_kb":8225,"num_write":936,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1680","reported_seq":3527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.613554+0000","last_change":"2024-09-05T00:49:29.928238+0000","last_active":"2024-09-05T02:15:48.613554+0000","last_peered":"2024-09-05T02:15:48.613554+0000","last_clean":"2024-09-05T02:15:48.613554+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:15:48.613554+0000","last_undegraded":"2024-09-05T02:15:48.613554+0000","last_fullsized":"2024-09-05T02:15:48.613554+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:49.778085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'311","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.470906+0000","last_change":"2024-09-05T00:49:27.883474+0000","last_active":"2024-09-05T02:16:21.470906+0000","last_peered":"2024-09-05T02:16:21.470906+0000","last_clean":"2024-09-05T02:16:21.470906+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:21.470906+0000","last_undegraded":"2024-09-05T02:16:21.470906+0000","last_fullsized":"2024-09-05T02:16:21.470906+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:51.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27293344,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":491,"num_read_kb":75262,"num_write":1022,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'622","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.857581+0000","last_change":"2024-09-05T00:49:29.911388+0000","last_active":"2024-09-05T02:13:32.857581+0000","last_peered":"2024-09-05T02:13:32.857581+0000","last_clean":"2024-09-05T02:13:32.857581+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:13:32.857581+0000","last_undegraded":"2024-09-05T02:13:32.857581+0000","last_fullsized":"2024-09-05T02:13:32.857581+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:27.266690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'314","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.730835+0000","last_change":"2024-09-05T00:49:27.884310+0000","last_active":"2024-09-05T02:16:21.730835+0000","last_peered":"2024-09-05T02:16:21.730835+0000","last_clean":"2024-09-05T02:16:21.730835+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:21.730835+0000","last_undegraded":"2024-09-05T02:16:21.730835+0000","last_fullsized":"2024-09-05T02:16:21.730835+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:03.108303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22777162,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":490,"num_read_kb":27141,"num_write":1080,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'683","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.629116+0000","last_change":"2024-09-05T00:49:29.925070+0000","last_active":"2024-09-05T02:15:48.629116+0000","last_peered":"2024-09-05T02:15:48.629116+0000","last_clean":"2024-09-05T02:15:48.629116+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:15:48.629116+0000","last_undegraded":"2024-09-05T02:15:48.629116+0000","last_fullsized":"2024-09-05T02:15:48.629116+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:33.562310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'323","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.208857+0000","last_change":"2024-09-05T00:49:27.909574+0000","last_active":"2024-09-05T02:16:21.208857+0000","last_peered":"2024-09-05T02:16:21.208857+0000","last_clean":"2024-09-05T02:16:21.208857+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:21.208857+0000","last_undegraded":"2024-09-05T02:16:21.208857+0000","last_fullsized":"2024-09-05T02:16:21.208857+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:51.020169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266199,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":540,"num_read_kb":10940,"num_write":1226,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'476","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.888825+0000","last_change":"2024-09-05T00:49:29.888887+0000","last_active":"2024-09-05T02:13:37.888825+0000","last_peered":"2024-09-05T02:13:37.888825+0000","last_clean":"2024-09-05T02:13:37.888825+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:13:37.888825+0000","last_undegraded":"2024-09-05T02:13:37.888825+0000","last_fullsized":"2024-09-05T02:13:37.888825+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:05.114720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'301","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.510833+0000","last_change":"2024-09-05T00:49:27.886848+0000","last_active":"2024-09-05T02:16:21.510833+0000","last_peered":"2024-09-05T02:16:21.510833+0000","last_clean":"2024-09-05T02:16:21.510833+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:21.510833+0000","last_undegraded":"2024-09-05T02:16:21.510833+0000","last_fullsized":"2024-09-05T02:16:21.510833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:26.738479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11790648,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":445,"num_read_kb":29009,"num_write":1154,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1109","reported_seq":2750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701677+0000","last_change":"2024-09-05T00:49:29.915871+0000","last_active":"2024-09-05T02:14:27.701677+0000","last_peered":"2024-09-05T02:14:27.701677+0000","last_clean":"2024-09-05T02:14:27.701677+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:14:27.701677+0000","last_undegraded":"2024-09-05T02:14:27.701677+0000","last_fullsized":"2024-09-05T02:14:27.701677+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:08:29.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'298","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:41.118507+0000","last_change":"2024-09-05T00:49:27.889044+0000","last_active":"2024-09-05T02:15:41.118507+0000","last_peered":"2024-09-05T02:15:41.118507+0000","last_clean":"2024-09-05T02:15:41.118507+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:15:41.118507+0000","last_undegraded":"2024-09-05T02:15:41.118507+0000","last_fullsized":"2024-09-05T02:15:41.118507+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:10.256222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706729,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":551,"num_read_kb":61900,"num_write":1086,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'619","reported_seq":2294,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.905447+0000","last_change":"2024-09-05T00:49:29.912552+0000","last_active":"2024-09-05T02:13:45.905447+0000","last_peered":"2024-09-05T02:13:45.905447+0000","last_clean":"2024-09-05T02:13:45.905447+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:13:45.905447+0000","last_undegraded":"2024-09-05T02:13:45.905447+0000","last_fullsized":"2024-09-05T02:13:45.905447+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":600,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:05.014550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'293","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.454721+0000","last_change":"2024-09-05T00:49:27.886360+0000","last_active":"2024-09-05T02:16:21.454721+0000","last_peered":"2024-09-05T02:16:21.454721+0000","last_clean":"2024-09-05T02:16:21.454721+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:21.454721+0000","last_undegraded":"2024-09-05T02:16:21.454721+0000","last_fullsized":"2024-09-05T02:16:21.454721+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:15:32.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7002703,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":440,"num_read_kb":25095,"num_write":1114,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'540","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.636487+0000","last_change":"2024-09-05T00:49:29.898543+0000","last_active":"2024-09-05T02:15:48.636487+0000","last_peered":"2024-09-05T02:15:48.636487+0000","last_clean":"2024-09-05T02:15:48.636487+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:15:48.636487+0000","last_undegraded":"2024-09-05T02:15:48.636487+0000","last_fullsized":"2024-09-05T02:15:48.636487+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:11.197697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'342","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.373973+0000","last_change":"2024-09-05T00:50:04.181293+0000","last_active":"2024-09-05T02:16:21.373973+0000","last_peered":"2024-09-05T02:16:21.373973+0000","last_clean":"2024-09-05T02:16:21.373973+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:21.373973+0000","last_undegraded":"2024-09-05T02:16:21.373973+0000","last_fullsized":"2024-09-05T02:16:21.373973+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:31.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10998355,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":580,"num_read_kb":5699,"num_write":1187,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1184","reported_seq":2835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.896967+0000","last_change":"2024-09-05T00:49:29.914676+0000","last_active":"2024-09-05T02:13:37.896967+0000","last_peered":"2024-09-05T02:13:37.896967+0000","last_clean":"2024-09-05T02:13:37.896967+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:13:37.896967+0000","last_undegraded":"2024-09-05T02:13:37.896967+0000","last_fullsized":"2024-09-05T02:13:37.896967+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:02.143783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449787+0000","last_change":"2024-09-05T00:49:27.905936+0000","last_active":"2024-09-05T02:12:45.449787+0000","last_peered":"2024-09-05T02:12:45.449787+0000","last_clean":"2024-09-05T02:12:45.449787+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:12:45.449787+0000","last_undegraded":"2024-09-05T02:12:45.449787+0000","last_fullsized":"2024-09-05T02:12:45.449787+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:06.100911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18301850,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":546,"num_read_kb":5076,"num_write":1140,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'490","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623799+0000","last_change":"2024-09-05T00:49:29.925901+0000","last_active":"2024-09-05T02:14:29.623799+0000","last_peered":"2024-09-05T02:14:29.623799+0000","last_clean":"2024-09-05T02:14:29.623799+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:14:29.623799+0000","last_undegraded":"2024-09-05T02:14:29.623799+0000","last_fullsized":"2024-09-05T02:14:29.623799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:36.737428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'316","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.210869+0000","last_change":"2024-09-05T00:49:27.888664+0000","last_active":"2024-09-05T02:16:21.210869+0000","last_peered":"2024-09-05T02:16:21.210869+0000","last_clean":"2024-09-05T02:16:21.210869+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:21.210869+0000","last_undegraded":"2024-09-05T02:16:21.210869+0000","last_fullsized":"2024-09-05T02:16:21.210869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:01.736837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6938143,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":31375,"num_write":1232,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'686","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449674+0000","last_change":"2024-09-05T00:49:29.922331+0000","last_active":"2024-09-05T02:12:45.449674+0000","last_peered":"2024-09-05T02:12:45.449674+0000","last_clean":"2024-09-05T02:12:45.449674+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:12:45.449674+0000","last_undegraded":"2024-09-05T02:12:45.449674+0000","last_fullsized":"2024-09-05T02:12:45.449674+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:17:15.909498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'299","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.655685+0000","last_change":"2024-09-05T00:49:27.912949+0000","last_active":"2024-09-05T02:16:21.655685+0000","last_peered":"2024-09-05T02:16:21.655685+0000","last_clean":"2024-09-05T02:16:21.655685+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:21.655685+0000","last_undegraded":"2024-09-05T02:16:21.655685+0000","last_fullsized":"2024-09-05T02:16:21.655685+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:24.446425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10555908,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":507,"num_read_kb":11102,"num_write":1089,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'522","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629988+0000","last_change":"2024-09-05T00:49:29.915489+0000","last_active":"2024-09-05T02:14:29.629988+0000","last_peered":"2024-09-05T02:14:29.629988+0000","last_clean":"2024-09-05T02:14:29.629988+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:14:29.629988+0000","last_undegraded":"2024-09-05T02:14:29.629988+0000","last_fullsized":"2024-09-05T02:14:29.629988+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:16.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.387890+0000","last_change":"2024-09-05T00:49:27.888381+0000","last_active":"2024-09-05T02:16:21.387890+0000","last_peered":"2024-09-05T02:16:21.387890+0000","last_clean":"2024-09-05T02:16:21.387890+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:21.387890+0000","last_undegraded":"2024-09-05T02:16:21.387890+0000","last_fullsized":"2024-09-05T02:16:21.387890+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:03.147163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471666,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":478,"num_read_kb":115088,"num_write":1004,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.061843+0000","last_change":"2024-09-05T00:49:29.922395+0000","last_active":"2024-09-05T02:13:56.061843+0000","last_peered":"2024-09-05T02:13:56.061843+0000","last_clean":"2024-09-05T02:13:56.061843+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:13:56.061843+0000","last_undegraded":"2024-09-05T02:13:56.061843+0000","last_fullsized":"2024-09-05T02:13:56.061843+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:27.332843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'246","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.798661+0000","last_change":"2024-09-05T00:49:27.915755+0000","last_active":"2024-09-05T02:13:36.798661+0000","last_peered":"2024-09-05T02:13:36.798661+0000","last_clean":"2024-09-05T02:13:36.798661+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:13:36.798661+0000","last_undegraded":"2024-09-05T02:13:36.798661+0000","last_fullsized":"2024-09-05T02:13:36.798661+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:24.744189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10995013,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":382,"num_read_kb":641,"num_write":977,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'351","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:42.970298+0000","last_change":"2024-09-05T00:49:27.900502+0000","last_active":"2024-09-05T02:13:42.970298+0000","last_peered":"2024-09-05T02:13:42.970298+0000","last_clean":"2024-09-05T02:13:42.970298+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:13:42.970298+0000","last_undegraded":"2024-09-05T02:13:42.970298+0000","last_fullsized":"2024-09-05T02:13:42.970298+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:21:36.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9688004,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":674,"num_read_kb":35469,"num_write":1219,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'402","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.580490+0000","last_change":"2024-09-05T00:49:29.916741+0000","last_active":"2024-09-05T02:14:29.580490+0000","last_peered":"2024-09-05T02:14:29.580490+0000","last_clean":"2024-09-05T02:14:29.580490+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:14:29.580490+0000","last_undegraded":"2024-09-05T02:14:29.580490+0000","last_fullsized":"2024-09-05T02:14:29.580490+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:48.147595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'321","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.790856+0000","last_change":"2024-09-05T00:49:27.885362+0000","last_active":"2024-09-05T02:16:21.790856+0000","last_peered":"2024-09-05T02:16:21.790856+0000","last_clean":"2024-09-05T02:16:21.790856+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:21.790856+0000","last_undegraded":"2024-09-05T02:16:21.790856+0000","last_fullsized":"2024-09-05T02:16:21.790856+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:17.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409052,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":434,"num_read_kb":26073,"num_write":1141,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'871","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844564+0000","last_change":"2024-09-05T00:49:29.908617+0000","last_active":"2024-09-05T02:13:40.844564+0000","last_peered":"2024-09-05T02:13:40.844564+0000","last_clean":"2024-09-05T02:13:40.844564+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:13:40.844564+0000","last_undegraded":"2024-09-05T02:13:40.844564+0000","last_fullsized":"2024-09-05T02:13:40.844564+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:37.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":642,"ondisk_log_size":642,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1787069,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19479,"num_read_kb":36985,"num_write":16369,"num_write_kb":12025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2686976,"data_stored":2216074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1729,"ondisk_log_size":1729,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4136,"ondisk_log_size":4136,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":511400498,"num_objects":3703,"num_object_clones":0,"num_object_copies":7406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3703,"num_whiteouts":0,"num_read":32753,"num_read_kb":2043732,"num_write":68457,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1010569216,"data_stored":983172905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4114,"ondisk_log_size":4114,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":57813924,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":117,"num_read_kb":174352,"num_write":137,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":111443968,"data_stored":111433544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49425316,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":117,"num_read_kb":174298,"num_write":139,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96710656,"data_stored":96703021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472292,"kb_used_data":198080,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93899548,"statfs":{"total":96636764160,"available":96153137152,"internally_reserved":0,"allocated":202833920,"data_stored":197035027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510492,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342692,"kb_used_data":122708,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94029148,"statfs":{"total":96636764160,"available":96285847552,"internally_reserved":0,"allocated":125652992,"data_stored":121198204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510489,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":233024,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":238616576,"data_stored":232309463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510493,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547560,"kb_used_data":273496,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93824280,"statfs":{"total":96636764160,"available":96076062720,"internally_reserved":0,"allocated":280059904,"data_stored":273792646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510491,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207432,"kb_used_data":118008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94164408,"statfs":{"total":96636764160,"available":96424353792,"internally_reserved":0,"allocated":120840192,"data_stored":116462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287660,"kb_used_data":135732,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94084180,"statfs":{"total":96636764160,"available":96342200320,"internally_reserved":0,"allocated":138989568,"data_stored":134977591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543195,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":177840,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":182108160,"data_stored":175714227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543196,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443472,"kb_used_data":199936,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93928368,"statfs":{"total":96636764160,"available":96182648832,"internally_reserved":0,"allocated":204734464,"data_stored":198151379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167403520,"data_stored":162409480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98988032,"data_stored":97079602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77041664,"data_stored":74827789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145481728,"data_stored":141924390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":198594560,"data_stored":194324063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":154648576,"data_stored":149855918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68902912,"data_stored":66308087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":99508224,"data_stored":96443576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":355649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":262269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":123211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":348292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":85782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":659456,"data_stored":554892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":307358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26357760,"data_stored":26353431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5337088,"data_stored":5334665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17870848,"data_stored":17869150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44130304,"data_stored":44128764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":9487643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:16:23.837 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T02:16:23.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:16:24.224 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:24.240 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:16:24.257 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2872,"stamp":"2024-09-05T02:16:22.502599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":621034432,"num_objects":4225,"num_object_clones":0,"num_object_copies":8450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4225,"num_whiteouts":0,"num_read":288801,"num_read_kb":2645314,"num_write":159268,"num_write_kb":2503539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13749,"ondisk_log_size":13749,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2904772,"kb_used_data":1458824,"kb_used_omap":12,"kb_used_meta":1445683,"kb_avail":752069948,"statfs":{"total":773094113280,"available":770119626752,"internally_reserved":0,"allocated":1493835776,"data_stored":1449641121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1480379952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-107280603,"num_objects":-698,"num_object_clones":0,"num_object_copies":-1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-698,"num_whiteouts":0,"num_read":804,"num_read_kb":850,"num_write":752,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008088"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200116+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:12:00.200116+0000","last_peered":"2024-09-05T02:12:00.200116+0000","last_clean":"2024-09-05T02:12:00.200116+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:12:00.200116+0000","last_undegraded":"2024-09-05T02:12:00.200116+0000","last_fullsized":"2024-09-05T02:12:00.200116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:56.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'7","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459278+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:11:56.459278+0000","last_peered":"2024-09-05T02:11:56.459278+0000","last_clean":"2024-09-05T02:11:56.459278+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:11:56.459278+0000","last_undegraded":"2024-09-05T02:11:56.459278+0000","last_fullsized":"2024-09-05T02:11:56.459278+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:52:17.217061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":10242,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375602+0000","last_change":"2024-09-05T01:30:15.667346+0000","last_active":"2024-09-05T02:12:46.375602+0000","last_peered":"2024-09-05T02:12:46.375602+0000","last_clean":"2024-09-05T02:12:46.375602+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:12:46.375602+0000","last_undegraded":"2024-09-05T02:12:46.375602+0000","last_fullsized":"2024-09-05T02:12:46.375602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:40.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'1","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.202821+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:11:56.202821+0000","last_peered":"2024-09-05T02:11:56.202821+0000","last_clean":"2024-09-05T02:11:56.202821+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:11:56.202821+0000","last_undegraded":"2024-09-05T02:11:56.202821+0000","last_fullsized":"2024-09-05T02:11:56.202821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:01.475308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766667+0000","last_change":"2024-09-05T01:09:22.194515+0000","last_active":"2024-09-05T02:11:51.766667+0000","last_peered":"2024-09-05T02:11:51.766667+0000","last_clean":"2024-09-05T02:11:51.766667+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:11:51.766667+0000","last_undegraded":"2024-09-05T02:11:51.766667+0000","last_fullsized":"2024-09-05T02:11:51.766667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:51.467116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.381829+0000","last_change":"2024-09-05T01:05:07.120154+0000","last_active":"2024-09-05T02:13:16.381829+0000","last_peered":"2024-09-05T02:13:16.381829+0000","last_clean":"2024-09-05T02:13:16.381829+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:13:16.381829+0000","last_undegraded":"2024-09-05T02:13:16.381829+0000","last_fullsized":"2024-09-05T02:13:16.381829+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:15.466155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468968+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:14:05.468968+0000","last_peered":"2024-09-05T02:14:05.468968+0000","last_clean":"2024-09-05T02:14:05.468968+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:14:05.468968+0000","last_undegraded":"2024-09-05T02:14:05.468968+0000","last_fullsized":"2024-09-05T02:14:05.468968+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":53,"num_write":3,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.384719+0000","last_change":"2024-09-05T01:09:22.189240+0000","last_active":"2024-09-05T02:13:31.384719+0000","last_peered":"2024-09-05T02:13:31.384719+0000","last_clean":"2024-09-05T02:13:31.384719+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:13:31.384719+0000","last_undegraded":"2024-09-05T02:13:31.384719+0000","last_fullsized":"2024-09-05T02:13:31.384719+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:27.906635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448662+0000","last_change":"2024-09-05T01:05:07.099663+0000","last_active":"2024-09-05T02:12:40.448662+0000","last_peered":"2024-09-05T02:12:40.448662+0000","last_clean":"2024-09-05T02:12:40.448662+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:12:40.448662+0000","last_undegraded":"2024-09-05T02:12:40.448662+0000","last_fullsized":"2024-09-05T02:12:40.448662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:05.063618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467527+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:12:26.467527+0000","last_peered":"2024-09-05T02:12:26.467527+0000","last_clean":"2024-09-05T02:12:26.467527+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:12:26.467527+0000","last_undegraded":"2024-09-05T02:12:26.467527+0000","last_fullsized":"2024-09-05T02:12:26.467527+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209385+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:12:40.209385+0000","last_peered":"2024-09-05T02:12:40.209385+0000","last_clean":"2024-09-05T02:12:40.209385+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:12:40.209385+0000","last_undegraded":"2024-09-05T02:12:40.209385+0000","last_fullsized":"2024-09-05T02:12:40.209385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":13,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441829+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:12:15.441829+0000","last_peered":"2024-09-05T02:12:15.441829+0000","last_clean":"2024-09-05T02:12:15.441829+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:12:15.441829+0000","last_undegraded":"2024-09-05T02:12:15.441829+0000","last_fullsized":"2024-09-05T02:12:15.441829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:48.174424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390642+0000","last_change":"2024-09-05T01:09:26.324652+0000","last_active":"2024-09-05T02:12:16.390642+0000","last_peered":"2024-09-05T02:12:16.390642+0000","last_clean":"2024-09-05T02:12:16.390642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:12:16.390642+0000","last_undegraded":"2024-09-05T02:12:16.390642+0000","last_fullsized":"2024-09-05T02:12:16.390642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:50:46.559032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.209816+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:12:26.209816+0000","last_peered":"2024-09-05T02:12:26.209816+0000","last_clean":"2024-09-05T02:12:26.209816+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:12:26.209816+0000","last_undegraded":"2024-09-05T02:12:26.209816+0000","last_fullsized":"2024-09-05T02:12:26.209816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394840+0000","last_change":"2024-09-05T01:05:07.100070+0000","last_active":"2024-09-05T02:12:36.394840+0000","last_peered":"2024-09-05T02:12:36.394840+0000","last_clean":"2024-09-05T02:12:36.394840+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:12:36.394840+0000","last_undegraded":"2024-09-05T02:12:36.394840+0000","last_fullsized":"2024-09-05T02:12:36.394840+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:38.489253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.386284+0000","last_change":"2024-09-05T01:09:26.324239+0000","last_active":"2024-09-05T02:11:56.386284+0000","last_peered":"2024-09-05T02:11:56.386284+0000","last_clean":"2024-09-05T02:11:56.386284+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:11:56.386284+0000","last_undegraded":"2024-09-05T02:11:56.386284+0000","last_fullsized":"2024-09-05T02:11:56.386284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:27:56.884028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.201470+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:11:51.201470+0000","last_peered":"2024-09-05T02:11:51.201470+0000","last_clean":"2024-09-05T02:11:51.201470+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:11:51.201470+0000","last_undegraded":"2024-09-05T02:11:51.201470+0000","last_fullsized":"2024-09-05T02:11:51.201470+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:47:24.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:05.454470+0000","last_change":"2024-09-05T01:05:07.114198+0000","last_active":"2024-09-05T02:13:05.454470+0000","last_peered":"2024-09-05T02:13:05.454470+0000","last_clean":"2024-09-05T02:13:05.454470+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:13:05.454470+0000","last_undegraded":"2024-09-05T02:13:05.454470+0000","last_fullsized":"2024-09-05T02:13:05.454470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:21:32.703401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'7","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.459157+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:11:56.459157+0000","last_peered":"2024-09-05T02:11:56.459157+0000","last_clean":"2024-09-05T02:11:56.459157+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:11:56.459157+0000","last_undegraded":"2024-09-05T02:11:56.459157+0000","last_fullsized":"2024-09-05T02:11:56.459157+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:51:40.645794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'7","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:55.436882+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:11:55.436882+0000","last_peered":"2024-09-05T02:11:55.436882+0000","last_clean":"2024-09-05T02:11:55.436882+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:11:55.436882+0000","last_undegraded":"2024-09-05T02:11:55.436882+0000","last_fullsized":"2024-09-05T02:11:55.436882+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:46.829038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3196187,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":23604,"num_write":12,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779304+0000","last_change":"2024-09-05T01:05:07.107441+0000","last_active":"2024-09-05T02:12:46.779304+0000","last_peered":"2024-09-05T02:12:46.779304+0000","last_clean":"2024-09-05T02:12:46.779304+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:12:46.779304+0000","last_undegraded":"2024-09-05T02:12:46.779304+0000","last_fullsized":"2024-09-05T02:12:46.779304+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:28.771503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.772503+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:12:16.772503+0000","last_peered":"2024-09-05T02:12:16.772503+0000","last_clean":"2024-09-05T02:12:16.772503+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:12:16.772503+0000","last_undegraded":"2024-09-05T02:12:16.772503+0000","last_fullsized":"2024-09-05T02:12:16.772503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:13.638808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464948+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:12:16.464948+0000","last_peered":"2024-09-05T02:12:16.464948+0000","last_clean":"2024-09-05T02:12:16.464948+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:12:16.464948+0000","last_undegraded":"2024-09-05T02:12:16.464948+0000","last_fullsized":"2024-09-05T02:12:16.464948+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:48.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.369336+0000","last_change":"2024-09-05T01:30:15.668869+0000","last_active":"2024-09-05T02:12:16.369336+0000","last_peered":"2024-09-05T02:12:16.369336+0000","last_clean":"2024-09-05T02:12:16.369336+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:12:16.369336+0000","last_undegraded":"2024-09-05T02:12:16.369336+0000","last_fullsized":"2024-09-05T02:12:16.369336+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:05.261577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.471304+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:12:41.471304+0000","last_peered":"2024-09-05T02:12:41.471304+0000","last_clean":"2024-09-05T02:12:41.471304+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:12:41.471304+0000","last_undegraded":"2024-09-05T02:12:41.471304+0000","last_fullsized":"2024-09-05T02:12:41.471304+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":28674,"num_write":13,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.817097+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:12:11.817097+0000","last_peered":"2024-09-05T02:12:11.817097+0000","last_clean":"2024-09-05T02:12:11.817097+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:12:11.817097+0000","last_undegraded":"2024-09-05T02:12:11.817097+0000","last_fullsized":"2024-09-05T02:12:11.817097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:06.449467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818016+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:12:16.818016+0000","last_peered":"2024-09-05T02:12:16.818016+0000","last_clean":"2024-09-05T02:12:16.818016+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:12:16.818016+0000","last_undegraded":"2024-09-05T02:12:16.818016+0000","last_fullsized":"2024-09-05T02:12:16.818016+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:08:36.986922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.465067+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:12:16.465067+0000","last_peered":"2024-09-05T02:12:16.465067+0000","last_clean":"2024-09-05T02:12:16.465067+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:12:16.465067+0000","last_undegraded":"2024-09-05T02:12:16.465067+0000","last_fullsized":"2024-09-05T02:12:16.465067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:19:22.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.368114+0000","last_change":"2024-09-05T01:09:22.197361+0000","last_active":"2024-09-05T02:12:11.368114+0000","last_peered":"2024-09-05T02:12:11.368114+0000","last_clean":"2024-09-05T02:12:11.368114+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:12:11.368114+0000","last_undegraded":"2024-09-05T02:12:11.368114+0000","last_fullsized":"2024-09-05T02:12:11.368114+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:33:21.371226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375737+0000","last_change":"2024-09-05T01:05:07.119548+0000","last_active":"2024-09-05T02:12:46.375737+0000","last_peered":"2024-09-05T02:12:46.375737+0000","last_clean":"2024-09-05T02:12:46.375737+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:12:46.375737+0000","last_undegraded":"2024-09-05T02:12:46.375737+0000","last_fullsized":"2024-09-05T02:12:46.375737+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:35:04.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203655+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:12:15.203655+0000","last_peered":"2024-09-05T02:12:15.203655+0000","last_clean":"2024-09-05T02:12:15.203655+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:12:15.203655+0000","last_undegraded":"2024-09-05T02:12:15.203655+0000","last_fullsized":"2024-09-05T02:12:15.203655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:15.910872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207592+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:12:16.207592+0000","last_peered":"2024-09-05T02:12:16.207592+0000","last_clean":"2024-09-05T02:12:16.207592+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:12:16.207592+0000","last_undegraded":"2024-09-05T02:12:16.207592+0000","last_fullsized":"2024-09-05T02:12:16.207592+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:25.770411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442264+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:12:15.442264+0000","last_peered":"2024-09-05T02:12:15.442264+0000","last_clean":"2024-09-05T02:12:15.442264+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:12:15.442264+0000","last_undegraded":"2024-09-05T02:12:15.442264+0000","last_fullsized":"2024-09-05T02:12:15.442264+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:46:14.641983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774807+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:12:26.774807+0000","last_peered":"2024-09-05T02:12:26.774807+0000","last_clean":"2024-09-05T02:12:26.774807+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:12:26.774807+0000","last_undegraded":"2024-09-05T02:12:26.774807+0000","last_fullsized":"2024-09-05T02:12:26.774807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:09.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208586+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:12:21.208586+0000","last_peered":"2024-09-05T02:12:21.208586+0000","last_clean":"2024-09-05T02:12:21.208586+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:12:21.208586+0000","last_undegraded":"2024-09-05T02:12:21.208586+0000","last_fullsized":"2024-09-05T02:12:21.208586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:53.136374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774662+0000","last_change":"2024-09-05T01:09:26.327272+0000","last_active":"2024-09-05T02:12:26.774662+0000","last_peered":"2024-09-05T02:12:26.774662+0000","last_clean":"2024-09-05T02:12:26.774662+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:12:26.774662+0000","last_undegraded":"2024-09-05T02:12:26.774662+0000","last_fullsized":"2024-09-05T02:12:26.774662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:00.744251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467246+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:12:26.467246+0000","last_peered":"2024-09-05T02:12:26.467246+0000","last_clean":"2024-09-05T02:12:26.467246+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:12:26.467246+0000","last_undegraded":"2024-09-05T02:12:26.467246+0000","last_fullsized":"2024-09-05T02:12:26.467246+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:36:00.381248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'116","reported_seq":469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450850+0000","last_change":"2024-09-05T01:05:07.106194+0000","last_active":"2024-09-05T02:12:50.450850+0000","last_peered":"2024-09-05T02:12:50.450850+0000","last_clean":"2024-09-05T02:12:50.450850+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:12:50.450850+0000","last_undegraded":"2024-09-05T02:12:50.450850+0000","last_fullsized":"2024-09-05T02:12:50.450850+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444865+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:12:25.444865+0000","last_peered":"2024-09-05T02:12:25.444865+0000","last_clean":"2024-09-05T02:12:25.444865+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:12:25.444865+0000","last_undegraded":"2024-09-05T02:12:25.444865+0000","last_fullsized":"2024-09-05T02:12:25.444865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:58:42.242758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467369+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:12:26.467369+0000","last_peered":"2024-09-05T02:12:26.467369+0000","last_clean":"2024-09-05T02:12:26.467369+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:12:26.467369+0000","last_undegraded":"2024-09-05T02:12:26.467369+0000","last_fullsized":"2024-09-05T02:12:26.467369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:39.545081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.391757+0000","last_change":"2024-09-05T01:09:22.204898+0000","last_active":"2024-09-05T02:12:21.391757+0000","last_peered":"2024-09-05T02:12:21.391757+0000","last_clean":"2024-09-05T02:12:21.391757+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:12:21.391757+0000","last_undegraded":"2024-09-05T02:12:21.391757+0000","last_fullsized":"2024-09-05T02:12:21.391757+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:48:27.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.392810+0000","last_change":"2024-09-05T01:09:26.329147+0000","last_active":"2024-09-05T02:12:26.392810+0000","last_peered":"2024-09-05T02:12:26.392810+0000","last_clean":"2024-09-05T02:12:26.392810+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:12:26.392810+0000","last_undegraded":"2024-09-05T02:12:26.392810+0000","last_fullsized":"2024-09-05T02:12:26.392810+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:07.238760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'1","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.206066+0000","last_change":"2024-09-05T01:09:22.187559+0000","last_active":"2024-09-05T02:12:25.206066+0000","last_peered":"2024-09-05T02:12:25.206066+0000","last_clean":"2024-09-05T02:12:25.206066+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:12:25.206066+0000","last_undegraded":"2024-09-05T02:12:25.206066+0000","last_fullsized":"2024-09-05T02:12:25.206066+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:07:59.966273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.386682+0000","last_change":"2024-09-05T01:30:15.669605+0000","last_active":"2024-09-05T02:13:41.386682+0000","last_peered":"2024-09-05T02:13:41.386682+0000","last_clean":"2024-09-05T02:13:41.386682+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:13:41.386682+0000","last_undegraded":"2024-09-05T02:13:41.386682+0000","last_fullsized":"2024-09-05T02:13:41.386682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:56.360434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467501+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:12:26.467501+0000","last_peered":"2024-09-05T02:12:26.467501+0000","last_clean":"2024-09-05T02:12:26.467501+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:12:26.467501+0000","last_undegraded":"2024-09-05T02:12:26.467501+0000","last_fullsized":"2024-09-05T02:12:26.467501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:48.846611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.819378+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:12:21.819378+0000","last_peered":"2024-09-05T02:12:21.819378+0000","last_clean":"2024-09-05T02:12:21.819378+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:12:21.819378+0000","last_undegraded":"2024-09-05T02:12:21.819378+0000","last_fullsized":"2024-09-05T02:12:21.819378+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:34.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467422+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:12:26.467422+0000","last_peered":"2024-09-05T02:12:26.467422+0000","last_clean":"2024-09-05T02:12:26.467422+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:12:26.467422+0000","last_undegraded":"2024-09-05T02:12:26.467422+0000","last_fullsized":"2024-09-05T02:12:26.467422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:59.970464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'5","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.370570+0000","last_change":"2024-09-05T01:09:22.173216+0000","last_active":"2024-09-05T02:12:21.370570+0000","last_peered":"2024-09-05T02:12:21.370570+0000","last_clean":"2024-09-05T02:12:21.370570+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:12:21.370570+0000","last_undegraded":"2024-09-05T02:12:21.370570+0000","last_fullsized":"2024-09-05T02:12:21.370570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:30:30.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209629+0000","last_change":"2024-09-05T01:05:07.097402+0000","last_active":"2024-09-05T02:12:40.209629+0000","last_peered":"2024-09-05T02:12:40.209629+0000","last_clean":"2024-09-05T02:12:40.209629+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:12:40.209629+0000","last_undegraded":"2024-09-05T02:12:40.209629+0000","last_fullsized":"2024-09-05T02:12:40.209629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:29.548612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407611+0000","last_change":"2024-09-05T01:30:15.659142+0000","last_active":"2024-09-05T02:13:36.407611+0000","last_peered":"2024-09-05T02:13:36.407611+0000","last_clean":"2024-09-05T02:13:36.407611+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:13:36.407611+0000","last_undegraded":"2024-09-05T02:13:36.407611+0000","last_fullsized":"2024-09-05T02:13:36.407611+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:28.741051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.805493+0000","last_change":"2024-09-05T01:09:26.328593+0000","last_active":"2024-09-05T02:14:51.805493+0000","last_peered":"2024-09-05T02:14:51.805493+0000","last_clean":"2024-09-05T02:14:51.805493+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:14:51.805493+0000","last_undegraded":"2024-09-05T02:14:51.805493+0000","last_fullsized":"2024-09-05T02:14:51.805493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:38.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444961+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:12:25.444961+0000","last_peered":"2024-09-05T02:12:25.444961+0000","last_clean":"2024-09-05T02:12:25.444961+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:12:25.444961+0000","last_undegraded":"2024-09-05T02:12:25.444961+0000","last_fullsized":"2024-09-05T02:12:25.444961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:22:24.610460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88572,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":88,"num_write":2,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394924+0000","last_change":"2024-09-05T01:05:07.108722+0000","last_active":"2024-09-05T02:12:36.394924+0000","last_peered":"2024-09-05T02:12:36.394924+0000","last_clean":"2024-09-05T02:12:36.394924+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:12:36.394924+0000","last_undegraded":"2024-09-05T02:12:36.394924+0000","last_fullsized":"2024-09-05T02:12:36.394924+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:28:14.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'4","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467549+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:12:26.467549+0000","last_peered":"2024-09-05T02:12:26.467549+0000","last_clean":"2024-09-05T02:12:26.467549+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:12:26.467549+0000","last_undegraded":"2024-09-05T02:12:26.467549+0000","last_fullsized":"2024-09-05T02:12:26.467549+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:39.337140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:31.776137+0000","last_change":"2024-09-05T01:09:22.199397+0000","last_active":"2024-09-05T02:12:31.776137+0000","last_peered":"2024-09-05T02:12:31.776137+0000","last_clean":"2024-09-05T02:12:31.776137+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:12:31.776137+0000","last_undegraded":"2024-09-05T02:12:31.776137+0000","last_fullsized":"2024-09-05T02:12:31.776137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:09:58.963052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.373537+0000","last_change":"2024-09-05T01:05:07.107459+0000","last_active":"2024-09-05T02:12:36.373537+0000","last_peered":"2024-09-05T02:12:36.373537+0000","last_clean":"2024-09-05T02:12:36.373537+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:12:36.373537+0000","last_undegraded":"2024-09-05T02:12:36.373537+0000","last_fullsized":"2024-09-05T02:12:36.373537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:14.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207379+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:12:16.207379+0000","last_peered":"2024-09-05T02:12:16.207379+0000","last_clean":"2024-09-05T02:12:16.207379+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:12:16.207379+0000","last_undegraded":"2024-09-05T02:12:16.207379+0000","last_fullsized":"2024-09-05T02:12:16.207379+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:34:26.565026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441893+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:12:15.441893+0000","last_peered":"2024-09-05T02:12:15.441893+0000","last_clean":"2024-09-05T02:12:15.441893+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:12:15.441893+0000","last_undegraded":"2024-09-05T02:12:15.441893+0000","last_fullsized":"2024-09-05T02:12:15.441893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:26.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448523+0000","last_change":"2024-09-05T01:05:07.113278+0000","last_active":"2024-09-05T02:12:40.448523+0000","last_peered":"2024-09-05T02:12:40.448523+0000","last_clean":"2024-09-05T02:12:40.448523+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:12:40.448523+0000","last_undegraded":"2024-09-05T02:12:40.448523+0000","last_fullsized":"2024-09-05T02:12:40.448523+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:01.987557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'1","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818058+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:12:16.818058+0000","last_peered":"2024-09-05T02:12:16.818058+0000","last_clean":"2024-09-05T02:12:16.818058+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:12:16.818058+0000","last_undegraded":"2024-09-05T02:12:16.818058+0000","last_fullsized":"2024-09-05T02:12:16.818058+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:29:50.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.771516+0000","last_change":"2024-09-05T01:09:22.205702+0000","last_active":"2024-09-05T02:12:11.771516+0000","last_peered":"2024-09-05T02:12:11.771516+0000","last_clean":"2024-09-05T02:12:11.771516+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:12:11.771516+0000","last_undegraded":"2024-09-05T02:12:11.771516+0000","last_fullsized":"2024-09-05T02:12:11.771516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:20.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820508+0000","last_change":"2024-09-05T01:05:07.107783+0000","last_active":"2024-09-05T02:12:26.820508+0000","last_peered":"2024-09-05T02:12:26.820508+0000","last_clean":"2024-09-05T02:12:26.820508+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:12:26.820508+0000","last_undegraded":"2024-09-05T02:12:26.820508+0000","last_fullsized":"2024-09-05T02:12:26.820508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:14.335901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774914+0000","last_change":"2024-09-05T01:09:26.335994+0000","last_active":"2024-09-05T02:12:26.774914+0000","last_peered":"2024-09-05T02:12:26.774914+0000","last_clean":"2024-09-05T02:12:26.774914+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:12:26.774914+0000","last_undegraded":"2024-09-05T02:12:26.774914+0000","last_fullsized":"2024-09-05T02:12:26.774914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:07.883192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'6","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:30.445993+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:12:30.445993+0000","last_peered":"2024-09-05T02:12:30.445993+0000","last_clean":"2024-09-05T02:12:30.445993+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:12:30.445993+0000","last_undegraded":"2024-09-05T02:12:30.445993+0000","last_fullsized":"2024-09-05T02:12:30.445993+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:34.388590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":16,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464656+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:12:16.464656+0000","last_peered":"2024-09-05T02:12:16.464656+0000","last_clean":"2024-09-05T02:12:16.464656+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:12:16.464656+0000","last_undegraded":"2024-09-05T02:12:16.464656+0000","last_fullsized":"2024-09-05T02:12:16.464656+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:04.705416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820465+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:12:26.820465+0000","last_peered":"2024-09-05T02:12:26.820465+0000","last_clean":"2024-09-05T02:12:26.820465+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:12:26.820465+0000","last_undegraded":"2024-09-05T02:12:26.820465+0000","last_fullsized":"2024-09-05T02:12:26.820465+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.990596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208761+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:12:21.208761+0000","last_peered":"2024-09-05T02:12:21.208761+0000","last_clean":"2024-09-05T02:12:21.208761+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:12:21.208761+0000","last_undegraded":"2024-09-05T02:12:21.208761+0000","last_fullsized":"2024-09-05T02:12:21.208761+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:08.518794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390597+0000","last_change":"2024-09-05T01:05:07.108906+0000","last_active":"2024-09-05T02:12:16.390597+0000","last_peered":"2024-09-05T02:12:16.390597+0000","last_clean":"2024-09-05T02:12:16.390597+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:12:16.390597+0000","last_undegraded":"2024-09-05T02:12:16.390597+0000","last_fullsized":"2024-09-05T02:12:16.390597+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:30:18.560371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.442141+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:12:15.442141+0000","last_peered":"2024-09-05T02:12:15.442141+0000","last_clean":"2024-09-05T02:12:15.442141+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:12:15.442141+0000","last_undegraded":"2024-09-05T02:12:15.442141+0000","last_fullsized":"2024-09-05T02:12:15.442141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:20.443723+0000","last_change":"2024-09-05T01:05:07.120976+0000","last_active":"2024-09-05T02:12:20.443723+0000","last_peered":"2024-09-05T02:12:20.443723+0000","last_clean":"2024-09-05T02:12:20.443723+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:12:20.443723+0000","last_undegraded":"2024-09-05T02:12:20.443723+0000","last_fullsized":"2024-09-05T02:12:20.443723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:22.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391904+0000","last_change":"2024-09-05T01:09:22.172712+0000","last_active":"2024-09-05T02:14:06.391904+0000","last_peered":"2024-09-05T02:14:06.391904+0000","last_clean":"2024-09-05T02:14:06.391904+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:14:06.391904+0000","last_undegraded":"2024-09-05T02:14:06.391904+0000","last_fullsized":"2024-09-05T02:14:06.391904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:20.436128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390757+0000","last_change":"2024-09-05T01:05:07.102945+0000","last_active":"2024-09-05T02:12:16.390757+0000","last_peered":"2024-09-05T02:12:16.390757+0000","last_clean":"2024-09-05T02:12:16.390757+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:12:16.390757+0000","last_undegraded":"2024-09-05T02:12:16.390757+0000","last_fullsized":"2024-09-05T02:12:16.390757+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:11:05.062597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774731+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:12:26.774731+0000","last_peered":"2024-09-05T02:12:26.774731+0000","last_clean":"2024-09-05T02:12:26.774731+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:12:26.774731+0000","last_undegraded":"2024-09-05T02:12:26.774731+0000","last_fullsized":"2024-09-05T02:12:26.774731+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:07.625006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818258+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:12:16.818258+0000","last_peered":"2024-09-05T02:12:16.818258+0000","last_clean":"2024-09-05T02:12:16.818258+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:12:16.818258+0000","last_undegraded":"2024-09-05T02:12:16.818258+0000","last_fullsized":"2024-09-05T02:12:16.818258+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:39.015669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203874+0000","last_change":"2024-09-05T01:09:22.189533+0000","last_active":"2024-09-05T02:12:15.203874+0000","last_peered":"2024-09-05T02:12:15.203874+0000","last_clean":"2024-09-05T02:12:15.203874+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:12:15.203874+0000","last_undegraded":"2024-09-05T02:12:15.203874+0000","last_fullsized":"2024-09-05T02:12:15.203874+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:17.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.634124+0000","last_change":"2024-09-05T01:05:07.104648+0000","last_active":"2024-09-05T02:14:06.634124+0000","last_peered":"2024-09-05T02:14:06.634124+0000","last_clean":"2024-09-05T02:14:06.634124+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:14:06.634124+0000","last_undegraded":"2024-09-05T02:14:06.634124+0000","last_fullsized":"2024-09-05T02:14:06.634124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:02.121064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207620+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:12:16.207620+0000","last_peered":"2024-09-05T02:12:16.207620+0000","last_clean":"2024-09-05T02:12:16.207620+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:12:16.207620+0000","last_undegraded":"2024-09-05T02:12:16.207620+0000","last_fullsized":"2024-09-05T02:12:16.207620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:55.569114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.313397+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.313397+0000","last_peered":"2024-09-05T02:16:21.313397+0000","last_clean":"2024-09-05T02:16:21.313397+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.313397+0000","last_undegraded":"2024-09-05T02:16:21.313397+0000","last_fullsized":"2024-09-05T02:16:21.313397+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:52.383560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792699+0000","last_change":"2024-09-05T01:05:07.109781+0000","last_active":"2024-09-05T02:13:51.792699+0000","last_peered":"2024-09-05T02:13:51.792699+0000","last_clean":"2024-09-05T02:13:51.792699+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:13:51.792699+0000","last_undegraded":"2024-09-05T02:13:51.792699+0000","last_fullsized":"2024-09-05T02:13:51.792699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:11.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.385750+0000","last_change":"2024-09-05T01:30:15.670716+0000","last_active":"2024-09-05T02:13:36.385750+0000","last_peered":"2024-09-05T02:13:36.385750+0000","last_clean":"2024-09-05T02:13:36.385750+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:13:36.385750+0000","last_undegraded":"2024-09-05T02:13:36.385750+0000","last_fullsized":"2024-09-05T02:13:36.385750+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:30.214527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'1","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794558+0000","last_change":"2024-09-05T01:09:26.336791+0000","last_active":"2024-09-05T02:14:01.794558+0000","last_peered":"2024-09-05T02:14:01.794558+0000","last_clean":"2024-09-05T02:14:01.794558+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:14:01.794558+0000","last_undegraded":"2024-09-05T02:14:01.794558+0000","last_fullsized":"2024-09-05T02:14:01.794558+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:27:19.850660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50459,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":100,"num_write":1,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227128+0000","last_change":"2024-09-05T01:05:07.103532+0000","last_active":"2024-09-05T02:13:55.227128+0000","last_peered":"2024-09-05T02:13:55.227128+0000","last_clean":"2024-09-05T02:13:55.227128+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:13:55.227128+0000","last_undegraded":"2024-09-05T02:13:55.227128+0000","last_fullsized":"2024-09-05T02:13:55.227128+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:09.868656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228540+0000","last_change":"2024-09-05T01:05:07.106167+0000","last_active":"2024-09-05T02:13:51.228540+0000","last_peered":"2024-09-05T02:13:51.228540+0000","last_clean":"2024-09-05T02:13:51.228540+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:13:51.228540+0000","last_undegraded":"2024-09-05T02:13:51.228540+0000","last_fullsized":"2024-09-05T02:13:51.228540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:44.638683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'1","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.413210+0000","last_change":"2024-09-05T01:09:26.348937+0000","last_active":"2024-09-05T02:14:01.413210+0000","last_peered":"2024-09-05T02:14:01.413210+0000","last_clean":"2024-09-05T02:14:01.413210+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:14:01.413210+0000","last_undegraded":"2024-09-05T02:14:01.413210+0000","last_fullsized":"2024-09-05T02:14:01.413210+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48427,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.793654+0000","last_change":"2024-09-05T01:09:22.183966+0000","last_active":"2024-09-05T02:13:56.793654+0000","last_peered":"2024-09-05T02:13:56.793654+0000","last_clean":"2024-09-05T02:13:56.793654+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:13:56.793654+0000","last_undegraded":"2024-09-05T02:13:56.793654+0000","last_fullsized":"2024-09-05T02:13:56.793654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:52.065642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":216,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.410907+0000","last_change":"2024-09-05T01:05:07.105723+0000","last_active":"2024-09-05T02:13:51.410907+0000","last_peered":"2024-09-05T02:13:51.410907+0000","last_clean":"2024-09-05T02:13:51.410907+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:13:51.410907+0000","last_undegraded":"2024-09-05T02:13:51.410907+0000","last_fullsized":"2024-09-05T02:13:51.410907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:08.187510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.412152+0000","last_change":"2024-09-05T01:09:22.173186+0000","last_active":"2024-09-05T02:13:56.412152+0000","last_peered":"2024-09-05T02:13:56.412152+0000","last_clean":"2024-09-05T02:13:56.412152+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:13:56.412152+0000","last_undegraded":"2024-09-05T02:13:56.412152+0000","last_fullsized":"2024-09-05T02:13:56.412152+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:45.178339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.832398+0000","last_change":"2024-09-05T01:05:07.103211+0000","last_active":"2024-09-05T02:13:16.832398+0000","last_peered":"2024-09-05T02:13:16.832398+0000","last_clean":"2024-09-05T02:13:16.832398+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:13:16.832398+0000","last_undegraded":"2024-09-05T02:13:16.832398+0000","last_fullsized":"2024-09-05T02:13:16.832398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:40.214831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'322","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.368995+0000","last_change":"2024-09-05T00:50:04.197760+0000","last_active":"2024-09-05T02:16:21.368995+0000","last_peered":"2024-09-05T02:16:21.368995+0000","last_clean":"2024-09-05T02:16:21.368995+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:21.368995+0000","last_undegraded":"2024-09-05T02:16:21.368995+0000","last_fullsized":"2024-09-05T02:16:21.368995+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:08.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16681512,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":567,"num_read_kb":47641,"num_write":1166,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'505","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844799+0000","last_change":"2024-09-05T00:49:29.902310+0000","last_active":"2024-09-05T02:13:40.844799+0000","last_peered":"2024-09-05T02:13:40.844799+0000","last_clean":"2024-09-05T02:13:40.844799+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:13:40.844799+0000","last_undegraded":"2024-09-05T02:13:40.844799+0000","last_fullsized":"2024-09-05T02:13:40.844799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:52.315609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'328","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.752985+0000","last_change":"2024-09-05T00:49:27.898633+0000","last_active":"2024-09-05T02:16:21.752985+0000","last_peered":"2024-09-05T02:16:21.752985+0000","last_clean":"2024-09-05T02:16:21.752985+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:21.752985+0000","last_undegraded":"2024-09-05T02:16:21.752985+0000","last_fullsized":"2024-09-05T02:16:21.752985+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:12:19.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10487413,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":514,"num_read_kb":74892,"num_write":1128,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'444","reported_seq":2073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.060176+0000","last_change":"2024-09-05T00:50:04.184130+0000","last_active":"2024-09-05T02:13:56.060176+0000","last_peered":"2024-09-05T02:13:56.060176+0000","last_clean":"2024-09-05T02:13:56.060176+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:13:56.060176+0000","last_undegraded":"2024-09-05T02:13:56.060176+0000","last_fullsized":"2024-09-05T02:13:56.060176+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:41.824164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'320","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:04.720119+0000","last_change":"2024-09-05T00:49:27.878763+0000","last_active":"2024-09-05T02:13:04.720119+0000","last_peered":"2024-09-05T02:13:04.720119+0000","last_clean":"2024-09-05T02:13:04.720119+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:13:04.720119+0000","last_undegraded":"2024-09-05T02:13:04.720119+0000","last_fullsized":"2024-09-05T02:13:04.720119+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:40.061514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76785,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":521,"num_read_kb":741,"num_write":1072,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'852","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842642+0000","last_change":"2024-09-05T00:49:29.900944+0000","last_active":"2024-09-05T02:14:19.842642+0000","last_peered":"2024-09-05T02:14:19.842642+0000","last_clean":"2024-09-05T02:14:19.842642+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:14:19.842642+0000","last_undegraded":"2024-09-05T02:14:19.842642+0000","last_fullsized":"2024-09-05T02:14:19.842642+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:48.973383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'314","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227167+0000","last_change":"2024-09-05T00:49:27.891660+0000","last_active":"2024-09-05T02:13:55.227167+0000","last_peered":"2024-09-05T02:13:55.227167+0000","last_clean":"2024-09-05T02:13:55.227167+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:13:55.227167+0000","last_undegraded":"2024-09-05T02:13:55.227167+0000","last_fullsized":"2024-09-05T02:13:55.227167+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:52:25.219927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":495938,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":633,"num_read_kb":68500,"num_write":1247,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.840193+0000","last_change":"2024-09-05T00:49:29.919632+0000","last_active":"2024-09-05T02:13:40.840193+0000","last_peered":"2024-09-05T02:13:40.840193+0000","last_clean":"2024-09-05T02:13:40.840193+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:13:40.840193+0000","last_undegraded":"2024-09-05T02:13:40.840193+0000","last_fullsized":"2024-09-05T02:13:40.840193+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:31:42.074665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'321","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.603561+0000","last_change":"2024-09-05T00:49:27.904486+0000","last_active":"2024-09-05T02:16:21.603561+0000","last_peered":"2024-09-05T02:16:21.603561+0000","last_clean":"2024-09-05T02:16:21.603561+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:21.603561+0000","last_undegraded":"2024-09-05T02:16:21.603561+0000","last_fullsized":"2024-09-05T02:16:21.603561+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:22:56.989812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56400,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":422,"num_read_kb":9059,"num_write":1116,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'446","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.625924+0000","last_change":"2024-09-05T00:49:29.903354+0000","last_active":"2024-09-05T02:14:29.625924+0000","last_peered":"2024-09-05T02:14:29.625924+0000","last_clean":"2024-09-05T02:14:29.625924+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:14:29.625924+0000","last_undegraded":"2024-09-05T02:14:29.625924+0000","last_fullsized":"2024-09-05T02:14:29.625924+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:22.469137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'265","reported_seq":898,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200027+0000","last_change":"2024-09-05T00:49:27.899576+0000","last_active":"2024-09-05T02:12:00.200027+0000","last_peered":"2024-09-05T02:12:00.200027+0000","last_clean":"2024-09-05T02:12:00.200027+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:12:00.200027+0000","last_undegraded":"2024-09-05T02:12:00.200027+0000","last_fullsized":"2024-09-05T02:12:00.200027+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:56:44.824648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":267473,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":441,"num_read_kb":472,"num_write":1032,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'503","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.906613+0000","last_change":"2024-09-05T00:49:29.900890+0000","last_active":"2024-09-05T02:13:45.906613+0000","last_peered":"2024-09-05T02:13:45.906613+0000","last_clean":"2024-09-05T02:13:45.906613+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:13:45.906613+0000","last_undegraded":"2024-09-05T02:13:45.906613+0000","last_fullsized":"2024-09-05T02:13:45.906613+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'308","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.630906+0000","last_change":"2024-09-05T00:49:27.905426+0000","last_active":"2024-09-05T02:16:21.630906+0000","last_peered":"2024-09-05T02:16:21.630906+0000","last_clean":"2024-09-05T02:16:21.630906+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:21.630906+0000","last_undegraded":"2024-09-05T02:16:21.630906+0000","last_fullsized":"2024-09-05T02:16:21.630906+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:05.030484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7518681,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":470,"num_read_kb":57163,"num_write":1075,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'473","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.607735+0000","last_change":"2024-09-05T00:49:29.918860+0000","last_active":"2024-09-05T02:15:48.607735+0000","last_peered":"2024-09-05T02:15:48.607735+0000","last_clean":"2024-09-05T02:15:48.607735+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:15:48.607735+0000","last_undegraded":"2024-09-05T02:15:48.607735+0000","last_fullsized":"2024-09-05T02:15:48.607735+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:36.131820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'308","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.482117+0000","last_change":"2024-09-05T00:49:27.894250+0000","last_active":"2024-09-05T02:16:21.482117+0000","last_peered":"2024-09-05T02:16:21.482117+0000","last_clean":"2024-09-05T02:16:21.482117+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:21.482117+0000","last_undegraded":"2024-09-05T02:16:21.482117+0000","last_fullsized":"2024-09-05T02:16:21.482117+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:55:18.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103081,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":776,"num_read_kb":7162,"num_write":1090,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'450","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:14.403614+0000","last_change":"2024-09-05T00:49:29.917227+0000","last_active":"2024-09-05T02:13:14.403614+0000","last_peered":"2024-09-05T02:13:14.403614+0000","last_clean":"2024-09-05T02:13:14.403614+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:13:14.403614+0000","last_undegraded":"2024-09-05T02:13:14.403614+0000","last_fullsized":"2024-09-05T02:13:14.403614+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:45.091417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'744","reported_seq":2208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.062464+0000","last_change":"2024-09-05T00:49:29.905360+0000","last_active":"2024-09-05T02:13:56.062464+0000","last_peered":"2024-09-05T02:13:56.062464+0000","last_clean":"2024-09-05T02:13:56.062464+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:13:56.062464+0000","last_undegraded":"2024-09-05T02:13:56.062464+0000","last_fullsized":"2024-09-05T02:13:56.062464+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:40.876830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'298","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.617515+0000","last_change":"2024-09-05T00:49:27.910019+0000","last_active":"2024-09-05T02:16:21.617515+0000","last_peered":"2024-09-05T02:16:21.617515+0000","last_clean":"2024-09-05T02:16:21.617515+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:21.617515+0000","last_undegraded":"2024-09-05T02:16:21.617515+0000","last_fullsized":"2024-09-05T02:16:21.617515+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:00.426807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7003989,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":436,"num_read_kb":16771,"num_write":1036,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'434","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697734+0000","last_change":"2024-09-05T00:49:29.924150+0000","last_active":"2024-09-05T02:15:48.697734+0000","last_peered":"2024-09-05T02:15:48.697734+0000","last_clean":"2024-09-05T02:15:48.697734+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:15:48.697734+0000","last_undegraded":"2024-09-05T02:15:48.697734+0000","last_fullsized":"2024-09-05T02:15:48.697734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:21.326911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'289","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.241639+0000","last_change":"2024-09-05T00:49:27.896351+0000","last_active":"2024-09-05T02:16:21.241639+0000","last_peered":"2024-09-05T02:16:21.241639+0000","last_clean":"2024-09-05T02:16:21.241639+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:21.241639+0000","last_undegraded":"2024-09-05T02:16:21.241639+0000","last_fullsized":"2024-09-05T02:16:21.241639+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:17:37.231288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604179,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":408,"num_read_kb":5849,"num_write":1001,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'460","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.696002+0000","last_change":"2024-09-05T00:49:29.910681+0000","last_active":"2024-09-05T02:15:48.696002+0000","last_peered":"2024-09-05T02:15:48.696002+0000","last_clean":"2024-09-05T02:15:48.696002+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:15:48.696002+0000","last_undegraded":"2024-09-05T02:15:48.696002+0000","last_fullsized":"2024-09-05T02:15:48.696002+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:22.606854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'300","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.161079+0000","last_change":"2024-09-05T00:49:27.894988+0000","last_active":"2024-09-05T02:16:21.161079+0000","last_peered":"2024-09-05T02:16:21.161079+0000","last_clean":"2024-09-05T02:16:21.161079+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:21.161079+0000","last_undegraded":"2024-09-05T02:16:21.161079+0000","last_fullsized":"2024-09-05T02:16:21.161079+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:21.825324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128211,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":479,"num_read_kb":7060,"num_write":1167,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'491","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:47.724900+0000","last_change":"2024-09-05T00:49:29.912607+0000","last_active":"2024-09-05T02:12:47.724900+0000","last_peered":"2024-09-05T02:12:47.724900+0000","last_clean":"2024-09-05T02:12:47.724900+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:12:47.724900+0000","last_undegraded":"2024-09-05T02:12:47.724900+0000","last_fullsized":"2024-09-05T02:12:47.724900+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:34.256983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'302","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.180001+0000","last_change":"2024-09-05T00:49:27.882843+0000","last_active":"2024-09-05T02:16:21.180001+0000","last_peered":"2024-09-05T02:16:21.180001+0000","last_clean":"2024-09-05T02:16:21.180001+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:21.180001+0000","last_undegraded":"2024-09-05T02:16:21.180001+0000","last_fullsized":"2024-09-05T02:16:21.180001+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:25.955814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5423612,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":501,"num_read_kb":17342,"num_write":1177,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'405","reported_seq":1862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.843762+0000","last_change":"2024-09-05T00:49:29.917744+0000","last_active":"2024-09-05T02:13:40.843762+0000","last_peered":"2024-09-05T02:13:40.843762+0000","last_clean":"2024-09-05T02:13:40.843762+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:13:40.843762+0000","last_undegraded":"2024-09-05T02:13:40.843762+0000","last_fullsized":"2024-09-05T02:13:40.843762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:26.837337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'303","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.436666+0000","last_change":"2024-09-05T00:49:27.879495+0000","last_active":"2024-09-05T02:16:21.436666+0000","last_peered":"2024-09-05T02:16:21.436666+0000","last_clean":"2024-09-05T02:16:21.436666+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:21.436666+0000","last_undegraded":"2024-09-05T02:16:21.436666+0000","last_fullsized":"2024-09-05T02:16:21.436666+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:13.251498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114681,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":1528,"num_write":1184,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'749","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.563397+0000","last_change":"2024-09-05T00:49:29.921148+0000","last_active":"2024-09-05T02:14:29.563397+0000","last_peered":"2024-09-05T02:14:29.563397+0000","last_clean":"2024-09-05T02:14:29.563397+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:14:29.563397+0000","last_undegraded":"2024-09-05T02:14:29.563397+0000","last_fullsized":"2024-09-05T02:14:29.563397+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:28.667675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'272","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465372+0000","last_change":"2024-09-05T00:49:27.893557+0000","last_active":"2024-09-05T02:13:50.465372+0000","last_peered":"2024-09-05T02:13:50.465372+0000","last_clean":"2024-09-05T02:13:50.465372+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:13:50.465372+0000","last_undegraded":"2024-09-05T02:13:50.465372+0000","last_fullsized":"2024-09-05T02:13:50.465372+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:16:58.696922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5690064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":439,"num_read_kb":32078,"num_write":1015,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'127","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.840852+0000","last_change":"2024-09-05T00:49:37.949792+0000","last_active":"2024-09-05T02:14:29.840852+0000","last_peered":"2024-09-05T02:14:29.840852+0000","last_clean":"2024-09-05T02:14:29.840852+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:14:29.840852+0000","last_undegraded":"2024-09-05T02:14:29.840852+0000","last_fullsized":"2024-09-05T02:14:29.840852+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:18.632196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'322","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:25.027490+0000","last_change":"2024-09-05T00:50:04.179604+0000","last_active":"2024-09-05T02:13:25.027490+0000","last_peered":"2024-09-05T02:13:25.027490+0000","last_clean":"2024-09-05T02:13:25.027490+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:13:25.027490+0000","last_undegraded":"2024-09-05T02:13:25.027490+0000","last_fullsized":"2024-09-05T02:13:25.027490+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:19.315200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646392+0000","last_change":"2024-09-05T00:49:27.908163+0000","last_active":"2024-09-05T02:16:21.646392+0000","last_peered":"2024-09-05T02:16:21.646392+0000","last_clean":"2024-09-05T02:16:21.646392+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:21.646392+0000","last_undegraded":"2024-09-05T02:16:21.646392+0000","last_fullsized":"2024-09-05T02:16:21.646392+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:26.321927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332538,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":414,"num_read_kb":5561,"num_write":1081,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196301+0000","last_change":"2024-09-05T00:49:31.911566+0000","last_active":"2024-09-05T02:11:45.196301+0000","last_peered":"2024-09-05T02:11:45.196301+0000","last_clean":"2024-09-05T02:11:45.196301+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:11:45.196301+0000","last_undegraded":"2024-09-05T02:11:45.196301+0000","last_fullsized":"2024-09-05T02:11:45.196301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:50.459772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'362","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.470202+0000","last_change":"2024-09-05T00:49:33.908342+0000","last_active":"2024-09-05T02:14:10.470202+0000","last_peered":"2024-09-05T02:14:10.470202+0000","last_clean":"2024-09-05T02:14:10.470202+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:14:10.470202+0000","last_undegraded":"2024-09-05T02:14:10.470202+0000","last_fullsized":"2024-09-05T02:14:10.470202+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:30:43.947001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51820,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":1066,"num_write":448,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.810732+0000","last_change":"2024-09-05T00:49:35.935224+0000","last_active":"2024-09-05T02:11:46.810732+0000","last_peered":"2024-09-05T02:11:46.810732+0000","last_clean":"2024-09-05T02:11:46.810732+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:11:46.810732+0000","last_undegraded":"2024-09-05T02:11:46.810732+0000","last_fullsized":"2024-09-05T02:11:46.810732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:50.276599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2467","reported_seq":4375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.838585+0000","last_change":"2024-09-05T00:49:37.940197+0000","last_active":"2024-09-05T02:14:27.838585+0000","last_peered":"2024-09-05T02:14:27.838585+0000","last_clean":"2024-09-05T02:14:27.838585+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:14:27.838585+0000","last_undegraded":"2024-09-05T02:14:27.838585+0000","last_fullsized":"2024-09-05T02:14:27.838585+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:21.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.634828+0000","last_change":"2024-09-05T00:49:29.904918+0000","last_active":"2024-09-05T02:14:27.634828+0000","last_peered":"2024-09-05T02:14:27.634828+0000","last_clean":"2024-09-05T02:14:27.634828+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:14:27.634828+0000","last_undegraded":"2024-09-05T02:14:27.634828+0000","last_fullsized":"2024-09-05T02:14:27.634828+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:01:06.117657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'248","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:30.460041+0000","last_change":"2024-09-05T00:49:27.905821+0000","last_active":"2024-09-05T02:13:30.460041+0000","last_peered":"2024-09-05T02:13:30.460041+0000","last_clean":"2024-09-05T02:13:30.460041+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:13:30.460041+0000","last_undegraded":"2024-09-05T02:13:30.460041+0000","last_fullsized":"2024-09-05T02:13:30.460041+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:56:59.762079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10507262,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":366,"num_read_kb":61922,"num_write":840,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487978+0000","last_change":"2024-09-05T00:49:31.917103+0000","last_active":"2024-09-05T02:13:51.487978+0000","last_peered":"2024-09-05T02:13:51.487978+0000","last_clean":"2024-09-05T02:13:51.487978+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:13:51.487978+0000","last_undegraded":"2024-09-05T02:13:51.487978+0000","last_fullsized":"2024-09-05T02:13:51.487978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:08.039118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200339+0000","last_change":"2024-09-05T00:49:33.908801+0000","last_active":"2024-09-05T02:11:46.200339+0000","last_peered":"2024-09-05T02:11:46.200339+0000","last_clean":"2024-09-05T02:11:46.200339+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:11:46.200339+0000","last_undegraded":"2024-09-05T02:11:46.200339+0000","last_fullsized":"2024-09-05T02:11:46.200339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:32.220937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200292+0000","last_change":"2024-09-05T00:49:35.930182+0000","last_active":"2024-09-05T02:11:46.200292+0000","last_peered":"2024-09-05T02:11:46.200292+0000","last_clean":"2024-09-05T02:11:46.200292+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:11:46.200292+0000","last_undegraded":"2024-09-05T02:11:46.200292+0000","last_fullsized":"2024-09-05T02:11:46.200292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:35.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'106","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.066549+0000","last_change":"2024-09-05T00:49:37.932878+0000","last_active":"2024-09-05T02:14:26.066549+0000","last_peered":"2024-09-05T02:14:26.066549+0000","last_clean":"2024-09-05T02:14:26.066549+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:14:26.066549+0000","last_undegraded":"2024-09-05T02:14:26.066549+0000","last_fullsized":"2024-09-05T02:14:26.066549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:02.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1219","reported_seq":2904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.627360+0000","last_change":"2024-09-05T00:49:29.911068+0000","last_active":"2024-09-05T02:14:29.627360+0000","last_peered":"2024-09-05T02:14:29.627360+0000","last_clean":"2024-09-05T02:14:29.627360+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:14:29.627360+0000","last_undegraded":"2024-09-05T02:14:29.627360+0000","last_fullsized":"2024-09-05T02:14:29.627360+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:31.287838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'277","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.646925+0000","last_change":"2024-09-05T00:49:27.904699+0000","last_active":"2024-09-05T02:16:21.646925+0000","last_peered":"2024-09-05T02:16:21.646925+0000","last_clean":"2024-09-05T02:16:21.646925+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:21.646925+0000","last_undegraded":"2024-09-05T02:16:21.646925+0000","last_fullsized":"2024-09-05T02:16:21.646925+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:24.274679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325261,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":473,"num_read_kb":6929,"num_write":973,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.455259+0000","last_change":"2024-09-05T00:49:31.914059+0000","last_active":"2024-09-05T02:11:41.455259+0000","last_peered":"2024-09-05T02:11:41.455259+0000","last_clean":"2024-09-05T02:11:41.455259+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:11:41.455259+0000","last_undegraded":"2024-09-05T02:11:41.455259+0000","last_fullsized":"2024-09-05T02:11:41.455259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:54.072194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'181","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.387691+0000","last_change":"2024-09-05T00:49:33.902480+0000","last_active":"2024-09-05T02:13:46.387691+0000","last_peered":"2024-09-05T02:13:46.387691+0000","last_clean":"2024-09-05T02:13:46.387691+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:13:46.387691+0000","last_undegraded":"2024-09-05T02:13:46.387691+0000","last_fullsized":"2024-09-05T02:13:46.387691+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:14.928690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'784","reported_seq":4948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.837971+0000","last_change":"2024-09-05T00:49:35.927429+0000","last_active":"2024-09-05T02:16:20.837971+0000","last_peered":"2024-09-05T02:16:20.837971+0000","last_clean":"2024-09-05T02:16:20.837971+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:20.837971+0000","last_undegraded":"2024-09-05T02:16:20.837971+0000","last_fullsized":"2024-09-05T02:16:20.837971+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:49.036040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'234","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.269828+0000","last_change":"2024-09-05T00:49:37.922161+0000","last_active":"2024-09-05T02:15:48.269828+0000","last_peered":"2024-09-05T02:15:48.269828+0000","last_clean":"2024-09-05T02:15:48.269828+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:15:48.269828+0000","last_undegraded":"2024-09-05T02:15:48.269828+0000","last_fullsized":"2024-09-05T02:15:48.269828+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:45.817026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'682","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:07.422737+0000","last_change":"2024-09-05T00:49:29.927852+0000","last_active":"2024-09-05T02:13:07.422737+0000","last_peered":"2024-09-05T02:13:07.422737+0000","last_clean":"2024-09-05T02:13:07.422737+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:13:07.422737+0000","last_undegraded":"2024-09-05T02:13:07.422737+0000","last_fullsized":"2024-09-05T02:13:07.422737+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:09.704012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'299","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.202645+0000","last_change":"2024-09-05T00:49:27.880796+0000","last_active":"2024-09-05T02:16:21.202645+0000","last_peered":"2024-09-05T02:16:21.202645+0000","last_clean":"2024-09-05T02:16:21.202645+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:21.202645+0000","last_undegraded":"2024-09-05T02:16:21.202645+0000","last_fullsized":"2024-09-05T02:16:21.202645+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:01.610874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509103,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":513,"num_read_kb":55829,"num_write":1056,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196390+0000","last_change":"2024-09-05T00:49:31.910341+0000","last_active":"2024-09-05T02:11:45.196390+0000","last_peered":"2024-09-05T02:11:45.196390+0000","last_clean":"2024-09-05T02:11:45.196390+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:11:45.196390+0000","last_undegraded":"2024-09-05T02:11:45.196390+0000","last_fullsized":"2024-09-05T02:11:45.196390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:21.538486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'326","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.255008+0000","last_change":"2024-09-05T00:49:34.055554+0000","last_active":"2024-09-05T02:16:21.255008+0000","last_peered":"2024-09-05T02:16:21.255008+0000","last_clean":"2024-09-05T02:16:21.255008+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:21.255008+0000","last_undegraded":"2024-09-05T02:16:21.255008+0000","last_fullsized":"2024-09-05T02:16:21.255008+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:03:22.138176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'798","reported_seq":4536,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.846817+0000","last_change":"2024-09-05T00:49:35.938226+0000","last_active":"2024-09-05T02:16:20.846817+0000","last_peered":"2024-09-05T02:16:20.846817+0000","last_clean":"2024-09-05T02:16:20.846817+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:16:20.846817+0000","last_undegraded":"2024-09-05T02:16:20.846817+0000","last_fullsized":"2024-09-05T02:16:20.846817+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:56.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'744","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228164+0000","last_change":"2024-09-05T00:49:29.903992+0000","last_active":"2024-09-05T02:14:00.228164+0000","last_peered":"2024-09-05T02:14:00.228164+0000","last_clean":"2024-09-05T02:14:00.228164+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:14:00.228164+0000","last_undegraded":"2024-09-05T02:14:00.228164+0000","last_fullsized":"2024-09-05T02:14:00.228164+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:36.833935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'395","reported_seq":1105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.590878+0000","last_change":"2024-09-05T00:49:27.914055+0000","last_active":"2024-09-05T02:16:21.590878+0000","last_peered":"2024-09-05T02:16:21.590878+0000","last_clean":"2024-09-05T02:16:21.590878+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:21.590878+0000","last_undegraded":"2024-09-05T02:16:21.590878+0000","last_fullsized":"2024-09-05T02:16:21.590878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:52.269578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":333761,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":784,"num_read_kb":4739,"num_write":1373,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632817+0000","last_change":"2024-09-05T00:49:31.919796+0000","last_active":"2024-09-05T02:14:01.632817+0000","last_peered":"2024-09-05T02:14:01.632817+0000","last_clean":"2024-09-05T02:14:01.632817+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:14:01.632817+0000","last_undegraded":"2024-09-05T02:14:01.632817+0000","last_fullsized":"2024-09-05T02:14:01.632817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:17.976816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'415","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.235437+0000","last_change":"2024-09-05T00:49:34.052466+0000","last_active":"2024-09-05T02:14:30.235437+0000","last_peered":"2024-09-05T02:14:30.235437+0000","last_clean":"2024-09-05T02:14:30.235437+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:14:30.235437+0000","last_undegraded":"2024-09-05T02:14:30.235437+0000","last_fullsized":"2024-09-05T02:14:30.235437+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:20.386465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":687,"num_read_kb":1255,"num_write":534,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.780250+0000","last_change":"2024-09-05T00:49:35.937335+0000","last_active":"2024-09-05T02:12:51.780250+0000","last_peered":"2024-09-05T02:12:51.780250+0000","last_clean":"2024-09-05T02:12:51.780250+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:12:51.780250+0000","last_undegraded":"2024-09-05T02:12:51.780250+0000","last_fullsized":"2024-09-05T02:12:51.780250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:11.123088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'584","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.668190+0000","last_change":"2024-09-05T00:49:37.946024+0000","last_active":"2024-09-05T02:15:49.668190+0000","last_peered":"2024-09-05T02:15:49.668190+0000","last_clean":"2024-09-05T02:15:49.668190+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:15:49.668190+0000","last_undegraded":"2024-09-05T02:15:49.668190+0000","last_fullsized":"2024-09-05T02:15:49.668190+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:47:31.597559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'438","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230841+0000","last_change":"2024-09-05T00:49:29.923948+0000","last_active":"2024-09-05T02:14:01.230841+0000","last_peered":"2024-09-05T02:14:01.230841+0000","last_clean":"2024-09-05T02:14:01.230841+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:14:01.230841+0000","last_undegraded":"2024-09-05T02:14:01.230841+0000","last_fullsized":"2024-09-05T02:14:01.230841+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:07.536362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'260","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.643889+0000","last_change":"2024-09-05T00:49:27.905783+0000","last_active":"2024-09-05T02:16:21.643889+0000","last_peered":"2024-09-05T02:16:21.643889+0000","last_clean":"2024-09-05T02:16:21.643889+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:21.643889+0000","last_undegraded":"2024-09-05T02:16:21.643889+0000","last_fullsized":"2024-09-05T02:16:21.643889+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:18.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":636638,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":359,"num_read_kb":6806,"num_write":830,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390543+0000","last_change":"2024-09-05T00:49:31.900583+0000","last_active":"2024-09-05T02:14:01.390543+0000","last_peered":"2024-09-05T02:14:01.390543+0000","last_clean":"2024-09-05T02:14:01.390543+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:14:01.390543+0000","last_undegraded":"2024-09-05T02:14:01.390543+0000","last_fullsized":"2024-09-05T02:14:01.390543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:18.073117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'294","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.596957+0000","last_change":"2024-09-05T00:49:33.925800+0000","last_active":"2024-09-05T02:15:49.596957+0000","last_peered":"2024-09-05T02:15:49.596957+0000","last_clean":"2024-09-05T02:15:49.596957+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:15:49.596957+0000","last_undegraded":"2024-09-05T02:15:49.596957+0000","last_fullsized":"2024-09-05T02:15:49.596957+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:21.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56994,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":474,"num_read_kb":989,"num_write":382,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464772+0000","last_change":"2024-09-05T00:49:35.934298+0000","last_active":"2024-09-05T02:12:16.464772+0000","last_peered":"2024-09-05T02:12:16.464772+0000","last_clean":"2024-09-05T02:12:16.464772+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:12:16.464772+0000","last_undegraded":"2024-09-05T02:12:16.464772+0000","last_fullsized":"2024-09-05T02:12:16.464772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:20.839555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:26.432127+0000","last_change":"2024-09-05T00:49:37.939432+0000","last_active":"2024-09-05T02:15:26.432127+0000","last_peered":"2024-09-05T02:15:26.432127+0000","last_clean":"2024-09-05T02:15:26.432127+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:15:26.432127+0000","last_undegraded":"2024-09-05T02:15:26.432127+0000","last_fullsized":"2024-09-05T02:15:26.432127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:10:08.494468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'478","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.850142+0000","last_change":"2024-09-05T00:49:29.896300+0000","last_active":"2024-09-05T02:13:32.850142+0000","last_peered":"2024-09-05T02:13:32.850142+0000","last_clean":"2024-09-05T02:13:32.850142+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:13:32.850142+0000","last_undegraded":"2024-09-05T02:13:32.850142+0000","last_fullsized":"2024-09-05T02:13:32.850142+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:52:46.379207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.555869+0000","last_change":"2024-09-05T00:49:27.907570+0000","last_active":"2024-09-05T02:16:21.555869+0000","last_peered":"2024-09-05T02:16:21.555869+0000","last_clean":"2024-09-05T02:16:21.555869+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:21.555869+0000","last_undegraded":"2024-09-05T02:16:21.555869+0000","last_fullsized":"2024-09-05T02:16:21.555869+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:05.915567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1617206,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":414,"num_read_kb":11870,"num_write":1046,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375656+0000","last_change":"2024-09-05T00:49:31.902598+0000","last_active":"2024-09-05T02:12:46.375656+0000","last_peered":"2024-09-05T02:12:46.375656+0000","last_clean":"2024-09-05T02:12:46.375656+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:12:46.375656+0000","last_undegraded":"2024-09-05T02:12:46.375656+0000","last_fullsized":"2024-09-05T02:12:46.375656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:39.314352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'360","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:16.665940+0000","last_change":"2024-09-05T00:49:33.914287+0000","last_active":"2024-09-05T02:16:16.665940+0000","last_peered":"2024-09-05T02:16:16.665940+0000","last_clean":"2024-09-05T02:16:16.665940+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:16.665940+0000","last_undegraded":"2024-09-05T02:16:16.665940+0000","last_fullsized":"2024-09-05T02:16:16.665940+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:11.461929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53087,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":1050,"num_write":436,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'799","reported_seq":2967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.566046+0000","last_change":"2024-09-05T00:49:35.943066+0000","last_active":"2024-09-05T02:15:53.566046+0000","last_peered":"2024-09-05T02:15:53.566046+0000","last_clean":"2024-09-05T02:15:53.566046+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:15:53.566046+0000","last_undegraded":"2024-09-05T02:15:53.566046+0000","last_fullsized":"2024-09-05T02:15:53.566046+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.083488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.657912+0000","last_change":"2024-09-05T00:49:37.930994+0000","last_active":"2024-09-05T02:15:48.657912+0000","last_peered":"2024-09-05T02:15:48.657912+0000","last_clean":"2024-09-05T02:15:48.657912+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:15:48.657912+0000","last_undegraded":"2024-09-05T02:15:48.657912+0000","last_fullsized":"2024-09-05T02:15:48.657912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:37:05.359031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'803","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844942+0000","last_change":"2024-09-05T00:49:29.920955+0000","last_active":"2024-09-05T02:14:19.844942+0000","last_peered":"2024-09-05T02:14:19.844942+0000","last_clean":"2024-09-05T02:14:19.844942+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:14:19.844942+0000","last_undegraded":"2024-09-05T02:14:19.844942+0000","last_fullsized":"2024-09-05T02:14:19.844942+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:44:52.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'257","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210767+0000","last_change":"2024-09-05T00:49:27.889887+0000","last_active":"2024-09-05T02:12:45.210767+0000","last_peered":"2024-09-05T02:12:45.210767+0000","last_clean":"2024-09-05T02:12:45.210767+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:12:45.210767+0000","last_undegraded":"2024-09-05T02:12:45.210767+0000","last_fullsized":"2024-09-05T02:12:45.210767+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:39.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19488382,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":486,"num_read_kb":126733,"num_write":908,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.392808+0000","last_change":"2024-09-05T00:49:31.918141+0000","last_active":"2024-09-05T02:14:11.392808+0000","last_peered":"2024-09-05T02:14:11.392808+0000","last_clean":"2024-09-05T02:14:11.392808+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:14:11.392808+0000","last_undegraded":"2024-09-05T02:14:11.392808+0000","last_fullsized":"2024-09-05T02:14:11.392808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:29.030370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'538","reported_seq":1200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.651757+0000","last_change":"2024-09-05T00:49:33.914174+0000","last_active":"2024-09-05T02:15:49.651757+0000","last_peered":"2024-09-05T02:15:49.651757+0000","last_clean":"2024-09-05T02:15:49.651757+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:15:49.651757+0000","last_undegraded":"2024-09-05T02:15:49.651757+0000","last_fullsized":"2024-09-05T02:15:49.651757+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:19.745942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":958,"num_read_kb":2142,"num_write":802,"num_write_kb":670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391710+0000","last_change":"2024-09-05T00:49:35.924089+0000","last_active":"2024-09-05T02:14:06.391710+0000","last_peered":"2024-09-05T02:14:06.391710+0000","last_clean":"2024-09-05T02:14:06.391710+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:14:06.391710+0000","last_undegraded":"2024-09-05T02:14:06.391710+0000","last_fullsized":"2024-09-05T02:14:06.391710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.796632+0000","last_change":"2024-09-05T00:49:37.951943+0000","last_active":"2024-09-05T02:14:11.796632+0000","last_peered":"2024-09-05T02:14:11.796632+0000","last_clean":"2024-09-05T02:14:11.796632+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:14:11.796632+0000","last_undegraded":"2024-09-05T02:14:11.796632+0000","last_fullsized":"2024-09-05T02:14:11.796632+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:10:12.600724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'957","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844122+0000","last_change":"2024-09-05T00:49:29.916462+0000","last_active":"2024-09-05T02:13:40.844122+0000","last_peered":"2024-09-05T02:13:40.844122+0000","last_clean":"2024-09-05T02:13:40.844122+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:13:40.844122+0000","last_undegraded":"2024-09-05T02:13:40.844122+0000","last_fullsized":"2024-09-05T02:13:40.844122+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:54.951960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'527","reported_seq":1349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.477914+0000","last_change":"2024-09-05T00:49:27.882006+0000","last_active":"2024-09-05T02:16:21.477914+0000","last_peered":"2024-09-05T02:16:21.477914+0000","last_clean":"2024-09-05T02:16:21.477914+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:21.477914+0000","last_undegraded":"2024-09-05T02:16:21.477914+0000","last_fullsized":"2024-09-05T02:16:21.477914+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:30.493857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7940790,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1225,"num_read_kb":93814,"num_write":1725,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375772+0000","last_change":"2024-09-05T00:49:31.914002+0000","last_active":"2024-09-05T02:12:46.375772+0000","last_peered":"2024-09-05T02:12:46.375772+0000","last_clean":"2024-09-05T02:12:46.375772+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:12:46.375772+0000","last_undegraded":"2024-09-05T02:12:46.375772+0000","last_fullsized":"2024-09-05T02:12:46.375772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:51:45.528236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'313","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.604532+0000","last_change":"2024-09-05T00:49:33.912638+0000","last_active":"2024-09-05T02:15:49.604532+0000","last_peered":"2024-09-05T02:15:49.604532+0000","last_clean":"2024-09-05T02:15:49.604532+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:15:49.604532+0000","last_undegraded":"2024-09-05T02:15:49.604532+0000","last_fullsized":"2024-09-05T02:15:49.604532+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:18:34.630632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51420,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":966,"num_write":452,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455773+0000","last_change":"2024-09-05T00:49:35.943863+0000","last_active":"2024-09-05T02:13:10.455773+0000","last_peered":"2024-09-05T02:13:10.455773+0000","last_clean":"2024-09-05T02:13:10.455773+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:13:10.455773+0000","last_undegraded":"2024-09-05T02:13:10.455773+0000","last_fullsized":"2024-09-05T02:13:10.455773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:18:41.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'102","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:37.522963+0000","last_change":"2024-09-05T00:49:37.954493+0000","last_active":"2024-09-05T02:15:37.522963+0000","last_peered":"2024-09-05T02:15:37.522963+0000","last_clean":"2024-09-05T02:15:37.522963+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:15:37.522963+0000","last_undegraded":"2024-09-05T02:15:37.522963+0000","last_fullsized":"2024-09-05T02:15:37.522963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:55.189506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'494","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214294+0000","last_change":"2024-09-05T00:49:29.913611+0000","last_active":"2024-09-05T02:12:46.214294+0000","last_peered":"2024-09-05T02:12:46.214294+0000","last_clean":"2024-09-05T02:12:46.214294+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:12:46.214294+0000","last_undegraded":"2024-09-05T02:12:46.214294+0000","last_fullsized":"2024-09-05T02:12:46.214294+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:37:37.589615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'329","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.219682+0000","last_change":"2024-09-05T00:49:27.888513+0000","last_active":"2024-09-05T02:16:21.219682+0000","last_peered":"2024-09-05T02:16:21.219682+0000","last_clean":"2024-09-05T02:16:21.219682+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:21.219682+0000","last_undegraded":"2024-09-05T02:16:21.219682+0000","last_fullsized":"2024-09-05T02:16:21.219682+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:09.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1252799,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":594,"num_read_kb":21238,"num_write":1176,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779463+0000","last_change":"2024-09-05T00:49:31.926052+0000","last_active":"2024-09-05T02:12:46.779463+0000","last_peered":"2024-09-05T02:12:46.779463+0000","last_clean":"2024-09-05T02:12:46.779463+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:12:46.779463+0000","last_undegraded":"2024-09-05T02:12:46.779463+0000","last_fullsized":"2024-09-05T02:12:46.779463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:30.427944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.665771+0000","last_change":"2024-09-05T00:49:33.923431+0000","last_active":"2024-09-05T02:15:49.665771+0000","last_peered":"2024-09-05T02:15:49.665771+0000","last_clean":"2024-09-05T02:15:49.665771+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:15:49.665771+0000","last_undegraded":"2024-09-05T02:15:49.665771+0000","last_fullsized":"2024-09-05T02:15:49.665771+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:01.776499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53367,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":969,"num_write":410,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'732","reported_seq":2782,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.839462+0000","last_change":"2024-09-05T00:49:35.937729+0000","last_active":"2024-09-05T02:16:20.839462+0000","last_peered":"2024-09-05T02:16:20.839462+0000","last_clean":"2024-09-05T02:16:20.839462+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:20.839462+0000","last_undegraded":"2024-09-05T02:16:20.839462+0000","last_fullsized":"2024-09-05T02:16:20.839462+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:07:50.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.281544+0000","last_change":"2024-09-05T00:49:37.933620+0000","last_active":"2024-09-05T02:14:25.281544+0000","last_peered":"2024-09-05T02:14:25.281544+0000","last_clean":"2024-09-05T02:14:25.281544+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:14:25.281544+0000","last_undegraded":"2024-09-05T02:14:25.281544+0000","last_fullsized":"2024-09-05T02:14:25.281544+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:06.955650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'393","reported_seq":1887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214352+0000","last_change":"2024-09-05T00:49:29.914015+0000","last_active":"2024-09-05T02:12:46.214352+0000","last_peered":"2024-09-05T02:12:46.214352+0000","last_clean":"2024-09-05T02:12:46.214352+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:12:46.214352+0000","last_undegraded":"2024-09-05T02:12:46.214352+0000","last_fullsized":"2024-09-05T02:12:46.214352+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:02:56.335552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'265","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.185898+0000","last_change":"2024-09-05T00:49:27.875113+0000","last_active":"2024-09-05T02:16:21.185898+0000","last_peered":"2024-09-05T02:16:21.185898+0000","last_clean":"2024-09-05T02:16:21.185898+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:21.185898+0000","last_undegraded":"2024-09-05T02:16:21.185898+0000","last_fullsized":"2024-09-05T02:16:21.185898+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:27:05.251788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6375261,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":455,"num_read_kb":32425,"num_write":1028,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1459,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.541606+0000","last_change":"2024-09-05T00:49:31.921867+0000","last_active":"2024-09-05T02:15:49.541606+0000","last_peered":"2024-09-05T02:15:49.541606+0000","last_clean":"2024-09-05T02:15:49.541606+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:15:49.541606+0000","last_undegraded":"2024-09-05T02:15:49.541606+0000","last_fullsized":"2024-09-05T02:15:49.541606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:12.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473659+0000","last_change":"2024-09-05T00:49:34.054334+0000","last_active":"2024-09-05T02:12:51.473659+0000","last_peered":"2024-09-05T02:12:51.473659+0000","last_clean":"2024-09-05T02:12:51.473659+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:12:51.473659+0000","last_undegraded":"2024-09-05T02:12:51.473659+0000","last_fullsized":"2024-09-05T02:12:51.473659+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:44:00.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'769","reported_seq":2806,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.840171+0000","last_change":"2024-09-05T00:49:35.927090+0000","last_active":"2024-09-05T02:16:20.840171+0000","last_peered":"2024-09-05T02:16:20.840171+0000","last_clean":"2024-09-05T02:16:20.840171+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:20.840171+0000","last_undegraded":"2024-09-05T02:16:20.840171+0000","last_fullsized":"2024-09-05T02:16:20.840171+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:44.053640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.217672+0000","last_change":"2024-09-05T00:49:37.927836+0000","last_active":"2024-09-05T02:13:01.217672+0000","last_peered":"2024-09-05T02:13:01.217672+0000","last_clean":"2024-09-05T02:13:01.217672+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:13:01.217672+0000","last_undegraded":"2024-09-05T02:13:01.217672+0000","last_fullsized":"2024-09-05T02:13:01.217672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:55:13.858470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1289","reported_seq":3045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.644446+0000","last_change":"2024-09-05T00:49:29.920000+0000","last_active":"2024-09-05T02:15:48.644446+0000","last_peered":"2024-09-05T02:15:48.644446+0000","last_clean":"2024-09-05T02:15:48.644446+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:15:48.644446+0000","last_undegraded":"2024-09-05T02:15:48.644446+0000","last_fullsized":"2024-09-05T02:15:48.644446+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:23.678465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'296","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.284018+0000","last_change":"2024-09-05T00:49:27.884563+0000","last_active":"2024-09-05T02:16:21.284018+0000","last_peered":"2024-09-05T02:16:21.284018+0000","last_clean":"2024-09-05T02:16:21.284018+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:21.284018+0000","last_undegraded":"2024-09-05T02:16:21.284018+0000","last_fullsized":"2024-09-05T02:16:21.284018+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:32.747613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6504318,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":425,"num_read_kb":2332,"num_write":1126,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214330+0000","last_change":"2024-09-05T00:49:31.917398+0000","last_active":"2024-09-05T02:12:46.214330+0000","last_peered":"2024-09-05T02:12:46.214330+0000","last_clean":"2024-09-05T02:12:46.214330+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:12:46.214330+0000","last_undegraded":"2024-09-05T02:12:46.214330+0000","last_fullsized":"2024-09-05T02:12:46.214330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:04.120586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'448","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243657+0000","last_change":"2024-09-05T00:49:33.911807+0000","last_active":"2024-09-05T02:15:05.243657+0000","last_peered":"2024-09-05T02:15:05.243657+0000","last_clean":"2024-09-05T02:15:05.243657+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:15:05.243657+0000","last_undegraded":"2024-09-05T02:15:05.243657+0000","last_fullsized":"2024-09-05T02:15:05.243657+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:40:17.975347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52279,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1302,"num_read_kb":1773,"num_write":1870,"num_write_kb":1685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397943+0000","last_change":"2024-09-05T00:49:35.933208+0000","last_active":"2024-09-05T02:12:51.397943+0000","last_peered":"2024-09-05T02:12:51.397943+0000","last_clean":"2024-09-05T02:12:51.397943+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:12:51.397943+0000","last_undegraded":"2024-09-05T02:12:51.397943+0000","last_fullsized":"2024-09-05T02:12:51.397943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:18.752769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'152","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.782551+0000","last_change":"2024-09-05T00:49:37.945006+0000","last_active":"2024-09-05T02:13:01.782551+0000","last_peered":"2024-09-05T02:13:01.782551+0000","last_clean":"2024-09-05T02:13:01.782551+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:13:01.782551+0000","last_undegraded":"2024-09-05T02:13:01.782551+0000","last_fullsized":"2024-09-05T02:13:01.782551+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:03:44.203556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'892","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.845228+0000","last_change":"2024-09-05T00:49:29.900064+0000","last_active":"2024-09-05T02:14:19.845228+0000","last_peered":"2024-09-05T02:14:19.845228+0000","last_clean":"2024-09-05T02:14:19.845228+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:14:19.845228+0000","last_undegraded":"2024-09-05T02:14:19.845228+0000","last_fullsized":"2024-09-05T02:14:19.845228+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:13.462710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:26.834774+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T02:13:26.834774+0000","last_peered":"2024-09-05T02:13:26.834774+0000","last_clean":"2024-09-05T02:13:26.834774+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:13:26.834774+0000","last_undegraded":"2024-09-05T02:13:26.834774+0000","last_fullsized":"2024-09-05T02:13:26.834774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209522+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T02:12:40.209522+0000","last_peered":"2024-09-05T02:12:40.209522+0000","last_clean":"2024-09-05T02:12:40.209522+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:12:40.209522+0000","last_undegraded":"2024-09-05T02:12:40.209522+0000","last_fullsized":"2024-09-05T02:12:40.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'255","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.328352+0000","last_change":"2024-09-05T00:50:04.179246+0000","last_active":"2024-09-05T02:16:21.328352+0000","last_peered":"2024-09-05T02:16:21.328352+0000","last_clean":"2024-09-05T02:16:21.328352+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:21.328352+0000","last_undegraded":"2024-09-05T02:16:21.328352+0000","last_fullsized":"2024-09-05T02:16:21.328352+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:55.427090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1355273,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":411,"num_read_kb":14472,"num_write":824,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826578+0000","last_change":"2024-09-05T00:49:31.913193+0000","last_active":"2024-09-05T02:12:51.826578+0000","last_peered":"2024-09-05T02:12:51.826578+0000","last_clean":"2024-09-05T02:12:51.826578+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:12:51.826578+0000","last_undegraded":"2024-09-05T02:12:51.826578+0000","last_fullsized":"2024-09-05T02:12:51.826578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:35.650327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'772","reported_seq":1490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.659667+0000","last_change":"2024-09-05T00:49:33.921799+0000","last_active":"2024-09-05T02:15:49.659667+0000","last_peered":"2024-09-05T02:15:49.659667+0000","last_clean":"2024-09-05T02:15:49.659667+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:15:49.659667+0000","last_undegraded":"2024-09-05T02:15:49.659667+0000","last_fullsized":"2024-09-05T02:15:49.659667+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:02.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190302,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1502,"num_read_kb":3214,"num_write":1434,"num_write_kb":1271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468924+0000","last_change":"2024-09-05T00:49:35.943449+0000","last_active":"2024-09-05T02:14:05.468924+0000","last_peered":"2024-09-05T02:14:05.468924+0000","last_clean":"2024-09-05T02:14:05.468924+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:14:05.468924+0000","last_undegraded":"2024-09-05T02:14:05.468924+0000","last_fullsized":"2024-09-05T02:14:05.468924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:59.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'201","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.696227+0000","last_change":"2024-09-05T00:49:37.942775+0000","last_active":"2024-09-05T02:14:29.696227+0000","last_peered":"2024-09-05T02:14:29.696227+0000","last_clean":"2024-09-05T02:14:29.696227+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:14:29.696227+0000","last_undegraded":"2024-09-05T02:14:29.696227+0000","last_fullsized":"2024-09-05T02:14:29.696227+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:04.497388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'782","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844939+0000","last_change":"2024-09-05T00:49:29.921333+0000","last_active":"2024-09-05T02:14:19.844939+0000","last_peered":"2024-09-05T02:14:19.844939+0000","last_clean":"2024-09-05T02:14:19.844939+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:14:19.844939+0000","last_undegraded":"2024-09-05T02:14:19.844939+0000","last_fullsized":"2024-09-05T02:14:19.844939+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:47.295103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836049+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T02:13:31.836049+0000","last_peered":"2024-09-05T02:13:31.836049+0000","last_clean":"2024-09-05T02:13:31.836049+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:13:31.836049+0000","last_undegraded":"2024-09-05T02:13:31.836049+0000","last_fullsized":"2024-09-05T02:13:31.836049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'256","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450783+0000","last_change":"2024-09-05T00:49:27.878156+0000","last_active":"2024-09-05T02:12:50.450783+0000","last_peered":"2024-09-05T02:12:50.450783+0000","last_clean":"2024-09-05T02:12:50.450783+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:12:50.450783+0000","last_undegraded":"2024-09-05T02:12:50.450783+0000","last_fullsized":"2024-09-05T02:12:50.450783+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:53:01.442424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6449287,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":364,"num_read_kb":5706,"num_write":1015,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229660+0000","last_change":"2024-09-05T00:49:31.908526+0000","last_active":"2024-09-05T02:14:05.229660+0000","last_peered":"2024-09-05T02:14:05.229660+0000","last_clean":"2024-09-05T02:14:05.229660+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:14:05.229660+0000","last_undegraded":"2024-09-05T02:14:05.229660+0000","last_fullsized":"2024-09-05T02:14:05.229660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:47.306493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1368","reported_seq":3378,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.679194+0000","last_change":"2024-09-05T00:49:33.926295+0000","last_active":"2024-09-05T02:16:21.679194+0000","last_peered":"2024-09-05T02:16:21.679194+0000","last_clean":"2024-09-05T02:16:21.679194+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:21.679194+0000","last_undegraded":"2024-09-05T02:16:21.679194+0000","last_fullsized":"2024-09-05T02:16:21.679194+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:34:33.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150549,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":3812,"num_write":1224,"num_write_kb":999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830253+0000","last_change":"2024-09-05T00:49:35.940367+0000","last_active":"2024-09-05T02:13:06.830253+0000","last_peered":"2024-09-05T02:13:06.830253+0000","last_clean":"2024-09-05T02:13:06.830253+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:13:06.830253+0000","last_undegraded":"2024-09-05T02:13:06.830253+0000","last_fullsized":"2024-09-05T02:13:06.830253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:41.127677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'248","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.066730+0000","last_change":"2024-09-05T00:49:37.939098+0000","last_active":"2024-09-05T02:14:27.066730+0000","last_peered":"2024-09-05T02:14:27.066730+0000","last_clean":"2024-09-05T02:14:27.066730+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:14:27.066730+0000","last_undegraded":"2024-09-05T02:14:27.066730+0000","last_fullsized":"2024-09-05T02:14:27.066730+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:24:16.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'409","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.699092+0000","last_change":"2024-09-05T00:49:29.900527+0000","last_active":"2024-09-05T02:15:48.699092+0000","last_peered":"2024-09-05T02:15:48.699092+0000","last_clean":"2024-09-05T02:15:48.699092+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:15:48.699092+0000","last_undegraded":"2024-09-05T02:15:48.699092+0000","last_fullsized":"2024-09-05T02:15:48.699092+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.374481+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T02:12:41.374481+0000","last_peered":"2024-09-05T02:12:41.374481+0000","last_clean":"2024-09-05T02:12:41.374481+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:12:41.374481+0000","last_undegraded":"2024-09-05T02:12:41.374481+0000","last_fullsized":"2024-09-05T02:12:41.374481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'278","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.789469+0000","last_change":"2024-09-05T00:49:27.883563+0000","last_active":"2024-09-05T02:16:21.789469+0000","last_peered":"2024-09-05T02:16:21.789469+0000","last_clean":"2024-09-05T02:16:21.789469+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:21.789469+0000","last_undegraded":"2024-09-05T02:16:21.789469+0000","last_fullsized":"2024-09-05T02:16:21.789469+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:39.304949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9700033,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":578,"num_read_kb":23361,"num_write":857,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390702+0000","last_change":"2024-09-05T00:49:31.895357+0000","last_active":"2024-09-05T02:14:01.390702+0000","last_peered":"2024-09-05T02:14:01.390702+0000","last_clean":"2024-09-05T02:14:01.390702+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:14:01.390702+0000","last_undegraded":"2024-09-05T02:14:01.390702+0000","last_fullsized":"2024-09-05T02:14:01.390702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:42.106138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'346","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:46.508089+0000","last_change":"2024-09-05T00:49:34.055522+0000","last_active":"2024-09-05T02:15:46.508089+0000","last_peered":"2024-09-05T02:15:46.508089+0000","last_clean":"2024-09-05T02:15:46.508089+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:15:46.508089+0000","last_undegraded":"2024-09-05T02:15:46.508089+0000","last_fullsized":"2024-09-05T02:15:46.508089+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:45:16.964827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452179+0000","last_change":"2024-09-05T00:49:35.926479+0000","last_active":"2024-09-05T02:12:55.452179+0000","last_peered":"2024-09-05T02:12:55.452179+0000","last_clean":"2024-09-05T02:12:55.452179+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:12:55.452179+0000","last_undegraded":"2024-09-05T02:12:55.452179+0000","last_fullsized":"2024-09-05T02:12:55.452179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:15:53.424417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'243","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.151838+0000","last_change":"2024-09-05T00:49:37.952280+0000","last_active":"2024-09-05T02:14:30.151838+0000","last_peered":"2024-09-05T02:14:30.151838+0000","last_clean":"2024-09-05T02:14:30.151838+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:14:30.151838+0000","last_undegraded":"2024-09-05T02:14:30.151838+0000","last_fullsized":"2024-09-05T02:14:30.151838+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:26.910581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1276","reported_seq":2925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.706457+0000","last_change":"2024-09-05T00:49:29.908449+0000","last_active":"2024-09-05T02:14:27.706457+0000","last_peered":"2024-09-05T02:14:27.706457+0000","last_clean":"2024-09-05T02:14:27.706457+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:14:27.706457+0000","last_undegraded":"2024-09-05T02:14:27.706457+0000","last_fullsized":"2024-09-05T02:14:27.706457+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209438+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T02:12:40.209438+0000","last_peered":"2024-09-05T02:12:40.209438+0000","last_clean":"2024-09-05T02:12:40.209438+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:12:40.209438+0000","last_undegraded":"2024-09-05T02:12:40.209438+0000","last_fullsized":"2024-09-05T02:12:40.209438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'296","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.143992+0000","last_change":"2024-09-05T00:49:27.898358+0000","last_active":"2024-09-05T02:16:21.143992+0000","last_peered":"2024-09-05T02:16:21.143992+0000","last_clean":"2024-09-05T02:16:21.143992+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:21.143992+0000","last_undegraded":"2024-09-05T02:16:21.143992+0000","last_fullsized":"2024-09-05T02:16:21.143992+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:29.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21328244,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":488,"num_read_kb":46632,"num_write":1109,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.456748+0000","last_change":"2024-09-05T00:49:31.910432+0000","last_active":"2024-09-05T02:13:15.456748+0000","last_peered":"2024-09-05T02:13:15.456748+0000","last_clean":"2024-09-05T02:13:15.456748+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:13:15.456748+0000","last_undegraded":"2024-09-05T02:13:15.456748+0000","last_fullsized":"2024-09-05T02:13:15.456748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:21:42.078643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.928708+0000","last_change":"2024-09-05T00:49:33.929270+0000","last_active":"2024-09-05T02:15:49.928708+0000","last_peered":"2024-09-05T02:15:49.928708+0000","last_clean":"2024-09-05T02:15:49.928708+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:15:49.928708+0000","last_undegraded":"2024-09-05T02:15:49.928708+0000","last_fullsized":"2024-09-05T02:15:49.928708+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:24:30.946732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.414541+0000","last_change":"2024-09-05T00:49:35.948033+0000","last_active":"2024-09-05T02:14:06.414541+0000","last_peered":"2024-09-05T02:14:06.414541+0000","last_clean":"2024-09-05T02:14:06.414541+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:14:06.414541+0000","last_undegraded":"2024-09-05T02:14:06.414541+0000","last_fullsized":"2024-09-05T02:14:06.414541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:58.062174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'117","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230591+0000","last_change":"2024-09-05T00:49:37.953956+0000","last_active":"2024-09-05T02:14:10.230591+0000","last_peered":"2024-09-05T02:14:10.230591+0000","last_clean":"2024-09-05T02:14:10.230591+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:14:10.230591+0000","last_undegraded":"2024-09-05T02:14:10.230591+0000","last_fullsized":"2024-09-05T02:14:10.230591+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:12.611232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'541","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.617732+0000","last_change":"2024-09-05T00:49:29.907763+0000","last_active":"2024-09-05T02:15:48.617732+0000","last_peered":"2024-09-05T02:15:48.617732+0000","last_clean":"2024-09-05T02:15:48.617732+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:15:48.617732+0000","last_undegraded":"2024-09-05T02:15:48.617732+0000","last_fullsized":"2024-09-05T02:15:48.617732+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:22.730148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'233","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.217613+0000","last_change":"2024-09-05T00:49:27.889027+0000","last_active":"2024-09-05T02:13:15.217613+0000","last_peered":"2024-09-05T02:13:15.217613+0000","last_clean":"2024-09-05T02:13:15.217613+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:13:15.217613+0000","last_undegraded":"2024-09-05T02:13:15.217613+0000","last_fullsized":"2024-09-05T02:13:15.217613+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:37.525116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9458431,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":495,"num_read_kb":39042,"num_write":851,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.778371+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T02:12:41.778371+0000","last_peered":"2024-09-05T02:12:41.778371+0000","last_clean":"2024-09-05T02:12:41.778371+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:12:41.778371+0000","last_undegraded":"2024-09-05T02:12:41.778371+0000","last_fullsized":"2024-09-05T02:12:41.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452119+0000","last_change":"2024-09-05T00:49:31.917058+0000","last_active":"2024-09-05T02:12:55.452119+0000","last_peered":"2024-09-05T02:12:55.452119+0000","last_clean":"2024-09-05T02:12:55.452119+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:12:55.452119+0000","last_undegraded":"2024-09-05T02:12:55.452119+0000","last_fullsized":"2024-09-05T02:12:55.452119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:09:49.645261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'668","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.663651+0000","last_change":"2024-09-05T00:49:33.928573+0000","last_active":"2024-09-05T02:15:49.663651+0000","last_peered":"2024-09-05T02:15:49.663651+0000","last_clean":"2024-09-05T02:15:49.663651+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:15:49.663651+0000","last_undegraded":"2024-09-05T02:15:49.663651+0000","last_fullsized":"2024-09-05T02:15:49.663651+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:49:02.005394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130968,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1113,"num_read_kb":2239,"num_write":998,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216518+0000","last_change":"2024-09-05T00:49:35.938207+0000","last_active":"2024-09-05T02:12:56.216518+0000","last_peered":"2024-09-05T02:12:56.216518+0000","last_clean":"2024-09-05T02:12:56.216518+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:12:56.216518+0000","last_undegraded":"2024-09-05T02:12:56.216518+0000","last_fullsized":"2024-09-05T02:12:56.216518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:03.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.920772+0000","last_change":"2024-09-05T00:49:37.933639+0000","last_active":"2024-09-05T02:14:29.920772+0000","last_peered":"2024-09-05T02:14:29.920772+0000","last_clean":"2024-09-05T02:14:29.920772+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:14:29.920772+0000","last_undegraded":"2024-09-05T02:14:29.920772+0000","last_fullsized":"2024-09-05T02:14:29.920772+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:37.728081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'883","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701326+0000","last_change":"2024-09-05T00:49:29.913232+0000","last_active":"2024-09-05T02:14:27.701326+0000","last_peered":"2024-09-05T02:14:27.701326+0000","last_clean":"2024-09-05T02:14:27.701326+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:14:27.701326+0000","last_undegraded":"2024-09-05T02:14:27.701326+0000","last_fullsized":"2024-09-05T02:14:27.701326+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:24.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'286","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.811136+0000","last_change":"2024-09-05T00:49:27.879948+0000","last_active":"2024-09-05T02:16:21.811136+0000","last_peered":"2024-09-05T02:16:21.811136+0000","last_clean":"2024-09-05T02:16:21.811136+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:21.811136+0000","last_undegraded":"2024-09-05T02:16:21.811136+0000","last_fullsized":"2024-09-05T02:16:21.811136+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:21:52.199092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081198,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":491,"num_read_kb":37378,"num_write":1020,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826629+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T02:12:51.826629+0000","last_peered":"2024-09-05T02:12:51.826629+0000","last_clean":"2024-09-05T02:12:51.826629+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:12:51.826629+0000","last_undegraded":"2024-09-05T02:12:51.826629+0000","last_fullsized":"2024-09-05T02:12:51.826629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397897+0000","last_change":"2024-09-05T00:49:31.913143+0000","last_active":"2024-09-05T02:12:51.397897+0000","last_peered":"2024-09-05T02:12:51.397897+0000","last_clean":"2024-09-05T02:12:51.397897+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:12:51.397897+0000","last_undegraded":"2024-09-05T02:12:51.397897+0000","last_fullsized":"2024-09-05T02:12:51.397897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:26.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'204","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.781213+0000","last_change":"2024-09-05T00:49:34.054211+0000","last_active":"2024-09-05T02:12:56.781213+0000","last_peered":"2024-09-05T02:12:56.781213+0000","last_clean":"2024-09-05T02:12:56.781213+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:12:56.781213+0000","last_undegraded":"2024-09-05T02:12:56.781213+0000","last_fullsized":"2024-09-05T02:12:56.781213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:13.534123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'792","reported_seq":3273,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:53.536994+0000","last_change":"2024-09-05T00:49:35.933822+0000","last_active":"2024-09-05T02:15:53.536994+0000","last_peered":"2024-09-05T02:15:53.536994+0000","last_clean":"2024-09-05T02:15:53.536994+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:15:53.536994+0000","last_undegraded":"2024-09-05T02:15:53.536994+0000","last_fullsized":"2024-09-05T02:15:53.536994+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'146","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:31.508344+0000","last_change":"2024-09-05T00:49:37.948757+0000","last_active":"2024-09-05T02:15:31.508344+0000","last_peered":"2024-09-05T02:15:31.508344+0000","last_clean":"2024-09-05T02:15:31.508344+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:15:31.508344+0000","last_undegraded":"2024-09-05T02:15:31.508344+0000","last_fullsized":"2024-09-05T02:15:31.508344+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:40.306605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'962","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487814+0000","last_change":"2024-09-05T00:49:29.927814+0000","last_active":"2024-09-05T02:13:51.487814+0000","last_peered":"2024-09-05T02:13:51.487814+0000","last_clean":"2024-09-05T02:13:51.487814+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:13:51.487814+0000","last_undegraded":"2024-09-05T02:13:51.487814+0000","last_fullsized":"2024-09-05T02:13:51.487814+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:53:13.267895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'362","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.500110+0000","last_change":"2024-09-05T00:49:27.910000+0000","last_active":"2024-09-05T02:16:21.500110+0000","last_peered":"2024-09-05T02:16:21.500110+0000","last_clean":"2024-09-05T02:16:21.500110+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:21.500110+0000","last_undegraded":"2024-09-05T02:16:21.500110+0000","last_fullsized":"2024-09-05T02:16:21.500110+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:27:09.939131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89265,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":704,"num_read_kb":36690,"num_write":1383,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792763+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T02:13:51.792763+0000","last_peered":"2024-09-05T02:13:51.792763+0000","last_clean":"2024-09-05T02:13:51.792763+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:13:51.792763+0000","last_undegraded":"2024-09-05T02:13:51.792763+0000","last_fullsized":"2024-09-05T02:13:51.792763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.215403+0000","last_change":"2024-09-05T00:49:31.916181+0000","last_active":"2024-09-05T02:12:51.215403+0000","last_peered":"2024-09-05T02:12:51.215403+0000","last_clean":"2024-09-05T02:12:51.215403+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:12:51.215403+0000","last_undegraded":"2024-09-05T02:12:51.215403+0000","last_fullsized":"2024-09-05T02:12:51.215403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:16:28.018466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'156","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216578+0000","last_change":"2024-09-05T00:49:33.919913+0000","last_active":"2024-09-05T02:12:56.216578+0000","last_peered":"2024-09-05T02:12:56.216578+0000","last_clean":"2024-09-05T02:12:56.216578+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:12:56.216578+0000","last_undegraded":"2024-09-05T02:12:56.216578+0000","last_fullsized":"2024-09-05T02:12:56.216578+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:48.393350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'799","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.844438+0000","last_change":"2024-09-05T00:49:35.938148+0000","last_active":"2024-09-05T02:16:20.844438+0000","last_peered":"2024-09-05T02:16:20.844438+0000","last_clean":"2024-09-05T02:16:20.844438+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:20.844438+0000","last_undegraded":"2024-09-05T02:16:20.844438+0000","last_fullsized":"2024-09-05T02:16:20.844438+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:27.051091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'174","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452197+0000","last_change":"2024-09-05T00:49:37.954318+0000","last_active":"2024-09-05T02:12:55.452197+0000","last_peered":"2024-09-05T02:12:55.452197+0000","last_clean":"2024-09-05T02:12:55.452197+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:12:55.452197+0000","last_undegraded":"2024-09-05T02:12:55.452197+0000","last_fullsized":"2024-09-05T02:12:55.452197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:51.538774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'563","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.707331+0000","last_change":"2024-09-05T00:49:29.906133+0000","last_active":"2024-09-05T02:14:27.707331+0000","last_peered":"2024-09-05T02:14:27.707331+0000","last_clean":"2024-09-05T02:14:27.707331+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:14:27.707331+0000","last_undegraded":"2024-09-05T02:14:27.707331+0000","last_fullsized":"2024-09-05T02:14:27.707331+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:44.863527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'295","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467748+0000","last_change":"2024-09-05T00:49:27.894589+0000","last_active":"2024-09-05T02:14:00.467748+0000","last_peered":"2024-09-05T02:14:00.467748+0000","last_clean":"2024-09-05T02:14:00.467748+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:14:00.467748+0000","last_undegraded":"2024-09-05T02:14:00.467748+0000","last_fullsized":"2024-09-05T02:14:00.467748+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:44.386284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11119831,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":428,"num_read_kb":1280,"num_write":986,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.411126+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T02:13:51.411126+0000","last_peered":"2024-09-05T02:13:51.411126+0000","last_clean":"2024-09-05T02:13:51.411126+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:13:51.411126+0000","last_undegraded":"2024-09-05T02:13:51.411126+0000","last_fullsized":"2024-09-05T02:13:51.411126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487854+0000","last_change":"2024-09-05T00:49:31.913300+0000","last_active":"2024-09-05T02:13:51.487854+0000","last_peered":"2024-09-05T02:13:51.487854+0000","last_clean":"2024-09-05T02:13:51.487854+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:13:51.487854+0000","last_undegraded":"2024-09-05T02:13:51.487854+0000","last_fullsized":"2024-09-05T02:13:51.487854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'755","reported_seq":1511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.487705+0000","last_change":"2024-09-05T00:49:34.054583+0000","last_active":"2024-09-05T02:16:21.487705+0000","last_peered":"2024-09-05T02:16:21.487705+0000","last_clean":"2024-09-05T02:16:21.487705+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:21.487705+0000","last_undegraded":"2024-09-05T02:16:21.487705+0000","last_fullsized":"2024-09-05T02:16:21.487705+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:41.332842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146628,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1309,"num_read_kb":2983,"num_write":1048,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.474955+0000","last_change":"2024-09-05T00:49:35.934315+0000","last_active":"2024-09-05T02:12:56.474955+0000","last_peered":"2024-09-05T02:12:56.474955+0000","last_clean":"2024-09-05T02:12:56.474955+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:12:56.474955+0000","last_undegraded":"2024-09-05T02:12:56.474955+0000","last_fullsized":"2024-09-05T02:12:56.474955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:47.877686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.213128+0000","last_change":"2024-09-05T00:49:37.942217+0000","last_active":"2024-09-05T02:12:55.213128+0000","last_peered":"2024-09-05T02:12:55.213128+0000","last_clean":"2024-09-05T02:12:55.213128+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:12:55.213128+0000","last_undegraded":"2024-09-05T02:12:55.213128+0000","last_fullsized":"2024-09-05T02:12:55.213128+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:07:48.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'136","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.069901+0000","last_change":"2024-09-05T00:49:37.943464+0000","last_active":"2024-09-05T02:14:30.069901+0000","last_peered":"2024-09-05T02:14:30.069901+0000","last_clean":"2024-09-05T02:14:30.069901+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:14:30.069901+0000","last_undegraded":"2024-09-05T02:14:30.069901+0000","last_fullsized":"2024-09-05T02:14:30.069901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:53.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'583","reported_seq":2215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.224203+0000","last_change":"2024-09-05T00:49:29.912807+0000","last_active":"2024-09-05T02:13:31.224203+0000","last_peered":"2024-09-05T02:13:31.224203+0000","last_clean":"2024-09-05T02:13:31.224203+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:13:31.224203+0000","last_undegraded":"2024-09-05T02:13:31.224203+0000","last_fullsized":"2024-09-05T02:13:31.224203+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'241","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.159306+0000","last_change":"2024-09-05T00:49:27.907668+0000","last_active":"2024-09-05T02:16:21.159306+0000","last_peered":"2024-09-05T02:16:21.159306+0000","last_clean":"2024-09-05T02:16:21.159306+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:21.159306+0000","last_undegraded":"2024-09-05T02:16:21.159306+0000","last_fullsized":"2024-09-05T02:16:21.159306+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:40.897083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18373462,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":445,"num_read_kb":27235,"num_write":892,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.788861+0000","last_change":"2024-09-05T00:49:31.905642+0000","last_active":"2024-09-05T02:13:31.788861+0000","last_peered":"2024-09-05T02:13:31.788861+0000","last_clean":"2024-09-05T02:13:31.788861+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:13:31.788861+0000","last_undegraded":"2024-09-05T02:13:31.788861+0000","last_fullsized":"2024-09-05T02:13:31.788861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:00.091113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'311","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.513487+0000","last_change":"2024-09-05T00:49:33.930112+0000","last_active":"2024-09-05T02:15:56.513487+0000","last_peered":"2024-09-05T02:15:56.513487+0000","last_clean":"2024-09-05T02:15:56.513487+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:15:56.513487+0000","last_undegraded":"2024-09-05T02:15:56.513487+0000","last_fullsized":"2024-09-05T02:15:56.513487+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:14.000620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56863,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":521,"num_read_kb":1061,"num_write":420,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.484298+0000","last_change":"2024-09-05T00:49:35.939413+0000","last_active":"2024-09-05T02:13:36.484298+0000","last_peered":"2024-09-05T02:13:36.484298+0000","last_clean":"2024-09-05T02:13:36.484298+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:13:36.484298+0000","last_undegraded":"2024-09-05T02:13:36.484298+0000","last_fullsized":"2024-09-05T02:13:36.484298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.914012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'371","reported_seq":1835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623686+0000","last_change":"2024-09-05T00:49:29.890020+0000","last_active":"2024-09-05T02:14:29.623686+0000","last_peered":"2024-09-05T02:14:29.623686+0000","last_clean":"2024-09-05T02:14:29.623686+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:14:29.623686+0000","last_undegraded":"2024-09-05T02:14:29.623686+0000","last_fullsized":"2024-09-05T02:14:29.623686+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:34.765894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'265","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.512786+0000","last_change":"2024-09-05T00:49:27.905154+0000","last_active":"2024-09-05T02:16:21.512786+0000","last_peered":"2024-09-05T02:16:21.512786+0000","last_clean":"2024-09-05T02:16:21.512786+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:21.512786+0000","last_undegraded":"2024-09-05T02:16:21.512786+0000","last_fullsized":"2024-09-05T02:16:21.512786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:44.309565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6345017,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":707,"num_read_kb":54962,"num_write":1000,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483453+0000","last_change":"2024-09-05T00:49:31.910668+0000","last_active":"2024-09-05T02:13:31.483453+0000","last_peered":"2024-09-05T02:13:31.483453+0000","last_clean":"2024-09-05T02:13:31.483453+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:13:31.483453+0000","last_undegraded":"2024-09-05T02:13:31.483453+0000","last_fullsized":"2024-09-05T02:13:31.483453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:49.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461072+0000","last_change":"2024-09-05T00:49:33.915459+0000","last_active":"2024-09-05T02:13:35.461072+0000","last_peered":"2024-09-05T02:13:35.461072+0000","last_clean":"2024-09-05T02:13:35.461072+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:13:35.461072+0000","last_undegraded":"2024-09-05T02:13:35.461072+0000","last_fullsized":"2024-09-05T02:13:35.461072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626911+0000","last_change":"2024-09-05T00:49:35.935530+0000","last_active":"2024-09-05T02:13:36.626911+0000","last_peered":"2024-09-05T02:13:36.626911+0000","last_clean":"2024-09-05T02:13:36.626911+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:13:36.626911+0000","last_undegraded":"2024-09-05T02:13:36.626911+0000","last_fullsized":"2024-09-05T02:13:36.626911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:22:34.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'228","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.905325+0000","last_change":"2024-09-05T00:49:37.926241+0000","last_active":"2024-09-05T02:14:29.905325+0000","last_peered":"2024-09-05T02:14:29.905325+0000","last_clean":"2024-09-05T02:14:29.905325+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:14:29.905325+0000","last_undegraded":"2024-09-05T02:14:29.905325+0000","last_fullsized":"2024-09-05T02:14:29.905325+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:25.119785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'412","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697308+0000","last_change":"2024-09-05T00:49:29.927723+0000","last_active":"2024-09-05T02:15:48.697308+0000","last_peered":"2024-09-05T02:15:48.697308+0000","last_clean":"2024-09-05T02:15:48.697308+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:15:48.697308+0000","last_undegraded":"2024-09-05T02:15:48.697308+0000","last_fullsized":"2024-09-05T02:15:48.697308+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:50.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'253","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.195218+0000","last_change":"2024-09-05T00:49:27.911758+0000","last_active":"2024-09-05T02:11:40.195218+0000","last_peered":"2024-09-05T02:11:40.195218+0000","last_clean":"2024-09-05T02:11:40.195218+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:11:40.195218+0000","last_undegraded":"2024-09-05T02:11:40.195218+0000","last_fullsized":"2024-09-05T02:11:40.195218+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:11:19.729173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333746,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":425,"num_read_kb":91576,"num_write":975,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836079+0000","last_change":"2024-09-05T00:49:31.926718+0000","last_active":"2024-09-05T02:13:31.836079+0000","last_peered":"2024-09-05T02:13:31.836079+0000","last_clean":"2024-09-05T02:13:31.836079+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:13:31.836079+0000","last_undegraded":"2024-09-05T02:13:31.836079+0000","last_fullsized":"2024-09-05T02:13:31.836079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:51:03.171626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.174204+0000","last_change":"2024-09-05T00:49:33.930627+0000","last_active":"2024-09-05T02:16:21.174204+0000","last_peered":"2024-09-05T02:16:21.174204+0000","last_clean":"2024-09-05T02:16:21.174204+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:21.174204+0000","last_undegraded":"2024-09-05T02:16:21.174204+0000","last_fullsized":"2024-09-05T02:16:21.174204+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:57:28.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407690+0000","last_change":"2024-09-05T00:49:35.948016+0000","last_active":"2024-09-05T02:13:36.407690+0000","last_peered":"2024-09-05T02:13:36.407690+0000","last_clean":"2024-09-05T02:13:36.407690+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:13:36.407690+0000","last_undegraded":"2024-09-05T02:13:36.407690+0000","last_fullsized":"2024-09-05T02:13:36.407690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.587514+0000","last_change":"2024-09-05T00:49:37.946851+0000","last_active":"2024-09-05T02:14:29.587514+0000","last_peered":"2024-09-05T02:14:29.587514+0000","last_clean":"2024-09-05T02:14:29.587514+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:14:29.587514+0000","last_undegraded":"2024-09-05T02:14:29.587514+0000","last_fullsized":"2024-09-05T02:14:29.587514+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:32.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483310+0000","last_change":"2024-09-05T00:49:29.924987+0000","last_active":"2024-09-05T02:13:31.483310+0000","last_peered":"2024-09-05T02:13:31.483310+0000","last_clean":"2024-09-05T02:13:31.483310+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:13:31.483310+0000","last_undegraded":"2024-09-05T02:13:31.483310+0000","last_fullsized":"2024-09-05T02:13:31.483310+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:54:10.390860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'273","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:40.433210+0000","last_change":"2024-09-05T00:49:27.894130+0000","last_active":"2024-09-05T02:11:40.433210+0000","last_peered":"2024-09-05T02:11:40.433210+0000","last_clean":"2024-09-05T02:11:40.433210+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:11:40.433210+0000","last_undegraded":"2024-09-05T02:11:40.433210+0000","last_fullsized":"2024-09-05T02:11:40.433210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:56.396000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1345006,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":475,"num_read_kb":6648,"num_write":1049,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.406490+0000","last_change":"2024-09-05T00:49:31.923471+0000","last_active":"2024-09-05T02:13:31.406490+0000","last_peered":"2024-09-05T02:13:31.406490+0000","last_clean":"2024-09-05T02:13:31.406490+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:13:31.406490+0000","last_undegraded":"2024-09-05T02:13:31.406490+0000","last_fullsized":"2024-09-05T02:13:31.406490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:09.929132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'294","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:56.661206+0000","last_change":"2024-09-05T00:49:33.908585+0000","last_active":"2024-09-05T02:15:56.661206+0000","last_peered":"2024-09-05T02:15:56.661206+0000","last_clean":"2024-09-05T02:15:56.661206+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:15:56.661206+0000","last_undegraded":"2024-09-05T02:15:56.661206+0000","last_fullsized":"2024-09-05T02:15:56.661206+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:52.420648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61673,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1062,"num_write":410,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461188+0000","last_change":"2024-09-05T00:49:35.943952+0000","last_active":"2024-09-05T02:13:35.461188+0000","last_peered":"2024-09-05T02:13:35.461188+0000","last_clean":"2024-09-05T02:13:35.461188+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:13:35.461188+0000","last_undegraded":"2024-09-05T02:13:35.461188+0000","last_fullsized":"2024-09-05T02:13:35.461188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:48.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'398","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:28.052618+0000","last_change":"2024-09-05T00:49:29.903345+0000","last_active":"2024-09-05T02:13:28.052618+0000","last_peered":"2024-09-05T02:13:28.052618+0000","last_clean":"2024-09-05T02:13:28.052618+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:13:28.052618+0000","last_undegraded":"2024-09-05T02:13:28.052618+0000","last_fullsized":"2024-09-05T02:13:28.052618+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:55:40.567779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'286","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451596+0000","last_change":"2024-09-05T00:49:27.884147+0000","last_active":"2024-09-05T02:16:21.451596+0000","last_peered":"2024-09-05T02:16:21.451596+0000","last_clean":"2024-09-05T02:16:21.451596+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:21.451596+0000","last_undegraded":"2024-09-05T02:16:21.451596+0000","last_fullsized":"2024-09-05T02:16:21.451596+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:59:47.503408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291972,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":868,"num_read_kb":44981,"num_write":1031,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.544020+0000","last_change":"2024-09-05T00:49:31.915305+0000","last_active":"2024-09-05T02:15:49.544020+0000","last_peered":"2024-09-05T02:15:49.544020+0000","last_clean":"2024-09-05T02:15:49.544020+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:15:49.544020+0000","last_undegraded":"2024-09-05T02:15:49.544020+0000","last_fullsized":"2024-09-05T02:15:49.544020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:46.356538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'526","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.875587+0000","last_change":"2024-09-05T00:49:33.912309+0000","last_active":"2024-09-05T02:16:20.875587+0000","last_peered":"2024-09-05T02:16:20.875587+0000","last_clean":"2024-09-05T02:16:20.875587+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:20.875587+0000","last_undegraded":"2024-09-05T02:16:20.875587+0000","last_fullsized":"2024-09-05T02:16:20.875587+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:19:37.409372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113415,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":924,"num_read_kb":2006,"num_write":808,"num_write_kb":702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.201299+0000","last_change":"2024-09-05T00:49:35.938332+0000","last_active":"2024-09-05T02:12:05.201299+0000","last_peered":"2024-09-05T02:12:05.201299+0000","last_clean":"2024-09-05T02:12:05.201299+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:12:05.201299+0000","last_undegraded":"2024-09-05T02:12:05.201299+0000","last_fullsized":"2024-09-05T02:12:05.201299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:56:14.582023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'181","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485412+0000","last_change":"2024-09-05T00:49:37.953067+0000","last_active":"2024-09-05T02:13:41.485412+0000","last_peered":"2024-09-05T02:13:41.485412+0000","last_clean":"2024-09-05T02:13:41.485412+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:13:41.485412+0000","last_undegraded":"2024-09-05T02:13:41.485412+0000","last_fullsized":"2024-09-05T02:13:41.485412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:56.679412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'420","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465509+0000","last_change":"2024-09-05T00:49:29.904429+0000","last_active":"2024-09-05T02:13:50.465509+0000","last_peered":"2024-09-05T02:13:50.465509+0000","last_clean":"2024-09-05T02:13:50.465509+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:13:50.465509+0000","last_undegraded":"2024-09-05T02:13:50.465509+0000","last_fullsized":"2024-09-05T02:13:50.465509+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:12.986135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'295","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.769909+0000","last_change":"2024-09-05T00:49:27.881769+0000","last_active":"2024-09-05T02:16:21.769909+0000","last_peered":"2024-09-05T02:16:21.769909+0000","last_clean":"2024-09-05T02:16:21.769909+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:21.769909+0000","last_undegraded":"2024-09-05T02:16:21.769909+0000","last_fullsized":"2024-09-05T02:16:21.769909+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:21.143493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8478999,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":516,"num_read_kb":27594,"num_write":980,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.398020+0000","last_change":"2024-09-05T00:49:31.923706+0000","last_active":"2024-09-05T02:12:51.398020+0000","last_peered":"2024-09-05T02:12:51.398020+0000","last_clean":"2024-09-05T02:12:51.398020+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:12:51.398020+0000","last_undegraded":"2024-09-05T02:12:51.398020+0000","last_fullsized":"2024-09-05T02:12:51.398020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:07:49.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'334","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.028866+0000","last_change":"2024-09-05T00:49:33.917339+0000","last_active":"2024-09-05T02:16:21.028866+0000","last_peered":"2024-09-05T02:16:21.028866+0000","last_clean":"2024-09-05T02:16:21.028866+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:21.028866+0000","last_undegraded":"2024-09-05T02:16:21.028866+0000","last_fullsized":"2024-09-05T02:16:21.028866+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:34.348566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.770357+0000","last_change":"2024-09-05T00:49:35.924621+0000","last_active":"2024-09-05T02:12:06.770357+0000","last_peered":"2024-09-05T02:12:06.770357+0000","last_clean":"2024-09-05T02:12:06.770357+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:12:06.770357+0000","last_undegraded":"2024-09-05T02:12:06.770357+0000","last_fullsized":"2024-09-05T02:12:06.770357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:29.284134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.408737+0000","last_change":"2024-09-05T00:49:37.931246+0000","last_active":"2024-09-05T02:13:41.408737+0000","last_peered":"2024-09-05T02:13:41.408737+0000","last_clean":"2024-09-05T02:13:41.408737+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:13:41.408737+0000","last_undegraded":"2024-09-05T02:13:41.408737+0000","last_fullsized":"2024-09-05T02:13:41.408737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:20.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'493","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709348+0000","last_change":"2024-09-05T00:49:29.925442+0000","last_active":"2024-09-05T02:14:27.709348+0000","last_peered":"2024-09-05T02:14:27.709348+0000","last_clean":"2024-09-05T02:14:27.709348+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:14:27.709348+0000","last_undegraded":"2024-09-05T02:14:27.709348+0000","last_fullsized":"2024-09-05T02:14:27.709348+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:04.486708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'261","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.129143+0000","last_change":"2024-09-05T00:49:27.883246+0000","last_active":"2024-09-05T02:16:21.129143+0000","last_peered":"2024-09-05T02:16:21.129143+0000","last_clean":"2024-09-05T02:16:21.129143+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:21.129143+0000","last_undegraded":"2024-09-05T02:16:21.129143+0000","last_fullsized":"2024-09-05T02:16:21.129143+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:38:45.620263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16796977,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":391,"num_read_kb":39348,"num_write":910,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.204119+0000","last_change":"2024-09-05T00:49:31.923994+0000","last_active":"2024-09-05T02:12:01.204119+0000","last_peered":"2024-09-05T02:12:01.204119+0000","last_clean":"2024-09-05T02:12:01.204119+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:12:01.204119+0000","last_undegraded":"2024-09-05T02:12:01.204119+0000","last_fullsized":"2024-09-05T02:12:01.204119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:56.251468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'316","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.653932+0000","last_change":"2024-09-05T00:49:34.055772+0000","last_active":"2024-09-05T02:15:49.653932+0000","last_peered":"2024-09-05T02:15:49.653932+0000","last_clean":"2024-09-05T02:15:49.653932+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:15:49.653932+0000","last_undegraded":"2024-09-05T02:15:49.653932+0000","last_fullsized":"2024-09-05T02:15:49.653932+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:58.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56876,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":526,"num_read_kb":1086,"num_write":426,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.792016+0000","last_change":"2024-09-05T00:49:35.935059+0000","last_active":"2024-09-05T02:13:46.792016+0000","last_peered":"2024-09-05T02:13:46.792016+0000","last_clean":"2024-09-05T02:13:46.792016+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:13:46.792016+0000","last_undegraded":"2024-09-05T02:13:46.792016+0000","last_fullsized":"2024-09-05T02:13:46.792016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:18:31.249785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'106","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.686139+0000","last_change":"2024-09-05T00:49:37.938971+0000","last_active":"2024-09-05T02:15:49.686139+0000","last_peered":"2024-09-05T02:15:49.686139+0000","last_clean":"2024-09-05T02:15:49.686139+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:15:49.686139+0000","last_undegraded":"2024-09-05T02:15:49.686139+0000","last_fullsized":"2024-09-05T02:15:49.686139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:26.724944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.621488+0000","last_change":"2024-09-05T00:49:29.900558+0000","last_active":"2024-09-05T02:15:48.621488+0000","last_peered":"2024-09-05T02:15:48.621488+0000","last_clean":"2024-09-05T02:15:48.621488+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:15:48.621488+0000","last_undegraded":"2024-09-05T02:15:48.621488+0000","last_fullsized":"2024-09-05T02:15:48.621488+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:58:48.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'327","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.822756+0000","last_change":"2024-09-05T00:49:27.876740+0000","last_active":"2024-09-05T02:13:36.822756+0000","last_peered":"2024-09-05T02:13:36.822756+0000","last_clean":"2024-09-05T02:13:36.822756+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:13:36.822756+0000","last_undegraded":"2024-09-05T02:13:36.822756+0000","last_fullsized":"2024-09-05T02:13:36.822756+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:04:11.453294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6975197,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":670,"num_read_kb":25028,"num_write":1187,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.769113+0000","last_change":"2024-09-05T00:49:31.926005+0000","last_active":"2024-09-05T02:12:01.769113+0000","last_peered":"2024-09-05T02:12:01.769113+0000","last_clean":"2024-09-05T02:12:01.769113+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:12:01.769113+0000","last_undegraded":"2024-09-05T02:12:01.769113+0000","last_fullsized":"2024-09-05T02:12:01.769113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:56.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228677+0000","last_change":"2024-09-05T00:49:34.053064+0000","last_active":"2024-09-05T02:13:51.228677+0000","last_peered":"2024-09-05T02:13:51.228677+0000","last_clean":"2024-09-05T02:13:51.228677+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:13:51.228677+0000","last_undegraded":"2024-09-05T02:13:51.228677+0000","last_fullsized":"2024-09-05T02:13:51.228677+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:16.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'769","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.829636+0000","last_change":"2024-09-05T00:49:35.932657+0000","last_active":"2024-09-05T02:16:20.829636+0000","last_peered":"2024-09-05T02:16:20.829636+0000","last_clean":"2024-09-05T02:16:20.829636+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:20.829636+0000","last_undegraded":"2024-09-05T02:16:20.829636+0000","last_fullsized":"2024-09-05T02:16:20.829636+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":700,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:55.080143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.628035+0000","last_change":"2024-09-05T00:49:37.942533+0000","last_active":"2024-09-05T02:13:41.628035+0000","last_peered":"2024-09-05T02:13:41.628035+0000","last_clean":"2024-09-05T02:13:41.628035+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:13:41.628035+0000","last_undegraded":"2024-09-05T02:13:41.628035+0000","last_fullsized":"2024-09-05T02:13:41.628035+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:02:29.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'867","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629749+0000","last_change":"2024-09-05T00:49:29.918570+0000","last_active":"2024-09-05T02:14:29.629749+0000","last_peered":"2024-09-05T02:14:29.629749+0000","last_clean":"2024-09-05T02:14:29.629749+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:14:29.629749+0000","last_undegraded":"2024-09-05T02:14:29.629749+0000","last_fullsized":"2024-09-05T02:14:29.629749+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:50.098868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'228","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:13.557049+0000","last_change":"2024-09-05T00:49:27.898399+0000","last_active":"2024-09-05T02:13:13.557049+0000","last_peered":"2024-09-05T02:13:13.557049+0000","last_clean":"2024-09-05T02:13:13.557049+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:13:13.557049+0000","last_undegraded":"2024-09-05T02:13:13.557049+0000","last_fullsized":"2024-09-05T02:13:13.557049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:30.481449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7594706,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":310,"num_read_kb":6339,"num_write":813,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.814573+0000","last_change":"2024-09-05T00:49:31.924947+0000","last_active":"2024-09-05T02:12:01.814573+0000","last_peered":"2024-09-05T02:12:01.814573+0000","last_clean":"2024-09-05T02:12:01.814573+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:12:01.814573+0000","last_undegraded":"2024-09-05T02:12:01.814573+0000","last_fullsized":"2024-09-05T02:12:01.814573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:00:06.551471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'377","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:35.236621+0000","last_change":"2024-09-05T00:49:33.910494+0000","last_active":"2024-09-05T02:14:35.236621+0000","last_peered":"2024-09-05T02:14:35.236621+0000","last_clean":"2024-09-05T02:14:35.236621+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:14:35.236621+0000","last_undegraded":"2024-09-05T02:14:35.236621+0000","last_fullsized":"2024-09-05T02:14:35.236621+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:46.890368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58331,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":610,"num_read_kb":1163,"num_write":484,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.434154+0000","last_change":"2024-09-05T00:49:35.941463+0000","last_active":"2024-09-05T02:11:45.434154+0000","last_peered":"2024-09-05T02:11:45.434154+0000","last_clean":"2024-09-05T02:11:45.434154+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:11:45.434154+0000","last_undegraded":"2024-09-05T02:11:45.434154+0000","last_fullsized":"2024-09-05T02:11:45.434154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:14.296731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'194","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.273394+0000","last_change":"2024-09-05T00:49:37.946192+0000","last_active":"2024-09-05T02:14:25.273394+0000","last_peered":"2024-09-05T02:14:25.273394+0000","last_clean":"2024-09-05T02:14:25.273394+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:14:25.273394+0000","last_undegraded":"2024-09-05T02:14:25.273394+0000","last_fullsized":"2024-09-05T02:14:25.273394+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:46.109450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'731","reported_seq":2519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842408+0000","last_change":"2024-09-05T00:49:29.916165+0000","last_active":"2024-09-05T02:14:19.842408+0000","last_peered":"2024-09-05T02:14:19.842408+0000","last_clean":"2024-09-05T02:14:19.842408+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:14:19.842408+0000","last_undegraded":"2024-09-05T02:14:19.842408+0000","last_fullsized":"2024-09-05T02:14:19.842408+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:54:04.834607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'331","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:38.279130+0000","last_change":"2024-09-05T00:49:27.889993+0000","last_active":"2024-09-05T02:15:38.279130+0000","last_peered":"2024-09-05T02:15:38.279130+0000","last_clean":"2024-09-05T02:15:38.279130+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:15:38.279130+0000","last_undegraded":"2024-09-05T02:15:38.279130+0000","last_fullsized":"2024-09-05T02:15:38.279130+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:01.461692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33961747,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":573,"num_read_kb":137825,"num_write":1239,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"35'3","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.529188+0000","last_change":"2024-09-05T00:49:31.903883+0000","last_active":"2024-09-05T02:15:49.529188+0000","last_peered":"2024-09-05T02:15:49.529188+0000","last_clean":"2024-09-05T02:15:49.529188+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:15:49.529188+0000","last_undegraded":"2024-09-05T02:15:49.529188+0000","last_fullsized":"2024-09-05T02:15:49.529188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:46.830057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":722,"num_read_kb":720,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'295","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.469993+0000","last_change":"2024-09-05T00:49:33.909608+0000","last_active":"2024-09-05T02:14:10.469993+0000","last_peered":"2024-09-05T02:14:10.469993+0000","last_clean":"2024-09-05T02:14:10.469993+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:14:10.469993+0000","last_undegraded":"2024-09-05T02:14:10.469993+0000","last_fullsized":"2024-09-05T02:14:10.469993+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:02.770171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57219,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1019,"num_write":396,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.388458+0000","last_change":"2024-09-05T00:49:35.941006+0000","last_active":"2024-09-05T02:12:06.388458+0000","last_peered":"2024-09-05T02:12:06.388458+0000","last_clean":"2024-09-05T02:12:06.388458+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:12:06.388458+0000","last_undegraded":"2024-09-05T02:12:06.388458+0000","last_fullsized":"2024-09-05T02:12:06.388458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:09.389985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.457891+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:11:51.457891+0000","last_peered":"2024-09-05T02:11:51.457891+0000","last_clean":"2024-09-05T02:11:51.457891+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:11:51.457891+0000","last_undegraded":"2024-09-05T02:11:51.457891+0000","last_fullsized":"2024-09-05T02:11:51.457891+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:49.316615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'474","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709554+0000","last_change":"2024-09-05T00:49:29.913963+0000","last_active":"2024-09-05T02:14:27.709554+0000","last_peered":"2024-09-05T02:14:27.709554+0000","last_clean":"2024-09-05T02:14:27.709554+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:14:27.709554+0000","last_undegraded":"2024-09-05T02:14:27.709554+0000","last_fullsized":"2024-09-05T02:14:27.709554+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:53.563132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'268","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.451565+0000","last_change":"2024-09-05T00:49:27.884322+0000","last_active":"2024-09-05T02:16:21.451565+0000","last_peered":"2024-09-05T02:16:21.451565+0000","last_clean":"2024-09-05T02:16:21.451565+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:21.451565+0000","last_undegraded":"2024-09-05T02:16:21.451565+0000","last_fullsized":"2024-09-05T02:16:21.451565+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:06.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11564123,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":370,"num_read_kb":12831,"num_write":964,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.199016+0000","last_change":"2024-09-05T00:49:31.918942+0000","last_active":"2024-09-05T02:11:41.199016+0000","last_peered":"2024-09-05T02:11:41.199016+0000","last_clean":"2024-09-05T02:11:41.199016+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:11:41.199016+0000","last_undegraded":"2024-09-05T02:11:41.199016+0000","last_fullsized":"2024-09-05T02:11:41.199016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:32.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'261","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.648988+0000","last_change":"2024-09-05T00:49:33.927237+0000","last_active":"2024-09-05T02:15:49.648988+0000","last_peered":"2024-09-05T02:15:49.648988+0000","last_clean":"2024-09-05T02:15:49.648988+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:15:49.648988+0000","last_undegraded":"2024-09-05T02:15:49.648988+0000","last_fullsized":"2024-09-05T02:15:49.648988+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:38:43.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59570,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":954,"num_write":352,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.205283+0000","last_change":"2024-09-05T00:49:35.925928+0000","last_active":"2024-09-05T02:12:06.205283+0000","last_peered":"2024-09-05T02:12:06.205283+0000","last_clean":"2024-09-05T02:12:06.205283+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:12:06.205283+0000","last_undegraded":"2024-09-05T02:12:06.205283+0000","last_fullsized":"2024-09-05T02:12:06.205283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:21.943807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'165","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.053963+0000","last_change":"2024-09-05T00:49:37.943592+0000","last_active":"2024-09-05T02:14:29.053963+0000","last_peered":"2024-09-05T02:14:29.053963+0000","last_clean":"2024-09-05T02:14:29.053963+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:14:29.053963+0000","last_undegraded":"2024-09-05T02:14:29.053963+0000","last_fullsized":"2024-09-05T02:14:29.053963+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:04.586566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'343","reported_seq":1852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.232009+0000","last_change":"2024-09-05T00:49:29.916442+0000","last_active":"2024-09-05T02:14:06.232009+0000","last_peered":"2024-09-05T02:14:06.232009+0000","last_clean":"2024-09-05T02:14:06.232009+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:14:06.232009+0000","last_undegraded":"2024-09-05T02:14:06.232009+0000","last_fullsized":"2024-09-05T02:14:06.232009+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:01:17.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'279","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:40.213892+0000","last_change":"2024-09-05T00:49:27.894135+0000","last_active":"2024-09-05T02:15:40.213892+0000","last_peered":"2024-09-05T02:15:40.213892+0000","last_clean":"2024-09-05T02:15:40.213892+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:15:40.213892+0000","last_undegraded":"2024-09-05T02:15:40.213892+0000","last_fullsized":"2024-09-05T02:15:40.213892+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:13:02.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826177,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":431,"num_read_kb":8852,"num_write":1022,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766535+0000","last_change":"2024-09-05T00:49:31.903736+0000","last_active":"2024-09-05T02:11:51.766535+0000","last_peered":"2024-09-05T02:11:51.766535+0000","last_clean":"2024-09-05T02:11:51.766535+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:11:51.766535+0000","last_undegraded":"2024-09-05T02:11:51.766535+0000","last_fullsized":"2024-09-05T02:11:51.766535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:35.531703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'333","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.654924+0000","last_change":"2024-09-05T00:49:33.908269+0000","last_active":"2024-09-05T02:15:49.654924+0000","last_peered":"2024-09-05T02:15:49.654924+0000","last_clean":"2024-09-05T02:15:49.654924+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:15:49.654924+0000","last_undegraded":"2024-09-05T02:15:49.654924+0000","last_fullsized":"2024-09-05T02:15:49.654924+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:50.246291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52665,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":530,"num_read_kb":1037,"num_write":422,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.439359+0000","last_change":"2024-09-05T00:49:35.940921+0000","last_active":"2024-09-05T02:12:05.439359+0000","last_peered":"2024-09-05T02:12:05.439359+0000","last_clean":"2024-09-05T02:12:05.439359+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:12:05.439359+0000","last_undegraded":"2024-09-05T02:12:05.439359+0000","last_fullsized":"2024-09-05T02:12:05.439359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:45:23.954287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.723417+0000","last_change":"2024-09-05T00:49:37.929472+0000","last_active":"2024-09-05T02:15:48.723417+0000","last_peered":"2024-09-05T02:15:48.723417+0000","last_clean":"2024-09-05T02:15:48.723417+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:15:48.723417+0000","last_undegraded":"2024-09-05T02:15:48.723417+0000","last_fullsized":"2024-09-05T02:15:48.723417+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:25.886624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'429","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.624104+0000","last_change":"2024-09-05T00:49:29.892206+0000","last_active":"2024-09-05T02:14:29.624104+0000","last_peered":"2024-09-05T02:14:29.624104+0000","last_clean":"2024-09-05T02:14:29.624104+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:14:29.624104+0000","last_undegraded":"2024-09-05T02:14:29.624104+0000","last_fullsized":"2024-09-05T02:14:29.624104+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:04.846605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'301","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.154241+0000","last_change":"2024-09-05T00:49:27.897228+0000","last_active":"2024-09-05T02:16:21.154241+0000","last_peered":"2024-09-05T02:16:21.154241+0000","last_clean":"2024-09-05T02:16:21.154241+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:21.154241+0000","last_undegraded":"2024-09-05T02:16:21.154241+0000","last_fullsized":"2024-09-05T02:16:21.154241+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:59.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6353533,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":420,"num_read_kb":8853,"num_write":1067,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1142","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794691+0000","last_change":"2024-09-05T00:49:29.906381+0000","last_active":"2024-09-05T02:14:01.794691+0000","last_peered":"2024-09-05T02:14:01.794691+0000","last_clean":"2024-09-05T02:14:01.794691+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:14:01.794691+0000","last_undegraded":"2024-09-05T02:14:01.794691+0000","last_fullsized":"2024-09-05T02:14:01.794691+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:43.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'288","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.389582+0000","last_change":"2024-09-05T00:50:04.182383+0000","last_active":"2024-09-05T02:16:21.389582+0000","last_peered":"2024-09-05T02:16:21.389582+0000","last_clean":"2024-09-05T02:16:21.389582+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:21.389582+0000","last_undegraded":"2024-09-05T02:16:21.389582+0000","last_fullsized":"2024-09-05T02:16:21.389582+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:45.984207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12240060,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":464,"num_read_kb":102142,"num_write":1086,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228410+0000","last_change":"2024-09-05T00:49:29.905701+0000","last_active":"2024-09-05T02:14:00.228410+0000","last_peered":"2024-09-05T02:14:00.228410+0000","last_clean":"2024-09-05T02:14:00.228410+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:14:00.228410+0000","last_undegraded":"2024-09-05T02:14:00.228410+0000","last_fullsized":"2024-09-05T02:14:00.228410+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:35:29.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'251","reported_seq":880,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.211786+0000","last_change":"2024-09-05T00:49:27.894703+0000","last_active":"2024-09-05T02:12:50.211786+0000","last_peered":"2024-09-05T02:12:50.211786+0000","last_clean":"2024-09-05T02:12:50.211786+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:12:50.211786+0000","last_undegraded":"2024-09-05T02:12:50.211786+0000","last_fullsized":"2024-09-05T02:12:50.211786+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:39.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":377,"num_read_kb":406,"num_write":922,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'414","reported_seq":1989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794636+0000","last_change":"2024-09-05T00:49:29.909413+0000","last_active":"2024-09-05T02:14:01.794636+0000","last_peered":"2024-09-05T02:14:01.794636+0000","last_clean":"2024-09-05T02:14:01.794636+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:14:01.794636+0000","last_undegraded":"2024-09-05T02:14:01.794636+0000","last_fullsized":"2024-09-05T02:14:01.794636+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:27.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'248","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455656+0000","last_change":"2024-09-05T00:49:27.869339+0000","last_active":"2024-09-05T02:13:10.455656+0000","last_peered":"2024-09-05T02:13:10.455656+0000","last_clean":"2024-09-05T02:13:10.455656+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:13:10.455656+0000","last_undegraded":"2024-09-05T02:13:10.455656+0000","last_fullsized":"2024-09-05T02:13:10.455656+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:57.416708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7403003,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":671,"num_read_kb":8225,"num_write":936,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1680","reported_seq":3527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.613554+0000","last_change":"2024-09-05T00:49:29.928238+0000","last_active":"2024-09-05T02:15:48.613554+0000","last_peered":"2024-09-05T02:15:48.613554+0000","last_clean":"2024-09-05T02:15:48.613554+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:15:48.613554+0000","last_undegraded":"2024-09-05T02:15:48.613554+0000","last_fullsized":"2024-09-05T02:15:48.613554+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:49.778085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'311","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.470906+0000","last_change":"2024-09-05T00:49:27.883474+0000","last_active":"2024-09-05T02:16:21.470906+0000","last_peered":"2024-09-05T02:16:21.470906+0000","last_clean":"2024-09-05T02:16:21.470906+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:21.470906+0000","last_undegraded":"2024-09-05T02:16:21.470906+0000","last_fullsized":"2024-09-05T02:16:21.470906+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:51.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27293344,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":491,"num_read_kb":75262,"num_write":1022,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'622","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.857581+0000","last_change":"2024-09-05T00:49:29.911388+0000","last_active":"2024-09-05T02:13:32.857581+0000","last_peered":"2024-09-05T02:13:32.857581+0000","last_clean":"2024-09-05T02:13:32.857581+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:13:32.857581+0000","last_undegraded":"2024-09-05T02:13:32.857581+0000","last_fullsized":"2024-09-05T02:13:32.857581+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:27.266690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'314","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.730835+0000","last_change":"2024-09-05T00:49:27.884310+0000","last_active":"2024-09-05T02:16:21.730835+0000","last_peered":"2024-09-05T02:16:21.730835+0000","last_clean":"2024-09-05T02:16:21.730835+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:21.730835+0000","last_undegraded":"2024-09-05T02:16:21.730835+0000","last_fullsized":"2024-09-05T02:16:21.730835+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:03.108303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22777162,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":490,"num_read_kb":27141,"num_write":1080,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'683","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.629116+0000","last_change":"2024-09-05T00:49:29.925070+0000","last_active":"2024-09-05T02:15:48.629116+0000","last_peered":"2024-09-05T02:15:48.629116+0000","last_clean":"2024-09-05T02:15:48.629116+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:15:48.629116+0000","last_undegraded":"2024-09-05T02:15:48.629116+0000","last_fullsized":"2024-09-05T02:15:48.629116+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:33.562310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'323","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.208857+0000","last_change":"2024-09-05T00:49:27.909574+0000","last_active":"2024-09-05T02:16:21.208857+0000","last_peered":"2024-09-05T02:16:21.208857+0000","last_clean":"2024-09-05T02:16:21.208857+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:21.208857+0000","last_undegraded":"2024-09-05T02:16:21.208857+0000","last_fullsized":"2024-09-05T02:16:21.208857+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:51.020169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266199,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":540,"num_read_kb":10940,"num_write":1226,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'476","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.888825+0000","last_change":"2024-09-05T00:49:29.888887+0000","last_active":"2024-09-05T02:13:37.888825+0000","last_peered":"2024-09-05T02:13:37.888825+0000","last_clean":"2024-09-05T02:13:37.888825+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:13:37.888825+0000","last_undegraded":"2024-09-05T02:13:37.888825+0000","last_fullsized":"2024-09-05T02:13:37.888825+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:05.114720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'301","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.510833+0000","last_change":"2024-09-05T00:49:27.886848+0000","last_active":"2024-09-05T02:16:21.510833+0000","last_peered":"2024-09-05T02:16:21.510833+0000","last_clean":"2024-09-05T02:16:21.510833+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:21.510833+0000","last_undegraded":"2024-09-05T02:16:21.510833+0000","last_fullsized":"2024-09-05T02:16:21.510833+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:26.738479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11790648,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":445,"num_read_kb":29009,"num_write":1154,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1109","reported_seq":2750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701677+0000","last_change":"2024-09-05T00:49:29.915871+0000","last_active":"2024-09-05T02:14:27.701677+0000","last_peered":"2024-09-05T02:14:27.701677+0000","last_clean":"2024-09-05T02:14:27.701677+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:14:27.701677+0000","last_undegraded":"2024-09-05T02:14:27.701677+0000","last_fullsized":"2024-09-05T02:14:27.701677+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:08:29.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'298","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:41.118507+0000","last_change":"2024-09-05T00:49:27.889044+0000","last_active":"2024-09-05T02:15:41.118507+0000","last_peered":"2024-09-05T02:15:41.118507+0000","last_clean":"2024-09-05T02:15:41.118507+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:15:41.118507+0000","last_undegraded":"2024-09-05T02:15:41.118507+0000","last_fullsized":"2024-09-05T02:15:41.118507+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:10.256222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18706729,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":551,"num_read_kb":61900,"num_write":1086,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'619","reported_seq":2294,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.905447+0000","last_change":"2024-09-05T00:49:29.912552+0000","last_active":"2024-09-05T02:13:45.905447+0000","last_peered":"2024-09-05T02:13:45.905447+0000","last_clean":"2024-09-05T02:13:45.905447+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:13:45.905447+0000","last_undegraded":"2024-09-05T02:13:45.905447+0000","last_fullsized":"2024-09-05T02:13:45.905447+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":600,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:05.014550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'293","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.454721+0000","last_change":"2024-09-05T00:49:27.886360+0000","last_active":"2024-09-05T02:16:21.454721+0000","last_peered":"2024-09-05T02:16:21.454721+0000","last_clean":"2024-09-05T02:16:21.454721+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:21.454721+0000","last_undegraded":"2024-09-05T02:16:21.454721+0000","last_fullsized":"2024-09-05T02:16:21.454721+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:15:32.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7002703,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":440,"num_read_kb":25095,"num_write":1114,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'540","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.636487+0000","last_change":"2024-09-05T00:49:29.898543+0000","last_active":"2024-09-05T02:15:48.636487+0000","last_peered":"2024-09-05T02:15:48.636487+0000","last_clean":"2024-09-05T02:15:48.636487+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:15:48.636487+0000","last_undegraded":"2024-09-05T02:15:48.636487+0000","last_fullsized":"2024-09-05T02:15:48.636487+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:11.197697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'342","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.373973+0000","last_change":"2024-09-05T00:50:04.181293+0000","last_active":"2024-09-05T02:16:21.373973+0000","last_peered":"2024-09-05T02:16:21.373973+0000","last_clean":"2024-09-05T02:16:21.373973+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:21.373973+0000","last_undegraded":"2024-09-05T02:16:21.373973+0000","last_fullsized":"2024-09-05T02:16:21.373973+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:31.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10998355,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":580,"num_read_kb":5699,"num_write":1187,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1184","reported_seq":2835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.896967+0000","last_change":"2024-09-05T00:49:29.914676+0000","last_active":"2024-09-05T02:13:37.896967+0000","last_peered":"2024-09-05T02:13:37.896967+0000","last_clean":"2024-09-05T02:13:37.896967+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:13:37.896967+0000","last_undegraded":"2024-09-05T02:13:37.896967+0000","last_fullsized":"2024-09-05T02:13:37.896967+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:02.143783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'275","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449787+0000","last_change":"2024-09-05T00:49:27.905936+0000","last_active":"2024-09-05T02:12:45.449787+0000","last_peered":"2024-09-05T02:12:45.449787+0000","last_clean":"2024-09-05T02:12:45.449787+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:12:45.449787+0000","last_undegraded":"2024-09-05T02:12:45.449787+0000","last_fullsized":"2024-09-05T02:12:45.449787+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:06.100911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18301850,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":546,"num_read_kb":5076,"num_write":1140,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'490","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623799+0000","last_change":"2024-09-05T00:49:29.925901+0000","last_active":"2024-09-05T02:14:29.623799+0000","last_peered":"2024-09-05T02:14:29.623799+0000","last_clean":"2024-09-05T02:14:29.623799+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:14:29.623799+0000","last_undegraded":"2024-09-05T02:14:29.623799+0000","last_fullsized":"2024-09-05T02:14:29.623799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:36.737428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'316","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.210869+0000","last_change":"2024-09-05T00:49:27.888664+0000","last_active":"2024-09-05T02:16:21.210869+0000","last_peered":"2024-09-05T02:16:21.210869+0000","last_clean":"2024-09-05T02:16:21.210869+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:21.210869+0000","last_undegraded":"2024-09-05T02:16:21.210869+0000","last_fullsized":"2024-09-05T02:16:21.210869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:01.736837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6938143,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":559,"num_read_kb":31375,"num_write":1232,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'686","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449674+0000","last_change":"2024-09-05T00:49:29.922331+0000","last_active":"2024-09-05T02:12:45.449674+0000","last_peered":"2024-09-05T02:12:45.449674+0000","last_clean":"2024-09-05T02:12:45.449674+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:12:45.449674+0000","last_undegraded":"2024-09-05T02:12:45.449674+0000","last_fullsized":"2024-09-05T02:12:45.449674+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:17:15.909498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'299","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.655685+0000","last_change":"2024-09-05T00:49:27.912949+0000","last_active":"2024-09-05T02:16:21.655685+0000","last_peered":"2024-09-05T02:16:21.655685+0000","last_clean":"2024-09-05T02:16:21.655685+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:21.655685+0000","last_undegraded":"2024-09-05T02:16:21.655685+0000","last_fullsized":"2024-09-05T02:16:21.655685+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:24.446425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10555908,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":507,"num_read_kb":11102,"num_write":1089,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'522","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629988+0000","last_change":"2024-09-05T00:49:29.915489+0000","last_active":"2024-09-05T02:14:29.629988+0000","last_peered":"2024-09-05T02:14:29.629988+0000","last_clean":"2024-09-05T02:14:29.629988+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:14:29.629988+0000","last_undegraded":"2024-09-05T02:14:29.629988+0000","last_fullsized":"2024-09-05T02:14:29.629988+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:16.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'283","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.387890+0000","last_change":"2024-09-05T00:49:27.888381+0000","last_active":"2024-09-05T02:16:21.387890+0000","last_peered":"2024-09-05T02:16:21.387890+0000","last_clean":"2024-09-05T02:16:21.387890+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:21.387890+0000","last_undegraded":"2024-09-05T02:16:21.387890+0000","last_fullsized":"2024-09-05T02:16:21.387890+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:03.147163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":471666,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":478,"num_read_kb":115088,"num_write":1004,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.061843+0000","last_change":"2024-09-05T00:49:29.922395+0000","last_active":"2024-09-05T02:13:56.061843+0000","last_peered":"2024-09-05T02:13:56.061843+0000","last_clean":"2024-09-05T02:13:56.061843+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:13:56.061843+0000","last_undegraded":"2024-09-05T02:13:56.061843+0000","last_fullsized":"2024-09-05T02:13:56.061843+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:27.332843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'246","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.798661+0000","last_change":"2024-09-05T00:49:27.915755+0000","last_active":"2024-09-05T02:13:36.798661+0000","last_peered":"2024-09-05T02:13:36.798661+0000","last_clean":"2024-09-05T02:13:36.798661+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:13:36.798661+0000","last_undegraded":"2024-09-05T02:13:36.798661+0000","last_fullsized":"2024-09-05T02:13:36.798661+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:24.744189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10995013,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":382,"num_read_kb":641,"num_write":977,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'351","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:42.970298+0000","last_change":"2024-09-05T00:49:27.900502+0000","last_active":"2024-09-05T02:13:42.970298+0000","last_peered":"2024-09-05T02:13:42.970298+0000","last_clean":"2024-09-05T02:13:42.970298+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:13:42.970298+0000","last_undegraded":"2024-09-05T02:13:42.970298+0000","last_fullsized":"2024-09-05T02:13:42.970298+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:21:36.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9688004,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":674,"num_read_kb":35469,"num_write":1219,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'402","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.580490+0000","last_change":"2024-09-05T00:49:29.916741+0000","last_active":"2024-09-05T02:14:29.580490+0000","last_peered":"2024-09-05T02:14:29.580490+0000","last_clean":"2024-09-05T02:14:29.580490+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:14:29.580490+0000","last_undegraded":"2024-09-05T02:14:29.580490+0000","last_fullsized":"2024-09-05T02:14:29.580490+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:48.147595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'321","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.790856+0000","last_change":"2024-09-05T00:49:27.885362+0000","last_active":"2024-09-05T02:16:21.790856+0000","last_peered":"2024-09-05T02:16:21.790856+0000","last_clean":"2024-09-05T02:16:21.790856+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:21.790856+0000","last_undegraded":"2024-09-05T02:16:21.790856+0000","last_fullsized":"2024-09-05T02:16:21.790856+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:17.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3409052,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":434,"num_read_kb":26073,"num_write":1141,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'871","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844564+0000","last_change":"2024-09-05T00:49:29.908617+0000","last_active":"2024-09-05T02:13:40.844564+0000","last_peered":"2024-09-05T02:13:40.844564+0000","last_clean":"2024-09-05T02:13:40.844564+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:13:40.844564+0000","last_undegraded":"2024-09-05T02:13:40.844564+0000","last_fullsized":"2024-09-05T02:13:40.844564+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:37.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":642,"ondisk_log_size":642,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1787069,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19479,"num_read_kb":36985,"num_write":16369,"num_write_kb":12025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2686976,"data_stored":2216074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1729,"ondisk_log_size":1729,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2393,"num_read_kb":2852,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4136,"ondisk_log_size":4136,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":511400498,"num_objects":3703,"num_object_clones":0,"num_object_copies":7406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3703,"num_whiteouts":0,"num_read":32753,"num_read_kb":2043732,"num_write":68457,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1010569216,"data_stored":983172905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4114,"ondisk_log_size":4114,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":57813924,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":117,"num_read_kb":174352,"num_write":137,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":111443968,"data_stored":111433544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":49425316,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":117,"num_read_kb":174298,"num_write":139,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96710656,"data_stored":96703021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510493,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472292,"kb_used_data":198080,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93899548,"statfs":{"total":96636764160,"available":96153137152,"internally_reserved":0,"allocated":202833920,"data_stored":197035027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510492,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342692,"kb_used_data":122708,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94029148,"statfs":{"total":96636764160,"available":96285847552,"internally_reserved":0,"allocated":125652992,"data_stored":121198204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510489,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300304,"kb_used_data":233024,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94071536,"statfs":{"total":96636764160,"available":96329252864,"internally_reserved":0,"allocated":238616576,"data_stored":232309463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510493,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":547560,"kb_used_data":273496,"kb_used_omap":1,"kb_used_meta":274046,"kb_avail":93824280,"statfs":{"total":96636764160,"available":96076062720,"internally_reserved":0,"allocated":280059904,"data_stored":273792646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280623559},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510491,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207432,"kb_used_data":118008,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94164408,"statfs":{"total":96636764160,"available":96424353792,"internally_reserved":0,"allocated":120840192,"data_stored":116462584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91552197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510492,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287660,"kb_used_data":135732,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94084180,"statfs":{"total":96636764160,"available":96342200320,"internally_reserved":0,"allocated":138989568,"data_stored":134977591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543195,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303360,"kb_used_data":177840,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94068480,"statfs":{"total":96636764160,"available":96326123520,"internally_reserved":0,"allocated":182108160,"data_stored":175714227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128514501},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543196,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":443472,"kb_used_data":199936,"kb_used_omap":1,"kb_used_meta":243518,"kb_avail":93928368,"statfs":{"total":96636764160,"available":96182648832,"internally_reserved":0,"allocated":204734464,"data_stored":198151379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249362885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":167403520,"data_stored":162409480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98988032,"data_stored":97079602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77041664,"data_stored":74827789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145481728,"data_stored":141924390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":198594560,"data_stored":194324063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":154648576,"data_stored":149855918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":68902912,"data_stored":66308087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":99508224,"data_stored":96443576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":355649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":262269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":123211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":348292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":85782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":659456,"data_stored":554892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":178621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":307358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26357760,"data_stored":26353431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5337088,"data_stored":5334665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6295552,"data_stored":6294669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":50459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17870848,"data_stored":17869150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":44130304,"data_stored":44128764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9490432,"data_stored":9487643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:16:24.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T02:16:24.617 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:24.617 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":264,"fsid":"678d0e28-1db8-4c70-ad6a-8dd16c8db3f1","created":"2024-09-05T00:48:58.137225+0000","modified":"2024-09-05T01:30:16.649732+0000","last_up_change":"2024-09-05T00:49:10.725685+0000","last_in_change":"2024-09-05T00:49:00.458832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T00:49:11.104281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T00:49:16.374250+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-05T00:49:26.681230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-05T00:49:28.214102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-05T00:49:30.025561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-05T00:49:32.013112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-05T00:49:33.937904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-05T00:49:36.060605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-05T01:05:05.098838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-05T01:09:20.739753+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-05T01:09:24.630500+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-05T01:30:13.643238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"630d5d03-eea4-4b71-ba69-a93245b87399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6801","nonce":4087752053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6803","nonce":4087752053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6807","nonce":4087752053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":4087752053},{"type":"v1","addr":"172.21.15.99:6805","nonce":4087752053}]},"public_addr":"172.21.15.99:6801/4087752053","cluster_addr":"172.21.15.99:6803/4087752053","heartbeat_back_addr":"172.21.15.99:6807/4087752053","heartbeat_front_addr":"172.21.15.99:6805/4087752053","state":["exists","up"]},{"osd":1,"uuid":"cebd19e6-fe2e-43cc-a87a-67b2cac669dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6809","nonce":643721128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6811","nonce":643721128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6815","nonce":643721128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":643721128},{"type":"v1","addr":"172.21.15.99:6813","nonce":643721128}]},"public_addr":"172.21.15.99:6809/643721128","cluster_addr":"172.21.15.99:6811/643721128","heartbeat_back_addr":"172.21.15.99:6815/643721128","heartbeat_front_addr":"172.21.15.99:6813/643721128","state":["exists","up"]},{"osd":2,"uuid":"65ce1394-f6ca-4017-8572-fd91dfdd6f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6817","nonce":3137608818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6819","nonce":3137608818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6823","nonce":3137608818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":3137608818},{"type":"v1","addr":"172.21.15.99:6821","nonce":3137608818}]},"public_addr":"172.21.15.99:6817/3137608818","cluster_addr":"172.21.15.99:6819/3137608818","heartbeat_back_addr":"172.21.15.99:6823/3137608818","heartbeat_front_addr":"172.21.15.99:6821/3137608818","state":["exists","up"]},{"osd":3,"uuid":"b455fb2f-afaf-4f6d-bc57-464679994b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6825","nonce":2421217256}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6827","nonce":2421217256}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6831","nonce":2421217256}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":2421217256},{"type":"v1","addr":"172.21.15.99:6829","nonce":2421217256}]},"public_addr":"172.21.15.99:6825/2421217256","cluster_addr":"172.21.15.99:6827/2421217256","heartbeat_back_addr":"172.21.15.99:6831/2421217256","heartbeat_front_addr":"172.21.15.99:6829/2421217256","state":["exists","up"]},{"osd":4,"uuid":"69e1536e-8d52-4983-847a-632c03d62dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6809","nonce":2199271947}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6811","nonce":2199271947}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6815","nonce":2199271947}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":2199271947},{"type":"v1","addr":"172.21.15.204:6813","nonce":2199271947}]},"public_addr":"172.21.15.204:6809/2199271947","cluster_addr":"172.21.15.204:6811/2199271947","heartbeat_back_addr":"172.21.15.204:6815/2199271947","heartbeat_front_addr":"172.21.15.204:6813/2199271947","state":["exists","up"]},{"osd":5,"uuid":"0e5485c5-36e2-457f-980e-6e854cd4e8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6801","nonce":444489520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6803","nonce":444489520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6807","nonce":444489520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":444489520},{"type":"v1","addr":"172.21.15.204:6805","nonce":444489520}]},"public_addr":"172.21.15.204:6801/444489520","cluster_addr":"172.21.15.204:6803/444489520","heartbeat_back_addr":"172.21.15.204:6807/444489520","heartbeat_front_addr":"172.21.15.204:6805/444489520","state":["exists","up"]},{"osd":6,"uuid":"fe0d7896-af4f-47e1-8887-21f8f8af252a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6825","nonce":2123851170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6827","nonce":2123851170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6831","nonce":2123851170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":2123851170},{"type":"v1","addr":"172.21.15.204:6829","nonce":2123851170}]},"public_addr":"172.21.15.204:6825/2123851170","cluster_addr":"172.21.15.204:6827/2123851170","heartbeat_back_addr":"172.21.15.204:6831/2123851170","heartbeat_front_addr":"172.21.15.204:6829/2123851170","state":["exists","up"]},{"osd":7,"uuid":"206caed4-741a-43cc-9812-6a8221de1bcf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6817","nonce":4289187000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6819","nonce":4289187000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6823","nonce":4289187000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":4289187000},{"type":"v1","addr":"172.21.15.204:6821","nonce":4289187000}]},"public_addr":"172.21.15.204:6817/4289187000","cluster_addr":"172.21.15.204:6819/4289187000","heartbeat_back_addr":"172.21.15.204:6823/4289187000","heartbeat_front_addr":"172.21.15.204:6821/4289187000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.841654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.196772+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.198579+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.740973+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.031860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:06.793053+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.330521+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T00:49:07.307079+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":1,"to":5}]},{"pgid":"67.9","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T02:16:25.638 INFO:tasks.ceph:Scrubbing osd.0 2024-09-05T02:16:25.638 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:25.802 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:25.802 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:25.802 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:25.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-05T02:16:26.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-05T02:16:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-09-05T02:16:26.136 INFO:tasks.ceph:Scrubbing osd.1 2024-09-05T02:16:26.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:26.287 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:26.287 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:26.287 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:26.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-05T02:16:26.612 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-09-05T02:16:26.633 INFO:tasks.ceph:Scrubbing osd.2 2024-09-05T02:16:26.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:26.776 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:26.776 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:26.776 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:26.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-05T02:16:27.078 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-09-05T02:16:27.097 INFO:tasks.ceph:Scrubbing osd.3 2024-09-05T02:16:27.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:27.242 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:27.242 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:27.242 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:27.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-05T02:16:27.545 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-09-05T02:16:27.563 INFO:tasks.ceph:Scrubbing osd.4 2024-09-05T02:16:27.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:27.711 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:27.711 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:27.726 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-05T02:16:28.024 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-09-05T02:16:28.042 INFO:tasks.ceph:Scrubbing osd.5 2024-09-05T02:16:28.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:28.188 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:28.188 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:28.188 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:28.204 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-05T02:16:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-09-05T02:16:28.530 INFO:tasks.ceph:Scrubbing osd.6 2024-09-05T02:16:28.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:28.675 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:28.675 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:28.675 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:28.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-05T02:16:28.976 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-09-05T02:16:28.994 INFO:tasks.ceph:Scrubbing osd.7 2024-09-05T02:16:29.040 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-05T02:16:29.200 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-05T02:16:29.200 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T02:16:29.201 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-05T02:16:29.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-05T02:16:29.497 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-09-05T02:16:29.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:16:29.867 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:29.879 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:16:29.883 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2875,"stamp":"2024-09-05T02:16:28.506639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68867067,"num_objects":856,"num_object_clones":0,"num_object_copies":1712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":856,"num_whiteouts":0,"num_read":292554,"num_read_kb":2648548,"num_write":162836,"num_write_kb":2503589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13505,"ondisk_log_size":13505,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1618080,"kb_used_data":161216,"kb_used_omap":12,"kb_used_meta":1455411,"kb_avail":753356640,"statfs":{"total":773094113280,"available":771437199360,"internally_reserved":0,"allocated":165085184,"data_stored":151756702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1490341424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-659447968,"num_objects":-4067,"num_object_clones":0,"num_object_copies":-8134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4067,"num_whiteouts":0,"num_read":4557,"num_read_kb":4084,"num_write":4320,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008238"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200116+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:12:00.200116+0000","last_peered":"2024-09-05T02:12:00.200116+0000","last_clean":"2024-09-05T02:12:00.200116+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:12:00.200116+0000","last_undegraded":"2024-09-05T02:12:00.200116+0000","last_fullsized":"2024-09-05T02:12:00.200116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:56.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'8","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495301+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:14:26.495301+0000","last_peered":"2024-09-05T02:14:26.495301+0000","last_clean":"2024-09-05T02:14:26.495301+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:14:26.495301+0000","last_undegraded":"2024-09-05T02:14:26.495301+0000","last_fullsized":"2024-09-05T02:14:26.495301+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:52:17.217061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375602+0000","last_change":"2024-09-05T01:30:15.667346+0000","last_active":"2024-09-05T02:12:46.375602+0000","last_peered":"2024-09-05T02:12:46.375602+0000","last_clean":"2024-09-05T02:12:46.375602+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:12:46.375602+0000","last_undegraded":"2024-09-05T02:12:46.375602+0000","last_fullsized":"2024-09-05T02:12:46.375602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:40.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.236610+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:14:26.236610+0000","last_peered":"2024-09-05T02:14:26.236610+0000","last_clean":"2024-09-05T02:14:26.236610+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:14:26.236610+0000","last_undegraded":"2024-09-05T02:14:26.236610+0000","last_fullsized":"2024-09-05T02:14:26.236610+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:01.475308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766667+0000","last_change":"2024-09-05T01:09:22.194515+0000","last_active":"2024-09-05T02:11:51.766667+0000","last_peered":"2024-09-05T02:11:51.766667+0000","last_clean":"2024-09-05T02:11:51.766667+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:11:51.766667+0000","last_undegraded":"2024-09-05T02:11:51.766667+0000","last_fullsized":"2024-09-05T02:11:51.766667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:51.467116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.381829+0000","last_change":"2024-09-05T01:05:07.120154+0000","last_active":"2024-09-05T02:13:16.381829+0000","last_peered":"2024-09-05T02:13:16.381829+0000","last_clean":"2024-09-05T02:13:16.381829+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:13:16.381829+0000","last_undegraded":"2024-09-05T02:13:16.381829+0000","last_fullsized":"2024-09-05T02:13:16.381829+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:15.466155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:10.495204+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:16:10.495204+0000","last_peered":"2024-09-05T02:16:10.495204+0000","last_clean":"2024-09-05T02:16:10.495204+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:16:10.495204+0000","last_undegraded":"2024-09-05T02:16:10.495204+0000","last_fullsized":"2024-09-05T02:16:10.495204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":53,"num_write":4,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.384719+0000","last_change":"2024-09-05T01:09:22.189240+0000","last_active":"2024-09-05T02:13:31.384719+0000","last_peered":"2024-09-05T02:13:31.384719+0000","last_clean":"2024-09-05T02:13:31.384719+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:13:31.384719+0000","last_undegraded":"2024-09-05T02:13:31.384719+0000","last_fullsized":"2024-09-05T02:13:31.384719+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:27.906635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448662+0000","last_change":"2024-09-05T01:05:07.099663+0000","last_active":"2024-09-05T02:12:40.448662+0000","last_peered":"2024-09-05T02:12:40.448662+0000","last_clean":"2024-09-05T02:12:40.448662+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:12:40.448662+0000","last_undegraded":"2024-09-05T02:12:40.448662+0000","last_fullsized":"2024-09-05T02:12:40.448662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:05.063618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495387+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:14:26.495387+0000","last_peered":"2024-09-05T02:14:26.495387+0000","last_clean":"2024-09-05T02:14:26.495387+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:14:26.495387+0000","last_undegraded":"2024-09-05T02:14:26.495387+0000","last_fullsized":"2024-09-05T02:14:26.495387+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'9","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243459+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:15:05.243459+0000","last_peered":"2024-09-05T02:15:05.243459+0000","last_clean":"2024-09-05T02:15:05.243459+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:15:05.243459+0000","last_undegraded":"2024-09-05T02:15:05.243459+0000","last_fullsized":"2024-09-05T02:15:05.243459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":22528,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441829+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:12:15.441829+0000","last_peered":"2024-09-05T02:12:15.441829+0000","last_clean":"2024-09-05T02:12:15.441829+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:12:15.441829+0000","last_undegraded":"2024-09-05T02:12:15.441829+0000","last_fullsized":"2024-09-05T02:12:15.441829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:48.174424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.422065+0000","last_change":"2024-09-05T01:09:26.324652+0000","last_active":"2024-09-05T02:14:41.422065+0000","last_peered":"2024-09-05T02:14:41.422065+0000","last_clean":"2024-09-05T02:14:41.422065+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:14:41.422065+0000","last_undegraded":"2024-09-05T02:14:41.422065+0000","last_fullsized":"2024-09-05T02:14:41.422065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:50:46.559032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.242584+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:14:51.242584+0000","last_peered":"2024-09-05T02:14:51.242584+0000","last_clean":"2024-09-05T02:14:51.242584+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:14:51.242584+0000","last_undegraded":"2024-09-05T02:14:51.242584+0000","last_fullsized":"2024-09-05T02:14:51.242584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394840+0000","last_change":"2024-09-05T01:05:07.100070+0000","last_active":"2024-09-05T02:12:36.394840+0000","last_peered":"2024-09-05T02:12:36.394840+0000","last_clean":"2024-09-05T02:12:36.394840+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:12:36.394840+0000","last_undegraded":"2024-09-05T02:12:36.394840+0000","last_fullsized":"2024-09-05T02:12:36.394840+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:38.489253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.386284+0000","last_change":"2024-09-05T01:09:26.324239+0000","last_active":"2024-09-05T02:11:56.386284+0000","last_peered":"2024-09-05T02:11:56.386284+0000","last_clean":"2024-09-05T02:11:56.386284+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:11:56.386284+0000","last_undegraded":"2024-09-05T02:11:56.386284+0000","last_fullsized":"2024-09-05T02:11:56.386284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:27:56.884028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.201470+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:11:51.201470+0000","last_peered":"2024-09-05T02:11:51.201470+0000","last_clean":"2024-09-05T02:11:51.201470+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:11:51.201470+0000","last_undegraded":"2024-09-05T02:11:51.201470+0000","last_fullsized":"2024-09-05T02:11:51.201470+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:47:24.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:05.454470+0000","last_change":"2024-09-05T01:05:07.114198+0000","last_active":"2024-09-05T02:13:05.454470+0000","last_peered":"2024-09-05T02:13:05.454470+0000","last_clean":"2024-09-05T02:13:05.454470+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:13:05.454470+0000","last_undegraded":"2024-09-05T02:13:05.454470+0000","last_fullsized":"2024-09-05T02:13:05.454470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:21:32.703401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495169+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:14:26.495169+0000","last_peered":"2024-09-05T02:14:26.495169+0000","last_clean":"2024-09-05T02:14:26.495169+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:14:26.495169+0000","last_undegraded":"2024-09-05T02:14:26.495169+0000","last_fullsized":"2024-09-05T02:14:26.495169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:51:40.645794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.312430+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:16:21.312430+0000","last_peered":"2024-09-05T02:16:21.312430+0000","last_clean":"2024-09-05T02:16:21.312430+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:16:21.312430+0000","last_undegraded":"2024-09-05T02:16:21.312430+0000","last_fullsized":"2024-09-05T02:16:21.312430+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:46.829038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":23604,"num_write":14,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779304+0000","last_change":"2024-09-05T01:05:07.107441+0000","last_active":"2024-09-05T02:12:46.779304+0000","last_peered":"2024-09-05T02:12:46.779304+0000","last_clean":"2024-09-05T02:12:46.779304+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:12:46.779304+0000","last_undegraded":"2024-09-05T02:12:46.779304+0000","last_fullsized":"2024-09-05T02:12:46.779304+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:28.771503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.772503+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:12:16.772503+0000","last_peered":"2024-09-05T02:12:16.772503+0000","last_clean":"2024-09-05T02:12:16.772503+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:12:16.772503+0000","last_undegraded":"2024-09-05T02:12:16.772503+0000","last_fullsized":"2024-09-05T02:12:16.772503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:13.638808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.802583+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:16:21.802583+0000","last_peered":"2024-09-05T02:16:21.802583+0000","last_clean":"2024-09-05T02:16:21.802583+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:16:21.802583+0000","last_undegraded":"2024-09-05T02:16:21.802583+0000","last_fullsized":"2024-09-05T02:16:21.802583+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:48.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.369336+0000","last_change":"2024-09-05T01:30:15.668869+0000","last_active":"2024-09-05T02:12:16.369336+0000","last_peered":"2024-09-05T02:12:16.369336+0000","last_clean":"2024-09-05T02:12:16.369336+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:12:16.369336+0000","last_undegraded":"2024-09-05T02:12:16.369336+0000","last_fullsized":"2024-09-05T02:12:16.369336+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:05.261577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'10","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.427502+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:16:22.427502+0000","last_peered":"2024-09-05T02:16:22.427502+0000","last_clean":"2024-09-05T02:16:22.427502+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:16:22.427502+0000","last_undegraded":"2024-09-05T02:16:22.427502+0000","last_fullsized":"2024-09-05T02:16:22.427502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28674,"num_write":15,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.817097+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:12:11.817097+0000","last_peered":"2024-09-05T02:12:11.817097+0000","last_clean":"2024-09-05T02:12:11.817097+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:12:11.817097+0000","last_undegraded":"2024-09-05T02:12:11.817097+0000","last_fullsized":"2024-09-05T02:12:11.817097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:06.449467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818016+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:12:16.818016+0000","last_peered":"2024-09-05T02:12:16.818016+0000","last_clean":"2024-09-05T02:12:16.818016+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:12:16.818016+0000","last_undegraded":"2024-09-05T02:12:16.818016+0000","last_fullsized":"2024-09-05T02:12:16.818016+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:08:36.986922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.465067+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:12:16.465067+0000","last_peered":"2024-09-05T02:12:16.465067+0000","last_clean":"2024-09-05T02:12:16.465067+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:12:16.465067+0000","last_undegraded":"2024-09-05T02:12:16.465067+0000","last_fullsized":"2024-09-05T02:12:16.465067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:19:22.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.368114+0000","last_change":"2024-09-05T01:09:22.197361+0000","last_active":"2024-09-05T02:12:11.368114+0000","last_peered":"2024-09-05T02:12:11.368114+0000","last_clean":"2024-09-05T02:12:11.368114+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:12:11.368114+0000","last_undegraded":"2024-09-05T02:12:11.368114+0000","last_fullsized":"2024-09-05T02:12:11.368114+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:33:21.371226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375737+0000","last_change":"2024-09-05T01:05:07.119548+0000","last_active":"2024-09-05T02:12:46.375737+0000","last_peered":"2024-09-05T02:12:46.375737+0000","last_clean":"2024-09-05T02:12:46.375737+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:12:46.375737+0000","last_undegraded":"2024-09-05T02:12:46.375737+0000","last_fullsized":"2024-09-05T02:12:46.375737+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:35:04.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203655+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:12:15.203655+0000","last_peered":"2024-09-05T02:12:15.203655+0000","last_clean":"2024-09-05T02:12:15.203655+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:12:15.203655+0000","last_undegraded":"2024-09-05T02:12:15.203655+0000","last_fullsized":"2024-09-05T02:12:15.203655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:15.910872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207592+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:12:16.207592+0000","last_peered":"2024-09-05T02:12:16.207592+0000","last_clean":"2024-09-05T02:12:16.207592+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:12:16.207592+0000","last_undegraded":"2024-09-05T02:12:16.207592+0000","last_fullsized":"2024-09-05T02:12:16.207592+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:25.770411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:40.476996+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:14:40.476996+0000","last_peered":"2024-09-05T02:14:40.476996+0000","last_clean":"2024-09-05T02:14:40.476996+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:14:40.476996+0000","last_undegraded":"2024-09-05T02:14:40.476996+0000","last_fullsized":"2024-09-05T02:14:40.476996+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:46:14.641983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774807+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:12:26.774807+0000","last_peered":"2024-09-05T02:12:26.774807+0000","last_clean":"2024-09-05T02:12:26.774807+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:12:26.774807+0000","last_undegraded":"2024-09-05T02:12:26.774807+0000","last_fullsized":"2024-09-05T02:12:26.774807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:09.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208586+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:12:21.208586+0000","last_peered":"2024-09-05T02:12:21.208586+0000","last_clean":"2024-09-05T02:12:21.208586+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:12:21.208586+0000","last_undegraded":"2024-09-05T02:12:21.208586+0000","last_fullsized":"2024-09-05T02:12:21.208586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:53.136374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774662+0000","last_change":"2024-09-05T01:09:26.327272+0000","last_active":"2024-09-05T02:12:26.774662+0000","last_peered":"2024-09-05T02:12:26.774662+0000","last_clean":"2024-09-05T02:12:26.774662+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:12:26.774662+0000","last_undegraded":"2024-09-05T02:12:26.774662+0000","last_fullsized":"2024-09-05T02:12:26.774662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:00.744251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:46.500078+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:14:46.500078+0000","last_peered":"2024-09-05T02:14:46.500078+0000","last_clean":"2024-09-05T02:14:46.500078+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:14:46.500078+0000","last_undegraded":"2024-09-05T02:14:46.500078+0000","last_fullsized":"2024-09-05T02:14:46.500078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:36:00.381248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'116","reported_seq":469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450850+0000","last_change":"2024-09-05T01:05:07.106194+0000","last_active":"2024-09-05T02:12:50.450850+0000","last_peered":"2024-09-05T02:12:50.450850+0000","last_clean":"2024-09-05T02:12:50.450850+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:12:50.450850+0000","last_undegraded":"2024-09-05T02:12:50.450850+0000","last_fullsized":"2024-09-05T02:12:50.450850+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444865+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:12:25.444865+0000","last_peered":"2024-09-05T02:12:25.444865+0000","last_clean":"2024-09-05T02:12:25.444865+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:12:25.444865+0000","last_undegraded":"2024-09-05T02:12:25.444865+0000","last_fullsized":"2024-09-05T02:12:25.444865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:58:42.242758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:46.500170+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:14:46.500170+0000","last_peered":"2024-09-05T02:14:46.500170+0000","last_clean":"2024-09-05T02:14:46.500170+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:14:46.500170+0000","last_undegraded":"2024-09-05T02:14:46.500170+0000","last_fullsized":"2024-09-05T02:14:46.500170+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:39.545081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.422135+0000","last_change":"2024-09-05T01:09:22.204898+0000","last_active":"2024-09-05T02:14:41.422135+0000","last_peered":"2024-09-05T02:14:41.422135+0000","last_clean":"2024-09-05T02:14:41.422135+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:14:41.422135+0000","last_undegraded":"2024-09-05T02:14:41.422135+0000","last_fullsized":"2024-09-05T02:14:41.422135+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:48:27.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.392810+0000","last_change":"2024-09-05T01:09:26.329147+0000","last_active":"2024-09-05T02:12:26.392810+0000","last_peered":"2024-09-05T02:12:26.392810+0000","last_clean":"2024-09-05T02:12:26.392810+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:12:26.392810+0000","last_undegraded":"2024-09-05T02:12:26.392810+0000","last_fullsized":"2024-09-05T02:12:26.392810+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:07.238760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:45.239003+0000","last_change":"2024-09-05T01:09:22.187559+0000","last_active":"2024-09-05T02:14:45.239003+0000","last_peered":"2024-09-05T02:14:45.239003+0000","last_clean":"2024-09-05T02:14:45.239003+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:14:45.239003+0000","last_undegraded":"2024-09-05T02:14:45.239003+0000","last_fullsized":"2024-09-05T02:14:45.239003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:07:59.966273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.386682+0000","last_change":"2024-09-05T01:30:15.669605+0000","last_active":"2024-09-05T02:13:41.386682+0000","last_peered":"2024-09-05T02:13:41.386682+0000","last_clean":"2024-09-05T02:13:41.386682+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:13:41.386682+0000","last_undegraded":"2024-09-05T02:13:41.386682+0000","last_fullsized":"2024-09-05T02:13:41.386682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:56.360434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467501+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:12:26.467501+0000","last_peered":"2024-09-05T02:12:26.467501+0000","last_clean":"2024-09-05T02:12:26.467501+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:12:26.467501+0000","last_undegraded":"2024-09-05T02:12:26.467501+0000","last_fullsized":"2024-09-05T02:12:26.467501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:48.846611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.819378+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:12:21.819378+0000","last_peered":"2024-09-05T02:12:21.819378+0000","last_clean":"2024-09-05T02:12:21.819378+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:12:21.819378+0000","last_undegraded":"2024-09-05T02:12:21.819378+0000","last_fullsized":"2024-09-05T02:12:21.819378+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:34.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467422+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:12:26.467422+0000","last_peered":"2024-09-05T02:12:26.467422+0000","last_clean":"2024-09-05T02:12:26.467422+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:12:26.467422+0000","last_undegraded":"2024-09-05T02:12:26.467422+0000","last_fullsized":"2024-09-05T02:12:26.467422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:59.970464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.398198+0000","last_change":"2024-09-05T01:09:22.173216+0000","last_active":"2024-09-05T02:14:36.398198+0000","last_peered":"2024-09-05T02:14:36.398198+0000","last_clean":"2024-09-05T02:14:36.398198+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:14:36.398198+0000","last_undegraded":"2024-09-05T02:14:36.398198+0000","last_fullsized":"2024-09-05T02:14:36.398198+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:30:30.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209629+0000","last_change":"2024-09-05T01:05:07.097402+0000","last_active":"2024-09-05T02:12:40.209629+0000","last_peered":"2024-09-05T02:12:40.209629+0000","last_clean":"2024-09-05T02:12:40.209629+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:12:40.209629+0000","last_undegraded":"2024-09-05T02:12:40.209629+0000","last_fullsized":"2024-09-05T02:12:40.209629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:29.548612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407611+0000","last_change":"2024-09-05T01:30:15.659142+0000","last_active":"2024-09-05T02:13:36.407611+0000","last_peered":"2024-09-05T02:13:36.407611+0000","last_clean":"2024-09-05T02:13:36.407611+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:13:36.407611+0000","last_undegraded":"2024-09-05T02:13:36.407611+0000","last_fullsized":"2024-09-05T02:13:36.407611+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:28.741051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.805493+0000","last_change":"2024-09-05T01:09:26.328593+0000","last_active":"2024-09-05T02:14:51.805493+0000","last_peered":"2024-09-05T02:14:51.805493+0000","last_clean":"2024-09-05T02:14:51.805493+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:14:51.805493+0000","last_undegraded":"2024-09-05T02:14:51.805493+0000","last_fullsized":"2024-09-05T02:14:51.805493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:38.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.878717+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:16:21.878717+0000","last_peered":"2024-09-05T02:16:21.878717+0000","last_clean":"2024-09-05T02:16:21.878717+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:16:21.878717+0000","last_undegraded":"2024-09-05T02:16:21.878717+0000","last_fullsized":"2024-09-05T02:16:21.878717+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:22:24.610460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":88,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394924+0000","last_change":"2024-09-05T01:05:07.108722+0000","last_active":"2024-09-05T02:12:36.394924+0000","last_peered":"2024-09-05T02:12:36.394924+0000","last_clean":"2024-09-05T02:12:36.394924+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:12:36.394924+0000","last_undegraded":"2024-09-05T02:12:36.394924+0000","last_fullsized":"2024-09-05T02:12:36.394924+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:28:14.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.803551+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:16:21.803551+0000","last_peered":"2024-09-05T02:16:21.803551+0000","last_clean":"2024-09-05T02:16:21.803551+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:16:21.803551+0000","last_undegraded":"2024-09-05T02:16:21.803551+0000","last_fullsized":"2024-09-05T02:16:21.803551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:39.337140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:31.776137+0000","last_change":"2024-09-05T01:09:22.199397+0000","last_active":"2024-09-05T02:12:31.776137+0000","last_peered":"2024-09-05T02:12:31.776137+0000","last_clean":"2024-09-05T02:12:31.776137+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:12:31.776137+0000","last_undegraded":"2024-09-05T02:12:31.776137+0000","last_fullsized":"2024-09-05T02:12:31.776137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:09:58.963052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.373537+0000","last_change":"2024-09-05T01:05:07.107459+0000","last_active":"2024-09-05T02:12:36.373537+0000","last_peered":"2024-09-05T02:12:36.373537+0000","last_clean":"2024-09-05T02:12:36.373537+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:12:36.373537+0000","last_undegraded":"2024-09-05T02:12:36.373537+0000","last_fullsized":"2024-09-05T02:12:36.373537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:14.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.236483+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:14:26.236483+0000","last_peered":"2024-09-05T02:14:26.236483+0000","last_clean":"2024-09-05T02:14:26.236483+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:14:26.236483+0000","last_undegraded":"2024-09-05T02:14:26.236483+0000","last_fullsized":"2024-09-05T02:14:26.236483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:34:26.565026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441893+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:12:15.441893+0000","last_peered":"2024-09-05T02:12:15.441893+0000","last_clean":"2024-09-05T02:12:15.441893+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:12:15.441893+0000","last_undegraded":"2024-09-05T02:12:15.441893+0000","last_fullsized":"2024-09-05T02:12:15.441893+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:26.266214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448523+0000","last_change":"2024-09-05T01:05:07.113278+0000","last_active":"2024-09-05T02:12:40.448523+0000","last_peered":"2024-09-05T02:12:40.448523+0000","last_clean":"2024-09-05T02:12:40.448523+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:12:40.448523+0000","last_undegraded":"2024-09-05T02:12:40.448523+0000","last_fullsized":"2024-09-05T02:12:40.448523+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:01.987557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.638839+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:14:26.638839+0000","last_peered":"2024-09-05T02:14:26.638839+0000","last_clean":"2024-09-05T02:14:26.638839+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:14:26.638839+0000","last_undegraded":"2024-09-05T02:14:26.638839+0000","last_fullsized":"2024-09-05T02:14:26.638839+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:29:50.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.771516+0000","last_change":"2024-09-05T01:09:22.205702+0000","last_active":"2024-09-05T02:12:11.771516+0000","last_peered":"2024-09-05T02:12:11.771516+0000","last_clean":"2024-09-05T02:12:11.771516+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:12:11.771516+0000","last_undegraded":"2024-09-05T02:12:11.771516+0000","last_fullsized":"2024-09-05T02:12:11.771516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:20.412468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820508+0000","last_change":"2024-09-05T01:05:07.107783+0000","last_active":"2024-09-05T02:12:26.820508+0000","last_peered":"2024-09-05T02:12:26.820508+0000","last_clean":"2024-09-05T02:12:26.820508+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:12:26.820508+0000","last_undegraded":"2024-09-05T02:12:26.820508+0000","last_fullsized":"2024-09-05T02:12:26.820508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:14.335901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774914+0000","last_change":"2024-09-05T01:09:26.335994+0000","last_active":"2024-09-05T02:12:26.774914+0000","last_peered":"2024-09-05T02:12:26.774914+0000","last_clean":"2024-09-05T02:12:26.774914+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:12:26.774914+0000","last_undegraded":"2024-09-05T02:12:26.774914+0000","last_fullsized":"2024-09-05T02:12:26.774914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:07.883192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'9","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.429720+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:16:21.429720+0000","last_peered":"2024-09-05T02:16:21.429720+0000","last_clean":"2024-09-05T02:16:21.429720+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:16:21.429720+0000","last_undegraded":"2024-09-05T02:16:21.429720+0000","last_fullsized":"2024-09-05T02:16:21.429720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:34.388590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464656+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:12:16.464656+0000","last_peered":"2024-09-05T02:12:16.464656+0000","last_clean":"2024-09-05T02:12:16.464656+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:12:16.464656+0000","last_undegraded":"2024-09-05T02:12:16.464656+0000","last_fullsized":"2024-09-05T02:12:16.464656+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:04.705416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.643003+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:14:41.643003+0000","last_peered":"2024-09-05T02:14:41.643003+0000","last_clean":"2024-09-05T02:14:41.643003+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:14:41.643003+0000","last_undegraded":"2024-09-05T02:14:41.643003+0000","last_fullsized":"2024-09-05T02:14:41.643003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.990596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208761+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:12:21.208761+0000","last_peered":"2024-09-05T02:12:21.208761+0000","last_clean":"2024-09-05T02:12:21.208761+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:12:21.208761+0000","last_undegraded":"2024-09-05T02:12:21.208761+0000","last_fullsized":"2024-09-05T02:12:21.208761+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:08.518794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390597+0000","last_change":"2024-09-05T01:05:07.108906+0000","last_active":"2024-09-05T02:12:16.390597+0000","last_peered":"2024-09-05T02:12:16.390597+0000","last_clean":"2024-09-05T02:12:16.390597+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:12:16.390597+0000","last_undegraded":"2024-09-05T02:12:16.390597+0000","last_fullsized":"2024-09-05T02:12:16.390597+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:30:18.560371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:20.472251+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:14:20.472251+0000","last_peered":"2024-09-05T02:14:20.472251+0000","last_clean":"2024-09-05T02:14:20.472251+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:14:20.472251+0000","last_undegraded":"2024-09-05T02:14:20.472251+0000","last_fullsized":"2024-09-05T02:14:20.472251+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:20.443723+0000","last_change":"2024-09-05T01:05:07.120976+0000","last_active":"2024-09-05T02:12:20.443723+0000","last_peered":"2024-09-05T02:12:20.443723+0000","last_clean":"2024-09-05T02:12:20.443723+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:12:20.443723+0000","last_undegraded":"2024-09-05T02:12:20.443723+0000","last_fullsized":"2024-09-05T02:12:20.443723+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:22.456569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391904+0000","last_change":"2024-09-05T01:09:22.172712+0000","last_active":"2024-09-05T02:14:06.391904+0000","last_peered":"2024-09-05T02:14:06.391904+0000","last_clean":"2024-09-05T02:14:06.391904+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:14:06.391904+0000","last_undegraded":"2024-09-05T02:14:06.391904+0000","last_fullsized":"2024-09-05T02:14:06.391904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:20.436128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.390757+0000","last_change":"2024-09-05T01:05:07.102945+0000","last_active":"2024-09-05T02:12:16.390757+0000","last_peered":"2024-09-05T02:12:16.390757+0000","last_clean":"2024-09-05T02:12:16.390757+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:12:16.390757+0000","last_undegraded":"2024-09-05T02:12:16.390757+0000","last_fullsized":"2024-09-05T02:12:16.390757+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:11:05.062597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.799675+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:14:26.799675+0000","last_peered":"2024-09-05T02:14:26.799675+0000","last_clean":"2024-09-05T02:14:26.799675+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:14:26.799675+0000","last_undegraded":"2024-09-05T02:14:26.799675+0000","last_fullsized":"2024-09-05T02:14:26.799675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818258+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:12:16.818258+0000","last_peered":"2024-09-05T02:12:16.818258+0000","last_clean":"2024-09-05T02:12:16.818258+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:12:16.818258+0000","last_undegraded":"2024-09-05T02:12:16.818258+0000","last_fullsized":"2024-09-05T02:12:16.818258+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:39.015669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203874+0000","last_change":"2024-09-05T01:09:22.189533+0000","last_active":"2024-09-05T02:12:15.203874+0000","last_peered":"2024-09-05T02:12:15.203874+0000","last_clean":"2024-09-05T02:12:15.203874+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:12:15.203874+0000","last_undegraded":"2024-09-05T02:12:15.203874+0000","last_fullsized":"2024-09-05T02:12:15.203874+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:17.465195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.634124+0000","last_change":"2024-09-05T01:05:07.104648+0000","last_active":"2024-09-05T02:14:06.634124+0000","last_peered":"2024-09-05T02:14:06.634124+0000","last_clean":"2024-09-05T02:14:06.634124+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:14:06.634124+0000","last_undegraded":"2024-09-05T02:14:06.634124+0000","last_fullsized":"2024-09-05T02:14:06.634124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:02.121064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207620+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:12:16.207620+0000","last_peered":"2024-09-05T02:12:16.207620+0000","last_clean":"2024-09-05T02:12:16.207620+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:12:16.207620+0000","last_undegraded":"2024-09-05T02:12:16.207620+0000","last_fullsized":"2024-09-05T02:12:16.207620+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:55.569114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.313397+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.313397+0000","last_peered":"2024-09-05T02:16:21.313397+0000","last_clean":"2024-09-05T02:16:21.313397+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.313397+0000","last_undegraded":"2024-09-05T02:16:21.313397+0000","last_fullsized":"2024-09-05T02:16:21.313397+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:52.383560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792699+0000","last_change":"2024-09-05T01:05:07.109781+0000","last_active":"2024-09-05T02:13:51.792699+0000","last_peered":"2024-09-05T02:13:51.792699+0000","last_clean":"2024-09-05T02:13:51.792699+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:13:51.792699+0000","last_undegraded":"2024-09-05T02:13:51.792699+0000","last_fullsized":"2024-09-05T02:13:51.792699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:11.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.385750+0000","last_change":"2024-09-05T01:30:15.670716+0000","last_active":"2024-09-05T02:13:36.385750+0000","last_peered":"2024-09-05T02:13:36.385750+0000","last_clean":"2024-09-05T02:13:36.385750+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:13:36.385750+0000","last_undegraded":"2024-09-05T02:13:36.385750+0000","last_fullsized":"2024-09-05T02:13:36.385750+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:30.214527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:06.819371+0000","last_change":"2024-09-05T01:09:26.336791+0000","last_active":"2024-09-05T02:16:06.819371+0000","last_peered":"2024-09-05T02:16:06.819371+0000","last_clean":"2024-09-05T02:16:06.819371+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:16:06.819371+0000","last_undegraded":"2024-09-05T02:16:06.819371+0000","last_fullsized":"2024-09-05T02:16:06.819371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:27:19.850660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227128+0000","last_change":"2024-09-05T01:05:07.103532+0000","last_active":"2024-09-05T02:13:55.227128+0000","last_peered":"2024-09-05T02:13:55.227128+0000","last_clean":"2024-09-05T02:13:55.227128+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:13:55.227128+0000","last_undegraded":"2024-09-05T02:13:55.227128+0000","last_fullsized":"2024-09-05T02:13:55.227128+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:09.868656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228540+0000","last_change":"2024-09-05T01:05:07.106167+0000","last_active":"2024-09-05T02:13:51.228540+0000","last_peered":"2024-09-05T02:13:51.228540+0000","last_clean":"2024-09-05T02:13:51.228540+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:13:51.228540+0000","last_undegraded":"2024-09-05T02:13:51.228540+0000","last_fullsized":"2024-09-05T02:13:51.228540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:44.638683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:06.247164+0000","last_change":"2024-09-05T01:09:26.348937+0000","last_active":"2024-09-05T02:16:06.247164+0000","last_peered":"2024-09-05T02:16:06.247164+0000","last_clean":"2024-09-05T02:16:06.247164+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:16:06.247164+0000","last_undegraded":"2024-09-05T02:16:06.247164+0000","last_fullsized":"2024-09-05T02:16:06.247164+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.793654+0000","last_change":"2024-09-05T01:09:22.183966+0000","last_active":"2024-09-05T02:13:56.793654+0000","last_peered":"2024-09-05T02:13:56.793654+0000","last_clean":"2024-09-05T02:13:56.793654+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:13:56.793654+0000","last_undegraded":"2024-09-05T02:13:56.793654+0000","last_fullsized":"2024-09-05T02:13:56.793654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:52.065642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":216,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.410907+0000","last_change":"2024-09-05T01:05:07.105723+0000","last_active":"2024-09-05T02:13:51.410907+0000","last_peered":"2024-09-05T02:13:51.410907+0000","last_clean":"2024-09-05T02:13:51.410907+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:13:51.410907+0000","last_undegraded":"2024-09-05T02:13:51.410907+0000","last_fullsized":"2024-09-05T02:13:51.410907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:08.187510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:01.439812+0000","last_change":"2024-09-05T01:09:22.173186+0000","last_active":"2024-09-05T02:16:01.439812+0000","last_peered":"2024-09-05T02:16:01.439812+0000","last_clean":"2024-09-05T02:16:01.439812+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:16:01.439812+0000","last_undegraded":"2024-09-05T02:16:01.439812+0000","last_fullsized":"2024-09-05T02:16:01.439812+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:45.178339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.832398+0000","last_change":"2024-09-05T01:05:07.103211+0000","last_active":"2024-09-05T02:13:16.832398+0000","last_peered":"2024-09-05T02:13:16.832398+0000","last_clean":"2024-09-05T02:13:16.832398+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:13:16.832398+0000","last_undegraded":"2024-09-05T02:13:16.832398+0000","last_fullsized":"2024-09-05T02:13:16.832398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:40.214831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'372","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.896066+0000","last_change":"2024-09-05T00:50:04.197760+0000","last_active":"2024-09-05T02:16:22.896066+0000","last_peered":"2024-09-05T02:16:22.896066+0000","last_clean":"2024-09-05T02:16:22.896066+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:22.896066+0000","last_undegraded":"2024-09-05T02:16:22.896066+0000","last_fullsized":"2024-09-05T02:16:22.896066+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:08.910794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":47646,"num_write":1216,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'505","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844799+0000","last_change":"2024-09-05T00:49:29.902310+0000","last_active":"2024-09-05T02:13:40.844799+0000","last_peered":"2024-09-05T02:13:40.844799+0000","last_clean":"2024-09-05T02:13:40.844799+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:13:40.844799+0000","last_undegraded":"2024-09-05T02:13:40.844799+0000","last_fullsized":"2024-09-05T02:13:40.844799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:52.315609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'379","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.902746+0000","last_change":"2024-09-05T00:49:27.898633+0000","last_active":"2024-09-05T02:16:22.902746+0000","last_peered":"2024-09-05T02:16:22.902746+0000","last_clean":"2024-09-05T02:16:22.902746+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:22.902746+0000","last_undegraded":"2024-09-05T02:16:22.902746+0000","last_fullsized":"2024-09-05T02:16:22.902746+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:12:19.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":565,"num_read_kb":74894,"num_write":1179,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'444","reported_seq":2073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.060176+0000","last_change":"2024-09-05T00:50:04.184130+0000","last_active":"2024-09-05T02:13:56.060176+0000","last_peered":"2024-09-05T02:13:56.060176+0000","last_clean":"2024-09-05T02:13:56.060176+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:13:56.060176+0000","last_undegraded":"2024-09-05T02:13:56.060176+0000","last_fullsized":"2024-09-05T02:13:56.060176+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:41.824164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'388","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.899602+0000","last_change":"2024-09-05T00:49:27.878763+0000","last_active":"2024-09-05T02:16:22.899602+0000","last_peered":"2024-09-05T02:16:22.899602+0000","last_clean":"2024-09-05T02:16:22.899602+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:16:22.899602+0000","last_undegraded":"2024-09-05T02:16:22.899602+0000","last_fullsized":"2024-09-05T02:16:22.899602+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:40.061514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":743,"num_write":1140,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'852","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842642+0000","last_change":"2024-09-05T00:49:29.900944+0000","last_active":"2024-09-05T02:14:19.842642+0000","last_peered":"2024-09-05T02:14:19.842642+0000","last_clean":"2024-09-05T02:14:19.842642+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:14:19.842642+0000","last_undegraded":"2024-09-05T02:14:19.842642+0000","last_fullsized":"2024-09-05T02:14:19.842642+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:48.973383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'377","reported_seq":1174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.858348+0000","last_change":"2024-09-05T00:49:27.891660+0000","last_active":"2024-09-05T02:16:22.858348+0000","last_peered":"2024-09-05T02:16:22.858348+0000","last_clean":"2024-09-05T02:16:22.858348+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:16:22.858348+0000","last_undegraded":"2024-09-05T02:16:22.858348+0000","last_fullsized":"2024-09-05T02:16:22.858348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:52:25.219927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":68502,"num_write":1310,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.840193+0000","last_change":"2024-09-05T00:49:29.919632+0000","last_active":"2024-09-05T02:13:40.840193+0000","last_peered":"2024-09-05T02:13:40.840193+0000","last_clean":"2024-09-05T02:13:40.840193+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:13:40.840193+0000","last_undegraded":"2024-09-05T02:13:40.840193+0000","last_fullsized":"2024-09-05T02:13:40.840193+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:31:42.074665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'359","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.897843+0000","last_change":"2024-09-05T00:49:27.904486+0000","last_active":"2024-09-05T02:16:22.897843+0000","last_peered":"2024-09-05T02:16:22.897843+0000","last_clean":"2024-09-05T02:16:22.897843+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:22.897843+0000","last_undegraded":"2024-09-05T02:16:22.897843+0000","last_fullsized":"2024-09-05T02:16:22.897843+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:22:56.989812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":9059,"num_write":1154,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'446","reported_seq":1922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.625924+0000","last_change":"2024-09-05T00:49:29.903354+0000","last_active":"2024-09-05T02:14:29.625924+0000","last_peered":"2024-09-05T02:14:29.625924+0000","last_clean":"2024-09-05T02:14:29.625924+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:14:29.625924+0000","last_undegraded":"2024-09-05T02:14:29.625924+0000","last_fullsized":"2024-09-05T02:14:29.625924+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:55:22.469137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'322","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.891419+0000","last_change":"2024-09-05T00:49:27.899576+0000","last_active":"2024-09-05T02:16:22.891419+0000","last_peered":"2024-09-05T02:16:22.891419+0000","last_clean":"2024-09-05T02:16:22.891419+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:16:22.891419+0000","last_undegraded":"2024-09-05T02:16:22.891419+0000","last_fullsized":"2024-09-05T02:16:22.891419+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:56:44.824648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":472,"num_write":1089,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'503","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.906613+0000","last_change":"2024-09-05T00:49:29.900890+0000","last_active":"2024-09-05T02:13:45.906613+0000","last_peered":"2024-09-05T02:13:45.906613+0000","last_clean":"2024-09-05T02:13:45.906613+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:13:45.906613+0000","last_undegraded":"2024-09-05T02:13:45.906613+0000","last_fullsized":"2024-09-05T02:13:45.906613+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'345","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.872878+0000","last_change":"2024-09-05T00:49:27.905426+0000","last_active":"2024-09-05T02:16:22.872878+0000","last_peered":"2024-09-05T02:16:22.872878+0000","last_clean":"2024-09-05T02:16:22.872878+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:22.872878+0000","last_undegraded":"2024-09-05T02:16:22.872878+0000","last_fullsized":"2024-09-05T02:16:22.872878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:05.030484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495269,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":507,"num_read_kb":57163,"num_write":1112,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'473","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.607735+0000","last_change":"2024-09-05T00:49:29.918860+0000","last_active":"2024-09-05T02:15:48.607735+0000","last_peered":"2024-09-05T02:15:48.607735+0000","last_clean":"2024-09-05T02:15:48.607735+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:15:48.607735+0000","last_undegraded":"2024-09-05T02:15:48.607735+0000","last_fullsized":"2024-09-05T02:15:48.607735+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:36.131820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'346","reported_seq":1175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.875047+0000","last_change":"2024-09-05T00:49:27.894250+0000","last_active":"2024-09-05T02:16:22.875047+0000","last_peered":"2024-09-05T02:16:22.875047+0000","last_clean":"2024-09-05T02:16:22.875047+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:22.875047+0000","last_undegraded":"2024-09-05T02:16:22.875047+0000","last_fullsized":"2024-09-05T02:16:22.875047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:55:18.649480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":814,"num_read_kb":7164,"num_write":1128,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'450","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:14.403614+0000","last_change":"2024-09-05T00:49:29.917227+0000","last_active":"2024-09-05T02:13:14.403614+0000","last_peered":"2024-09-05T02:13:14.403614+0000","last_clean":"2024-09-05T02:13:14.403614+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:13:14.403614+0000","last_undegraded":"2024-09-05T02:13:14.403614+0000","last_fullsized":"2024-09-05T02:13:14.403614+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:45.091417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'744","reported_seq":2208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.062464+0000","last_change":"2024-09-05T00:49:29.905360+0000","last_active":"2024-09-05T02:13:56.062464+0000","last_peered":"2024-09-05T02:13:56.062464+0000","last_clean":"2024-09-05T02:13:56.062464+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:13:56.062464+0000","last_undegraded":"2024-09-05T02:13:56.062464+0000","last_fullsized":"2024-09-05T02:13:56.062464+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:40.876830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'347","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.887997+0000","last_change":"2024-09-05T00:49:27.910019+0000","last_active":"2024-09-05T02:16:22.887997+0000","last_peered":"2024-09-05T02:16:22.887997+0000","last_clean":"2024-09-05T02:16:22.887997+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:22.887997+0000","last_undegraded":"2024-09-05T02:16:22.887997+0000","last_fullsized":"2024-09-05T02:16:22.887997+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:00.426807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1733359,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":485,"num_read_kb":16771,"num_write":1085,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'434","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697734+0000","last_change":"2024-09-05T00:49:29.924150+0000","last_active":"2024-09-05T02:15:48.697734+0000","last_peered":"2024-09-05T02:15:48.697734+0000","last_clean":"2024-09-05T02:15:48.697734+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:15:48.697734+0000","last_undegraded":"2024-09-05T02:15:48.697734+0000","last_fullsized":"2024-09-05T02:15:48.697734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:21.326911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'342","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.852103+0000","last_change":"2024-09-05T00:49:27.896351+0000","last_active":"2024-09-05T02:16:22.852103+0000","last_peered":"2024-09-05T02:16:22.852103+0000","last_clean":"2024-09-05T02:16:22.852103+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:22.852103+0000","last_undegraded":"2024-09-05T02:16:22.852103+0000","last_fullsized":"2024-09-05T02:16:22.852103+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:17:37.231288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":5849,"num_write":1054,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'460","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.696002+0000","last_change":"2024-09-05T00:49:29.910681+0000","last_active":"2024-09-05T02:15:48.696002+0000","last_peered":"2024-09-05T02:15:48.696002+0000","last_clean":"2024-09-05T02:15:48.696002+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:15:48.696002+0000","last_undegraded":"2024-09-05T02:15:48.696002+0000","last_fullsized":"2024-09-05T02:15:48.696002+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:22.606854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'354","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.853701+0000","last_change":"2024-09-05T00:49:27.894988+0000","last_active":"2024-09-05T02:16:22.853701+0000","last_peered":"2024-09-05T02:16:22.853701+0000","last_clean":"2024-09-05T02:16:22.853701+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:22.853701+0000","last_undegraded":"2024-09-05T02:16:22.853701+0000","last_fullsized":"2024-09-05T02:16:22.853701+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:21.825324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":7060,"num_write":1221,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'491","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:47.724900+0000","last_change":"2024-09-05T00:49:29.912607+0000","last_active":"2024-09-05T02:12:47.724900+0000","last_peered":"2024-09-05T02:12:47.724900+0000","last_clean":"2024-09-05T02:12:47.724900+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:12:47.724900+0000","last_undegraded":"2024-09-05T02:12:47.724900+0000","last_fullsized":"2024-09-05T02:12:47.724900+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:34.256983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'351","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.750516+0000","last_change":"2024-09-05T00:49:27.882843+0000","last_active":"2024-09-05T02:16:22.750516+0000","last_peered":"2024-09-05T02:16:22.750516+0000","last_clean":"2024-09-05T02:16:22.750516+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:22.750516+0000","last_undegraded":"2024-09-05T02:16:22.750516+0000","last_fullsized":"2024-09-05T02:16:22.750516+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:25.955814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":17342,"num_write":1226,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'405","reported_seq":1862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.843762+0000","last_change":"2024-09-05T00:49:29.917744+0000","last_active":"2024-09-05T02:13:40.843762+0000","last_peered":"2024-09-05T02:13:40.843762+0000","last_clean":"2024-09-05T02:13:40.843762+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:13:40.843762+0000","last_undegraded":"2024-09-05T02:13:40.843762+0000","last_fullsized":"2024-09-05T02:13:40.843762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:26.837337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'348","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.908410+0000","last_change":"2024-09-05T00:49:27.879495+0000","last_active":"2024-09-05T02:16:22.908410+0000","last_peered":"2024-09-05T02:16:22.908410+0000","last_clean":"2024-09-05T02:16:22.908410+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:22.908410+0000","last_undegraded":"2024-09-05T02:16:22.908410+0000","last_fullsized":"2024-09-05T02:16:22.908410+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:13.251498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":1528,"num_write":1229,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'749","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.563397+0000","last_change":"2024-09-05T00:49:29.921148+0000","last_active":"2024-09-05T02:14:29.563397+0000","last_peered":"2024-09-05T02:14:29.563397+0000","last_clean":"2024-09-05T02:14:29.563397+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:14:29.563397+0000","last_undegraded":"2024-09-05T02:14:29.563397+0000","last_fullsized":"2024-09-05T02:14:29.563397+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:42:28.667675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'334","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.891304+0000","last_change":"2024-09-05T00:49:27.893557+0000","last_active":"2024-09-05T02:16:22.891304+0000","last_peered":"2024-09-05T02:16:22.891304+0000","last_clean":"2024-09-05T02:16:22.891304+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:16:22.891304+0000","last_undegraded":"2024-09-05T02:16:22.891304+0000","last_fullsized":"2024-09-05T02:16:22.891304+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:16:58.696922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":32081,"num_write":1077,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'127","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.840852+0000","last_change":"2024-09-05T00:49:37.949792+0000","last_active":"2024-09-05T02:14:29.840852+0000","last_peered":"2024-09-05T02:14:29.840852+0000","last_clean":"2024-09-05T02:14:29.840852+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:14:29.840852+0000","last_undegraded":"2024-09-05T02:14:29.840852+0000","last_fullsized":"2024-09-05T02:14:29.840852+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:18.632196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'322","reported_seq":1628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:25.027490+0000","last_change":"2024-09-05T00:50:04.179604+0000","last_active":"2024-09-05T02:13:25.027490+0000","last_peered":"2024-09-05T02:13:25.027490+0000","last_clean":"2024-09-05T02:13:25.027490+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:13:25.027490+0000","last_undegraded":"2024-09-05T02:13:25.027490+0000","last_fullsized":"2024-09-05T02:13:25.027490+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:19.315200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'346","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.917720+0000","last_change":"2024-09-05T00:49:27.908163+0000","last_active":"2024-09-05T02:16:22.917720+0000","last_peered":"2024-09-05T02:16:22.917720+0000","last_clean":"2024-09-05T02:16:22.917720+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:22.917720+0000","last_undegraded":"2024-09-05T02:16:22.917720+0000","last_fullsized":"2024-09-05T02:16:22.917720+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:26.321927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":5561,"num_write":1118,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196301+0000","last_change":"2024-09-05T00:49:31.911566+0000","last_active":"2024-09-05T02:11:45.196301+0000","last_peered":"2024-09-05T02:11:45.196301+0000","last_clean":"2024-09-05T02:11:45.196301+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:11:45.196301+0000","last_undegraded":"2024-09-05T02:11:45.196301+0000","last_fullsized":"2024-09-05T02:11:45.196301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:50.459772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'367","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.543971+0000","last_change":"2024-09-05T00:49:33.908342+0000","last_active":"2024-09-05T02:16:21.543971+0000","last_peered":"2024-09-05T02:16:21.543971+0000","last_clean":"2024-09-05T02:16:21.543971+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:16:21.543971+0000","last_undegraded":"2024-09-05T02:16:21.543971+0000","last_fullsized":"2024-09-05T02:16:21.543971+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:30:43.947001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":585,"num_read_kb":1187,"num_write":454,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.810732+0000","last_change":"2024-09-05T00:49:35.935224+0000","last_active":"2024-09-05T02:11:46.810732+0000","last_peered":"2024-09-05T02:11:46.810732+0000","last_clean":"2024-09-05T02:11:46.810732+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:11:46.810732+0000","last_undegraded":"2024-09-05T02:11:46.810732+0000","last_fullsized":"2024-09-05T02:11:46.810732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:50.276599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2467","reported_seq":4375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.838585+0000","last_change":"2024-09-05T00:49:37.940197+0000","last_active":"2024-09-05T02:14:27.838585+0000","last_peered":"2024-09-05T02:14:27.838585+0000","last_clean":"2024-09-05T02:14:27.838585+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:14:27.838585+0000","last_undegraded":"2024-09-05T02:14:27.838585+0000","last_fullsized":"2024-09-05T02:14:27.838585+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:21.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.634828+0000","last_change":"2024-09-05T00:49:29.904918+0000","last_active":"2024-09-05T02:14:27.634828+0000","last_peered":"2024-09-05T02:14:27.634828+0000","last_clean":"2024-09-05T02:14:27.634828+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:14:27.634828+0000","last_undegraded":"2024-09-05T02:14:27.634828+0000","last_fullsized":"2024-09-05T02:14:27.634828+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:01:06.117657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'323","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.859513+0000","last_change":"2024-09-05T00:49:27.905821+0000","last_active":"2024-09-05T02:16:22.859513+0000","last_peered":"2024-09-05T02:16:22.859513+0000","last_clean":"2024-09-05T02:16:22.859513+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:16:22.859513+0000","last_undegraded":"2024-09-05T02:16:22.859513+0000","last_fullsized":"2024-09-05T02:16:22.859513+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:56:59.762079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":61922,"num_write":915,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487978+0000","last_change":"2024-09-05T00:49:31.917103+0000","last_active":"2024-09-05T02:13:51.487978+0000","last_peered":"2024-09-05T02:13:51.487978+0000","last_clean":"2024-09-05T02:13:51.487978+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:13:51.487978+0000","last_undegraded":"2024-09-05T02:13:51.487978+0000","last_fullsized":"2024-09-05T02:13:51.487978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:08.039118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200339+0000","last_change":"2024-09-05T00:49:33.908801+0000","last_active":"2024-09-05T02:11:46.200339+0000","last_peered":"2024-09-05T02:11:46.200339+0000","last_clean":"2024-09-05T02:11:46.200339+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:11:46.200339+0000","last_undegraded":"2024-09-05T02:11:46.200339+0000","last_fullsized":"2024-09-05T02:11:46.200339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:32.220937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:46.200292+0000","last_change":"2024-09-05T00:49:35.930182+0000","last_active":"2024-09-05T02:11:46.200292+0000","last_peered":"2024-09-05T02:11:46.200292+0000","last_clean":"2024-09-05T02:11:46.200292+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:11:46.200292+0000","last_undegraded":"2024-09-05T02:11:46.200292+0000","last_fullsized":"2024-09-05T02:11:46.200292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:35.613544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'106","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.066549+0000","last_change":"2024-09-05T00:49:37.932878+0000","last_active":"2024-09-05T02:14:26.066549+0000","last_peered":"2024-09-05T02:14:26.066549+0000","last_clean":"2024-09-05T02:14:26.066549+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:14:26.066549+0000","last_undegraded":"2024-09-05T02:14:26.066549+0000","last_fullsized":"2024-09-05T02:14:26.066549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:02.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1219","reported_seq":2904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.627360+0000","last_change":"2024-09-05T00:49:29.911068+0000","last_active":"2024-09-05T02:14:29.627360+0000","last_peered":"2024-09-05T02:14:29.627360+0000","last_clean":"2024-09-05T02:14:29.627360+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:14:29.627360+0000","last_undegraded":"2024-09-05T02:14:29.627360+0000","last_fullsized":"2024-09-05T02:14:29.627360+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:31.287838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'320","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.880842+0000","last_change":"2024-09-05T00:49:27.904699+0000","last_active":"2024-09-05T02:16:22.880842+0000","last_peered":"2024-09-05T02:16:22.880842+0000","last_clean":"2024-09-05T02:16:22.880842+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:22.880842+0000","last_undegraded":"2024-09-05T02:16:22.880842+0000","last_fullsized":"2024-09-05T02:16:22.880842+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:24.274679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":6929,"num_write":1016,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.455259+0000","last_change":"2024-09-05T00:49:31.914059+0000","last_active":"2024-09-05T02:11:41.455259+0000","last_peered":"2024-09-05T02:11:41.455259+0000","last_clean":"2024-09-05T02:11:41.455259+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:11:41.455259+0000","last_undegraded":"2024-09-05T02:11:41.455259+0000","last_fullsized":"2024-09-05T02:11:41.455259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:54.072194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'181","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.387691+0000","last_change":"2024-09-05T00:49:33.902480+0000","last_active":"2024-09-05T02:13:46.387691+0000","last_peered":"2024-09-05T02:13:46.387691+0000","last_clean":"2024-09-05T02:13:46.387691+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:13:46.387691+0000","last_undegraded":"2024-09-05T02:13:46.387691+0000","last_fullsized":"2024-09-05T02:13:46.387691+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:14.928690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'787","reported_seq":4951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.403526+0000","last_change":"2024-09-05T00:49:35.927429+0000","last_active":"2024-09-05T02:16:22.403526+0000","last_peered":"2024-09-05T02:16:22.403526+0000","last_clean":"2024-09-05T02:16:22.403526+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:22.403526+0000","last_undegraded":"2024-09-05T02:16:22.403526+0000","last_fullsized":"2024-09-05T02:16:22.403526+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:49.036040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'234","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.269828+0000","last_change":"2024-09-05T00:49:37.922161+0000","last_active":"2024-09-05T02:15:48.269828+0000","last_peered":"2024-09-05T02:15:48.269828+0000","last_clean":"2024-09-05T02:15:48.269828+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:15:48.269828+0000","last_undegraded":"2024-09-05T02:15:48.269828+0000","last_fullsized":"2024-09-05T02:15:48.269828+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:45.817026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'682","reported_seq":2135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:07.422737+0000","last_change":"2024-09-05T00:49:29.927852+0000","last_active":"2024-09-05T02:13:07.422737+0000","last_peered":"2024-09-05T02:13:07.422737+0000","last_clean":"2024-09-05T02:13:07.422737+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:13:07.422737+0000","last_undegraded":"2024-09-05T02:13:07.422737+0000","last_fullsized":"2024-09-05T02:13:07.422737+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:09.704012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'353","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.919837+0000","last_change":"2024-09-05T00:49:27.880796+0000","last_active":"2024-09-05T02:16:22.919837+0000","last_peered":"2024-09-05T02:16:22.919837+0000","last_clean":"2024-09-05T02:16:22.919837+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:22.919837+0000","last_undegraded":"2024-09-05T02:16:22.919837+0000","last_fullsized":"2024-09-05T02:16:22.919837+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:01.610874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":55829,"num_write":1110,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.196390+0000","last_change":"2024-09-05T00:49:31.910341+0000","last_active":"2024-09-05T02:11:45.196390+0000","last_peered":"2024-09-05T02:11:45.196390+0000","last_clean":"2024-09-05T02:11:45.196390+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:11:45.196390+0000","last_undegraded":"2024-09-05T02:11:45.196390+0000","last_fullsized":"2024-09-05T02:11:45.196390+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:21.538486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'326","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.255008+0000","last_change":"2024-09-05T00:49:34.055554+0000","last_active":"2024-09-05T02:16:21.255008+0000","last_peered":"2024-09-05T02:16:21.255008+0000","last_clean":"2024-09-05T02:16:21.255008+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:21.255008+0000","last_undegraded":"2024-09-05T02:16:21.255008+0000","last_fullsized":"2024-09-05T02:16:21.255008+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:03:22.138176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'801","reported_seq":4539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.387623+0000","last_change":"2024-09-05T00:49:35.938226+0000","last_active":"2024-09-05T02:16:22.387623+0000","last_peered":"2024-09-05T02:16:22.387623+0000","last_clean":"2024-09-05T02:16:22.387623+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:16:22.387623+0000","last_undegraded":"2024-09-05T02:16:22.387623+0000","last_fullsized":"2024-09-05T02:16:22.387623+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:56.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'744","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228164+0000","last_change":"2024-09-05T00:49:29.903992+0000","last_active":"2024-09-05T02:14:00.228164+0000","last_peered":"2024-09-05T02:14:00.228164+0000","last_clean":"2024-09-05T02:14:00.228164+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:14:00.228164+0000","last_undegraded":"2024-09-05T02:14:00.228164+0000","last_fullsized":"2024-09-05T02:14:00.228164+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":700,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:36.833935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'434","reported_seq":1144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.873308+0000","last_change":"2024-09-05T00:49:27.914055+0000","last_active":"2024-09-05T02:16:22.873308+0000","last_peered":"2024-09-05T02:16:22.873308+0000","last_clean":"2024-09-05T02:16:22.873308+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:22.873308+0000","last_undegraded":"2024-09-05T02:16:22.873308+0000","last_fullsized":"2024-09-05T02:16:22.873308+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:52.269578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":823,"num_read_kb":4743,"num_write":1412,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632817+0000","last_change":"2024-09-05T00:49:31.919796+0000","last_active":"2024-09-05T02:14:01.632817+0000","last_peered":"2024-09-05T02:14:01.632817+0000","last_clean":"2024-09-05T02:14:01.632817+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:14:01.632817+0000","last_undegraded":"2024-09-05T02:14:01.632817+0000","last_fullsized":"2024-09-05T02:14:01.632817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:17.976816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'420","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.793853+0000","last_change":"2024-09-05T00:49:34.052466+0000","last_active":"2024-09-05T02:16:21.793853+0000","last_peered":"2024-09-05T02:16:21.793853+0000","last_clean":"2024-09-05T02:16:21.793853+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:16:21.793853+0000","last_undegraded":"2024-09-05T02:16:21.793853+0000","last_fullsized":"2024-09-05T02:16:21.793853+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:20.386465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":700,"num_read_kb":1390,"num_write":540,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.780250+0000","last_change":"2024-09-05T00:49:35.937335+0000","last_active":"2024-09-05T02:12:51.780250+0000","last_peered":"2024-09-05T02:12:51.780250+0000","last_clean":"2024-09-05T02:12:51.780250+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:12:51.780250+0000","last_undegraded":"2024-09-05T02:12:51.780250+0000","last_fullsized":"2024-09-05T02:12:51.780250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:11.123088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'584","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.668190+0000","last_change":"2024-09-05T00:49:37.946024+0000","last_active":"2024-09-05T02:15:49.668190+0000","last_peered":"2024-09-05T02:15:49.668190+0000","last_clean":"2024-09-05T02:15:49.668190+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:15:49.668190+0000","last_undegraded":"2024-09-05T02:15:49.668190+0000","last_fullsized":"2024-09-05T02:15:49.668190+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:47:31.597559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'438","reported_seq":1974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230841+0000","last_change":"2024-09-05T00:49:29.923948+0000","last_active":"2024-09-05T02:14:01.230841+0000","last_peered":"2024-09-05T02:14:01.230841+0000","last_clean":"2024-09-05T02:14:01.230841+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:14:01.230841+0000","last_undegraded":"2024-09-05T02:14:01.230841+0000","last_fullsized":"2024-09-05T02:14:01.230841+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:07.536362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'302","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.908529+0000","last_change":"2024-09-05T00:49:27.905783+0000","last_active":"2024-09-05T02:16:22.908529+0000","last_peered":"2024-09-05T02:16:22.908529+0000","last_clean":"2024-09-05T02:16:22.908529+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:22.908529+0000","last_undegraded":"2024-09-05T02:16:22.908529+0000","last_fullsized":"2024-09-05T02:16:22.908529+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:18.584102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":6807,"num_write":872,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390543+0000","last_change":"2024-09-05T00:49:31.900583+0000","last_active":"2024-09-05T02:14:01.390543+0000","last_peered":"2024-09-05T02:14:01.390543+0000","last_clean":"2024-09-05T02:14:01.390543+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:14:01.390543+0000","last_undegraded":"2024-09-05T02:14:01.390543+0000","last_fullsized":"2024-09-05T02:14:01.390543+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:18.073117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'298","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.617340+0000","last_change":"2024-09-05T00:49:33.925800+0000","last_active":"2024-09-05T02:16:22.617340+0000","last_peered":"2024-09-05T02:16:22.617340+0000","last_clean":"2024-09-05T02:16:22.617340+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:16:22.617340+0000","last_undegraded":"2024-09-05T02:16:22.617340+0000","last_fullsized":"2024-09-05T02:16:22.617340+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:21.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45431,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1122,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.464772+0000","last_change":"2024-09-05T00:49:35.934298+0000","last_active":"2024-09-05T02:12:16.464772+0000","last_peered":"2024-09-05T02:12:16.464772+0000","last_clean":"2024-09-05T02:12:16.464772+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:12:16.464772+0000","last_undegraded":"2024-09-05T02:12:16.464772+0000","last_fullsized":"2024-09-05T02:12:16.464772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:20.839555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:26.432127+0000","last_change":"2024-09-05T00:49:37.939432+0000","last_active":"2024-09-05T02:15:26.432127+0000","last_peered":"2024-09-05T02:15:26.432127+0000","last_clean":"2024-09-05T02:15:26.432127+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:15:26.432127+0000","last_undegraded":"2024-09-05T02:15:26.432127+0000","last_fullsized":"2024-09-05T02:15:26.432127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:10:08.494468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'478","reported_seq":2244,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.850142+0000","last_change":"2024-09-05T00:49:29.896300+0000","last_active":"2024-09-05T02:13:32.850142+0000","last_peered":"2024-09-05T02:13:32.850142+0000","last_clean":"2024-09-05T02:13:32.850142+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:13:32.850142+0000","last_undegraded":"2024-09-05T02:13:32.850142+0000","last_fullsized":"2024-09-05T02:13:32.850142+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:52:46.379207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'299","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.911232+0000","last_change":"2024-09-05T00:49:27.907570+0000","last_active":"2024-09-05T02:16:22.911232+0000","last_peered":"2024-09-05T02:16:22.911232+0000","last_clean":"2024-09-05T02:16:22.911232+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:22.911232+0000","last_undegraded":"2024-09-05T02:16:22.911232+0000","last_fullsized":"2024-09-05T02:16:22.911232+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:05.915567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":11870,"num_write":1072,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375656+0000","last_change":"2024-09-05T00:49:31.902598+0000","last_active":"2024-09-05T02:12:46.375656+0000","last_peered":"2024-09-05T02:12:46.375656+0000","last_clean":"2024-09-05T02:12:46.375656+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:12:46.375656+0000","last_undegraded":"2024-09-05T02:12:46.375656+0000","last_fullsized":"2024-09-05T02:12:46.375656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:39.314352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'364","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.921065+0000","last_change":"2024-09-05T00:49:33.914287+0000","last_active":"2024-09-05T02:16:21.921065+0000","last_peered":"2024-09-05T02:16:21.921065+0000","last_clean":"2024-09-05T02:16:21.921065+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:21.921065+0000","last_undegraded":"2024-09-05T02:16:21.921065+0000","last_fullsized":"2024-09-05T02:16:21.921065+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:11.461929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1153,"num_write":442,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.707511+0000","last_change":"2024-09-05T00:49:35.943066+0000","last_active":"2024-09-05T02:16:21.707511+0000","last_peered":"2024-09-05T02:16:21.707511+0000","last_clean":"2024-09-05T02:16:21.707511+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:16:21.707511+0000","last_undegraded":"2024-09-05T02:16:21.707511+0000","last_fullsized":"2024-09-05T02:16:21.707511+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.083488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.657912+0000","last_change":"2024-09-05T00:49:37.930994+0000","last_active":"2024-09-05T02:15:48.657912+0000","last_peered":"2024-09-05T02:15:48.657912+0000","last_clean":"2024-09-05T02:15:48.657912+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:15:48.657912+0000","last_undegraded":"2024-09-05T02:15:48.657912+0000","last_fullsized":"2024-09-05T02:15:48.657912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:37:05.359031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'803","reported_seq":2398,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844942+0000","last_change":"2024-09-05T00:49:29.920955+0000","last_active":"2024-09-05T02:14:19.844942+0000","last_peered":"2024-09-05T02:14:19.844942+0000","last_clean":"2024-09-05T02:14:19.844942+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:14:19.844942+0000","last_undegraded":"2024-09-05T02:14:19.844942+0000","last_fullsized":"2024-09-05T02:14:19.844942+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:44:52.804706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'324","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.853220+0000","last_change":"2024-09-05T00:49:27.889887+0000","last_active":"2024-09-05T02:16:22.853220+0000","last_peered":"2024-09-05T02:16:22.853220+0000","last_clean":"2024-09-05T02:16:22.853220+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:16:22.853220+0000","last_undegraded":"2024-09-05T02:16:22.853220+0000","last_fullsized":"2024-09-05T02:16:22.853220+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:39.130709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":126733,"num_write":975,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.392808+0000","last_change":"2024-09-05T00:49:31.918141+0000","last_active":"2024-09-05T02:14:11.392808+0000","last_peered":"2024-09-05T02:14:11.392808+0000","last_clean":"2024-09-05T02:14:11.392808+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:14:11.392808+0000","last_undegraded":"2024-09-05T02:14:11.392808+0000","last_fullsized":"2024-09-05T02:14:11.392808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:29.030370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'548","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.788708+0000","last_change":"2024-09-05T00:49:33.914174+0000","last_active":"2024-09-05T02:16:22.788708+0000","last_peered":"2024-09-05T02:16:22.788708+0000","last_clean":"2024-09-05T02:16:22.788708+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:16:22.788708+0000","last_undegraded":"2024-09-05T02:16:22.788708+0000","last_fullsized":"2024-09-05T02:16:22.788708+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:19.745942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101782,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":984,"num_read_kb":2420,"num_write":814,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391710+0000","last_change":"2024-09-05T00:49:35.924089+0000","last_active":"2024-09-05T02:14:06.391710+0000","last_peered":"2024-09-05T02:14:06.391710+0000","last_clean":"2024-09-05T02:14:06.391710+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:14:06.391710+0000","last_undegraded":"2024-09-05T02:14:06.391710+0000","last_fullsized":"2024-09-05T02:14:06.391710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.796632+0000","last_change":"2024-09-05T00:49:37.951943+0000","last_active":"2024-09-05T02:14:11.796632+0000","last_peered":"2024-09-05T02:14:11.796632+0000","last_clean":"2024-09-05T02:14:11.796632+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:14:11.796632+0000","last_undegraded":"2024-09-05T02:14:11.796632+0000","last_fullsized":"2024-09-05T02:14:11.796632+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:10:12.600724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'957","reported_seq":2785,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844122+0000","last_change":"2024-09-05T00:49:29.916462+0000","last_active":"2024-09-05T02:13:40.844122+0000","last_peered":"2024-09-05T02:13:40.844122+0000","last_clean":"2024-09-05T02:13:40.844122+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:13:40.844122+0000","last_undegraded":"2024-09-05T02:13:40.844122+0000","last_fullsized":"2024-09-05T02:13:40.844122+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":900,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:54.951960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'581","reported_seq":1403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.923342+0000","last_change":"2024-09-05T00:49:27.882006+0000","last_active":"2024-09-05T02:16:22.923342+0000","last_peered":"2024-09-05T02:16:22.923342+0000","last_clean":"2024-09-05T02:16:22.923342+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:22.923342+0000","last_undegraded":"2024-09-05T02:16:22.923342+0000","last_fullsized":"2024-09-05T02:16:22.923342+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:46:30.493857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1279,"num_read_kb":93816,"num_write":1779,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375772+0000","last_change":"2024-09-05T00:49:31.914002+0000","last_active":"2024-09-05T02:12:46.375772+0000","last_peered":"2024-09-05T02:12:46.375772+0000","last_clean":"2024-09-05T02:12:46.375772+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:12:46.375772+0000","last_undegraded":"2024-09-05T02:12:46.375772+0000","last_fullsized":"2024-09-05T02:12:46.375772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:51:45.528236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'317","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.830748+0000","last_change":"2024-09-05T00:49:33.912638+0000","last_active":"2024-09-05T02:16:22.830748+0000","last_peered":"2024-09-05T02:16:22.830748+0000","last_clean":"2024-09-05T02:16:22.830748+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:16:22.830748+0000","last_undegraded":"2024-09-05T02:16:22.830748+0000","last_fullsized":"2024-09-05T02:16:22.830748+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:18:34.630632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":1083,"num_write":458,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455773+0000","last_change":"2024-09-05T00:49:35.943863+0000","last_active":"2024-09-05T02:13:10.455773+0000","last_peered":"2024-09-05T02:13:10.455773+0000","last_clean":"2024-09-05T02:13:10.455773+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:13:10.455773+0000","last_undegraded":"2024-09-05T02:13:10.455773+0000","last_fullsized":"2024-09-05T02:13:10.455773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:18:41.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'102","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:37.522963+0000","last_change":"2024-09-05T00:49:37.954493+0000","last_active":"2024-09-05T02:15:37.522963+0000","last_peered":"2024-09-05T02:15:37.522963+0000","last_clean":"2024-09-05T02:15:37.522963+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:15:37.522963+0000","last_undegraded":"2024-09-05T02:15:37.522963+0000","last_fullsized":"2024-09-05T02:15:37.522963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:55.189506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'494","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214294+0000","last_change":"2024-09-05T00:49:29.913611+0000","last_active":"2024-09-05T02:12:46.214294+0000","last_peered":"2024-09-05T02:12:46.214294+0000","last_clean":"2024-09-05T02:12:46.214294+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:12:46.214294+0000","last_undegraded":"2024-09-05T02:12:46.214294+0000","last_fullsized":"2024-09-05T02:12:46.214294+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:37:37.589615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'377","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.884842+0000","last_change":"2024-09-05T00:49:27.888513+0000","last_active":"2024-09-05T02:16:22.884842+0000","last_peered":"2024-09-05T02:16:22.884842+0000","last_clean":"2024-09-05T02:16:22.884842+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:22.884842+0000","last_undegraded":"2024-09-05T02:16:22.884842+0000","last_fullsized":"2024-09-05T02:16:22.884842+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:09.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250145,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":21240,"num_write":1224,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779463+0000","last_change":"2024-09-05T00:49:31.926052+0000","last_active":"2024-09-05T02:12:46.779463+0000","last_peered":"2024-09-05T02:12:46.779463+0000","last_clean":"2024-09-05T02:12:46.779463+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:12:46.779463+0000","last_undegraded":"2024-09-05T02:12:46.779463+0000","last_fullsized":"2024-09-05T02:12:46.779463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:30.427944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'347","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.419772+0000","last_change":"2024-09-05T00:49:33.923431+0000","last_active":"2024-09-05T02:16:22.419772+0000","last_peered":"2024-09-05T02:16:22.419772+0000","last_clean":"2024-09-05T02:16:22.419772+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:16:22.419772+0000","last_undegraded":"2024-09-05T02:16:22.419772+0000","last_fullsized":"2024-09-05T02:16:22.419772+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:01.776499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":1068,"num_write":416,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.842082+0000","last_change":"2024-09-05T00:49:35.937729+0000","last_active":"2024-09-05T02:16:20.842082+0000","last_peered":"2024-09-05T02:16:20.842082+0000","last_clean":"2024-09-05T02:16:20.842082+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:20.842082+0000","last_undegraded":"2024-09-05T02:16:20.842082+0000","last_fullsized":"2024-09-05T02:16:20.842082+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:07:50.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.281544+0000","last_change":"2024-09-05T00:49:37.933620+0000","last_active":"2024-09-05T02:14:25.281544+0000","last_peered":"2024-09-05T02:14:25.281544+0000","last_clean":"2024-09-05T02:14:25.281544+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:14:25.281544+0000","last_undegraded":"2024-09-05T02:14:25.281544+0000","last_fullsized":"2024-09-05T02:14:25.281544+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:06.955650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'393","reported_seq":1887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214352+0000","last_change":"2024-09-05T00:49:29.914015+0000","last_active":"2024-09-05T02:12:46.214352+0000","last_peered":"2024-09-05T02:12:46.214352+0000","last_clean":"2024-09-05T02:12:46.214352+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:12:46.214352+0000","last_undegraded":"2024-09-05T02:12:46.214352+0000","last_fullsized":"2024-09-05T02:12:46.214352+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:02:56.335552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'319","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.898089+0000","last_change":"2024-09-05T00:49:27.875113+0000","last_active":"2024-09-05T02:16:22.898089+0000","last_peered":"2024-09-05T02:16:22.898089+0000","last_clean":"2024-09-05T02:16:22.898089+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:22.898089+0000","last_undegraded":"2024-09-05T02:16:22.898089+0000","last_fullsized":"2024-09-05T02:16:22.898089+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:27:05.251788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":32430,"num_write":1082,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.587099+0000","last_change":"2024-09-05T00:49:31.921867+0000","last_active":"2024-09-05T02:16:20.587099+0000","last_peered":"2024-09-05T02:16:20.587099+0000","last_clean":"2024-09-05T02:16:20.587099+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:16:20.587099+0000","last_undegraded":"2024-09-05T02:16:20.587099+0000","last_fullsized":"2024-09-05T02:16:20.587099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:12.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473659+0000","last_change":"2024-09-05T00:49:34.054334+0000","last_active":"2024-09-05T02:12:51.473659+0000","last_peered":"2024-09-05T02:12:51.473659+0000","last_clean":"2024-09-05T02:12:51.473659+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:12:51.473659+0000","last_undegraded":"2024-09-05T02:12:51.473659+0000","last_fullsized":"2024-09-05T02:12:51.473659+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:44:00.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'771","reported_seq":2808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.391809+0000","last_change":"2024-09-05T00:49:35.927090+0000","last_active":"2024-09-05T02:16:22.391809+0000","last_peered":"2024-09-05T02:16:22.391809+0000","last_clean":"2024-09-05T02:16:22.391809+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:22.391809+0000","last_undegraded":"2024-09-05T02:16:22.391809+0000","last_fullsized":"2024-09-05T02:16:22.391809+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:44.053640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.217672+0000","last_change":"2024-09-05T00:49:37.927836+0000","last_active":"2024-09-05T02:13:01.217672+0000","last_peered":"2024-09-05T02:13:01.217672+0000","last_clean":"2024-09-05T02:13:01.217672+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:13:01.217672+0000","last_undegraded":"2024-09-05T02:13:01.217672+0000","last_fullsized":"2024-09-05T02:13:01.217672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:55:13.858470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1289","reported_seq":3045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.644446+0000","last_change":"2024-09-05T00:49:29.920000+0000","last_active":"2024-09-05T02:15:48.644446+0000","last_peered":"2024-09-05T02:15:48.644446+0000","last_clean":"2024-09-05T02:15:48.644446+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:15:48.644446+0000","last_undegraded":"2024-09-05T02:15:48.644446+0000","last_fullsized":"2024-09-05T02:15:48.644446+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":1200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:23.678465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'355","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.855266+0000","last_change":"2024-09-05T00:49:27.884563+0000","last_active":"2024-09-05T02:16:22.855266+0000","last_peered":"2024-09-05T02:16:22.855266+0000","last_clean":"2024-09-05T02:16:22.855266+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:22.855266+0000","last_undegraded":"2024-09-05T02:16:22.855266+0000","last_fullsized":"2024-09-05T02:16:22.855266+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:32.747613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":2332,"num_write":1185,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214330+0000","last_change":"2024-09-05T00:49:31.917398+0000","last_active":"2024-09-05T02:12:46.214330+0000","last_peered":"2024-09-05T02:12:46.214330+0000","last_clean":"2024-09-05T02:12:46.214330+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:12:46.214330+0000","last_undegraded":"2024-09-05T02:12:46.214330+0000","last_fullsized":"2024-09-05T02:12:46.214330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:04.120586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'453","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.608241+0000","last_change":"2024-09-05T00:49:33.911807+0000","last_active":"2024-09-05T02:16:21.608241+0000","last_peered":"2024-09-05T02:16:21.608241+0000","last_clean":"2024-09-05T02:16:21.608241+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:16:21.608241+0000","last_undegraded":"2024-09-05T02:16:21.608241+0000","last_fullsized":"2024-09-05T02:16:21.608241+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:40:17.975347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49653,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1315,"num_read_kb":1876,"num_write":1876,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397943+0000","last_change":"2024-09-05T00:49:35.933208+0000","last_active":"2024-09-05T02:12:51.397943+0000","last_peered":"2024-09-05T02:12:51.397943+0000","last_clean":"2024-09-05T02:12:51.397943+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:12:51.397943+0000","last_undegraded":"2024-09-05T02:12:51.397943+0000","last_fullsized":"2024-09-05T02:12:51.397943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:18.752769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'152","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.782551+0000","last_change":"2024-09-05T00:49:37.945006+0000","last_active":"2024-09-05T02:13:01.782551+0000","last_peered":"2024-09-05T02:13:01.782551+0000","last_clean":"2024-09-05T02:13:01.782551+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:13:01.782551+0000","last_undegraded":"2024-09-05T02:13:01.782551+0000","last_fullsized":"2024-09-05T02:13:01.782551+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:03:44.203556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'892","reported_seq":2566,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.845228+0000","last_change":"2024-09-05T00:49:29.900064+0000","last_active":"2024-09-05T02:14:19.845228+0000","last_peered":"2024-09-05T02:14:19.845228+0000","last_clean":"2024-09-05T02:14:19.845228+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:14:19.845228+0000","last_undegraded":"2024-09-05T02:14:19.845228+0000","last_fullsized":"2024-09-05T02:14:19.845228+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:13.462710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:26.834774+0000","last_change":"2024-09-05T00:49:12.758625+0000","last_active":"2024-09-05T02:13:26.834774+0000","last_peered":"2024-09-05T02:13:26.834774+0000","last_clean":"2024-09-05T02:13:26.834774+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:13:26.834774+0000","last_undegraded":"2024-09-05T02:13:26.834774+0000","last_fullsized":"2024-09-05T02:13:26.834774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:11.728885+0000","last_clean_scrub_stamp":"2024-09-05T00:49:11.728885+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:24.270436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209522+0000","last_change":"2024-09-05T00:49:19.814283+0000","last_active":"2024-09-05T02:12:40.209522+0000","last_peered":"2024-09-05T02:12:40.209522+0000","last_clean":"2024-09-05T02:12:40.209522+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:12:40.209522+0000","last_undegraded":"2024-09-05T02:12:40.209522+0000","last_fullsized":"2024-09-05T02:12:40.209522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:51.651571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'301","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.893988+0000","last_change":"2024-09-05T00:50:04.179246+0000","last_active":"2024-09-05T02:16:22.893988+0000","last_peered":"2024-09-05T02:16:22.893988+0000","last_clean":"2024-09-05T02:16:22.893988+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:22.893988+0000","last_undegraded":"2024-09-05T02:16:22.893988+0000","last_fullsized":"2024-09-05T02:16:22.893988+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:55.427090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306176,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":457,"num_read_kb":14472,"num_write":870,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826578+0000","last_change":"2024-09-05T00:49:31.913193+0000","last_active":"2024-09-05T02:12:51.826578+0000","last_peered":"2024-09-05T02:12:51.826578+0000","last_clean":"2024-09-05T02:12:51.826578+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:12:51.826578+0000","last_undegraded":"2024-09-05T02:12:51.826578+0000","last_fullsized":"2024-09-05T02:12:51.826578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:35.650327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'787","reported_seq":1520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.287820+0000","last_change":"2024-09-05T00:49:33.921799+0000","last_active":"2024-09-05T02:16:22.287820+0000","last_peered":"2024-09-05T02:16:22.287820+0000","last_clean":"2024-09-05T02:16:22.287820+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:16:22.287820+0000","last_undegraded":"2024-09-05T02:16:22.287820+0000","last_fullsized":"2024-09-05T02:16:22.287820+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:02.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157356,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1541,"num_read_kb":3609,"num_write":1452,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468924+0000","last_change":"2024-09-05T00:49:35.943449+0000","last_active":"2024-09-05T02:14:05.468924+0000","last_peered":"2024-09-05T02:14:05.468924+0000","last_clean":"2024-09-05T02:14:05.468924+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:14:05.468924+0000","last_undegraded":"2024-09-05T02:14:05.468924+0000","last_fullsized":"2024-09-05T02:14:05.468924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:59.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'201","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.696227+0000","last_change":"2024-09-05T00:49:37.942775+0000","last_active":"2024-09-05T02:14:29.696227+0000","last_peered":"2024-09-05T02:14:29.696227+0000","last_clean":"2024-09-05T02:14:29.696227+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:14:29.696227+0000","last_undegraded":"2024-09-05T02:14:29.696227+0000","last_fullsized":"2024-09-05T02:14:29.696227+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:04.497388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'782","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.844939+0000","last_change":"2024-09-05T00:49:29.921333+0000","last_active":"2024-09-05T02:14:19.844939+0000","last_peered":"2024-09-05T02:14:19.844939+0000","last_clean":"2024-09-05T02:14:19.844939+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:14:19.844939+0000","last_undegraded":"2024-09-05T02:14:19.844939+0000","last_fullsized":"2024-09-05T02:14:19.844939+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:47.295103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836049+0000","last_change":"2024-09-05T00:49:20.850382+0000","last_active":"2024-09-05T02:13:31.836049+0000","last_peered":"2024-09-05T02:13:31.836049+0000","last_clean":"2024-09-05T02:13:31.836049+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:13:31.836049+0000","last_undegraded":"2024-09-05T02:13:31.836049+0000","last_fullsized":"2024-09-05T02:13:31.836049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:09:18.274308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.856531+0000","last_change":"2024-09-05T00:49:27.878156+0000","last_active":"2024-09-05T02:16:22.856531+0000","last_peered":"2024-09-05T02:16:22.856531+0000","last_clean":"2024-09-05T02:16:22.856531+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:16:22.856531+0000","last_undegraded":"2024-09-05T02:16:22.856531+0000","last_fullsized":"2024-09-05T02:16:22.856531+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:53:01.442424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":5706,"num_write":1068,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229660+0000","last_change":"2024-09-05T00:49:31.908526+0000","last_active":"2024-09-05T02:14:05.229660+0000","last_peered":"2024-09-05T02:14:05.229660+0000","last_clean":"2024-09-05T02:14:05.229660+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:14:05.229660+0000","last_undegraded":"2024-09-05T02:14:05.229660+0000","last_fullsized":"2024-09-05T02:14:05.229660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:47.306493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1374","reported_seq":3389,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.679813+0000","last_change":"2024-09-05T00:49:33.926295+0000","last_active":"2024-09-05T02:16:22.679813+0000","last_peered":"2024-09-05T02:16:22.679813+0000","last_clean":"2024-09-05T02:16:22.679813+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:22.679813+0000","last_undegraded":"2024-09-05T02:16:22.679813+0000","last_fullsized":"2024-09-05T02:16:22.679813+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:34:33.571782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2121,"num_read_kb":3935,"num_write":1230,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830253+0000","last_change":"2024-09-05T00:49:35.940367+0000","last_active":"2024-09-05T02:13:06.830253+0000","last_peered":"2024-09-05T02:13:06.830253+0000","last_clean":"2024-09-05T02:13:06.830253+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:13:06.830253+0000","last_undegraded":"2024-09-05T02:13:06.830253+0000","last_fullsized":"2024-09-05T02:13:06.830253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:41.127677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'248","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.066730+0000","last_change":"2024-09-05T00:49:37.939098+0000","last_active":"2024-09-05T02:14:27.066730+0000","last_peered":"2024-09-05T02:14:27.066730+0000","last_clean":"2024-09-05T02:14:27.066730+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:14:27.066730+0000","last_undegraded":"2024-09-05T02:14:27.066730+0000","last_fullsized":"2024-09-05T02:14:27.066730+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:24:16.011247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'409","reported_seq":1907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.699092+0000","last_change":"2024-09-05T00:49:29.900527+0000","last_active":"2024-09-05T02:15:48.699092+0000","last_peered":"2024-09-05T02:15:48.699092+0000","last_clean":"2024-09-05T02:15:48.699092+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:15:48.699092+0000","last_undegraded":"2024-09-05T02:15:48.699092+0000","last_fullsized":"2024-09-05T02:15:48.699092+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":537,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.374481+0000","last_change":"2024-09-05T00:49:19.810209+0000","last_active":"2024-09-05T02:12:41.374481+0000","last_peered":"2024-09-05T02:12:41.374481+0000","last_clean":"2024-09-05T02:12:41.374481+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:12:41.374481+0000","last_undegraded":"2024-09-05T02:12:41.374481+0000","last_fullsized":"2024-09-05T02:12:41.374481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:55.312279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'331","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.899897+0000","last_change":"2024-09-05T00:49:27.883563+0000","last_active":"2024-09-05T02:16:22.899897+0000","last_peered":"2024-09-05T02:16:22.899897+0000","last_clean":"2024-09-05T02:16:22.899897+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:22.899897+0000","last_undegraded":"2024-09-05T02:16:22.899897+0000","last_fullsized":"2024-09-05T02:16:22.899897+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:39.304949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":23361,"num_write":910,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.390702+0000","last_change":"2024-09-05T00:49:31.895357+0000","last_active":"2024-09-05T02:14:01.390702+0000","last_peered":"2024-09-05T02:14:01.390702+0000","last_clean":"2024-09-05T02:14:01.390702+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:14:01.390702+0000","last_undegraded":"2024-09-05T02:14:01.390702+0000","last_fullsized":"2024-09-05T02:14:01.390702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:42.106138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'346","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:46.508089+0000","last_change":"2024-09-05T00:49:34.055522+0000","last_active":"2024-09-05T02:15:46.508089+0000","last_peered":"2024-09-05T02:15:46.508089+0000","last_clean":"2024-09-05T02:15:46.508089+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:15:46.508089+0000","last_undegraded":"2024-09-05T02:15:46.508089+0000","last_fullsized":"2024-09-05T02:15:46.508089+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:45:16.964827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452179+0000","last_change":"2024-09-05T00:49:35.926479+0000","last_active":"2024-09-05T02:12:55.452179+0000","last_peered":"2024-09-05T02:12:55.452179+0000","last_clean":"2024-09-05T02:12:55.452179+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:12:55.452179+0000","last_undegraded":"2024-09-05T02:12:55.452179+0000","last_fullsized":"2024-09-05T02:12:55.452179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:15:53.424417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'243","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.151838+0000","last_change":"2024-09-05T00:49:37.952280+0000","last_active":"2024-09-05T02:14:30.151838+0000","last_peered":"2024-09-05T02:14:30.151838+0000","last_clean":"2024-09-05T02:14:30.151838+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:14:30.151838+0000","last_undegraded":"2024-09-05T02:14:30.151838+0000","last_fullsized":"2024-09-05T02:14:30.151838+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:26.910581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1276","reported_seq":2925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.706457+0000","last_change":"2024-09-05T00:49:29.908449+0000","last_active":"2024-09-05T02:14:27.706457+0000","last_peered":"2024-09-05T02:14:27.706457+0000","last_clean":"2024-09-05T02:14:27.706457+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:14:27.706457+0000","last_undegraded":"2024-09-05T02:14:27.706457+0000","last_fullsized":"2024-09-05T02:14:27.706457+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209438+0000","last_change":"2024-09-05T00:49:19.815010+0000","last_active":"2024-09-05T02:12:40.209438+0000","last_peered":"2024-09-05T02:12:40.209438+0000","last_clean":"2024-09-05T02:12:40.209438+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:12:40.209438+0000","last_undegraded":"2024-09-05T02:12:40.209438+0000","last_fullsized":"2024-09-05T02:12:40.209438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:38.055770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'361","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.841787+0000","last_change":"2024-09-05T00:49:27.898358+0000","last_active":"2024-09-05T02:16:22.841787+0000","last_peered":"2024-09-05T02:16:22.841787+0000","last_clean":"2024-09-05T02:16:22.841787+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:22.841787+0000","last_undegraded":"2024-09-05T02:16:22.841787+0000","last_fullsized":"2024-09-05T02:16:22.841787+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:29.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":46632,"num_write":1174,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.456748+0000","last_change":"2024-09-05T00:49:31.910432+0000","last_active":"2024-09-05T02:13:15.456748+0000","last_peered":"2024-09-05T02:13:15.456748+0000","last_clean":"2024-09-05T02:13:15.456748+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:13:15.456748+0000","last_undegraded":"2024-09-05T02:13:15.456748+0000","last_fullsized":"2024-09-05T02:13:15.456748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:21:42.078643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.928708+0000","last_change":"2024-09-05T00:49:33.929270+0000","last_active":"2024-09-05T02:15:49.928708+0000","last_peered":"2024-09-05T02:15:49.928708+0000","last_clean":"2024-09-05T02:15:49.928708+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:15:49.928708+0000","last_undegraded":"2024-09-05T02:15:49.928708+0000","last_fullsized":"2024-09-05T02:15:49.928708+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:24:30.946732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.414541+0000","last_change":"2024-09-05T00:49:35.948033+0000","last_active":"2024-09-05T02:14:06.414541+0000","last_peered":"2024-09-05T02:14:06.414541+0000","last_clean":"2024-09-05T02:14:06.414541+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:14:06.414541+0000","last_undegraded":"2024-09-05T02:14:06.414541+0000","last_fullsized":"2024-09-05T02:14:06.414541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:58.062174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'117","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230591+0000","last_change":"2024-09-05T00:49:37.953956+0000","last_active":"2024-09-05T02:14:10.230591+0000","last_peered":"2024-09-05T02:14:10.230591+0000","last_clean":"2024-09-05T02:14:10.230591+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:14:10.230591+0000","last_undegraded":"2024-09-05T02:14:10.230591+0000","last_fullsized":"2024-09-05T02:14:10.230591+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:12.611232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'541","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.617732+0000","last_change":"2024-09-05T00:49:29.907763+0000","last_active":"2024-09-05T02:15:48.617732+0000","last_peered":"2024-09-05T02:15:48.617732+0000","last_clean":"2024-09-05T02:15:48.617732+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:15:48.617732+0000","last_undegraded":"2024-09-05T02:15:48.617732+0000","last_fullsized":"2024-09-05T02:15:48.617732+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:37:22.730148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'302","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.898584+0000","last_change":"2024-09-05T00:49:27.889027+0000","last_active":"2024-09-05T02:16:22.898584+0000","last_peered":"2024-09-05T02:16:22.898584+0000","last_clean":"2024-09-05T02:16:22.898584+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:16:22.898584+0000","last_undegraded":"2024-09-05T02:16:22.898584+0000","last_fullsized":"2024-09-05T02:16:22.898584+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:37.525116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":39042,"num_write":920,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:41.778371+0000","last_change":"2024-09-05T00:49:19.809494+0000","last_active":"2024-09-05T02:12:41.778371+0000","last_peered":"2024-09-05T02:12:41.778371+0000","last_clean":"2024-09-05T02:12:41.778371+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:12:41.778371+0000","last_undegraded":"2024-09-05T02:12:41.778371+0000","last_fullsized":"2024-09-05T02:12:41.778371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:15:41.183270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452119+0000","last_change":"2024-09-05T00:49:31.917058+0000","last_active":"2024-09-05T02:12:55.452119+0000","last_peered":"2024-09-05T02:12:55.452119+0000","last_clean":"2024-09-05T02:12:55.452119+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:12:55.452119+0000","last_undegraded":"2024-09-05T02:12:55.452119+0000","last_fullsized":"2024-09-05T02:12:55.452119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:09:49.645261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'678","reported_seq":1396,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.349231+0000","last_change":"2024-09-05T00:49:33.928573+0000","last_active":"2024-09-05T02:16:22.349231+0000","last_peered":"2024-09-05T02:16:22.349231+0000","last_clean":"2024-09-05T02:16:22.349231+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:16:22.349231+0000","last_undegraded":"2024-09-05T02:16:22.349231+0000","last_fullsized":"2024-09-05T02:16:22.349231+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:49:02.005394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1139,"num_read_kb":2483,"num_write":1010,"num_write_kb":799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216518+0000","last_change":"2024-09-05T00:49:35.938207+0000","last_active":"2024-09-05T02:12:56.216518+0000","last_peered":"2024-09-05T02:12:56.216518+0000","last_clean":"2024-09-05T02:12:56.216518+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:12:56.216518+0000","last_undegraded":"2024-09-05T02:12:56.216518+0000","last_fullsized":"2024-09-05T02:12:56.216518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:03.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.920772+0000","last_change":"2024-09-05T00:49:37.933639+0000","last_active":"2024-09-05T02:14:29.920772+0000","last_peered":"2024-09-05T02:14:29.920772+0000","last_clean":"2024-09-05T02:14:29.920772+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:14:29.920772+0000","last_undegraded":"2024-09-05T02:14:29.920772+0000","last_fullsized":"2024-09-05T02:14:29.920772+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:37.728081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'883","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701326+0000","last_change":"2024-09-05T00:49:29.913232+0000","last_active":"2024-09-05T02:14:27.701326+0000","last_peered":"2024-09-05T02:14:27.701326+0000","last_clean":"2024-09-05T02:14:27.701326+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:14:27.701326+0000","last_undegraded":"2024-09-05T02:14:27.701326+0000","last_fullsized":"2024-09-05T02:14:27.701326+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:24.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'321","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.873441+0000","last_change":"2024-09-05T00:49:27.879948+0000","last_active":"2024-09-05T02:16:22.873441+0000","last_peered":"2024-09-05T02:16:22.873441+0000","last_clean":"2024-09-05T02:16:22.873441+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:22.873441+0000","last_undegraded":"2024-09-05T02:16:22.873441+0000","last_fullsized":"2024-09-05T02:16:22.873441+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:21:52.199092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":37378,"num_write":1055,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826629+0000","last_change":"2024-09-05T00:49:20.850501+0000","last_active":"2024-09-05T02:12:51.826629+0000","last_peered":"2024-09-05T02:12:51.826629+0000","last_clean":"2024-09-05T02:12:51.826629+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:12:51.826629+0000","last_undegraded":"2024-09-05T02:12:51.826629+0000","last_fullsized":"2024-09-05T02:12:51.826629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:11.687606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.397897+0000","last_change":"2024-09-05T00:49:31.913143+0000","last_active":"2024-09-05T02:12:51.397897+0000","last_peered":"2024-09-05T02:12:51.397897+0000","last_clean":"2024-09-05T02:12:51.397897+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:12:51.397897+0000","last_undegraded":"2024-09-05T02:12:51.397897+0000","last_fullsized":"2024-09-05T02:12:51.397897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:26.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'204","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.781213+0000","last_change":"2024-09-05T00:49:34.054211+0000","last_active":"2024-09-05T02:12:56.781213+0000","last_peered":"2024-09-05T02:12:56.781213+0000","last_clean":"2024-09-05T02:12:56.781213+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:12:56.781213+0000","last_undegraded":"2024-09-05T02:12:56.781213+0000","last_fullsized":"2024-09-05T02:12:56.781213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:13.534123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'797","reported_seq":3278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.928718+0000","last_change":"2024-09-05T00:49:35.933822+0000","last_active":"2024-09-05T02:16:22.928718+0000","last_peered":"2024-09-05T02:16:22.928718+0000","last_clean":"2024-09-05T02:16:22.928718+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:16:22.928718+0000","last_undegraded":"2024-09-05T02:16:22.928718+0000","last_fullsized":"2024-09-05T02:16:22.928718+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'146","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:31.508344+0000","last_change":"2024-09-05T00:49:37.948757+0000","last_active":"2024-09-05T02:15:31.508344+0000","last_peered":"2024-09-05T02:15:31.508344+0000","last_clean":"2024-09-05T02:15:31.508344+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:15:31.508344+0000","last_undegraded":"2024-09-05T02:15:31.508344+0000","last_fullsized":"2024-09-05T02:15:31.508344+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:40.306605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'962","reported_seq":2550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487814+0000","last_change":"2024-09-05T00:49:29.927814+0000","last_active":"2024-09-05T02:13:51.487814+0000","last_peered":"2024-09-05T02:13:51.487814+0000","last_clean":"2024-09-05T02:13:51.487814+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:13:51.487814+0000","last_undegraded":"2024-09-05T02:13:51.487814+0000","last_fullsized":"2024-09-05T02:13:51.487814+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":900,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:53:13.267895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'412","reported_seq":1128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.902741+0000","last_change":"2024-09-05T00:49:27.910000+0000","last_active":"2024-09-05T02:16:22.902741+0000","last_peered":"2024-09-05T02:16:22.902741+0000","last_clean":"2024-09-05T02:16:22.902741+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:22.902741+0000","last_undegraded":"2024-09-05T02:16:22.902741+0000","last_fullsized":"2024-09-05T02:16:22.902741+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:27:09.939131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":754,"num_read_kb":36692,"num_write":1433,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792763+0000","last_change":"2024-09-05T00:49:19.809653+0000","last_active":"2024-09-05T02:13:51.792763+0000","last_peered":"2024-09-05T02:13:51.792763+0000","last_clean":"2024-09-05T02:13:51.792763+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:13:51.792763+0000","last_undegraded":"2024-09-05T02:13:51.792763+0000","last_fullsized":"2024-09-05T02:13:51.792763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:17.882937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.215403+0000","last_change":"2024-09-05T00:49:31.916181+0000","last_active":"2024-09-05T02:12:51.215403+0000","last_peered":"2024-09-05T02:12:51.215403+0000","last_clean":"2024-09-05T02:12:51.215403+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:12:51.215403+0000","last_undegraded":"2024-09-05T02:12:51.215403+0000","last_fullsized":"2024-09-05T02:12:51.215403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:16:28.018466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'156","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216578+0000","last_change":"2024-09-05T00:49:33.919913+0000","last_active":"2024-09-05T02:12:56.216578+0000","last_peered":"2024-09-05T02:12:56.216578+0000","last_clean":"2024-09-05T02:12:56.216578+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:12:56.216578+0000","last_undegraded":"2024-09-05T02:12:56.216578+0000","last_fullsized":"2024-09-05T02:12:56.216578+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:48.393350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":2788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.387607+0000","last_change":"2024-09-05T00:49:35.938148+0000","last_active":"2024-09-05T02:16:22.387607+0000","last_peered":"2024-09-05T02:16:22.387607+0000","last_clean":"2024-09-05T02:16:22.387607+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:22.387607+0000","last_undegraded":"2024-09-05T02:16:22.387607+0000","last_fullsized":"2024-09-05T02:16:22.387607+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:27.051091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'174","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452197+0000","last_change":"2024-09-05T00:49:37.954318+0000","last_active":"2024-09-05T02:12:55.452197+0000","last_peered":"2024-09-05T02:12:55.452197+0000","last_clean":"2024-09-05T02:12:55.452197+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:12:55.452197+0000","last_undegraded":"2024-09-05T02:12:55.452197+0000","last_fullsized":"2024-09-05T02:12:55.452197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:51.538774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'563","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.707331+0000","last_change":"2024-09-05T00:49:29.906133+0000","last_active":"2024-09-05T02:14:27.707331+0000","last_peered":"2024-09-05T02:14:27.707331+0000","last_clean":"2024-09-05T02:14:27.707331+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:14:27.707331+0000","last_undegraded":"2024-09-05T02:14:27.707331+0000","last_fullsized":"2024-09-05T02:14:27.707331+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:44.863527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'372","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.912208+0000","last_change":"2024-09-05T00:49:27.894589+0000","last_active":"2024-09-05T02:16:22.912208+0000","last_peered":"2024-09-05T02:16:22.912208+0000","last_clean":"2024-09-05T02:16:22.912208+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:16:22.912208+0000","last_undegraded":"2024-09-05T02:16:22.912208+0000","last_fullsized":"2024-09-05T02:16:22.912208+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:44.386284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306547,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":1286,"num_write":1063,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.411126+0000","last_change":"2024-09-05T00:49:20.240352+0000","last_active":"2024-09-05T02:13:51.411126+0000","last_peered":"2024-09-05T02:13:51.411126+0000","last_clean":"2024-09-05T02:13:51.411126+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:13:51.411126+0000","last_undegraded":"2024-09-05T02:13:51.411126+0000","last_fullsized":"2024-09-05T02:13:51.411126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:16.765157+0000","last_clean_scrub_stamp":"2024-09-05T00:49:16.765157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:04:57.883628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487854+0000","last_change":"2024-09-05T00:49:31.913300+0000","last_active":"2024-09-05T02:13:51.487854+0000","last_peered":"2024-09-05T02:13:51.487854+0000","last_clean":"2024-09-05T02:13:51.487854+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:13:51.487854+0000","last_undegraded":"2024-09-05T02:13:51.487854+0000","last_fullsized":"2024-09-05T02:13:51.487854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'759","reported_seq":1520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.732576+0000","last_change":"2024-09-05T00:49:34.054583+0000","last_active":"2024-09-05T02:16:22.732576+0000","last_peered":"2024-09-05T02:16:22.732576+0000","last_clean":"2024-09-05T02:16:22.732576+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:22.732576+0000","last_undegraded":"2024-09-05T02:16:22.732576+0000","last_fullsized":"2024-09-05T02:16:22.732576+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:41.332842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142523,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1322,"num_read_kb":3088,"num_write":1054,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.474955+0000","last_change":"2024-09-05T00:49:35.934315+0000","last_active":"2024-09-05T02:12:56.474955+0000","last_peered":"2024-09-05T02:12:56.474955+0000","last_clean":"2024-09-05T02:12:56.474955+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:12:56.474955+0000","last_undegraded":"2024-09-05T02:12:56.474955+0000","last_fullsized":"2024-09-05T02:12:56.474955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:47.877686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.213128+0000","last_change":"2024-09-05T00:49:37.942217+0000","last_active":"2024-09-05T02:12:55.213128+0000","last_peered":"2024-09-05T02:12:55.213128+0000","last_clean":"2024-09-05T02:12:55.213128+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:12:55.213128+0000","last_undegraded":"2024-09-05T02:12:55.213128+0000","last_fullsized":"2024-09-05T02:12:55.213128+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:07:48.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'136","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.069901+0000","last_change":"2024-09-05T00:49:37.943464+0000","last_active":"2024-09-05T02:14:30.069901+0000","last_peered":"2024-09-05T02:14:30.069901+0000","last_clean":"2024-09-05T02:14:30.069901+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:14:30.069901+0000","last_undegraded":"2024-09-05T02:14:30.069901+0000","last_fullsized":"2024-09-05T02:14:30.069901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:53.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'583","reported_seq":2215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.224203+0000","last_change":"2024-09-05T00:49:29.912807+0000","last_active":"2024-09-05T02:13:31.224203+0000","last_peered":"2024-09-05T02:13:31.224203+0000","last_clean":"2024-09-05T02:13:31.224203+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:13:31.224203+0000","last_undegraded":"2024-09-05T02:13:31.224203+0000","last_fullsized":"2024-09-05T02:13:31.224203+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":500,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'304","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.906728+0000","last_change":"2024-09-05T00:49:27.907668+0000","last_active":"2024-09-05T02:16:22.906728+0000","last_peered":"2024-09-05T02:16:22.906728+0000","last_clean":"2024-09-05T02:16:22.906728+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:22.906728+0000","last_undegraded":"2024-09-05T02:16:22.906728+0000","last_fullsized":"2024-09-05T02:16:22.906728+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:40.897083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524318,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":27235,"num_write":955,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.788861+0000","last_change":"2024-09-05T00:49:31.905642+0000","last_active":"2024-09-05T02:13:31.788861+0000","last_peered":"2024-09-05T02:13:31.788861+0000","last_clean":"2024-09-05T02:13:31.788861+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:13:31.788861+0000","last_undegraded":"2024-09-05T02:13:31.788861+0000","last_fullsized":"2024-09-05T02:13:31.788861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:00.091113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'315","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.870697+0000","last_change":"2024-09-05T00:49:33.930112+0000","last_active":"2024-09-05T02:16:21.870697+0000","last_peered":"2024-09-05T02:16:21.870697+0000","last_clean":"2024-09-05T02:16:21.870697+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:16:21.870697+0000","last_undegraded":"2024-09-05T02:16:21.870697+0000","last_fullsized":"2024-09-05T02:16:21.870697+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:14.000620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43168,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1204,"num_write":426,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.484298+0000","last_change":"2024-09-05T00:49:35.939413+0000","last_active":"2024-09-05T02:13:36.484298+0000","last_peered":"2024-09-05T02:13:36.484298+0000","last_clean":"2024-09-05T02:13:36.484298+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:13:36.484298+0000","last_undegraded":"2024-09-05T02:13:36.484298+0000","last_fullsized":"2024-09-05T02:13:36.484298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.914012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'371","reported_seq":1835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623686+0000","last_change":"2024-09-05T00:49:29.890020+0000","last_active":"2024-09-05T02:14:29.623686+0000","last_peered":"2024-09-05T02:14:29.623686+0000","last_clean":"2024-09-05T02:14:29.623686+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:14:29.623686+0000","last_undegraded":"2024-09-05T02:14:29.623686+0000","last_fullsized":"2024-09-05T02:14:29.623686+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:34.765894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'303","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.917038+0000","last_change":"2024-09-05T00:49:27.905154+0000","last_active":"2024-09-05T02:16:22.917038+0000","last_peered":"2024-09-05T02:16:22.917038+0000","last_clean":"2024-09-05T02:16:22.917038+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:22.917038+0000","last_undegraded":"2024-09-05T02:16:22.917038+0000","last_fullsized":"2024-09-05T02:16:22.917038+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:44.309565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":54962,"num_write":1038,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483453+0000","last_change":"2024-09-05T00:49:31.910668+0000","last_active":"2024-09-05T02:13:31.483453+0000","last_peered":"2024-09-05T02:13:31.483453+0000","last_clean":"2024-09-05T02:13:31.483453+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:13:31.483453+0000","last_undegraded":"2024-09-05T02:13:31.483453+0000","last_fullsized":"2024-09-05T02:13:31.483453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:49.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461072+0000","last_change":"2024-09-05T00:49:33.915459+0000","last_active":"2024-09-05T02:13:35.461072+0000","last_peered":"2024-09-05T02:13:35.461072+0000","last_clean":"2024-09-05T02:13:35.461072+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:13:35.461072+0000","last_undegraded":"2024-09-05T02:13:35.461072+0000","last_fullsized":"2024-09-05T02:13:35.461072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626911+0000","last_change":"2024-09-05T00:49:35.935530+0000","last_active":"2024-09-05T02:13:36.626911+0000","last_peered":"2024-09-05T02:13:36.626911+0000","last_clean":"2024-09-05T02:13:36.626911+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:13:36.626911+0000","last_undegraded":"2024-09-05T02:13:36.626911+0000","last_fullsized":"2024-09-05T02:13:36.626911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:22:34.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'228","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.905325+0000","last_change":"2024-09-05T00:49:37.926241+0000","last_active":"2024-09-05T02:14:29.905325+0000","last_peered":"2024-09-05T02:14:29.905325+0000","last_clean":"2024-09-05T02:14:29.905325+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:14:29.905325+0000","last_undegraded":"2024-09-05T02:14:29.905325+0000","last_fullsized":"2024-09-05T02:14:29.905325+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:25.119785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'412","reported_seq":1998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.697308+0000","last_change":"2024-09-05T00:49:29.927723+0000","last_active":"2024-09-05T02:15:48.697308+0000","last_peered":"2024-09-05T02:15:48.697308+0000","last_clean":"2024-09-05T02:15:48.697308+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:15:48.697308+0000","last_undegraded":"2024-09-05T02:15:48.697308+0000","last_fullsized":"2024-09-05T02:15:48.697308+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:50.458783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'309","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.921920+0000","last_change":"2024-09-05T00:49:27.911758+0000","last_active":"2024-09-05T02:16:22.921920+0000","last_peered":"2024-09-05T02:16:22.921920+0000","last_clean":"2024-09-05T02:16:22.921920+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:16:22.921920+0000","last_undegraded":"2024-09-05T02:16:22.921920+0000","last_fullsized":"2024-09-05T02:16:22.921920+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:11:19.729173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":91576,"num_write":1030,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836079+0000","last_change":"2024-09-05T00:49:31.926718+0000","last_active":"2024-09-05T02:13:31.836079+0000","last_peered":"2024-09-05T02:13:31.836079+0000","last_clean":"2024-09-05T02:13:31.836079+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:13:31.836079+0000","last_undegraded":"2024-09-05T02:13:31.836079+0000","last_fullsized":"2024-09-05T02:13:31.836079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:51:03.171626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.174204+0000","last_change":"2024-09-05T00:49:33.930627+0000","last_active":"2024-09-05T02:16:21.174204+0000","last_peered":"2024-09-05T02:16:21.174204+0000","last_clean":"2024-09-05T02:16:21.174204+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:21.174204+0000","last_undegraded":"2024-09-05T02:16:21.174204+0000","last_fullsized":"2024-09-05T02:16:21.174204+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:57:28.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407690+0000","last_change":"2024-09-05T00:49:35.948016+0000","last_active":"2024-09-05T02:13:36.407690+0000","last_peered":"2024-09-05T02:13:36.407690+0000","last_clean":"2024-09-05T02:13:36.407690+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:13:36.407690+0000","last_undegraded":"2024-09-05T02:13:36.407690+0000","last_fullsized":"2024-09-05T02:13:36.407690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.587514+0000","last_change":"2024-09-05T00:49:37.946851+0000","last_active":"2024-09-05T02:14:29.587514+0000","last_peered":"2024-09-05T02:14:29.587514+0000","last_clean":"2024-09-05T02:14:29.587514+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:14:29.587514+0000","last_undegraded":"2024-09-05T02:14:29.587514+0000","last_fullsized":"2024-09-05T02:14:29.587514+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:32.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483310+0000","last_change":"2024-09-05T00:49:29.924987+0000","last_active":"2024-09-05T02:13:31.483310+0000","last_peered":"2024-09-05T02:13:31.483310+0000","last_clean":"2024-09-05T02:13:31.483310+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:13:31.483310+0000","last_undegraded":"2024-09-05T02:13:31.483310+0000","last_fullsized":"2024-09-05T02:13:31.483310+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:54:10.390860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'336","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.866288+0000","last_change":"2024-09-05T00:49:27.894130+0000","last_active":"2024-09-05T02:16:22.866288+0000","last_peered":"2024-09-05T02:16:22.866288+0000","last_clean":"2024-09-05T02:16:22.866288+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:16:22.866288+0000","last_undegraded":"2024-09-05T02:16:22.866288+0000","last_fullsized":"2024-09-05T02:16:22.866288+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:56.396000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342090,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":6648,"num_write":1112,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.406490+0000","last_change":"2024-09-05T00:49:31.923471+0000","last_active":"2024-09-05T02:13:31.406490+0000","last_peered":"2024-09-05T02:13:31.406490+0000","last_clean":"2024-09-05T02:13:31.406490+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:13:31.406490+0000","last_undegraded":"2024-09-05T02:13:31.406490+0000","last_fullsized":"2024-09-05T02:13:31.406490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:09.929132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'298","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.936100+0000","last_change":"2024-09-05T00:49:33.908585+0000","last_active":"2024-09-05T02:16:22.936100+0000","last_peered":"2024-09-05T02:16:22.936100+0000","last_clean":"2024-09-05T02:16:22.936100+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:16:22.936100+0000","last_undegraded":"2024-09-05T02:16:22.936100+0000","last_fullsized":"2024-09-05T02:16:22.936100+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:52.420648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1205,"num_write":416,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461188+0000","last_change":"2024-09-05T00:49:35.943952+0000","last_active":"2024-09-05T02:13:35.461188+0000","last_peered":"2024-09-05T02:13:35.461188+0000","last_clean":"2024-09-05T02:13:35.461188+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:13:35.461188+0000","last_undegraded":"2024-09-05T02:13:35.461188+0000","last_fullsized":"2024-09-05T02:13:35.461188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:48.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'398","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:28.052618+0000","last_change":"2024-09-05T00:49:29.903345+0000","last_active":"2024-09-05T02:13:28.052618+0000","last_peered":"2024-09-05T02:13:28.052618+0000","last_clean":"2024-09-05T02:13:28.052618+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:13:28.052618+0000","last_undegraded":"2024-09-05T02:13:28.052618+0000","last_fullsized":"2024-09-05T02:13:28.052618+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:55:40.567779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'326","reported_seq":1187,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.894072+0000","last_change":"2024-09-05T00:49:27.884147+0000","last_active":"2024-09-05T02:16:22.894072+0000","last_peered":"2024-09-05T02:16:22.894072+0000","last_clean":"2024-09-05T02:16:22.894072+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:22.894072+0000","last_undegraded":"2024-09-05T02:16:22.894072+0000","last_fullsized":"2024-09-05T02:16:22.894072+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:59:47.503408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":908,"num_read_kb":44981,"num_write":1071,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.574981+0000","last_change":"2024-09-05T00:49:31.915305+0000","last_active":"2024-09-05T02:16:20.574981+0000","last_peered":"2024-09-05T02:16:20.574981+0000","last_clean":"2024-09-05T02:16:20.574981+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:16:20.574981+0000","last_undegraded":"2024-09-05T02:16:20.574981+0000","last_fullsized":"2024-09-05T02:16:20.574981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:46.356538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'534","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.876628+0000","last_change":"2024-09-05T00:49:33.912309+0000","last_active":"2024-09-05T02:16:22.876628+0000","last_peered":"2024-09-05T02:16:22.876628+0000","last_clean":"2024-09-05T02:16:22.876628+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:22.876628+0000","last_undegraded":"2024-09-05T02:16:22.876628+0000","last_fullsized":"2024-09-05T02:16:22.876628+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:19:37.409372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90605,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":950,"num_read_kb":2270,"num_write":820,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.201299+0000","last_change":"2024-09-05T00:49:35.938332+0000","last_active":"2024-09-05T02:12:05.201299+0000","last_peered":"2024-09-05T02:12:05.201299+0000","last_clean":"2024-09-05T02:12:05.201299+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:12:05.201299+0000","last_undegraded":"2024-09-05T02:12:05.201299+0000","last_fullsized":"2024-09-05T02:12:05.201299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:56:14.582023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'181","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485412+0000","last_change":"2024-09-05T00:49:37.953067+0000","last_active":"2024-09-05T02:13:41.485412+0000","last_peered":"2024-09-05T02:13:41.485412+0000","last_clean":"2024-09-05T02:13:41.485412+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:13:41.485412+0000","last_undegraded":"2024-09-05T02:13:41.485412+0000","last_fullsized":"2024-09-05T02:13:41.485412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:56.679412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'420","reported_seq":1990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.465509+0000","last_change":"2024-09-05T00:49:29.904429+0000","last_active":"2024-09-05T02:13:50.465509+0000","last_peered":"2024-09-05T02:13:50.465509+0000","last_clean":"2024-09-05T02:13:50.465509+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:13:50.465509+0000","last_undegraded":"2024-09-05T02:13:50.465509+0000","last_fullsized":"2024-09-05T02:13:50.465509+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:12.986135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'340","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.902976+0000","last_change":"2024-09-05T00:49:27.881769+0000","last_active":"2024-09-05T02:16:22.902976+0000","last_peered":"2024-09-05T02:16:22.902976+0000","last_clean":"2024-09-05T02:16:22.902976+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:22.902976+0000","last_undegraded":"2024-09-05T02:16:22.902976+0000","last_fullsized":"2024-09-05T02:16:22.902976+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:21.143493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":27594,"num_write":1025,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.398020+0000","last_change":"2024-09-05T00:49:31.923706+0000","last_active":"2024-09-05T02:12:51.398020+0000","last_peered":"2024-09-05T02:12:51.398020+0000","last_clean":"2024-09-05T02:12:51.398020+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:12:51.398020+0000","last_undegraded":"2024-09-05T02:12:51.398020+0000","last_fullsized":"2024-09-05T02:12:51.398020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:07:49.078789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'334","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.028866+0000","last_change":"2024-09-05T00:49:33.917339+0000","last_active":"2024-09-05T02:16:21.028866+0000","last_peered":"2024-09-05T02:16:21.028866+0000","last_clean":"2024-09-05T02:16:21.028866+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:21.028866+0000","last_undegraded":"2024-09-05T02:16:21.028866+0000","last_fullsized":"2024-09-05T02:16:21.028866+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:34.348566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.770357+0000","last_change":"2024-09-05T00:49:35.924621+0000","last_active":"2024-09-05T02:12:06.770357+0000","last_peered":"2024-09-05T02:12:06.770357+0000","last_clean":"2024-09-05T02:12:06.770357+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:12:06.770357+0000","last_undegraded":"2024-09-05T02:12:06.770357+0000","last_fullsized":"2024-09-05T02:12:06.770357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:29.284134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.408737+0000","last_change":"2024-09-05T00:49:37.931246+0000","last_active":"2024-09-05T02:13:41.408737+0000","last_peered":"2024-09-05T02:13:41.408737+0000","last_clean":"2024-09-05T02:13:41.408737+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:13:41.408737+0000","last_undegraded":"2024-09-05T02:13:41.408737+0000","last_fullsized":"2024-09-05T02:13:41.408737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:20.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'493","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709348+0000","last_change":"2024-09-05T00:49:29.925442+0000","last_active":"2024-09-05T02:14:27.709348+0000","last_peered":"2024-09-05T02:14:27.709348+0000","last_clean":"2024-09-05T02:14:27.709348+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:14:27.709348+0000","last_undegraded":"2024-09-05T02:14:27.709348+0000","last_fullsized":"2024-09-05T02:14:27.709348+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:04.486708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'319","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.923164+0000","last_change":"2024-09-05T00:49:27.883246+0000","last_active":"2024-09-05T02:16:22.923164+0000","last_peered":"2024-09-05T02:16:22.923164+0000","last_clean":"2024-09-05T02:16:22.923164+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:22.923164+0000","last_undegraded":"2024-09-05T02:16:22.923164+0000","last_fullsized":"2024-09-05T02:16:22.923164+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:38:45.620263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":39348,"num_write":968,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.204119+0000","last_change":"2024-09-05T00:49:31.923994+0000","last_active":"2024-09-05T02:12:01.204119+0000","last_peered":"2024-09-05T02:12:01.204119+0000","last_clean":"2024-09-05T02:12:01.204119+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:12:01.204119+0000","last_undegraded":"2024-09-05T02:12:01.204119+0000","last_fullsized":"2024-09-05T02:12:01.204119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:56.251468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'320","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.098002+0000","last_change":"2024-09-05T00:49:34.055772+0000","last_active":"2024-09-05T02:16:22.098002+0000","last_peered":"2024-09-05T02:16:22.098002+0000","last_clean":"2024-09-05T02:16:22.098002+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:16:22.098002+0000","last_undegraded":"2024-09-05T02:16:22.098002+0000","last_fullsized":"2024-09-05T02:16:22.098002+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:58.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":1207,"num_write":432,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.792016+0000","last_change":"2024-09-05T00:49:35.935059+0000","last_active":"2024-09-05T02:13:46.792016+0000","last_peered":"2024-09-05T02:13:46.792016+0000","last_clean":"2024-09-05T02:13:46.792016+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:13:46.792016+0000","last_undegraded":"2024-09-05T02:13:46.792016+0000","last_fullsized":"2024-09-05T02:13:46.792016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:18:31.249785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'106","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.686139+0000","last_change":"2024-09-05T00:49:37.938971+0000","last_active":"2024-09-05T02:15:49.686139+0000","last_peered":"2024-09-05T02:15:49.686139+0000","last_clean":"2024-09-05T02:15:49.686139+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:15:49.686139+0000","last_undegraded":"2024-09-05T02:15:49.686139+0000","last_fullsized":"2024-09-05T02:15:49.686139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:26.724944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.621488+0000","last_change":"2024-09-05T00:49:29.900558+0000","last_active":"2024-09-05T02:15:48.621488+0000","last_peered":"2024-09-05T02:15:48.621488+0000","last_clean":"2024-09-05T02:15:48.621488+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:15:48.621488+0000","last_undegraded":"2024-09-05T02:15:48.621488+0000","last_fullsized":"2024-09-05T02:15:48.621488+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:58:48.677192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'396","reported_seq":1096,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.861705+0000","last_change":"2024-09-05T00:49:27.876740+0000","last_active":"2024-09-05T02:16:22.861705+0000","last_peered":"2024-09-05T02:16:22.861705+0000","last_clean":"2024-09-05T02:16:22.861705+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:16:22.861705+0000","last_undegraded":"2024-09-05T02:16:22.861705+0000","last_fullsized":"2024-09-05T02:16:22.861705+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:04:11.453294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642858,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":739,"num_read_kb":25030,"num_write":1256,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.769113+0000","last_change":"2024-09-05T00:49:31.926005+0000","last_active":"2024-09-05T02:12:01.769113+0000","last_peered":"2024-09-05T02:12:01.769113+0000","last_clean":"2024-09-05T02:12:01.769113+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:12:01.769113+0000","last_undegraded":"2024-09-05T02:12:01.769113+0000","last_fullsized":"2024-09-05T02:12:01.769113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:56.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228677+0000","last_change":"2024-09-05T00:49:34.053064+0000","last_active":"2024-09-05T02:13:51.228677+0000","last_peered":"2024-09-05T02:13:51.228677+0000","last_clean":"2024-09-05T02:13:51.228677+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:13:51.228677+0000","last_undegraded":"2024-09-05T02:13:51.228677+0000","last_fullsized":"2024-09-05T02:13:51.228677+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:16.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'771","reported_seq":2981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.389771+0000","last_change":"2024-09-05T00:49:35.932657+0000","last_active":"2024-09-05T02:16:22.389771+0000","last_peered":"2024-09-05T02:16:22.389771+0000","last_clean":"2024-09-05T02:16:22.389771+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:22.389771+0000","last_undegraded":"2024-09-05T02:16:22.389771+0000","last_fullsized":"2024-09-05T02:16:22.389771+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:55.080143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.628035+0000","last_change":"2024-09-05T00:49:37.942533+0000","last_active":"2024-09-05T02:13:41.628035+0000","last_peered":"2024-09-05T02:13:41.628035+0000","last_clean":"2024-09-05T02:13:41.628035+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:13:41.628035+0000","last_undegraded":"2024-09-05T02:13:41.628035+0000","last_fullsized":"2024-09-05T02:13:41.628035+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:02:29.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'867","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629749+0000","last_change":"2024-09-05T00:49:29.918570+0000","last_active":"2024-09-05T02:14:29.629749+0000","last_peered":"2024-09-05T02:14:29.629749+0000","last_clean":"2024-09-05T02:14:29.629749+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:14:29.629749+0000","last_undegraded":"2024-09-05T02:14:29.629749+0000","last_fullsized":"2024-09-05T02:14:29.629749+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:50.098868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'284","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.871547+0000","last_change":"2024-09-05T00:49:27.898399+0000","last_active":"2024-09-05T02:16:22.871547+0000","last_peered":"2024-09-05T02:16:22.871547+0000","last_clean":"2024-09-05T02:16:22.871547+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:16:22.871547+0000","last_undegraded":"2024-09-05T02:16:22.871547+0000","last_fullsized":"2024-09-05T02:16:22.871547+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:30.481449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":6339,"num_write":869,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.814573+0000","last_change":"2024-09-05T00:49:31.924947+0000","last_active":"2024-09-05T02:12:01.814573+0000","last_peered":"2024-09-05T02:12:01.814573+0000","last_clean":"2024-09-05T02:12:01.814573+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:12:01.814573+0000","last_undegraded":"2024-09-05T02:12:01.814573+0000","last_fullsized":"2024-09-05T02:12:01.814573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:00:06.551471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'382","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.483412+0000","last_change":"2024-09-05T00:49:33.910494+0000","last_active":"2024-09-05T02:16:22.483412+0000","last_peered":"2024-09-05T02:16:22.483412+0000","last_clean":"2024-09-05T02:16:22.483412+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:16:22.483412+0000","last_undegraded":"2024-09-05T02:16:22.483412+0000","last_fullsized":"2024-09-05T02:16:22.483412+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:46.890368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47763,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":623,"num_read_kb":1294,"num_write":490,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:45.434154+0000","last_change":"2024-09-05T00:49:35.941463+0000","last_active":"2024-09-05T02:11:45.434154+0000","last_peered":"2024-09-05T02:11:45.434154+0000","last_clean":"2024-09-05T02:11:45.434154+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:11:45.434154+0000","last_undegraded":"2024-09-05T02:11:45.434154+0000","last_fullsized":"2024-09-05T02:11:45.434154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:09:14.296731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'194","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.273394+0000","last_change":"2024-09-05T00:49:37.946192+0000","last_active":"2024-09-05T02:14:25.273394+0000","last_peered":"2024-09-05T02:14:25.273394+0000","last_clean":"2024-09-05T02:14:25.273394+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:14:25.273394+0000","last_undegraded":"2024-09-05T02:14:25.273394+0000","last_fullsized":"2024-09-05T02:14:25.273394+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:46.109450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'731","reported_seq":2519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842408+0000","last_change":"2024-09-05T00:49:29.916165+0000","last_active":"2024-09-05T02:14:19.842408+0000","last_peered":"2024-09-05T02:14:19.842408+0000","last_clean":"2024-09-05T02:14:19.842408+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:14:19.842408+0000","last_undegraded":"2024-09-05T02:14:19.842408+0000","last_fullsized":"2024-09-05T02:14:19.842408+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":700,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:54:04.834607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'409","reported_seq":1141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.925523+0000","last_change":"2024-09-05T00:49:27.889993+0000","last_active":"2024-09-05T02:16:22.925523+0000","last_peered":"2024-09-05T02:16:22.925523+0000","last_clean":"2024-09-05T02:16:22.925523+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:16:22.925523+0000","last_undegraded":"2024-09-05T02:16:22.925523+0000","last_fullsized":"2024-09-05T02:16:22.925523+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:01.461692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080041,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":137827,"num_write":1317,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"35'3","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.574873+0000","last_change":"2024-09-05T00:49:31.903883+0000","last_active":"2024-09-05T02:16:20.574873+0000","last_peered":"2024-09-05T02:16:20.574873+0000","last_clean":"2024-09-05T02:16:20.574873+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:16:20.574873+0000","last_undegraded":"2024-09-05T02:16:20.574873+0000","last_fullsized":"2024-09-05T02:16:20.574873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:46.830057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'300","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.550849+0000","last_change":"2024-09-05T00:49:33.909608+0000","last_active":"2024-09-05T02:16:22.550849+0000","last_peered":"2024-09-05T02:16:22.550849+0000","last_clean":"2024-09-05T02:16:22.550849+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:16:22.550849+0000","last_undegraded":"2024-09-05T02:16:22.550849+0000","last_fullsized":"2024-09-05T02:16:22.550849+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:02.770171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47523,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":500,"num_read_kb":1144,"num_write":402,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.388458+0000","last_change":"2024-09-05T00:49:35.941006+0000","last_active":"2024-09-05T02:12:06.388458+0000","last_peered":"2024-09-05T02:12:06.388458+0000","last_clean":"2024-09-05T02:12:06.388458+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:12:06.388458+0000","last_undegraded":"2024-09-05T02:12:06.388458+0000","last_fullsized":"2024-09-05T02:12:06.388458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:09.389985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.457891+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:11:51.457891+0000","last_peered":"2024-09-05T02:11:51.457891+0000","last_clean":"2024-09-05T02:11:51.457891+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:11:51.457891+0000","last_undegraded":"2024-09-05T02:11:51.457891+0000","last_fullsized":"2024-09-05T02:11:51.457891+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:49.316615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'474","reported_seq":2064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.709554+0000","last_change":"2024-09-05T00:49:29.913963+0000","last_active":"2024-09-05T02:14:27.709554+0000","last_peered":"2024-09-05T02:14:27.709554+0000","last_clean":"2024-09-05T02:14:27.709554+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:14:27.709554+0000","last_undegraded":"2024-09-05T02:14:27.709554+0000","last_fullsized":"2024-09-05T02:14:27.709554+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:53.563132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'317","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.886670+0000","last_change":"2024-09-05T00:49:27.884322+0000","last_active":"2024-09-05T02:16:22.886670+0000","last_peered":"2024-09-05T02:16:22.886670+0000","last_clean":"2024-09-05T02:16:22.886670+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:22.886670+0000","last_undegraded":"2024-09-05T02:16:22.886670+0000","last_fullsized":"2024-09-05T02:16:22.886670+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:07:06.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":12836,"num_write":1013,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:41.199016+0000","last_change":"2024-09-05T00:49:31.918942+0000","last_active":"2024-09-05T02:11:41.199016+0000","last_peered":"2024-09-05T02:11:41.199016+0000","last_clean":"2024-09-05T02:11:41.199016+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:11:41.199016+0000","last_undegraded":"2024-09-05T02:11:41.199016+0000","last_fullsized":"2024-09-05T02:11:41.199016+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:32.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.979102+0000","last_change":"2024-09-05T00:49:33.927237+0000","last_active":"2024-09-05T02:16:21.979102+0000","last_peered":"2024-09-05T02:16:21.979102+0000","last_clean":"2024-09-05T02:16:21.979102+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:16:21.979102+0000","last_undegraded":"2024-09-05T02:16:21.979102+0000","last_fullsized":"2024-09-05T02:16:21.979102+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:38:43.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47269,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1091,"num_write":358,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.205283+0000","last_change":"2024-09-05T00:49:35.925928+0000","last_active":"2024-09-05T02:12:06.205283+0000","last_peered":"2024-09-05T02:12:06.205283+0000","last_clean":"2024-09-05T02:12:06.205283+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:12:06.205283+0000","last_undegraded":"2024-09-05T02:12:06.205283+0000","last_fullsized":"2024-09-05T02:12:06.205283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:21.943807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'165","reported_seq":1643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.053963+0000","last_change":"2024-09-05T00:49:37.943592+0000","last_active":"2024-09-05T02:14:29.053963+0000","last_peered":"2024-09-05T02:14:29.053963+0000","last_clean":"2024-09-05T02:14:29.053963+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:14:29.053963+0000","last_undegraded":"2024-09-05T02:14:29.053963+0000","last_fullsized":"2024-09-05T02:14:29.053963+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:04.586566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'343","reported_seq":1852,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.232009+0000","last_change":"2024-09-05T00:49:29.916442+0000","last_active":"2024-09-05T02:14:06.232009+0000","last_peered":"2024-09-05T02:14:06.232009+0000","last_clean":"2024-09-05T02:14:06.232009+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:14:06.232009+0000","last_undegraded":"2024-09-05T02:14:06.232009+0000","last_fullsized":"2024-09-05T02:14:06.232009+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:01:17.033809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'352","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.848828+0000","last_change":"2024-09-05T00:49:27.894135+0000","last_active":"2024-09-05T02:16:22.848828+0000","last_peered":"2024-09-05T02:16:22.848828+0000","last_clean":"2024-09-05T02:16:22.848828+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:16:22.848828+0000","last_undegraded":"2024-09-05T02:16:22.848828+0000","last_fullsized":"2024-09-05T02:16:22.848828+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:13:02.014569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8860,"num_write":1095,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766535+0000","last_change":"2024-09-05T00:49:31.903736+0000","last_active":"2024-09-05T02:11:51.766535+0000","last_peered":"2024-09-05T02:11:51.766535+0000","last_clean":"2024-09-05T02:11:51.766535+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:11:51.766535+0000","last_undegraded":"2024-09-05T02:11:51.766535+0000","last_fullsized":"2024-09-05T02:11:51.766535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:35.531703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'337","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.172371+0000","last_change":"2024-09-05T00:49:33.908269+0000","last_active":"2024-09-05T02:16:22.172371+0000","last_peered":"2024-09-05T02:16:22.172371+0000","last_clean":"2024-09-05T02:16:22.172371+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:16:22.172371+0000","last_undegraded":"2024-09-05T02:16:22.172371+0000","last_fullsized":"2024-09-05T02:16:22.172371+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:50.246291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":1162,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.439359+0000","last_change":"2024-09-05T00:49:35.940921+0000","last_active":"2024-09-05T02:12:05.439359+0000","last_peered":"2024-09-05T02:12:05.439359+0000","last_clean":"2024-09-05T02:12:05.439359+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:12:05.439359+0000","last_undegraded":"2024-09-05T02:12:05.439359+0000","last_fullsized":"2024-09-05T02:12:05.439359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:45:23.954287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.723417+0000","last_change":"2024-09-05T00:49:37.929472+0000","last_active":"2024-09-05T02:15:48.723417+0000","last_peered":"2024-09-05T02:15:48.723417+0000","last_clean":"2024-09-05T02:15:48.723417+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:15:48.723417+0000","last_undegraded":"2024-09-05T02:15:48.723417+0000","last_fullsized":"2024-09-05T02:15:48.723417+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:25.886624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'429","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.624104+0000","last_change":"2024-09-05T00:49:29.892206+0000","last_active":"2024-09-05T02:14:29.624104+0000","last_peered":"2024-09-05T02:14:29.624104+0000","last_clean":"2024-09-05T02:14:29.624104+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:14:29.624104+0000","last_undegraded":"2024-09-05T02:14:29.624104+0000","last_fullsized":"2024-09-05T02:14:29.624104+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:04.846605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'368","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.860512+0000","last_change":"2024-09-05T00:49:27.897228+0000","last_active":"2024-09-05T02:16:22.860512+0000","last_peered":"2024-09-05T02:16:22.860512+0000","last_clean":"2024-09-05T02:16:22.860512+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:22.860512+0000","last_undegraded":"2024-09-05T02:16:22.860512+0000","last_fullsized":"2024-09-05T02:16:22.860512+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:59.446972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":487,"num_read_kb":8853,"num_write":1134,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1142","reported_seq":2633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794691+0000","last_change":"2024-09-05T00:49:29.906381+0000","last_active":"2024-09-05T02:14:01.794691+0000","last_peered":"2024-09-05T02:14:01.794691+0000","last_clean":"2024-09-05T02:14:01.794691+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:14:01.794691+0000","last_undegraded":"2024-09-05T02:14:01.794691+0000","last_fullsized":"2024-09-05T02:14:01.794691+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:43.942826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'329","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.889242+0000","last_change":"2024-09-05T00:50:04.182383+0000","last_active":"2024-09-05T02:16:22.889242+0000","last_peered":"2024-09-05T02:16:22.889242+0000","last_clean":"2024-09-05T02:16:22.889242+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:22.889242+0000","last_undegraded":"2024-09-05T02:16:22.889242+0000","last_fullsized":"2024-09-05T02:16:22.889242+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:45.984207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":102142,"num_write":1127,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228410+0000","last_change":"2024-09-05T00:49:29.905701+0000","last_active":"2024-09-05T02:14:00.228410+0000","last_peered":"2024-09-05T02:14:00.228410+0000","last_clean":"2024-09-05T02:14:00.228410+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:14:00.228410+0000","last_undegraded":"2024-09-05T02:14:00.228410+0000","last_fullsized":"2024-09-05T02:14:00.228410+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:35:29.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'305","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.864757+0000","last_change":"2024-09-05T00:49:27.894703+0000","last_active":"2024-09-05T02:16:22.864757+0000","last_peered":"2024-09-05T02:16:22.864757+0000","last_clean":"2024-09-05T02:16:22.864757+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:16:22.864757+0000","last_undegraded":"2024-09-05T02:16:22.864757+0000","last_fullsized":"2024-09-05T02:16:22.864757+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:39.484088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":411,"num_write":976,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'414","reported_seq":1989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794636+0000","last_change":"2024-09-05T00:49:29.909413+0000","last_active":"2024-09-05T02:14:01.794636+0000","last_peered":"2024-09-05T02:14:01.794636+0000","last_clean":"2024-09-05T02:14:01.794636+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:14:01.794636+0000","last_undegraded":"2024-09-05T02:14:01.794636+0000","last_fullsized":"2024-09-05T02:14:01.794636+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:27.400669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'314","reported_seq":1061,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.860020+0000","last_change":"2024-09-05T00:49:27.869339+0000","last_active":"2024-09-05T02:16:22.860020+0000","last_peered":"2024-09-05T02:16:22.860020+0000","last_clean":"2024-09-05T02:16:22.860020+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:16:22.860020+0000","last_undegraded":"2024-09-05T02:16:22.860020+0000","last_fullsized":"2024-09-05T02:16:22.860020+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:57.416708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":737,"num_read_kb":8229,"num_write":1002,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1680","reported_seq":3527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.613554+0000","last_change":"2024-09-05T00:49:29.928238+0000","last_active":"2024-09-05T02:15:48.613554+0000","last_peered":"2024-09-05T02:15:48.613554+0000","last_clean":"2024-09-05T02:15:48.613554+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:15:48.613554+0000","last_undegraded":"2024-09-05T02:15:48.613554+0000","last_fullsized":"2024-09-05T02:15:48.613554+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":1600,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:49.778085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'360","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.923430+0000","last_change":"2024-09-05T00:49:27.883474+0000","last_active":"2024-09-05T02:16:22.923430+0000","last_peered":"2024-09-05T02:16:22.923430+0000","last_clean":"2024-09-05T02:16:22.923430+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:22.923430+0000","last_undegraded":"2024-09-05T02:16:22.923430+0000","last_fullsized":"2024-09-05T02:16:22.923430+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:51.869968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":75263,"num_write":1071,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'622","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:32.857581+0000","last_change":"2024-09-05T00:49:29.911388+0000","last_active":"2024-09-05T02:13:32.857581+0000","last_peered":"2024-09-05T02:13:32.857581+0000","last_clean":"2024-09-05T02:13:32.857581+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:13:32.857581+0000","last_undegraded":"2024-09-05T02:13:32.857581+0000","last_fullsized":"2024-09-05T02:13:32.857581+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:34:27.266690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'352","reported_seq":1029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.866896+0000","last_change":"2024-09-05T00:49:27.884310+0000","last_active":"2024-09-05T02:16:22.866896+0000","last_peered":"2024-09-05T02:16:22.866896+0000","last_clean":"2024-09-05T02:16:22.866896+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:22.866896+0000","last_undegraded":"2024-09-05T02:16:22.866896+0000","last_fullsized":"2024-09-05T02:16:22.866896+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:03.108303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453457,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":27144,"num_write":1118,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'683","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.629116+0000","last_change":"2024-09-05T00:49:29.925070+0000","last_active":"2024-09-05T02:15:48.629116+0000","last_peered":"2024-09-05T02:15:48.629116+0000","last_clean":"2024-09-05T02:15:48.629116+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:15:48.629116+0000","last_undegraded":"2024-09-05T02:15:48.629116+0000","last_fullsized":"2024-09-05T02:15:48.629116+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":600,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:33.562310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'371","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.848792+0000","last_change":"2024-09-05T00:49:27.909574+0000","last_active":"2024-09-05T02:16:22.848792+0000","last_peered":"2024-09-05T02:16:22.848792+0000","last_clean":"2024-09-05T02:16:22.848792+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:22.848792+0000","last_undegraded":"2024-09-05T02:16:22.848792+0000","last_fullsized":"2024-09-05T02:16:22.848792+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:51.020169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":588,"num_read_kb":10940,"num_write":1274,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'476","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.888825+0000","last_change":"2024-09-05T00:49:29.888887+0000","last_active":"2024-09-05T02:13:37.888825+0000","last_peered":"2024-09-05T02:13:37.888825+0000","last_clean":"2024-09-05T02:13:37.888825+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:13:37.888825+0000","last_undegraded":"2024-09-05T02:13:37.888825+0000","last_fullsized":"2024-09-05T02:13:37.888825+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:05.114720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'342","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.873390+0000","last_change":"2024-09-05T00:49:27.886848+0000","last_active":"2024-09-05T02:16:22.873390+0000","last_peered":"2024-09-05T02:16:22.873390+0000","last_clean":"2024-09-05T02:16:22.873390+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:22.873390+0000","last_undegraded":"2024-09-05T02:16:22.873390+0000","last_fullsized":"2024-09-05T02:16:22.873390+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:26.738479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461798,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":29011,"num_write":1195,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1109","reported_seq":2750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701677+0000","last_change":"2024-09-05T00:49:29.915871+0000","last_active":"2024-09-05T02:14:27.701677+0000","last_peered":"2024-09-05T02:14:27.701677+0000","last_clean":"2024-09-05T02:14:27.701677+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:14:27.701677+0000","last_undegraded":"2024-09-05T02:14:27.701677+0000","last_fullsized":"2024-09-05T02:14:27.701677+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":1000,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:08:29.037816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'357","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.873584+0000","last_change":"2024-09-05T00:49:27.889044+0000","last_active":"2024-09-05T02:16:22.873584+0000","last_peered":"2024-09-05T02:16:22.873584+0000","last_clean":"2024-09-05T02:16:22.873584+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:16:22.873584+0000","last_undegraded":"2024-09-05T02:16:22.873584+0000","last_fullsized":"2024-09-05T02:16:22.873584+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:10.256222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":61900,"num_write":1145,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'619","reported_seq":2294,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.905447+0000","last_change":"2024-09-05T00:49:29.912552+0000","last_active":"2024-09-05T02:13:45.905447+0000","last_peered":"2024-09-05T02:13:45.905447+0000","last_clean":"2024-09-05T02:13:45.905447+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:13:45.905447+0000","last_undegraded":"2024-09-05T02:13:45.905447+0000","last_fullsized":"2024-09-05T02:13:45.905447+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":600,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:05.014550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'337","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.894336+0000","last_change":"2024-09-05T00:49:27.886360+0000","last_active":"2024-09-05T02:16:22.894336+0000","last_peered":"2024-09-05T02:16:22.894336+0000","last_clean":"2024-09-05T02:16:22.894336+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:22.894336+0000","last_undegraded":"2024-09-05T02:16:22.894336+0000","last_fullsized":"2024-09-05T02:16:22.894336+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:15:32.202085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953006,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":484,"num_read_kb":25097,"num_write":1158,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'540","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.636487+0000","last_change":"2024-09-05T00:49:29.898543+0000","last_active":"2024-09-05T02:15:48.636487+0000","last_peered":"2024-09-05T02:15:48.636487+0000","last_clean":"2024-09-05T02:15:48.636487+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:15:48.636487+0000","last_undegraded":"2024-09-05T02:15:48.636487+0000","last_fullsized":"2024-09-05T02:15:48.636487+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:14:11.197697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'402","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.910301+0000","last_change":"2024-09-05T00:50:04.181293+0000","last_active":"2024-09-05T02:16:22.910301+0000","last_peered":"2024-09-05T02:16:22.910301+0000","last_clean":"2024-09-05T02:16:22.910301+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:22.910301+0000","last_undegraded":"2024-09-05T02:16:22.910301+0000","last_fullsized":"2024-09-05T02:16:22.910301+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:03:31.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262234,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":5699,"num_write":1247,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1184","reported_seq":2835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:37.896967+0000","last_change":"2024-09-05T00:49:29.914676+0000","last_active":"2024-09-05T02:13:37.896967+0000","last_peered":"2024-09-05T02:13:37.896967+0000","last_clean":"2024-09-05T02:13:37.896967+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:13:37.896967+0000","last_undegraded":"2024-09-05T02:13:37.896967+0000","last_fullsized":"2024-09-05T02:13:37.896967+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":1100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:20:02.143783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'328","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.858621+0000","last_change":"2024-09-05T00:49:27.905936+0000","last_active":"2024-09-05T02:16:22.858621+0000","last_peered":"2024-09-05T02:16:22.858621+0000","last_clean":"2024-09-05T02:16:22.858621+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:16:22.858621+0000","last_undegraded":"2024-09-05T02:16:22.858621+0000","last_fullsized":"2024-09-05T02:16:22.858621+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:06.100911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":5076,"num_write":1193,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'490","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.623799+0000","last_change":"2024-09-05T00:49:29.925901+0000","last_active":"2024-09-05T02:14:29.623799+0000","last_peered":"2024-09-05T02:14:29.623799+0000","last_clean":"2024-09-05T02:14:29.623799+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:14:29.623799+0000","last_undegraded":"2024-09-05T02:14:29.623799+0000","last_fullsized":"2024-09-05T02:14:29.623799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:48:36.737428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'369","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.897367+0000","last_change":"2024-09-05T00:49:27.888664+0000","last_active":"2024-09-05T02:16:22.897367+0000","last_peered":"2024-09-05T02:16:22.897367+0000","last_clean":"2024-09-05T02:16:22.897367+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:22.897367+0000","last_undegraded":"2024-09-05T02:16:22.897367+0000","last_fullsized":"2024-09-05T02:16:22.897367+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:01.736837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":31375,"num_write":1285,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'686","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.449674+0000","last_change":"2024-09-05T00:49:29.922331+0000","last_active":"2024-09-05T02:12:45.449674+0000","last_peered":"2024-09-05T02:12:45.449674+0000","last_clean":"2024-09-05T02:12:45.449674+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:12:45.449674+0000","last_undegraded":"2024-09-05T02:12:45.449674+0000","last_fullsized":"2024-09-05T02:12:45.449674+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:17:15.909498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'341","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.927518+0000","last_change":"2024-09-05T00:49:27.912949+0000","last_active":"2024-09-05T02:16:22.927518+0000","last_peered":"2024-09-05T02:16:22.927518+0000","last_clean":"2024-09-05T02:16:22.927518+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:22.927518+0000","last_undegraded":"2024-09-05T02:16:22.927518+0000","last_fullsized":"2024-09-05T02:16:22.927518+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:24.446425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":11105,"num_write":1131,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'522","reported_seq":2123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629988+0000","last_change":"2024-09-05T00:49:29.915489+0000","last_active":"2024-09-05T02:14:29.629988+0000","last_peered":"2024-09-05T02:14:29.629988+0000","last_clean":"2024-09-05T02:14:29.629988+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:14:29.629988+0000","last_undegraded":"2024-09-05T02:14:29.629988+0000","last_fullsized":"2024-09-05T02:14:29.629988+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:16.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'327","reported_seq":1015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.918740+0000","last_change":"2024-09-05T00:49:27.888381+0000","last_active":"2024-09-05T02:16:22.918740+0000","last_peered":"2024-09-05T02:16:22.918740+0000","last_clean":"2024-09-05T02:16:22.918740+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:22.918740+0000","last_undegraded":"2024-09-05T02:16:22.918740+0000","last_fullsized":"2024-09-05T02:16:22.918740+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:03.147163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":115088,"num_write":1048,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:16.636432+0000","last_change":"2024-09-05T00:49:29.922395+0000","last_active":"2024-09-05T02:14:16.636432+0000","last_peered":"2024-09-05T02:14:16.636432+0000","last_clean":"2024-09-05T02:14:16.636432+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:14:16.636432+0000","last_undegraded":"2024-09-05T02:14:16.636432+0000","last_fullsized":"2024-09-05T02:14:16.636432+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:27.332843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'309","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.857879+0000","last_change":"2024-09-05T00:49:27.915755+0000","last_active":"2024-09-05T02:16:22.857879+0000","last_peered":"2024-09-05T02:16:22.857879+0000","last_clean":"2024-09-05T02:16:22.857879+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:16:22.857879+0000","last_undegraded":"2024-09-05T02:16:22.857879+0000","last_fullsized":"2024-09-05T02:16:22.857879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:24.744189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":641,"num_write":1040,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'415","reported_seq":1114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.922079+0000","last_change":"2024-09-05T00:49:27.900502+0000","last_active":"2024-09-05T02:16:22.922079+0000","last_peered":"2024-09-05T02:16:22.922079+0000","last_clean":"2024-09-05T02:16:22.922079+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:16:22.922079+0000","last_undegraded":"2024-09-05T02:16:22.922079+0000","last_fullsized":"2024-09-05T02:16:22.922079+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:21:36.617932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":738,"num_read_kb":35471,"num_write":1283,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'402","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.580490+0000","last_change":"2024-09-05T00:49:29.916741+0000","last_active":"2024-09-05T02:14:29.580490+0000","last_peered":"2024-09-05T02:14:29.580490+0000","last_clean":"2024-09-05T02:14:29.580490+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:14:29.580490+0000","last_undegraded":"2024-09-05T02:14:29.580490+0000","last_fullsized":"2024-09-05T02:14:29.580490+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:48.147595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'374","reported_seq":1022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.894319+0000","last_change":"2024-09-05T00:49:27.885362+0000","last_active":"2024-09-05T02:16:22.894319+0000","last_peered":"2024-09-05T02:16:22.894319+0000","last_clean":"2024-09-05T02:16:22.894319+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:22.894319+0000","last_undegraded":"2024-09-05T02:16:22.894319+0000","last_fullsized":"2024-09-05T02:16:22.894319+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:27.112947+0000","last_clean_scrub_stamp":"2024-09-05T00:49:27.112947+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:17.247155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":26073,"num_write":1194,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'871","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844564+0000","last_change":"2024-09-05T00:49:29.908617+0000","last_active":"2024-09-05T02:13:40.844564+0000","last_peered":"2024-09-05T02:13:40.844564+0000","last_clean":"2024-09-05T02:13:40.844564+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:13:40.844564+0000","last_undegraded":"2024-09-05T02:13:40.844564+0000","last_fullsized":"2024-09-05T02:13:40.844564+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:37.624060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1550994,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19804,"num_read_kb":40130,"num_write":16519,"num_write_kb":12075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1843,"ondisk_log_size":1843,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4136,"ondisk_log_size":4136,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66708448,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36139,"num_read_kb":2043809,"num_write":71843,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134676480,"data_stored":133416896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3701,"ondisk_log_size":3701,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174352,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174298,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510494,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285488,"kb_used_data":23788,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94086352,"statfs":{"total":96636764160,"available":96344424448,"internally_reserved":0,"allocated":24358912,"data_stored":22640434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510493,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234144,"kb_used_data":13980,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94137696,"statfs":{"total":96636764160,"available":96397000704,"internally_reserved":0,"allocated":14315520,"data_stored":12734941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510490,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120544,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94251296,"statfs":{"total":96636764160,"available":96513327104,"internally_reserved":0,"allocated":31711232,"data_stored":30061356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510494,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314292,"kb_used_data":35928,"kb_used_omap":1,"kb_used_meta":278206,"kb_avail":94057548,"statfs":{"total":96636764160,"available":96314929152,"internally_reserved":0,"allocated":36790272,"data_stored":35092545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":284883399},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510492,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103148,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94268692,"statfs":{"total":96636764160,"available":96531140608,"internally_reserved":0,"allocated":9740288,"data_stored":8176150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510493,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146048,"kb_used_data":10520,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94225792,"statfs":{"total":96636764160,"available":96487211008,"internally_reserved":0,"allocated":10772480,"data_stored":9180748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543196,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146916,"kb_used_data":16952,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94224924,"statfs":{"total":96636764160,"available":96486322176,"internally_reserved":0,"allocated":17358848,"data_stored":15590745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543197,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267500,"kb_used_data":19568,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94104340,"statfs":{"total":96636764160,"available":96362844160,"internally_reserved":0,"allocated":20037632,"data_stored":18279783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253622725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15736832,"data_stored":15540753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":7036545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6131712,"data_stored":6032468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33136640,"data_stored":32946939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28102656,"data_stored":27918588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":13446327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":10591792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20078592,"data_stored":19903484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:16:29.906 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.906 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.907 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.908 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.909 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.910 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.911 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.912 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.913 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.914 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.915 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.916 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.917 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.918 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.919 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.920 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.921 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.922 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.923 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.924 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.925 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.926 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.927 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.928 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.929 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.930 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.931 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.932 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-05T00:49:11.728885+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=11, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.933 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.934 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.935 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.936 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.937 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-05T00:49:16.765157+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=16, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.938 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.939 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.940 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.941 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.942 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.943 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.944 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.945 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.946 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.947 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.948 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.949 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.950 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-05T00:49:27.112947+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=27, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.951 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:29.951 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T02:16:49.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:16:50.315 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:16:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:16:50.351 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2885,"stamp":"2024-09-05T02:16:48.522296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68867067,"num_objects":856,"num_object_clones":0,"num_object_copies":1712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":856,"num_whiteouts":0,"num_read":292554,"num_read_kb":2648548,"num_write":162836,"num_write_kb":2503589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":42508,"num_omap_keys":166,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13438,"ondisk_log_size":13438,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1608448,"kb_used_data":161216,"kb_used_omap":12,"kb_used_meta":1447091,"kb_avail":753366272,"statfs":{"total":773094113280,"available":771447062528,"internally_reserved":0,"allocated":165085184,"data_stored":151756702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1481821744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":40214,"num_omap_keys":156,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009553"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:00.200116+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:12:00.200116+0000","last_peered":"2024-09-05T02:12:00.200116+0000","last_clean":"2024-09-05T02:12:00.200116+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:12:00.200116+0000","last_undegraded":"2024-09-05T02:12:00.200116+0000","last_fullsized":"2024-09-05T02:12:00.200116+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:56.081749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'8","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495301+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:14:26.495301+0000","last_peered":"2024-09-05T02:14:26.495301+0000","last_clean":"2024-09-05T02:14:26.495301+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:14:26.495301+0000","last_undegraded":"2024-09-05T02:14:26.495301+0000","last_fullsized":"2024-09-05T02:14:26.495301+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:52:17.217061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375602+0000","last_change":"2024-09-05T01:30:15.667346+0000","last_active":"2024-09-05T02:12:46.375602+0000","last_peered":"2024-09-05T02:12:46.375602+0000","last_clean":"2024-09-05T02:12:46.375602+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:12:46.375602+0000","last_undegraded":"2024-09-05T02:12:46.375602+0000","last_fullsized":"2024-09-05T02:12:46.375602+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:40.455562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.236610+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:14:26.236610+0000","last_peered":"2024-09-05T02:14:26.236610+0000","last_clean":"2024-09-05T02:14:26.236610+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:14:26.236610+0000","last_undegraded":"2024-09-05T02:14:26.236610+0000","last_fullsized":"2024-09-05T02:14:26.236610+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:01.475308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.766667+0000","last_change":"2024-09-05T01:09:22.194515+0000","last_active":"2024-09-05T02:11:51.766667+0000","last_peered":"2024-09-05T02:11:51.766667+0000","last_clean":"2024-09-05T02:11:51.766667+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:11:51.766667+0000","last_undegraded":"2024-09-05T02:11:51.766667+0000","last_fullsized":"2024-09-05T02:11:51.766667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:51.467116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.381829+0000","last_change":"2024-09-05T01:05:07.120154+0000","last_active":"2024-09-05T02:13:16.381829+0000","last_peered":"2024-09-05T02:13:16.381829+0000","last_clean":"2024-09-05T02:13:16.381829+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:13:16.381829+0000","last_undegraded":"2024-09-05T02:13:16.381829+0000","last_fullsized":"2024-09-05T02:13:16.381829+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:15.466155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:10.495204+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:16:10.495204+0000","last_peered":"2024-09-05T02:16:10.495204+0000","last_clean":"2024-09-05T02:16:10.495204+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:16:10.495204+0000","last_undegraded":"2024-09-05T02:16:10.495204+0000","last_fullsized":"2024-09-05T02:16:10.495204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":53,"num_write":4,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.384719+0000","last_change":"2024-09-05T01:09:22.189240+0000","last_active":"2024-09-05T02:13:31.384719+0000","last_peered":"2024-09-05T02:13:31.384719+0000","last_clean":"2024-09-05T02:13:31.384719+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:13:31.384719+0000","last_undegraded":"2024-09-05T02:13:31.384719+0000","last_fullsized":"2024-09-05T02:13:31.384719+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:27.906635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448662+0000","last_change":"2024-09-05T01:05:07.099663+0000","last_active":"2024-09-05T02:12:40.448662+0000","last_peered":"2024-09-05T02:12:40.448662+0000","last_clean":"2024-09-05T02:12:40.448662+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:12:40.448662+0000","last_undegraded":"2024-09-05T02:12:40.448662+0000","last_fullsized":"2024-09-05T02:12:40.448662+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:05.063618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495387+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:14:26.495387+0000","last_peered":"2024-09-05T02:14:26.495387+0000","last_clean":"2024-09-05T02:14:26.495387+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:14:26.495387+0000","last_undegraded":"2024-09-05T02:14:26.495387+0000","last_fullsized":"2024-09-05T02:14:26.495387+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'9","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243459+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:15:05.243459+0000","last_peered":"2024-09-05T02:15:05.243459+0000","last_clean":"2024-09-05T02:15:05.243459+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:15:05.243459+0000","last_undegraded":"2024-09-05T02:15:05.243459+0000","last_fullsized":"2024-09-05T02:15:05.243459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":22528,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.441829+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:12:15.441829+0000","last_peered":"2024-09-05T02:12:15.441829+0000","last_clean":"2024-09-05T02:12:15.441829+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:12:15.441829+0000","last_undegraded":"2024-09-05T02:12:15.441829+0000","last_fullsized":"2024-09-05T02:12:15.441829+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:48.174424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.422065+0000","last_change":"2024-09-05T01:09:26.324652+0000","last_active":"2024-09-05T02:14:41.422065+0000","last_peered":"2024-09-05T02:14:41.422065+0000","last_clean":"2024-09-05T02:14:41.422065+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:14:41.422065+0000","last_undegraded":"2024-09-05T02:14:41.422065+0000","last_fullsized":"2024-09-05T02:14:41.422065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:50:46.559032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.242584+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:14:51.242584+0000","last_peered":"2024-09-05T02:14:51.242584+0000","last_clean":"2024-09-05T02:14:51.242584+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:14:51.242584+0000","last_undegraded":"2024-09-05T02:14:51.242584+0000","last_fullsized":"2024-09-05T02:14:51.242584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394840+0000","last_change":"2024-09-05T01:05:07.100070+0000","last_active":"2024-09-05T02:12:36.394840+0000","last_peered":"2024-09-05T02:12:36.394840+0000","last_clean":"2024-09-05T02:12:36.394840+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:12:36.394840+0000","last_undegraded":"2024-09-05T02:12:36.394840+0000","last_fullsized":"2024-09-05T02:12:36.394840+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:38.489253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:56.386284+0000","last_change":"2024-09-05T01:09:26.324239+0000","last_active":"2024-09-05T02:11:56.386284+0000","last_peered":"2024-09-05T02:11:56.386284+0000","last_clean":"2024-09-05T02:11:56.386284+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:11:56.386284+0000","last_undegraded":"2024-09-05T02:11:56.386284+0000","last_fullsized":"2024-09-05T02:11:56.386284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:27:56.884028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:11:51.201470+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:11:51.201470+0000","last_peered":"2024-09-05T02:11:51.201470+0000","last_clean":"2024-09-05T02:11:51.201470+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:11:51.201470+0000","last_undegraded":"2024-09-05T02:11:51.201470+0000","last_fullsized":"2024-09-05T02:11:51.201470+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:47:24.863158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:05.454470+0000","last_change":"2024-09-05T01:05:07.114198+0000","last_active":"2024-09-05T02:13:05.454470+0000","last_peered":"2024-09-05T02:13:05.454470+0000","last_clean":"2024-09-05T02:13:05.454470+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:13:05.454470+0000","last_undegraded":"2024-09-05T02:13:05.454470+0000","last_fullsized":"2024-09-05T02:13:05.454470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:21:32.703401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'8","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495169+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:14:26.495169+0000","last_peered":"2024-09-05T02:14:26.495169+0000","last_clean":"2024-09-05T02:14:26.495169+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:14:26.495169+0000","last_undegraded":"2024-09-05T02:14:26.495169+0000","last_fullsized":"2024-09-05T02:14:26.495169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:51:40.645794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.312430+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:16:21.312430+0000","last_peered":"2024-09-05T02:16:21.312430+0000","last_clean":"2024-09-05T02:16:21.312430+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:16:21.312430+0000","last_undegraded":"2024-09-05T02:16:21.312430+0000","last_fullsized":"2024-09-05T02:16:21.312430+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:11:46.829038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":23604,"num_write":14,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.779304+0000","last_change":"2024-09-05T01:05:07.107441+0000","last_active":"2024-09-05T02:12:46.779304+0000","last_peered":"2024-09-05T02:12:46.779304+0000","last_clean":"2024-09-05T02:12:46.779304+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:12:46.779304+0000","last_undegraded":"2024-09-05T02:12:46.779304+0000","last_fullsized":"2024-09-05T02:12:46.779304+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:15:28.771503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.772503+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:12:16.772503+0000","last_peered":"2024-09-05T02:12:16.772503+0000","last_clean":"2024-09-05T02:12:16.772503+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:12:16.772503+0000","last_undegraded":"2024-09-05T02:12:16.772503+0000","last_fullsized":"2024-09-05T02:12:16.772503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:13.638808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.802583+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:16:21.802583+0000","last_peered":"2024-09-05T02:16:21.802583+0000","last_clean":"2024-09-05T02:16:21.802583+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:16:21.802583+0000","last_undegraded":"2024-09-05T02:16:21.802583+0000","last_fullsized":"2024-09-05T02:16:21.802583+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:48.151492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.369336+0000","last_change":"2024-09-05T01:30:15.668869+0000","last_active":"2024-09-05T02:12:16.369336+0000","last_peered":"2024-09-05T02:12:16.369336+0000","last_clean":"2024-09-05T02:12:16.369336+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:12:16.369336+0000","last_undegraded":"2024-09-05T02:12:16.369336+0000","last_fullsized":"2024-09-05T02:12:16.369336+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:05.261577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'10","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.427502+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:16:22.427502+0000","last_peered":"2024-09-05T02:16:22.427502+0000","last_clean":"2024-09-05T02:16:22.427502+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:16:22.427502+0000","last_undegraded":"2024-09-05T02:16:22.427502+0000","last_fullsized":"2024-09-05T02:16:22.427502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28674,"num_write":15,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.817097+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:12:11.817097+0000","last_peered":"2024-09-05T02:12:11.817097+0000","last_clean":"2024-09-05T02:12:11.817097+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:12:11.817097+0000","last_undegraded":"2024-09-05T02:12:11.817097+0000","last_fullsized":"2024-09-05T02:12:11.817097+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:34:06.449467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.818016+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:12:16.818016+0000","last_peered":"2024-09-05T02:12:16.818016+0000","last_clean":"2024-09-05T02:12:16.818016+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:12:16.818016+0000","last_undegraded":"2024-09-05T02:12:16.818016+0000","last_fullsized":"2024-09-05T02:12:16.818016+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:08:36.986922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.465067+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:12:16.465067+0000","last_peered":"2024-09-05T02:12:16.465067+0000","last_clean":"2024-09-05T02:12:16.465067+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:12:16.465067+0000","last_undegraded":"2024-09-05T02:12:16.465067+0000","last_fullsized":"2024-09-05T02:12:16.465067+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:19:22.935796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:11.368114+0000","last_change":"2024-09-05T01:09:22.197361+0000","last_active":"2024-09-05T02:12:11.368114+0000","last_peered":"2024-09-05T02:12:11.368114+0000","last_clean":"2024-09-05T02:12:11.368114+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:12:11.368114+0000","last_undegraded":"2024-09-05T02:12:11.368114+0000","last_fullsized":"2024-09-05T02:12:11.368114+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:33:21.371226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.375737+0000","last_change":"2024-09-05T01:05:07.119548+0000","last_active":"2024-09-05T02:12:46.375737+0000","last_peered":"2024-09-05T02:12:46.375737+0000","last_clean":"2024-09-05T02:12:46.375737+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:12:46.375737+0000","last_undegraded":"2024-09-05T02:12:46.375737+0000","last_fullsized":"2024-09-05T02:12:46.375737+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:35:04.252401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:15.203655+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:12:15.203655+0000","last_peered":"2024-09-05T02:12:15.203655+0000","last_clean":"2024-09-05T02:12:15.203655+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:12:15.203655+0000","last_undegraded":"2024-09-05T02:12:15.203655+0000","last_fullsized":"2024-09-05T02:12:15.203655+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:15.910872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:16.207592+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:12:16.207592+0000","last_peered":"2024-09-05T02:12:16.207592+0000","last_clean":"2024-09-05T02:12:16.207592+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:12:16.207592+0000","last_undegraded":"2024-09-05T02:12:16.207592+0000","last_fullsized":"2024-09-05T02:12:16.207592+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:25.770411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:40.476996+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:14:40.476996+0000","last_peered":"2024-09-05T02:14:40.476996+0000","last_clean":"2024-09-05T02:14:40.476996+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:14:40.476996+0000","last_undegraded":"2024-09-05T02:14:40.476996+0000","last_fullsized":"2024-09-05T02:14:40.476996+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:46:14.641983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774807+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:12:26.774807+0000","last_peered":"2024-09-05T02:12:26.774807+0000","last_clean":"2024-09-05T02:12:26.774807+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:12:26.774807+0000","last_undegraded":"2024-09-05T02:12:26.774807+0000","last_fullsized":"2024-09-05T02:12:26.774807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:09.146703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208586+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:12:21.208586+0000","last_peered":"2024-09-05T02:12:21.208586+0000","last_clean":"2024-09-05T02:12:21.208586+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:12:21.208586+0000","last_undegraded":"2024-09-05T02:12:21.208586+0000","last_fullsized":"2024-09-05T02:12:21.208586+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:53.136374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774662+0000","last_change":"2024-09-05T01:09:26.327272+0000","last_active":"2024-09-05T02:12:26.774662+0000","last_peered":"2024-09-05T02:12:26.774662+0000","last_clean":"2024-09-05T02:12:26.774662+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:12:26.774662+0000","last_undegraded":"2024-09-05T02:12:26.774662+0000","last_fullsized":"2024-09-05T02:12:26.774662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:00.744251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'5","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:46.500078+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:14:46.500078+0000","last_peered":"2024-09-05T02:14:46.500078+0000","last_clean":"2024-09-05T02:14:46.500078+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:14:46.500078+0000","last_undegraded":"2024-09-05T02:14:46.500078+0000","last_fullsized":"2024-09-05T02:14:46.500078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:36:00.381248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'116","reported_seq":469,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.450850+0000","last_change":"2024-09-05T01:05:07.106194+0000","last_active":"2024-09-05T02:12:50.450850+0000","last_peered":"2024-09-05T02:12:50.450850+0000","last_clean":"2024-09-05T02:12:50.450850+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:12:50.450850+0000","last_undegraded":"2024-09-05T02:12:50.450850+0000","last_fullsized":"2024-09-05T02:12:50.450850+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:11.528263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:25.444865+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:12:25.444865+0000","last_peered":"2024-09-05T02:12:25.444865+0000","last_clean":"2024-09-05T02:12:25.444865+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:12:25.444865+0000","last_undegraded":"2024-09-05T02:12:25.444865+0000","last_fullsized":"2024-09-05T02:12:25.444865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:58:42.242758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:46.500170+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:14:46.500170+0000","last_peered":"2024-09-05T02:14:46.500170+0000","last_clean":"2024-09-05T02:14:46.500170+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:14:46.500170+0000","last_undegraded":"2024-09-05T02:14:46.500170+0000","last_fullsized":"2024-09-05T02:14:46.500170+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:13:39.545081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.422135+0000","last_change":"2024-09-05T01:09:22.204898+0000","last_active":"2024-09-05T02:14:41.422135+0000","last_peered":"2024-09-05T02:14:41.422135+0000","last_clean":"2024-09-05T02:14:41.422135+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:14:41.422135+0000","last_undegraded":"2024-09-05T02:14:41.422135+0000","last_fullsized":"2024-09-05T02:14:41.422135+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:48:27.525986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.392810+0000","last_change":"2024-09-05T01:09:26.329147+0000","last_active":"2024-09-05T02:12:26.392810+0000","last_peered":"2024-09-05T02:12:26.392810+0000","last_clean":"2024-09-05T02:12:26.392810+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:12:26.392810+0000","last_undegraded":"2024-09-05T02:12:26.392810+0000","last_fullsized":"2024-09-05T02:12:26.392810+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:07.238760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:45.239003+0000","last_change":"2024-09-05T01:09:22.187559+0000","last_active":"2024-09-05T02:14:45.239003+0000","last_peered":"2024-09-05T02:14:45.239003+0000","last_clean":"2024-09-05T02:14:45.239003+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:14:45.239003+0000","last_undegraded":"2024-09-05T02:14:45.239003+0000","last_fullsized":"2024-09-05T02:14:45.239003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:07:59.966273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.386682+0000","last_change":"2024-09-05T01:30:15.669605+0000","last_active":"2024-09-05T02:13:41.386682+0000","last_peered":"2024-09-05T02:13:41.386682+0000","last_clean":"2024-09-05T02:13:41.386682+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:13:41.386682+0000","last_undegraded":"2024-09-05T02:13:41.386682+0000","last_fullsized":"2024-09-05T02:13:41.386682+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:59:56.360434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467501+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:12:26.467501+0000","last_peered":"2024-09-05T02:12:26.467501+0000","last_clean":"2024-09-05T02:12:26.467501+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:12:26.467501+0000","last_undegraded":"2024-09-05T02:12:26.467501+0000","last_fullsized":"2024-09-05T02:12:26.467501+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:48.846611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.819378+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:12:21.819378+0000","last_peered":"2024-09-05T02:12:21.819378+0000","last_clean":"2024-09-05T02:12:21.819378+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:12:21.819378+0000","last_undegraded":"2024-09-05T02:12:21.819378+0000","last_fullsized":"2024-09-05T02:12:21.819378+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:34.428068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.467422+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:12:26.467422+0000","last_peered":"2024-09-05T02:12:26.467422+0000","last_clean":"2024-09-05T02:12:26.467422+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:12:26.467422+0000","last_undegraded":"2024-09-05T02:12:26.467422+0000","last_fullsized":"2024-09-05T02:12:26.467422+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:59.970464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.398198+0000","last_change":"2024-09-05T01:09:22.173216+0000","last_active":"2024-09-05T02:14:36.398198+0000","last_peered":"2024-09-05T02:14:36.398198+0000","last_clean":"2024-09-05T02:14:36.398198+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:14:36.398198+0000","last_undegraded":"2024-09-05T02:14:36.398198+0000","last_fullsized":"2024-09-05T02:14:36.398198+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:30:30.318937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.209629+0000","last_change":"2024-09-05T01:05:07.097402+0000","last_active":"2024-09-05T02:12:40.209629+0000","last_peered":"2024-09-05T02:12:40.209629+0000","last_clean":"2024-09-05T02:12:40.209629+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:12:40.209629+0000","last_undegraded":"2024-09-05T02:12:40.209629+0000","last_fullsized":"2024-09-05T02:12:40.209629+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:29.548612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407611+0000","last_change":"2024-09-05T01:30:15.659142+0000","last_active":"2024-09-05T02:13:36.407611+0000","last_peered":"2024-09-05T02:13:36.407611+0000","last_clean":"2024-09-05T02:13:36.407611+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:13:36.407611+0000","last_undegraded":"2024-09-05T02:13:36.407611+0000","last_fullsized":"2024-09-05T02:13:36.407611+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:28.741051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.805493+0000","last_change":"2024-09-05T01:09:26.328593+0000","last_active":"2024-09-05T02:14:51.805493+0000","last_peered":"2024-09-05T02:14:51.805493+0000","last_clean":"2024-09-05T02:14:51.805493+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:14:51.805493+0000","last_undegraded":"2024-09-05T02:14:51.805493+0000","last_fullsized":"2024-09-05T02:14:51.805493+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:38.442411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.878717+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:16:21.878717+0000","last_peered":"2024-09-05T02:16:21.878717+0000","last_clean":"2024-09-05T02:16:21.878717+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:16:21.878717+0000","last_undegraded":"2024-09-05T02:16:21.878717+0000","last_fullsized":"2024-09-05T02:16:21.878717+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:22:24.610460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":88,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.394924+0000","last_change":"2024-09-05T01:05:07.108722+0000","last_active":"2024-09-05T02:12:36.394924+0000","last_peered":"2024-09-05T02:12:36.394924+0000","last_clean":"2024-09-05T02:12:36.394924+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:12:36.394924+0000","last_undegraded":"2024-09-05T02:12:36.394924+0000","last_fullsized":"2024-09-05T02:12:36.394924+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:28:14.901414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.803551+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:16:21.803551+0000","last_peered":"2024-09-05T02:16:21.803551+0000","last_clean":"2024-09-05T02:16:21.803551+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:16:21.803551+0000","last_undegraded":"2024-09-05T02:16:21.803551+0000","last_fullsized":"2024-09-05T02:16:21.803551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:39.337140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:31.776137+0000","last_change":"2024-09-05T01:09:22.199397+0000","last_active":"2024-09-05T02:12:31.776137+0000","last_peered":"2024-09-05T02:12:31.776137+0000","last_clean":"2024-09-05T02:12:31.776137+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:12:31.776137+0000","last_undegraded":"2024-09-05T02:12:31.776137+0000","last_fullsized":"2024-09-05T02:12:31.776137+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:09:58.963052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.373537+0000","last_change":"2024-09-05T01:05:07.107459+0000","last_active":"2024-09-05T02:12:36.373537+0000","last_peered":"2024-09-05T02:12:36.373537+0000","last_clean":"2024-09-05T02:12:36.373537+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:12:36.373537+0000","last_undegraded":"2024-09-05T02:12:36.373537+0000","last_fullsized":"2024-09-05T02:12:36.373537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:15:14.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.793917+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:16:22.793917+0000","last_peered":"2024-09-05T02:16:22.793917+0000","last_clean":"2024-09-05T02:16:22.793917+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:16:22.793917+0000","last_undegraded":"2024-09-05T02:16:22.793917+0000","last_fullsized":"2024-09-05T02:16:22.793917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.473153+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:14:25.473153+0000","last_peered":"2024-09-05T02:14:25.473153+0000","last_clean":"2024-09-05T02:14:25.473153+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:14:25.473153+0000","last_undegraded":"2024-09-05T02:14:25.473153+0000","last_fullsized":"2024-09-05T02:14:25.473153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:40.448523+0000","last_change":"2024-09-05T01:05:07.113278+0000","last_active":"2024-09-05T02:12:40.448523+0000","last_peered":"2024-09-05T02:12:40.448523+0000","last_clean":"2024-09-05T02:12:40.448523+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:12:40.448523+0000","last_undegraded":"2024-09-05T02:12:40.448523+0000","last_fullsized":"2024-09-05T02:12:40.448523+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:01.987557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.794616+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:16:22.794616+0000","last_peered":"2024-09-05T02:16:22.794616+0000","last_clean":"2024-09-05T02:16:22.794616+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:16:22.794616+0000","last_undegraded":"2024-09-05T02:16:22.794616+0000","last_fullsized":"2024-09-05T02:16:22.794616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:21.798601+0000","last_change":"2024-09-05T01:09:22.205702+0000","last_active":"2024-09-05T02:14:21.798601+0000","last_peered":"2024-09-05T02:14:21.798601+0000","last_clean":"2024-09-05T02:14:21.798601+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:14:21.798601+0000","last_undegraded":"2024-09-05T02:14:21.798601+0000","last_fullsized":"2024-09-05T02:14:21.798601+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.820508+0000","last_change":"2024-09-05T01:05:07.107783+0000","last_active":"2024-09-05T02:12:26.820508+0000","last_peered":"2024-09-05T02:12:26.820508+0000","last_clean":"2024-09-05T02:12:26.820508+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:12:26.820508+0000","last_undegraded":"2024-09-05T02:12:26.820508+0000","last_fullsized":"2024-09-05T02:12:26.820508+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:31:14.335901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:26.774914+0000","last_change":"2024-09-05T01:09:26.335994+0000","last_active":"2024-09-05T02:12:26.774914+0000","last_peered":"2024-09-05T02:12:26.774914+0000","last_clean":"2024-09-05T02:12:26.774914+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:12:26.774914+0000","last_undegraded":"2024-09-05T02:12:26.774914+0000","last_fullsized":"2024-09-05T02:12:26.774914+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:07.883192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'9","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.429720+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:16:21.429720+0000","last_peered":"2024-09-05T02:16:21.429720+0000","last_clean":"2024-09-05T02:16:21.429720+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:16:21.429720+0000","last_undegraded":"2024-09-05T02:16:21.429720+0000","last_fullsized":"2024-09-05T02:16:21.429720+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:14:34.388590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495035+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:14:26.495035+0000","last_peered":"2024-09-05T02:14:26.495035+0000","last_clean":"2024-09-05T02:14:26.495035+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:14:26.495035+0000","last_undegraded":"2024-09-05T02:14:26.495035+0000","last_fullsized":"2024-09-05T02:14:26.495035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.643003+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:14:41.643003+0000","last_peered":"2024-09-05T02:14:41.643003+0000","last_clean":"2024-09-05T02:14:41.643003+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:14:41.643003+0000","last_undegraded":"2024-09-05T02:14:41.643003+0000","last_fullsized":"2024-09-05T02:14:41.643003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:03.990596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:21.208761+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:12:21.208761+0000","last_peered":"2024-09-05T02:12:21.208761+0000","last_clean":"2024-09-05T02:12:21.208761+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:12:21.208761+0000","last_undegraded":"2024-09-05T02:12:21.208761+0000","last_fullsized":"2024-09-05T02:12:21.208761+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:08.518794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.418653+0000","last_change":"2024-09-05T01:05:07.108906+0000","last_active":"2024-09-05T02:14:26.418653+0000","last_peered":"2024-09-05T02:14:26.418653+0000","last_clean":"2024-09-05T02:14:26.418653+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:14:26.418653+0000","last_undegraded":"2024-09-05T02:14:26.418653+0000","last_fullsized":"2024-09-05T02:14:26.418653+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:20.472251+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:14:20.472251+0000","last_peered":"2024-09-05T02:14:20.472251+0000","last_clean":"2024-09-05T02:14:20.472251+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:14:20.472251+0000","last_undegraded":"2024-09-05T02:14:20.472251+0000","last_fullsized":"2024-09-05T02:14:20.472251+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":195,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.474649+0000","last_change":"2024-09-05T01:05:07.120976+0000","last_active":"2024-09-05T02:14:30.474649+0000","last_peered":"2024-09-05T02:14:30.474649+0000","last_clean":"2024-09-05T02:14:30.474649+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:14:30.474649+0000","last_undegraded":"2024-09-05T02:14:30.474649+0000","last_fullsized":"2024-09-05T02:14:30.474649+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391904+0000","last_change":"2024-09-05T01:09:22.172712+0000","last_active":"2024-09-05T02:14:06.391904+0000","last_peered":"2024-09-05T02:14:06.391904+0000","last_clean":"2024-09-05T02:14:06.391904+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:14:06.391904+0000","last_undegraded":"2024-09-05T02:14:06.391904+0000","last_fullsized":"2024-09-05T02:14:06.391904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:11:20.436128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.418865+0000","last_change":"2024-09-05T01:05:07.102945+0000","last_active":"2024-09-05T02:14:26.418865+0000","last_peered":"2024-09-05T02:14:26.418865+0000","last_clean":"2024-09-05T02:14:26.418865+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:14:26.418865+0000","last_undegraded":"2024-09-05T02:14:26.418865+0000","last_fullsized":"2024-09-05T02:14:26.418865+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.799675+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:14:26.799675+0000","last_peered":"2024-09-05T02:14:26.799675+0000","last_clean":"2024-09-05T02:14:26.799675+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:14:26.799675+0000","last_undegraded":"2024-09-05T02:14:26.799675+0000","last_fullsized":"2024-09-05T02:14:26.799675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.639096+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:14:26.639096+0000","last_peered":"2024-09-05T02:14:26.639096+0000","last_clean":"2024-09-05T02:14:26.639096+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:14:26.639096+0000","last_undegraded":"2024-09-05T02:14:26.639096+0000","last_fullsized":"2024-09-05T02:14:26.639096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.234099+0000","last_change":"2024-09-05T01:09:22.189533+0000","last_active":"2024-09-05T02:14:25.234099+0000","last_peered":"2024-09-05T02:14:25.234099+0000","last_clean":"2024-09-05T02:14:25.234099+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:14:25.234099+0000","last_undegraded":"2024-09-05T02:14:25.234099+0000","last_fullsized":"2024-09-05T02:14:25.234099+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.634124+0000","last_change":"2024-09-05T01:05:07.104648+0000","last_active":"2024-09-05T02:14:06.634124+0000","last_peered":"2024-09-05T02:14:06.634124+0000","last_clean":"2024-09-05T02:14:06.634124+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:14:06.634124+0000","last_undegraded":"2024-09-05T02:14:06.634124+0000","last_fullsized":"2024-09-05T02:14:06.634124+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:02.121064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.236666+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:14:26.236666+0000","last_peered":"2024-09-05T02:14:26.236666+0000","last_clean":"2024-09-05T02:14:26.236666+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:14:26.236666+0000","last_undegraded":"2024-09-05T02:14:26.236666+0000","last_fullsized":"2024-09-05T02:14:26.236666+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.432405+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.432405+0000","last_peered":"2024-09-05T02:16:21.432405+0000","last_clean":"2024-09-05T02:16:21.432405+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.432405+0000","last_undegraded":"2024-09-05T02:16:21.432405+0000","last_fullsized":"2024-09-05T02:16:21.432405+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.792699+0000","last_change":"2024-09-05T01:05:07.109781+0000","last_active":"2024-09-05T02:13:51.792699+0000","last_peered":"2024-09-05T02:13:51.792699+0000","last_clean":"2024-09-05T02:13:51.792699+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:13:51.792699+0000","last_undegraded":"2024-09-05T02:13:51.792699+0000","last_fullsized":"2024-09-05T02:13:51.792699+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:04:11.309775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.385750+0000","last_change":"2024-09-05T01:30:15.670716+0000","last_active":"2024-09-05T02:13:36.385750+0000","last_peered":"2024-09-05T02:13:36.385750+0000","last_clean":"2024-09-05T02:13:36.385750+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:13:36.385750+0000","last_undegraded":"2024-09-05T02:13:36.385750+0000","last_fullsized":"2024-09-05T02:13:36.385750+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:30.214527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:06.819371+0000","last_change":"2024-09-05T01:09:26.336791+0000","last_active":"2024-09-05T02:16:06.819371+0000","last_peered":"2024-09-05T02:16:06.819371+0000","last_clean":"2024-09-05T02:16:06.819371+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:16:06.819371+0000","last_undegraded":"2024-09-05T02:16:06.819371+0000","last_fullsized":"2024-09-05T02:16:06.819371+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:27:19.850660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.227128+0000","last_change":"2024-09-05T01:05:07.103532+0000","last_active":"2024-09-05T02:13:55.227128+0000","last_peered":"2024-09-05T02:13:55.227128+0000","last_clean":"2024-09-05T02:13:55.227128+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:13:55.227128+0000","last_undegraded":"2024-09-05T02:13:55.227128+0000","last_fullsized":"2024-09-05T02:13:55.227128+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:09.868656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228540+0000","last_change":"2024-09-05T01:05:07.106167+0000","last_active":"2024-09-05T02:13:51.228540+0000","last_peered":"2024-09-05T02:13:51.228540+0000","last_clean":"2024-09-05T02:13:51.228540+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:13:51.228540+0000","last_undegraded":"2024-09-05T02:13:51.228540+0000","last_fullsized":"2024-09-05T02:13:51.228540+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:44.638683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:06.247164+0000","last_change":"2024-09-05T01:09:26.348937+0000","last_active":"2024-09-05T02:16:06.247164+0000","last_peered":"2024-09-05T02:16:06.247164+0000","last_clean":"2024-09-05T02:16:06.247164+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:16:06.247164+0000","last_undegraded":"2024-09-05T02:16:06.247164+0000","last_fullsized":"2024-09-05T02:16:06.247164+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:33.480245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.793654+0000","last_change":"2024-09-05T01:09:22.183966+0000","last_active":"2024-09-05T02:13:56.793654+0000","last_peered":"2024-09-05T02:13:56.793654+0000","last_clean":"2024-09-05T02:13:56.793654+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:13:56.793654+0000","last_undegraded":"2024-09-05T02:13:56.793654+0000","last_fullsized":"2024-09-05T02:13:56.793654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:52.065642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":216,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.410907+0000","last_change":"2024-09-05T01:05:07.105723+0000","last_active":"2024-09-05T02:13:51.410907+0000","last_peered":"2024-09-05T02:13:51.410907+0000","last_clean":"2024-09-05T02:13:51.410907+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:13:51.410907+0000","last_undegraded":"2024-09-05T02:13:51.410907+0000","last_fullsized":"2024-09-05T02:13:51.410907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:08.187510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:01.439812+0000","last_change":"2024-09-05T01:09:22.173186+0000","last_active":"2024-09-05T02:16:01.439812+0000","last_peered":"2024-09-05T02:16:01.439812+0000","last_clean":"2024-09-05T02:16:01.439812+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:16:01.439812+0000","last_undegraded":"2024-09-05T02:16:01.439812+0000","last_fullsized":"2024-09-05T02:16:01.439812+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:34:45.178339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:16.832398+0000","last_change":"2024-09-05T01:05:07.103211+0000","last_active":"2024-09-05T02:13:16.832398+0000","last_peered":"2024-09-05T02:13:16.832398+0000","last_clean":"2024-09-05T02:13:16.832398+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:13:16.832398+0000","last_undegraded":"2024-09-05T02:13:16.832398+0000","last_fullsized":"2024-09-05T02:13:16.832398+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:40.214831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'377","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.819483+0000","last_change":"2024-09-05T02:16:32.819483+0000","last_active":"2024-09-05T02:16:32.819483+0000","last_peered":"2024-09-05T02:16:32.819483+0000","last_clean":"2024-09-05T02:16:32.819483+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:32.819483+0000","last_undegraded":"2024-09-05T02:16:32.819483+0000","last_fullsized":"2024-09-05T02:16:32.819483+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.819228+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:06.348956+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":47646,"num_write":1216,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'505","reported_seq":2105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.844799+0000","last_change":"2024-09-05T00:49:29.902310+0000","last_active":"2024-09-05T02:13:40.844799+0000","last_peered":"2024-09-05T02:13:40.844799+0000","last_clean":"2024-09-05T02:13:40.844799+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:13:40.844799+0000","last_undegraded":"2024-09-05T02:13:40.844799+0000","last_fullsized":"2024-09-05T02:13:40.844799+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:52.315609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'384","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.307989+0000","last_change":"2024-09-05T02:16:34.307989+0000","last_active":"2024-09-05T02:16:34.307989+0000","last_peered":"2024-09-05T02:16:34.307989+0000","last_clean":"2024-09-05T02:16:34.307989+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:34.307989+0000","last_undegraded":"2024-09-05T02:16:34.307989+0000","last_fullsized":"2024-09-05T02:16:34.307989+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.307761+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:07.165023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":565,"num_read_kb":74894,"num_write":1179,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'450","reported_seq":2087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.926317+0000","last_change":"2024-09-05T02:16:45.926317+0000","last_active":"2024-09-05T02:16:45.926317+0000","last_peered":"2024-09-05T02:16:45.926317+0000","last_clean":"2024-09-05T02:16:45.926317+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:16:45.926317+0000","last_undegraded":"2024-09-05T02:16:45.926317+0000","last_fullsized":"2024-09-05T02:16:45.926317+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.926073+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:34.170133+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'393","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.517827+0000","last_change":"2024-09-05T02:16:32.517827+0000","last_active":"2024-09-05T02:16:32.517827+0000","last_peered":"2024-09-05T02:16:32.517827+0000","last_clean":"2024-09-05T02:16:32.517827+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:16:32.517827+0000","last_undegraded":"2024-09-05T02:16:32.517827+0000","last_fullsized":"2024-09-05T02:16:32.517827+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.517629+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:14.484505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":743,"num_write":1140,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'852","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:19.842642+0000","last_change":"2024-09-05T00:49:29.900944+0000","last_active":"2024-09-05T02:14:19.842642+0000","last_peered":"2024-09-05T02:14:19.842642+0000","last_clean":"2024-09-05T02:14:19.842642+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:14:19.842642+0000","last_undegraded":"2024-09-05T02:14:19.842642+0000","last_fullsized":"2024-09-05T02:14:19.842642+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:48.973383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'380","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.511848+0000","last_change":"2024-09-05T02:16:41.511848+0000","last_active":"2024-09-05T02:16:41.511848+0000","last_peered":"2024-09-05T02:16:41.511848+0000","last_clean":"2024-09-05T02:16:41.511848+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:16:41.511848+0000","last_undegraded":"2024-09-05T02:16:41.511848+0000","last_fullsized":"2024-09-05T02:16:41.511848+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.511651+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:25.215125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":68502,"num_write":1310,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:40.840193+0000","last_change":"2024-09-05T00:49:29.919632+0000","last_active":"2024-09-05T02:13:40.840193+0000","last_peered":"2024-09-05T02:13:40.840193+0000","last_clean":"2024-09-05T02:13:40.840193+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:13:40.840193+0000","last_undegraded":"2024-09-05T02:13:40.840193+0000","last_fullsized":"2024-09-05T02:13:40.840193+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:31:42.074665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'363","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.081318+0000","last_change":"2024-09-05T02:16:42.081318+0000","last_active":"2024-09-05T02:16:42.081318+0000","last_peered":"2024-09-05T02:16:42.081318+0000","last_clean":"2024-09-05T02:16:42.081318+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:42.081318+0000","last_undegraded":"2024-09-05T02:16:42.081318+0000","last_fullsized":"2024-09-05T02:16:42.081318+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.081062+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:53:18.173817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":9059,"num_write":1154,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'447","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.875774+0000","last_change":"2024-09-05T02:16:42.875774+0000","last_active":"2024-09-05T02:16:42.875774+0000","last_peered":"2024-09-05T02:16:42.875774+0000","last_clean":"2024-09-05T02:16:42.875774+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:16:42.875774+0000","last_undegraded":"2024-09-05T02:16:42.875774+0000","last_fullsized":"2024-09-05T02:16:42.875774+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'447","last_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_deep_scrub":"264'447","last_deep_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.875583+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:30.938475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'324","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.540870+0000","last_change":"2024-09-05T02:16:39.540870+0000","last_active":"2024-09-05T02:16:39.540870+0000","last_peered":"2024-09-05T02:16:39.540870+0000","last_clean":"2024-09-05T02:16:39.540870+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:16:39.540870+0000","last_undegraded":"2024-09-05T02:16:39.540870+0000","last_fullsized":"2024-09-05T02:16:39.540870+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.540684+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:25.366090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":472,"num_write":1089,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'503","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.906613+0000","last_change":"2024-09-05T00:49:29.900890+0000","last_active":"2024-09-05T02:13:45.906613+0000","last_peered":"2024-09-05T02:13:45.906613+0000","last_clean":"2024-09-05T02:13:45.906613+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:13:45.906613+0000","last_undegraded":"2024-09-05T02:13:45.906613+0000","last_fullsized":"2024-09-05T02:13:45.906613+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:25:04.655215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'353","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.087320+0000","last_change":"2024-09-05T02:16:41.087320+0000","last_active":"2024-09-05T02:16:41.087320+0000","last_peered":"2024-09-05T02:16:41.087320+0000","last_clean":"2024-09-05T02:16:41.087320+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:41.087320+0000","last_undegraded":"2024-09-05T02:16:41.087320+0000","last_fullsized":"2024-09-05T02:16:41.087320+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.087096+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:59:56.430971+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495269,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":507,"num_read_kb":57163,"num_write":1112,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'473","reported_seq":2165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.607735+0000","last_change":"2024-09-05T00:49:29.918860+0000","last_active":"2024-09-05T02:15:48.607735+0000","last_peered":"2024-09-05T02:15:48.607735+0000","last_clean":"2024-09-05T02:15:48.607735+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:15:48.607735+0000","last_undegraded":"2024-09-05T02:15:48.607735+0000","last_fullsized":"2024-09-05T02:15:48.607735+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:36.131820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'355","reported_seq":1192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.002926+0000","last_change":"2024-09-05T02:16:39.002926+0000","last_active":"2024-09-05T02:16:39.002926+0000","last_peered":"2024-09-05T02:16:39.002926+0000","last_clean":"2024-09-05T02:16:39.002926+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:39.002926+0000","last_undegraded":"2024-09-05T02:16:39.002926+0000","last_fullsized":"2024-09-05T02:16:39.002926+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.002732+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:17.177395+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":814,"num_read_kb":7164,"num_write":1128,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'453","reported_seq":2036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.824593+0000","last_change":"2024-09-05T02:16:38.824593+0000","last_active":"2024-09-05T02:16:38.824593+0000","last_peered":"2024-09-05T02:16:38.824593+0000","last_clean":"2024-09-05T02:16:38.824593+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:16:38.824593+0000","last_undegraded":"2024-09-05T02:16:38.824593+0000","last_fullsized":"2024-09-05T02:16:38.824593+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.824400+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:46.210785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'747","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.472094+0000","last_change":"2024-09-05T02:16:45.472094+0000","last_active":"2024-09-05T02:16:45.472094+0000","last_peered":"2024-09-05T02:16:45.472094+0000","last_clean":"2024-09-05T02:16:45.472094+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:16:45.472094+0000","last_undegraded":"2024-09-05T02:16:45.472094+0000","last_fullsized":"2024-09-05T02:16:45.472094+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.471918+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:16.977832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'356","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.061665+0000","last_change":"2024-09-05T02:16:40.061510+0000","last_active":"2024-09-05T02:16:40.061665+0000","last_peered":"2024-09-05T02:16:40.061665+0000","last_clean":"2024-09-05T02:16:40.061665+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:40.061665+0000","last_undegraded":"2024-09-05T02:16:40.061665+0000","last_fullsized":"2024-09-05T02:16:40.061665+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.061289+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:56:17.879080+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1733359,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":485,"num_read_kb":16771,"num_write":1085,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'435","reported_seq":1966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.012421+0000","last_change":"2024-09-05T02:16:44.012421+0000","last_active":"2024-09-05T02:16:44.012421+0000","last_peered":"2024-09-05T02:16:44.012421+0000","last_clean":"2024-09-05T02:16:44.012421+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:16:44.012421+0000","last_undegraded":"2024-09-05T02:16:44.012421+0000","last_fullsized":"2024-09-05T02:16:44.012421+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.012213+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:25.759917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'350","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.815192+0000","last_change":"2024-09-05T02:16:36.815192+0000","last_active":"2024-09-05T02:16:36.815192+0000","last_peered":"2024-09-05T02:16:36.815192+0000","last_clean":"2024-09-05T02:16:36.815192+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:36.815192+0000","last_undegraded":"2024-09-05T02:16:36.815192+0000","last_fullsized":"2024-09-05T02:16:36.815192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.814965+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:24.655143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":5849,"num_write":1054,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'463","reported_seq":2003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.501298+0000","last_change":"2024-09-05T02:16:44.501298+0000","last_active":"2024-09-05T02:16:44.501298+0000","last_peered":"2024-09-05T02:16:44.501298+0000","last_clean":"2024-09-05T02:16:44.501298+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:16:44.501298+0000","last_undegraded":"2024-09-05T02:16:44.501298+0000","last_fullsized":"2024-09-05T02:16:44.501298+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.501076+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:51.917233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'361","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.812670+0000","last_change":"2024-09-05T02:16:35.812670+0000","last_active":"2024-09-05T02:16:35.812670+0000","last_peered":"2024-09-05T02:16:35.812670+0000","last_clean":"2024-09-05T02:16:35.812670+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:35.812670+0000","last_undegraded":"2024-09-05T02:16:35.812670+0000","last_fullsized":"2024-09-05T02:16:35.812670+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.812463+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:35.464351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":7060,"num_write":1221,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'493","reported_seq":2161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.766824+0000","last_change":"2024-09-05T02:16:36.766824+0000","last_active":"2024-09-05T02:16:36.766824+0000","last_peered":"2024-09-05T02:16:36.766824+0000","last_clean":"2024-09-05T02:16:36.766824+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:16:36.766824+0000","last_undegraded":"2024-09-05T02:16:36.766824+0000","last_fullsized":"2024-09-05T02:16:36.766824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'493","last_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_deep_scrub":"264'493","last_deep_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.766629+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:02:04.726199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'358","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.529586+0000","last_change":"2024-09-05T02:16:32.529586+0000","last_active":"2024-09-05T02:16:32.529586+0000","last_peered":"2024-09-05T02:16:32.529586+0000","last_clean":"2024-09-05T02:16:32.529586+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:32.529586+0000","last_undegraded":"2024-09-05T02:16:32.529586+0000","last_fullsized":"2024-09-05T02:16:32.529586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.529382+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:38.596982+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":17342,"num_write":1226,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'408","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.779690+0000","last_change":"2024-09-05T02:16:37.779690+0000","last_active":"2024-09-05T02:16:37.779690+0000","last_peered":"2024-09-05T02:16:37.779690+0000","last_clean":"2024-09-05T02:16:37.779690+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:16:37.779690+0000","last_undegraded":"2024-09-05T02:16:37.779690+0000","last_fullsized":"2024-09-05T02:16:37.779690+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.779509+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:37.394227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'353","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.985816+0000","last_change":"2024-09-05T02:16:34.985816+0000","last_active":"2024-09-05T02:16:34.985816+0000","last_peered":"2024-09-05T02:16:34.985816+0000","last_clean":"2024-09-05T02:16:34.985816+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:34.985816+0000","last_undegraded":"2024-09-05T02:16:34.985816+0000","last_fullsized":"2024-09-05T02:16:34.985816+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.985621+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:35.048288+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":1528,"num_write":1229,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'749","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.629631+0000","last_change":"2024-09-05T00:49:29.921148+0000","last_active":"2024-09-05T02:14:29.629631+0000","last_peered":"2024-09-05T02:14:29.629631+0000","last_clean":"2024-09-05T02:14:29.629631+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:14:29.629631+0000","last_undegraded":"2024-09-05T02:14:29.629631+0000","last_fullsized":"2024-09-05T02:14:29.629631+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'340","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.555210+0000","last_change":"2024-09-05T02:16:31.555210+0000","last_active":"2024-09-05T02:16:31.555210+0000","last_peered":"2024-09-05T02:16:31.555210+0000","last_clean":"2024-09-05T02:16:31.555210+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:16:31.555210+0000","last_undegraded":"2024-09-05T02:16:31.555210+0000","last_fullsized":"2024-09-05T02:16:31.555210+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.555009+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:13.682055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":32081,"num_write":1077,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'127","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.934273+0000","last_change":"2024-09-05T00:49:37.949792+0000","last_active":"2024-09-05T02:14:29.934273+0000","last_peered":"2024-09-05T02:14:29.934273+0000","last_clean":"2024-09-05T02:14:29.934273+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:14:29.934273+0000","last_undegraded":"2024-09-05T02:14:29.934273+0000","last_fullsized":"2024-09-05T02:14:29.934273+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.810201+0000","last_change":"2024-09-05T02:16:33.810064+0000","last_active":"2024-09-05T02:16:33.810201+0000","last_peered":"2024-09-05T02:16:33.810201+0000","last_clean":"2024-09-05T02:16:33.810201+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:16:33.810201+0000","last_undegraded":"2024-09-05T02:16:33.810201+0000","last_fullsized":"2024-09-05T02:16:33.810201+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.809886+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:56.483637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'351","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.079623+0000","last_change":"2024-09-05T02:16:37.079623+0000","last_active":"2024-09-05T02:16:37.079623+0000","last_peered":"2024-09-05T02:16:37.079623+0000","last_clean":"2024-09-05T02:16:37.079623+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:37.079623+0000","last_undegraded":"2024-09-05T02:16:37.079623+0000","last_fullsized":"2024-09-05T02:16:37.079623+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.079302+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:25:10.945666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":5561,"num_write":1118,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230732+0000","last_change":"2024-09-05T00:49:31.911566+0000","last_active":"2024-09-05T02:14:10.230732+0000","last_peered":"2024-09-05T02:14:10.230732+0000","last_clean":"2024-09-05T02:14:10.230732+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:14:10.230732+0000","last_undegraded":"2024-09-05T02:14:10.230732+0000","last_fullsized":"2024-09-05T02:14:10.230732+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'367","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.545296+0000","last_change":"2024-09-05T00:49:33.908342+0000","last_active":"2024-09-05T02:16:21.545296+0000","last_peered":"2024-09-05T02:16:21.545296+0000","last_clean":"2024-09-05T02:16:21.545296+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:16:21.545296+0000","last_undegraded":"2024-09-05T02:16:21.545296+0000","last_fullsized":"2024-09-05T02:16:21.545296+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":585,"num_read_kb":1187,"num_write":454,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635455+0000","last_change":"2024-09-05T00:49:35.935224+0000","last_active":"2024-09-05T02:14:11.635455+0000","last_peered":"2024-09-05T02:14:11.635455+0000","last_clean":"2024-09-05T02:14:11.635455+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:14:11.635455+0000","last_undegraded":"2024-09-05T02:14:11.635455+0000","last_fullsized":"2024-09-05T02:14:11.635455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2467","reported_seq":4375,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.838585+0000","last_change":"2024-09-05T00:49:37.940197+0000","last_active":"2024-09-05T02:14:27.838585+0000","last_peered":"2024-09-05T02:14:27.838585+0000","last_clean":"2024-09-05T02:14:27.838585+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:14:27.838585+0000","last_undegraded":"2024-09-05T02:14:27.838585+0000","last_fullsized":"2024-09-05T02:14:27.838585+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:21.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.488036+0000","last_change":"2024-09-05T02:16:43.488036+0000","last_active":"2024-09-05T02:16:43.488036+0000","last_peered":"2024-09-05T02:16:43.488036+0000","last_clean":"2024-09-05T02:16:43.488036+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:16:43.488036+0000","last_undegraded":"2024-09-05T02:16:43.488036+0000","last_fullsized":"2024-09-05T02:16:43.488036+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'752","last_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_deep_scrub":"264'752","last_deep_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.487849+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:28.339919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'326","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.495350+0000","last_change":"2024-09-05T02:16:29.495350+0000","last_active":"2024-09-05T02:16:29.495350+0000","last_peered":"2024-09-05T02:16:29.495350+0000","last_clean":"2024-09-05T02:16:29.495350+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:16:29.495350+0000","last_undegraded":"2024-09-05T02:16:29.495350+0000","last_fullsized":"2024-09-05T02:16:29.495350+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.495167+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:19:45.662775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":61922,"num_write":915,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487978+0000","last_change":"2024-09-05T00:49:31.917103+0000","last_active":"2024-09-05T02:13:51.487978+0000","last_peered":"2024-09-05T02:13:51.487978+0000","last_clean":"2024-09-05T02:13:51.487978+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:13:51.487978+0000","last_undegraded":"2024-09-05T02:13:51.487978+0000","last_fullsized":"2024-09-05T02:13:51.487978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:08.039118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'106","reported_seq":659,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.233336+0000","last_change":"2024-09-05T00:49:33.908801+0000","last_active":"2024-09-05T02:14:11.233336+0000","last_peered":"2024-09-05T02:14:11.233336+0000","last_clean":"2024-09-05T02:14:11.233336+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:14:11.233336+0000","last_undegraded":"2024-09-05T02:14:11.233336+0000","last_fullsized":"2024-09-05T02:14:11.233336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.233277+0000","last_change":"2024-09-05T00:49:35.930182+0000","last_active":"2024-09-05T02:14:11.233277+0000","last_peered":"2024-09-05T02:14:11.233277+0000","last_clean":"2024-09-05T02:14:11.233277+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:14:11.233277+0000","last_undegraded":"2024-09-05T02:14:11.233277+0000","last_fullsized":"2024-09-05T02:14:11.233277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'106","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.066549+0000","last_change":"2024-09-05T00:49:37.932878+0000","last_active":"2024-09-05T02:14:26.066549+0000","last_peered":"2024-09-05T02:14:26.066549+0000","last_clean":"2024-09-05T02:14:26.066549+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:14:26.066549+0000","last_undegraded":"2024-09-05T02:14:26.066549+0000","last_fullsized":"2024-09-05T02:14:26.066549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:47:02.300469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1224","reported_seq":2918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.299022+0000","last_change":"2024-09-05T02:16:42.299022+0000","last_active":"2024-09-05T02:16:42.299022+0000","last_peered":"2024-09-05T02:16:42.299022+0000","last_clean":"2024-09-05T02:16:42.299022+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:16:42.299022+0000","last_undegraded":"2024-09-05T02:16:42.299022+0000","last_fullsized":"2024-09-05T02:16:42.299022+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1224","last_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_deep_scrub":"264'1224","last_deep_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.298827+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:49.318161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.081594+0000","last_change":"2024-09-05T02:16:35.081594+0000","last_active":"2024-09-05T02:16:35.081594+0000","last_peered":"2024-09-05T02:16:35.081594+0000","last_clean":"2024-09-05T02:16:35.081594+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:35.081594+0000","last_undegraded":"2024-09-05T02:16:35.081594+0000","last_fullsized":"2024-09-05T02:16:35.081594+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.081383+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:56:51.256314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":6929,"num_write":1016,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.491186+0000","last_change":"2024-09-05T00:49:31.914059+0000","last_active":"2024-09-05T02:14:06.491186+0000","last_peered":"2024-09-05T02:14:06.491186+0000","last_clean":"2024-09-05T02:14:06.491186+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:14:06.491186+0000","last_undegraded":"2024-09-05T02:14:06.491186+0000","last_fullsized":"2024-09-05T02:14:06.491186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'188","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.799623+0000","last_change":"2024-09-05T02:16:45.799623+0000","last_active":"2024-09-05T02:16:45.799623+0000","last_peered":"2024-09-05T02:16:45.799623+0000","last_clean":"2024-09-05T02:16:45.799623+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:16:45.799623+0000","last_undegraded":"2024-09-05T02:16:45.799623+0000","last_fullsized":"2024-09-05T02:16:45.799623+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.799431+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:29.922191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'787","reported_seq":4952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.942957+0000","last_change":"2024-09-05T00:49:35.927429+0000","last_active":"2024-09-05T02:16:22.942957+0000","last_peered":"2024-09-05T02:16:22.942957+0000","last_clean":"2024-09-05T02:16:22.942957+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:22.942957+0000","last_undegraded":"2024-09-05T02:16:22.942957+0000","last_fullsized":"2024-09-05T02:16:22.942957+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'234","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.269828+0000","last_change":"2024-09-05T00:49:37.922161+0000","last_active":"2024-09-05T02:15:48.269828+0000","last_peered":"2024-09-05T02:15:48.269828+0000","last_clean":"2024-09-05T02:15:48.269828+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:15:48.269828+0000","last_undegraded":"2024-09-05T02:15:48.269828+0000","last_fullsized":"2024-09-05T02:15:48.269828+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:45.817026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'685","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.979024+0000","last_change":"2024-09-05T02:16:37.979024+0000","last_active":"2024-09-05T02:16:37.979024+0000","last_peered":"2024-09-05T02:16:37.979024+0000","last_clean":"2024-09-05T02:16:37.979024+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:16:37.979024+0000","last_undegraded":"2024-09-05T02:16:37.979024+0000","last_fullsized":"2024-09-05T02:16:37.979024+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.978839+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:33.371371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'362","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.834992+0000","last_change":"2024-09-05T02:16:31.834992+0000","last_active":"2024-09-05T02:16:31.834992+0000","last_peered":"2024-09-05T02:16:31.834992+0000","last_clean":"2024-09-05T02:16:31.834992+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:31.834992+0000","last_undegraded":"2024-09-05T02:16:31.834992+0000","last_fullsized":"2024-09-05T02:16:31.834992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.834772+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:22.380162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":55829,"num_write":1110,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230773+0000","last_change":"2024-09-05T00:49:31.910341+0000","last_active":"2024-09-05T02:14:10.230773+0000","last_peered":"2024-09-05T02:14:10.230773+0000","last_clean":"2024-09-05T02:14:10.230773+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:14:10.230773+0000","last_undegraded":"2024-09-05T02:14:10.230773+0000","last_fullsized":"2024-09-05T02:14:10.230773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'326","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.256387+0000","last_change":"2024-09-05T00:49:34.055554+0000","last_active":"2024-09-05T02:16:21.256387+0000","last_peered":"2024-09-05T02:16:21.256387+0000","last_clean":"2024-09-05T02:16:21.256387+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:21.256387+0000","last_undegraded":"2024-09-05T02:16:21.256387+0000","last_fullsized":"2024-09-05T02:16:21.256387+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'801","reported_seq":4539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.387623+0000","last_change":"2024-09-05T00:49:35.938226+0000","last_active":"2024-09-05T02:16:22.387623+0000","last_peered":"2024-09-05T02:16:22.387623+0000","last_clean":"2024-09-05T02:16:22.387623+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:16:22.387623+0000","last_undegraded":"2024-09-05T02:16:22.387623+0000","last_fullsized":"2024-09-05T02:16:22.387623+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:56.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'747","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.480047+0000","last_change":"2024-09-05T02:16:42.480047+0000","last_active":"2024-09-05T02:16:42.480047+0000","last_peered":"2024-09-05T02:16:42.480047+0000","last_clean":"2024-09-05T02:16:42.480047+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:16:42.480047+0000","last_undegraded":"2024-09-05T02:16:42.480047+0000","last_fullsized":"2024-09-05T02:16:42.480047+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.479861+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:12.117260+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5103,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'440","reported_seq":1158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.122895+0000","last_change":"2024-09-05T02:16:36.122895+0000","last_active":"2024-09-05T02:16:36.122895+0000","last_peered":"2024-09-05T02:16:36.122895+0000","last_clean":"2024-09-05T02:16:36.122895+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:36.122895+0000","last_undegraded":"2024-09-05T02:16:36.122895+0000","last_fullsized":"2024-09-05T02:16:36.122895+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.122675+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:51.397953+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":823,"num_read_kb":4743,"num_write":1412,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632817+0000","last_change":"2024-09-05T00:49:31.919796+0000","last_active":"2024-09-05T02:14:01.632817+0000","last_peered":"2024-09-05T02:14:01.632817+0000","last_clean":"2024-09-05T02:14:01.632817+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:14:01.632817+0000","last_undegraded":"2024-09-05T02:14:01.632817+0000","last_fullsized":"2024-09-05T02:14:01.632817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:17.976816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'420","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.795042+0000","last_change":"2024-09-05T00:49:34.052466+0000","last_active":"2024-09-05T02:16:21.795042+0000","last_peered":"2024-09-05T02:16:21.795042+0000","last_clean":"2024-09-05T02:16:21.795042+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:16:21.795042+0000","last_undegraded":"2024-09-05T02:16:21.795042+0000","last_fullsized":"2024-09-05T02:16:21.795042+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":700,"num_read_kb":1390,"num_write":540,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.780250+0000","last_change":"2024-09-05T00:49:35.937335+0000","last_active":"2024-09-05T02:12:51.780250+0000","last_peered":"2024-09-05T02:12:51.780250+0000","last_clean":"2024-09-05T02:12:51.780250+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:12:51.780250+0000","last_undegraded":"2024-09-05T02:12:51.780250+0000","last_fullsized":"2024-09-05T02:12:51.780250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:58:11.123088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'584","reported_seq":1411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.668190+0000","last_change":"2024-09-05T00:49:37.946024+0000","last_active":"2024-09-05T02:15:49.668190+0000","last_peered":"2024-09-05T02:15:49.668190+0000","last_clean":"2024-09-05T02:15:49.668190+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:15:49.668190+0000","last_undegraded":"2024-09-05T02:15:49.668190+0000","last_fullsized":"2024-09-05T02:15:49.668190+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:47:31.597559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'439","reported_seq":1983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.464369+0000","last_change":"2024-09-05T02:16:35.464369+0000","last_active":"2024-09-05T02:16:35.464369+0000","last_peered":"2024-09-05T02:16:35.464369+0000","last_clean":"2024-09-05T02:16:35.464369+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:16:35.464369+0000","last_undegraded":"2024-09-05T02:16:35.464369+0000","last_fullsized":"2024-09-05T02:16:35.464369+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.464163+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:34.736676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'305","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.125280+0000","last_change":"2024-09-05T02:16:33.125280+0000","last_active":"2024-09-05T02:16:33.125280+0000","last_peered":"2024-09-05T02:16:33.125280+0000","last_clean":"2024-09-05T02:16:33.125280+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:33.125280+0000","last_undegraded":"2024-09-05T02:16:33.125280+0000","last_fullsized":"2024-09-05T02:16:33.125280+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.125091+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:46.538429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":6807,"num_write":872,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.791859+0000","last_change":"2024-09-05T02:16:40.791859+0000","last_active":"2024-09-05T02:16:40.791859+0000","last_peered":"2024-09-05T02:16:40.791859+0000","last_clean":"2024-09-05T02:16:40.791859+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:16:40.791859+0000","last_undegraded":"2024-09-05T02:16:40.791859+0000","last_fullsized":"2024-09-05T02:16:40.791859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.791659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:00:07.109747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'298","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.617340+0000","last_change":"2024-09-05T00:49:33.925800+0000","last_active":"2024-09-05T02:16:22.617340+0000","last_peered":"2024-09-05T02:16:22.617340+0000","last_clean":"2024-09-05T02:16:22.617340+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:16:22.617340+0000","last_undegraded":"2024-09-05T02:16:22.617340+0000","last_fullsized":"2024-09-05T02:16:22.617340+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:21.800423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45431,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1122,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495206+0000","last_change":"2024-09-05T00:49:35.934298+0000","last_active":"2024-09-05T02:14:26.495206+0000","last_peered":"2024-09-05T02:14:26.495206+0000","last_clean":"2024-09-05T02:14:26.495206+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:14:26.495206+0000","last_undegraded":"2024-09-05T02:14:26.495206+0000","last_fullsized":"2024-09-05T02:14:26.495206+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:26.432127+0000","last_change":"2024-09-05T00:49:37.939432+0000","last_active":"2024-09-05T02:15:26.432127+0000","last_peered":"2024-09-05T02:15:26.432127+0000","last_clean":"2024-09-05T02:15:26.432127+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:15:26.432127+0000","last_undegraded":"2024-09-05T02:15:26.432127+0000","last_fullsized":"2024-09-05T02:15:26.432127+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:10:08.494468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'480","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.873624+0000","last_change":"2024-09-05T02:16:39.873624+0000","last_active":"2024-09-05T02:16:39.873624+0000","last_peered":"2024-09-05T02:16:39.873624+0000","last_clean":"2024-09-05T02:16:39.873624+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:16:39.873624+0000","last_undegraded":"2024-09-05T02:16:39.873624+0000","last_fullsized":"2024-09-05T02:16:39.873624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'480","last_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_deep_scrub":"264'480","last_deep_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.873409+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:34.456533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.108848+0000","last_change":"2024-09-05T02:16:34.108848+0000","last_active":"2024-09-05T02:16:34.108848+0000","last_peered":"2024-09-05T02:16:34.108848+0000","last_clean":"2024-09-05T02:16:34.108848+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:34.108848+0000","last_undegraded":"2024-09-05T02:16:34.108848+0000","last_fullsized":"2024-09-05T02:16:34.108848+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.108657+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:36:55.603566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":11870,"num_write":1072,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.767880+0000","last_change":"2024-09-05T02:16:42.767880+0000","last_active":"2024-09-05T02:16:42.767880+0000","last_peered":"2024-09-05T02:16:42.767880+0000","last_clean":"2024-09-05T02:16:42.767880+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:16:42.767880+0000","last_undegraded":"2024-09-05T02:16:42.767880+0000","last_fullsized":"2024-09-05T02:16:42.767880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.767694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:58:50.029710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'364","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.921065+0000","last_change":"2024-09-05T00:49:33.914287+0000","last_active":"2024-09-05T02:16:21.921065+0000","last_peered":"2024-09-05T02:16:21.921065+0000","last_clean":"2024-09-05T02:16:21.921065+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:21.921065+0000","last_undegraded":"2024-09-05T02:16:21.921065+0000","last_fullsized":"2024-09-05T02:16:21.921065+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:11.461929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1153,"num_write":442,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.239500+0000","last_change":"2024-09-05T02:16:44.239500+0000","last_active":"2024-09-05T02:16:44.239500+0000","last_peered":"2024-09-05T02:16:44.239500+0000","last_clean":"2024-09-05T02:16:44.239500+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:16:44.239500+0000","last_undegraded":"2024-09-05T02:16:44.239500+0000","last_fullsized":"2024-09-05T02:16:44.239500+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.239280+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:22:58.554723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.657912+0000","last_change":"2024-09-05T00:49:37.930994+0000","last_active":"2024-09-05T02:15:48.657912+0000","last_peered":"2024-09-05T02:15:48.657912+0000","last_clean":"2024-09-05T02:15:48.657912+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:15:48.657912+0000","last_undegraded":"2024-09-05T02:15:48.657912+0000","last_fullsized":"2024-09-05T02:15:48.657912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:37:05.359031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'807","reported_seq":2410,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.277310+0000","last_change":"2024-09-05T02:16:45.277310+0000","last_active":"2024-09-05T02:16:45.277310+0000","last_peered":"2024-09-05T02:16:45.277310+0000","last_clean":"2024-09-05T02:16:45.277310+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:16:45.277310+0000","last_undegraded":"2024-09-05T02:16:45.277310+0000","last_fullsized":"2024-09-05T02:16:45.277310+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'807","last_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_deep_scrub":"264'807","last_deep_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.277038+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:50.324780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3282,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'325","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.512680+0000","last_change":"2024-09-05T02:16:32.512680+0000","last_active":"2024-09-05T02:16:32.512680+0000","last_peered":"2024-09-05T02:16:32.512680+0000","last_clean":"2024-09-05T02:16:32.512680+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:16:32.512680+0000","last_undegraded":"2024-09-05T02:16:32.512680+0000","last_fullsized":"2024-09-05T02:16:32.512680+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.512392+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:51.415971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":126733,"num_write":975,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.758161+0000","last_change":"2024-09-05T02:16:41.758161+0000","last_active":"2024-09-05T02:16:41.758161+0000","last_peered":"2024-09-05T02:16:41.758161+0000","last_clean":"2024-09-05T02:16:41.758161+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:16:41.758161+0000","last_undegraded":"2024-09-05T02:16:41.758161+0000","last_fullsized":"2024-09-05T02:16:41.758161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.757955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:26.539921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'553","reported_seq":1233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.317795+0000","last_change":"2024-09-05T02:16:40.317795+0000","last_active":"2024-09-05T02:16:40.317795+0000","last_peered":"2024-09-05T02:16:40.317795+0000","last_clean":"2024-09-05T02:16:40.317795+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:16:40.317795+0000","last_undegraded":"2024-09-05T02:16:40.317795+0000","last_fullsized":"2024-09-05T02:16:40.317795+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.317611+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:00:06.774339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101782,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":984,"num_read_kb":2420,"num_write":814,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.391710+0000","last_change":"2024-09-05T00:49:35.924089+0000","last_active":"2024-09-05T02:14:06.391710+0000","last_peered":"2024-09-05T02:14:06.391710+0000","last_clean":"2024-09-05T02:14:06.391710+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:14:06.391710+0000","last_undegraded":"2024-09-05T02:14:06.391710+0000","last_fullsized":"2024-09-05T02:14:06.391710+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'123","reported_seq":667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.796632+0000","last_change":"2024-09-05T00:49:37.951943+0000","last_active":"2024-09-05T02:14:11.796632+0000","last_peered":"2024-09-05T02:14:11.796632+0000","last_clean":"2024-09-05T02:14:11.796632+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:14:11.796632+0000","last_undegraded":"2024-09-05T02:14:11.796632+0000","last_fullsized":"2024-09-05T02:14:11.796632+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:10:12.600724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'959","reported_seq":2795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.496164+0000","last_change":"2024-09-05T02:16:34.496164+0000","last_active":"2024-09-05T02:16:34.496164+0000","last_peered":"2024-09-05T02:16:34.496164+0000","last_clean":"2024-09-05T02:16:34.496164+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:16:34.496164+0000","last_undegraded":"2024-09-05T02:16:34.496164+0000","last_fullsized":"2024-09-05T02:16:34.496164+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'959","last_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_deep_scrub":"264'959","last_deep_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.495992+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:04.831466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'591","reported_seq":1421,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.881841+0000","last_change":"2024-09-05T02:16:27.881841+0000","last_active":"2024-09-05T02:16:27.881841+0000","last_peered":"2024-09-05T02:16:27.881841+0000","last_clean":"2024-09-05T02:16:27.881841+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:27.881841+0000","last_undegraded":"2024-09-05T02:16:27.881841+0000","last_fullsized":"2024-09-05T02:16:27.881841+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'591","last_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_deep_scrub":"264'591","last_deep_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.881626+0000","objects_scrubbed":10,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:45.891183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1279,"num_read_kb":93816,"num_write":1779,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.755375+0000","last_change":"2024-09-05T02:16:43.755375+0000","last_active":"2024-09-05T02:16:43.755375+0000","last_peered":"2024-09-05T02:16:43.755375+0000","last_clean":"2024-09-05T02:16:43.755375+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:16:43.755375+0000","last_undegraded":"2024-09-05T02:16:43.755375+0000","last_fullsized":"2024-09-05T02:16:43.755375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.755186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:44.890636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'317","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.830748+0000","last_change":"2024-09-05T00:49:33.912638+0000","last_active":"2024-09-05T02:16:22.830748+0000","last_peered":"2024-09-05T02:16:22.830748+0000","last_clean":"2024-09-05T02:16:22.830748+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:16:22.830748+0000","last_undegraded":"2024-09-05T02:16:22.830748+0000","last_fullsized":"2024-09-05T02:16:22.830748+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:18:34.630632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":1083,"num_write":458,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:10.455773+0000","last_change":"2024-09-05T00:49:35.943863+0000","last_active":"2024-09-05T02:13:10.455773+0000","last_peered":"2024-09-05T02:13:10.455773+0000","last_clean":"2024-09-05T02:13:10.455773+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:13:10.455773+0000","last_undegraded":"2024-09-05T02:13:10.455773+0000","last_fullsized":"2024-09-05T02:13:10.455773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:18:41.634624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'102","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:37.522963+0000","last_change":"2024-09-05T00:49:37.954493+0000","last_active":"2024-09-05T02:15:37.522963+0000","last_peered":"2024-09-05T02:15:37.522963+0000","last_clean":"2024-09-05T02:15:37.522963+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:15:37.522963+0000","last_undegraded":"2024-09-05T02:15:37.522963+0000","last_fullsized":"2024-09-05T02:15:37.522963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:55.189506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'497","reported_seq":2127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.495522+0000","last_change":"2024-09-05T02:16:36.495522+0000","last_active":"2024-09-05T02:16:36.495522+0000","last_peered":"2024-09-05T02:16:36.495522+0000","last_clean":"2024-09-05T02:16:36.495522+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:16:36.495522+0000","last_undegraded":"2024-09-05T02:16:36.495522+0000","last_fullsized":"2024-09-05T02:16:36.495522+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.495268+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:26.514116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'382","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.836546+0000","last_change":"2024-09-05T02:16:29.836399+0000","last_active":"2024-09-05T02:16:29.836546+0000","last_peered":"2024-09-05T02:16:29.836546+0000","last_clean":"2024-09-05T02:16:29.836546+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:29.836546+0000","last_undegraded":"2024-09-05T02:16:29.836546+0000","last_fullsized":"2024-09-05T02:16:29.836546+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.836204+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:59.305574+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250145,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":21240,"num_write":1224,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.186623+0000","last_change":"2024-09-05T02:16:42.186623+0000","last_active":"2024-09-05T02:16:42.186623+0000","last_peered":"2024-09-05T02:16:42.186623+0000","last_clean":"2024-09-05T02:16:42.186623+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:16:42.186623+0000","last_undegraded":"2024-09-05T02:16:42.186623+0000","last_fullsized":"2024-09-05T02:16:42.186623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.186438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:10.931784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'353","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.751783+0000","last_change":"2024-09-05T02:16:44.751783+0000","last_active":"2024-09-05T02:16:44.751783+0000","last_peered":"2024-09-05T02:16:44.751783+0000","last_clean":"2024-09-05T02:16:44.751783+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:16:44.751783+0000","last_undegraded":"2024-09-05T02:16:44.751783+0000","last_fullsized":"2024-09-05T02:16:44.751783+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.751562+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:24.105318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":1068,"num_write":416,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.842082+0000","last_change":"2024-09-05T00:49:35.937729+0000","last_active":"2024-09-05T02:16:20.842082+0000","last_peered":"2024-09-05T02:16:20.842082+0000","last_clean":"2024-09-05T02:16:20.842082+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:20.842082+0000","last_undegraded":"2024-09-05T02:16:20.842082+0000","last_fullsized":"2024-09-05T02:16:20.842082+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:07:50.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.281544+0000","last_change":"2024-09-05T00:49:37.933620+0000","last_active":"2024-09-05T02:14:25.281544+0000","last_peered":"2024-09-05T02:14:25.281544+0000","last_clean":"2024-09-05T02:14:25.281544+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:14:25.281544+0000","last_undegraded":"2024-09-05T02:14:25.281544+0000","last_fullsized":"2024-09-05T02:14:25.281544+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:06.955650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'394","reported_seq":1896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.447326+0000","last_change":"2024-09-05T02:16:37.447326+0000","last_active":"2024-09-05T02:16:37.447326+0000","last_peered":"2024-09-05T02:16:37.447326+0000","last_clean":"2024-09-05T02:16:37.447326+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:16:37.447326+0000","last_undegraded":"2024-09-05T02:16:37.447326+0000","last_fullsized":"2024-09-05T02:16:37.447326+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.447142+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:57.480162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.517777+0000","last_change":"2024-09-05T02:16:29.517777+0000","last_active":"2024-09-05T02:16:29.517777+0000","last_peered":"2024-09-05T02:16:29.517777+0000","last_clean":"2024-09-05T02:16:29.517777+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:29.517777+0000","last_undegraded":"2024-09-05T02:16:29.517777+0000","last_fullsized":"2024-09-05T02:16:29.517777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.517556+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:02:11.732840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":32430,"num_write":1082,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1463,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.587099+0000","last_change":"2024-09-05T00:49:31.921867+0000","last_active":"2024-09-05T02:16:20.587099+0000","last_peered":"2024-09-05T02:16:20.587099+0000","last_clean":"2024-09-05T02:16:20.587099+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:16:20.587099+0000","last_undegraded":"2024-09-05T02:16:20.587099+0000","last_fullsized":"2024-09-05T02:16:20.587099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:12.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'115","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473659+0000","last_change":"2024-09-05T00:49:34.054334+0000","last_active":"2024-09-05T02:12:51.473659+0000","last_peered":"2024-09-05T02:12:51.473659+0000","last_clean":"2024-09-05T02:12:51.473659+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:12:51.473659+0000","last_undegraded":"2024-09-05T02:12:51.473659+0000","last_fullsized":"2024-09-05T02:12:51.473659+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:44:00.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'771","reported_seq":2808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.391809+0000","last_change":"2024-09-05T00:49:35.927090+0000","last_active":"2024-09-05T02:16:22.391809+0000","last_peered":"2024-09-05T02:16:22.391809+0000","last_clean":"2024-09-05T02:16:22.391809+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:22.391809+0000","last_undegraded":"2024-09-05T02:16:22.391809+0000","last_fullsized":"2024-09-05T02:16:22.391809+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:54:44.053640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.217672+0000","last_change":"2024-09-05T00:49:37.927836+0000","last_active":"2024-09-05T02:13:01.217672+0000","last_peered":"2024-09-05T02:13:01.217672+0000","last_clean":"2024-09-05T02:13:01.217672+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:13:01.217672+0000","last_undegraded":"2024-09-05T02:13:01.217672+0000","last_fullsized":"2024-09-05T02:13:01.217672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:55:13.858470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1291","reported_seq":3055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.244971+0000","last_change":"2024-09-05T02:16:39.244971+0000","last_active":"2024-09-05T02:16:39.244971+0000","last_peered":"2024-09-05T02:16:39.244971+0000","last_clean":"2024-09-05T02:16:39.244971+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:16:39.244971+0000","last_undegraded":"2024-09-05T02:16:39.244971+0000","last_fullsized":"2024-09-05T02:16:39.244971+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1291","last_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_deep_scrub":"264'1291","last_deep_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.244780+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:47.585141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'361","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.900274+0000","last_change":"2024-09-05T02:16:29.900274+0000","last_active":"2024-09-05T02:16:29.900274+0000","last_peered":"2024-09-05T02:16:29.900274+0000","last_clean":"2024-09-05T02:16:29.900274+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:29.900274+0000","last_undegraded":"2024-09-05T02:16:29.900274+0000","last_fullsized":"2024-09-05T02:16:29.900274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.900193+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:20.281068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":2332,"num_write":1185,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214330+0000","last_change":"2024-09-05T00:49:31.917398+0000","last_active":"2024-09-05T02:12:46.214330+0000","last_peered":"2024-09-05T02:12:46.214330+0000","last_clean":"2024-09-05T02:12:46.214330+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:12:46.214330+0000","last_undegraded":"2024-09-05T02:12:46.214330+0000","last_fullsized":"2024-09-05T02:12:46.214330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:04:04.120586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'453","reported_seq":1099,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.608241+0000","last_change":"2024-09-05T00:49:33.911807+0000","last_active":"2024-09-05T02:16:21.608241+0000","last_peered":"2024-09-05T02:16:21.608241+0000","last_clean":"2024-09-05T02:16:21.608241+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:16:21.608241+0000","last_undegraded":"2024-09-05T02:16:21.608241+0000","last_fullsized":"2024-09-05T02:16:21.608241+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:40:17.975347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49653,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1315,"num_read_kb":1876,"num_write":1876,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.932041+0000","last_change":"2024-09-05T02:16:45.932041+0000","last_active":"2024-09-05T02:16:45.932041+0000","last_peered":"2024-09-05T02:16:45.932041+0000","last_clean":"2024-09-05T02:16:45.932041+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:16:45.932041+0000","last_undegraded":"2024-09-05T02:16:45.932041+0000","last_fullsized":"2024-09-05T02:16:45.932041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.931862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:22.195208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'152","reported_seq":668,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.782551+0000","last_change":"2024-09-05T00:49:37.945006+0000","last_active":"2024-09-05T02:13:01.782551+0000","last_peered":"2024-09-05T02:13:01.782551+0000","last_clean":"2024-09-05T02:13:01.782551+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:13:01.782551+0000","last_undegraded":"2024-09-05T02:13:01.782551+0000","last_fullsized":"2024-09-05T02:13:01.782551+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:03:44.203556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'895","reported_seq":2577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.837031+0000","last_change":"2024-09-05T02:16:37.837031+0000","last_active":"2024-09-05T02:16:37.837031+0000","last_peered":"2024-09-05T02:16:37.837031+0000","last_clean":"2024-09-05T02:16:37.837031+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:16:37.837031+0000","last_undegraded":"2024-09-05T02:16:37.837031+0000","last_fullsized":"2024-09-05T02:16:37.837031+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'895","last_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_deep_scrub":"264'895","last_deep_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.836840+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:26.109909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1433,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.175725+0000","last_change":"2024-09-05T02:16:30.175725+0000","last_active":"2024-09-05T02:16:30.175725+0000","last_peered":"2024-09-05T02:16:30.175725+0000","last_clean":"2024-09-05T02:16:30.175725+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:16:30.175725+0000","last_undegraded":"2024-09-05T02:16:30.175725+0000","last_fullsized":"2024-09-05T02:16:30.175725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.175528+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:42:10.298718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.462900+0000","last_change":"2024-09-05T02:16:30.462900+0000","last_active":"2024-09-05T02:16:30.462900+0000","last_peered":"2024-09-05T02:16:30.462900+0000","last_clean":"2024-09-05T02:16:30.462900+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:16:30.462900+0000","last_undegraded":"2024-09-05T02:16:30.462900+0000","last_fullsized":"2024-09-05T02:16:30.462900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.462683+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.227113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'307","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.764633+0000","last_change":"2024-09-05T02:16:27.764633+0000","last_active":"2024-09-05T02:16:27.764633+0000","last_peered":"2024-09-05T02:16:27.764633+0000","last_clean":"2024-09-05T02:16:27.764633+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:27.764633+0000","last_undegraded":"2024-09-05T02:16:27.764633+0000","last_fullsized":"2024-09-05T02:16:27.764633+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.764568+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.844822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306176,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":457,"num_read_kb":14472,"num_write":870,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.826578+0000","last_change":"2024-09-05T00:49:31.913193+0000","last_active":"2024-09-05T02:12:51.826578+0000","last_peered":"2024-09-05T02:12:51.826578+0000","last_clean":"2024-09-05T02:12:51.826578+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:12:51.826578+0000","last_undegraded":"2024-09-05T02:12:51.826578+0000","last_fullsized":"2024-09-05T02:12:51.826578+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:39:35.650327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'787","reported_seq":1520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.287820+0000","last_change":"2024-09-05T00:49:33.921799+0000","last_active":"2024-09-05T02:16:22.287820+0000","last_peered":"2024-09-05T02:16:22.287820+0000","last_clean":"2024-09-05T02:16:22.287820+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:16:22.287820+0000","last_undegraded":"2024-09-05T02:16:22.287820+0000","last_fullsized":"2024-09-05T02:16:22.287820+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:02.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157356,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1541,"num_read_kb":3609,"num_write":1452,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468924+0000","last_change":"2024-09-05T00:49:35.943449+0000","last_active":"2024-09-05T02:14:05.468924+0000","last_peered":"2024-09-05T02:14:05.468924+0000","last_clean":"2024-09-05T02:14:05.468924+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:14:05.468924+0000","last_undegraded":"2024-09-05T02:14:05.468924+0000","last_fullsized":"2024-09-05T02:14:05.468924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:59.846106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'201","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.696227+0000","last_change":"2024-09-05T00:49:37.942775+0000","last_active":"2024-09-05T02:14:29.696227+0000","last_peered":"2024-09-05T02:14:29.696227+0000","last_clean":"2024-09-05T02:14:29.696227+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:14:29.696227+0000","last_undegraded":"2024-09-05T02:14:29.696227+0000","last_fullsized":"2024-09-05T02:14:29.696227+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:27:04.497388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'785","reported_seq":2290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.420146+0000","last_change":"2024-09-05T02:16:35.420146+0000","last_active":"2024-09-05T02:16:35.420146+0000","last_peered":"2024-09-05T02:16:35.420146+0000","last_clean":"2024-09-05T02:16:35.420146+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:16:35.420146+0000","last_undegraded":"2024-09-05T02:16:35.420146+0000","last_fullsized":"2024-09-05T02:16:35.420146+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.419887+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:06.326976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.122749+0000","last_change":"2024-09-05T02:16:32.122749+0000","last_active":"2024-09-05T02:16:32.122749+0000","last_peered":"2024-09-05T02:16:32.122749+0000","last_clean":"2024-09-05T02:16:32.122749+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:16:32.122749+0000","last_undegraded":"2024-09-05T02:16:32.122749+0000","last_fullsized":"2024-09-05T02:16:32.122749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.122554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:52.851366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'314","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:26.509558+0000","last_change":"2024-09-05T02:16:26.509558+0000","last_active":"2024-09-05T02:16:26.509558+0000","last_peered":"2024-09-05T02:16:26.509558+0000","last_clean":"2024-09-05T02:16:26.509558+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:16:26.509558+0000","last_undegraded":"2024-09-05T02:16:26.509558+0000","last_fullsized":"2024-09-05T02:16:26.509558+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_clean_scrub_stamp":"2024-09-05T02:16:26.509242+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:07.832980+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":5706,"num_write":1068,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229660+0000","last_change":"2024-09-05T00:49:31.908526+0000","last_active":"2024-09-05T02:14:05.229660+0000","last_peered":"2024-09-05T02:14:05.229660+0000","last_clean":"2024-09-05T02:14:05.229660+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:14:05.229660+0000","last_undegraded":"2024-09-05T02:14:05.229660+0000","last_fullsized":"2024-09-05T02:14:05.229660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:47.306493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1382","reported_seq":3405,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.208830+0000","last_change":"2024-09-05T02:16:46.208830+0000","last_active":"2024-09-05T02:16:46.208830+0000","last_peered":"2024-09-05T02:16:46.208830+0000","last_clean":"2024-09-05T02:16:46.208830+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:46.208830+0000","last_undegraded":"2024-09-05T02:16:46.208830+0000","last_fullsized":"2024-09-05T02:16:46.208830+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1382","last_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_deep_scrub":"264'1382","last_deep_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.208570+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":1300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:04.028834+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2121,"num_read_kb":3935,"num_write":1230,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830253+0000","last_change":"2024-09-05T00:49:35.940367+0000","last_active":"2024-09-05T02:13:06.830253+0000","last_peered":"2024-09-05T02:13:06.830253+0000","last_clean":"2024-09-05T02:13:06.830253+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:13:06.830253+0000","last_undegraded":"2024-09-05T02:13:06.830253+0000","last_fullsized":"2024-09-05T02:13:06.830253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:25:41.127677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'248","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.682354+0000","last_change":"2024-09-05T00:49:37.939098+0000","last_active":"2024-09-05T02:14:27.682354+0000","last_peered":"2024-09-05T02:14:27.682354+0000","last_clean":"2024-09-05T02:14:27.682354+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:14:27.682354+0000","last_undegraded":"2024-09-05T02:14:27.682354+0000","last_fullsized":"2024-09-05T02:14:27.682354+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'413","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.210253+0000","last_change":"2024-09-05T02:16:40.210253+0000","last_active":"2024-09-05T02:16:40.210253+0000","last_peered":"2024-09-05T02:16:40.210253+0000","last_clean":"2024-09-05T02:16:40.210253+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:16:40.210253+0000","last_undegraded":"2024-09-05T02:16:40.210253+0000","last_fullsized":"2024-09-05T02:16:40.210253+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.210048+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:40.273557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":912,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.787900+0000","last_change":"2024-09-05T02:16:28.787900+0000","last_active":"2024-09-05T02:16:28.787900+0000","last_peered":"2024-09-05T02:16:28.787900+0000","last_clean":"2024-09-05T02:16:28.787900+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:16:28.787900+0000","last_undegraded":"2024-09-05T02:16:28.787900+0000","last_fullsized":"2024-09-05T02:16:28.787900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.787731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:26:43.122051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'335","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.326044+0000","last_change":"2024-09-05T02:16:29.326044+0000","last_active":"2024-09-05T02:16:29.326044+0000","last_peered":"2024-09-05T02:16:29.326044+0000","last_clean":"2024-09-05T02:16:29.326044+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:29.326044+0000","last_undegraded":"2024-09-05T02:16:29.326044+0000","last_fullsized":"2024-09-05T02:16:29.326044+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.325952+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:55.516960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":23361,"num_write":910,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.842874+0000","last_change":"2024-09-05T02:16:39.842874+0000","last_active":"2024-09-05T02:16:39.842874+0000","last_peered":"2024-09-05T02:16:39.842874+0000","last_clean":"2024-09-05T02:16:39.842874+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:16:39.842874+0000","last_undegraded":"2024-09-05T02:16:39.842874+0000","last_fullsized":"2024-09-05T02:16:39.842874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.842690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:16:19.549189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'346","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:46.508089+0000","last_change":"2024-09-05T00:49:34.055522+0000","last_active":"2024-09-05T02:15:46.508089+0000","last_peered":"2024-09-05T02:15:46.508089+0000","last_clean":"2024-09-05T02:15:46.508089+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:15:46.508089+0000","last_undegraded":"2024-09-05T02:15:46.508089+0000","last_fullsized":"2024-09-05T02:15:46.508089+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:45:16.964827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.287761+0000","last_change":"2024-09-05T02:16:43.287761+0000","last_active":"2024-09-05T02:16:43.287761+0000","last_peered":"2024-09-05T02:16:43.287761+0000","last_clean":"2024-09-05T02:16:43.287761+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:16:43.287761+0000","last_undegraded":"2024-09-05T02:16:43.287761+0000","last_fullsized":"2024-09-05T02:16:43.287761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.287581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:02.058137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'243","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.151838+0000","last_change":"2024-09-05T00:49:37.952280+0000","last_active":"2024-09-05T02:14:30.151838+0000","last_peered":"2024-09-05T02:14:30.151838+0000","last_clean":"2024-09-05T02:14:30.151838+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:14:30.151838+0000","last_undegraded":"2024-09-05T02:14:30.151838+0000","last_fullsized":"2024-09-05T02:14:30.151838+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:26:26.910581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1278","reported_seq":2935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.277149+0000","last_change":"2024-09-05T02:16:36.277149+0000","last_active":"2024-09-05T02:16:36.277149+0000","last_peered":"2024-09-05T02:16:36.277149+0000","last_clean":"2024-09-05T02:16:36.277149+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:16:36.277149+0000","last_undegraded":"2024-09-05T02:16:36.277149+0000","last_fullsized":"2024-09-05T02:16:36.277149+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1278","last_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_deep_scrub":"264'1278","last_deep_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.276963+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:10.284570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1616,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.466902+0000","last_change":"2024-09-05T02:16:29.466902+0000","last_active":"2024-09-05T02:16:29.466902+0000","last_peered":"2024-09-05T02:16:29.466902+0000","last_clean":"2024-09-05T02:16:29.466902+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:16:29.466902+0000","last_undegraded":"2024-09-05T02:16:29.466902+0000","last_fullsized":"2024-09-05T02:16:29.466902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.466718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:17.729741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'367","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.515719+0000","last_change":"2024-09-05T02:16:31.515719+0000","last_active":"2024-09-05T02:16:31.515719+0000","last_peered":"2024-09-05T02:16:31.515719+0000","last_clean":"2024-09-05T02:16:31.515719+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:31.515719+0000","last_undegraded":"2024-09-05T02:16:31.515719+0000","last_fullsized":"2024-09-05T02:16:31.515719+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.515456+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:25:12.133378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":46632,"num_write":1174,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:15.456748+0000","last_change":"2024-09-05T00:49:31.910432+0000","last_active":"2024-09-05T02:13:15.456748+0000","last_peered":"2024-09-05T02:13:15.456748+0000","last_clean":"2024-09-05T02:13:15.456748+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:13:15.456748+0000","last_undegraded":"2024-09-05T02:13:15.456748+0000","last_fullsized":"2024-09-05T02:13:15.456748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:21:42.078643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'164","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.928708+0000","last_change":"2024-09-05T00:49:33.929270+0000","last_active":"2024-09-05T02:15:49.928708+0000","last_peered":"2024-09-05T02:15:49.928708+0000","last_clean":"2024-09-05T02:15:49.928708+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:15:49.928708+0000","last_undegraded":"2024-09-05T02:15:49.928708+0000","last_fullsized":"2024-09-05T02:15:49.928708+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:24:30.946732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.414541+0000","last_change":"2024-09-05T00:49:35.948033+0000","last_active":"2024-09-05T02:14:06.414541+0000","last_peered":"2024-09-05T02:14:06.414541+0000","last_clean":"2024-09-05T02:14:06.414541+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:14:06.414541+0000","last_undegraded":"2024-09-05T02:14:06.414541+0000","last_fullsized":"2024-09-05T02:14:06.414541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:46:58.062174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'117","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.230591+0000","last_change":"2024-09-05T00:49:37.953956+0000","last_active":"2024-09-05T02:14:10.230591+0000","last_peered":"2024-09-05T02:14:10.230591+0000","last_clean":"2024-09-05T02:14:10.230591+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:14:10.230591+0000","last_undegraded":"2024-09-05T02:14:10.230591+0000","last_fullsized":"2024-09-05T02:14:10.230591+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:12.611232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'542","reported_seq":2172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.258563+0000","last_change":"2024-09-05T02:16:35.258563+0000","last_active":"2024-09-05T02:16:35.258563+0000","last_peered":"2024-09-05T02:16:35.258563+0000","last_clean":"2024-09-05T02:16:35.258563+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:16:35.258563+0000","last_undegraded":"2024-09-05T02:16:35.258563+0000","last_fullsized":"2024-09-05T02:16:35.258563+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.258316+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:30.208156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'306","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.502349+0000","last_change":"2024-09-05T02:16:31.502349+0000","last_active":"2024-09-05T02:16:31.502349+0000","last_peered":"2024-09-05T02:16:31.502349+0000","last_clean":"2024-09-05T02:16:31.502349+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:16:31.502349+0000","last_undegraded":"2024-09-05T02:16:31.502349+0000","last_fullsized":"2024-09-05T02:16:31.502349+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.502116+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:28.057536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":39042,"num_write":920,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.404366+0000","last_change":"2024-09-05T02:16:27.404366+0000","last_active":"2024-09-05T02:16:27.404366+0000","last_peered":"2024-09-05T02:16:27.404366+0000","last_clean":"2024-09-05T02:16:27.404366+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:16:27.404366+0000","last_undegraded":"2024-09-05T02:16:27.404366+0000","last_fullsized":"2024-09-05T02:16:27.404366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.404292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:45:52.441484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452119+0000","last_change":"2024-09-05T00:49:31.917058+0000","last_active":"2024-09-05T02:12:55.452119+0000","last_peered":"2024-09-05T02:12:55.452119+0000","last_clean":"2024-09-05T02:12:55.452119+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:12:55.452119+0000","last_undegraded":"2024-09-05T02:12:55.452119+0000","last_fullsized":"2024-09-05T02:12:55.452119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:09:49.645261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'678","reported_seq":1396,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.349231+0000","last_change":"2024-09-05T00:49:33.928573+0000","last_active":"2024-09-05T02:16:22.349231+0000","last_peered":"2024-09-05T02:16:22.349231+0000","last_clean":"2024-09-05T02:16:22.349231+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:16:22.349231+0000","last_undegraded":"2024-09-05T02:16:22.349231+0000","last_fullsized":"2024-09-05T02:16:22.349231+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:49:02.005394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1139,"num_read_kb":2483,"num_write":1010,"num_write_kb":799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216518+0000","last_change":"2024-09-05T00:49:35.938207+0000","last_active":"2024-09-05T02:12:56.216518+0000","last_peered":"2024-09-05T02:12:56.216518+0000","last_clean":"2024-09-05T02:12:56.216518+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:12:56.216518+0000","last_undegraded":"2024-09-05T02:12:56.216518+0000","last_fullsized":"2024-09-05T02:12:56.216518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:20:03.677382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.920772+0000","last_change":"2024-09-05T00:49:37.933639+0000","last_active":"2024-09-05T02:14:29.920772+0000","last_peered":"2024-09-05T02:14:29.920772+0000","last_clean":"2024-09-05T02:14:29.920772+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:14:29.920772+0000","last_undegraded":"2024-09-05T02:14:29.920772+0000","last_fullsized":"2024-09-05T02:14:29.920772+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:37.728081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'883","reported_seq":2350,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:27.701326+0000","last_change":"2024-09-05T00:49:29.913232+0000","last_active":"2024-09-05T02:14:27.701326+0000","last_peered":"2024-09-05T02:14:27.701326+0000","last_clean":"2024-09-05T02:14:27.701326+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:14:27.701326+0000","last_undegraded":"2024-09-05T02:14:27.701326+0000","last_fullsized":"2024-09-05T02:14:27.701326+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":800,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:24.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'324","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.372916+0000","last_change":"2024-09-05T02:16:30.372916+0000","last_active":"2024-09-05T02:16:30.372916+0000","last_peered":"2024-09-05T02:16:30.372916+0000","last_clean":"2024-09-05T02:16:30.372916+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:30.372916+0000","last_undegraded":"2024-09-05T02:16:30.372916+0000","last_fullsized":"2024-09-05T02:16:30.372916+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.372709+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:12:13.999885+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":37378,"num_write":1055,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.124622+0000","last_change":"2024-09-05T02:16:31.124622+0000","last_active":"2024-09-05T02:16:31.124622+0000","last_peered":"2024-09-05T02:16:31.124622+0000","last_clean":"2024-09-05T02:16:31.124622+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:16:31.124622+0000","last_undegraded":"2024-09-05T02:16:31.124622+0000","last_fullsized":"2024-09-05T02:16:31.124622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.124439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:31.003902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.884773+0000","last_change":"2024-09-05T02:16:43.884773+0000","last_active":"2024-09-05T02:16:43.884773+0000","last_peered":"2024-09-05T02:16:43.884773+0000","last_clean":"2024-09-05T02:16:43.884773+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:16:43.884773+0000","last_undegraded":"2024-09-05T02:16:43.884773+0000","last_fullsized":"2024-09-05T02:16:43.884773+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.884568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:16:44.961807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'204","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.781213+0000","last_change":"2024-09-05T00:49:34.054211+0000","last_active":"2024-09-05T02:12:56.781213+0000","last_peered":"2024-09-05T02:12:56.781213+0000","last_clean":"2024-09-05T02:12:56.781213+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:12:56.781213+0000","last_undegraded":"2024-09-05T02:12:56.781213+0000","last_fullsized":"2024-09-05T02:12:56.781213+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:13.534123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'797","reported_seq":3278,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.928718+0000","last_change":"2024-09-05T00:49:35.933822+0000","last_active":"2024-09-05T02:16:22.928718+0000","last_peered":"2024-09-05T02:16:22.928718+0000","last_clean":"2024-09-05T02:16:22.928718+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:16:22.928718+0000","last_undegraded":"2024-09-05T02:16:22.928718+0000","last_fullsized":"2024-09-05T02:16:22.928718+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.230310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'146","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:31.508344+0000","last_change":"2024-09-05T00:49:37.948757+0000","last_active":"2024-09-05T02:15:31.508344+0000","last_peered":"2024-09-05T02:15:31.508344+0000","last_clean":"2024-09-05T02:15:31.508344+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:15:31.508344+0000","last_undegraded":"2024-09-05T02:15:31.508344+0000","last_fullsized":"2024-09-05T02:15:31.508344+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:10:40.306605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'964","reported_seq":2560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.072318+0000","last_change":"2024-09-05T02:16:45.072318+0000","last_active":"2024-09-05T02:16:45.072318+0000","last_peered":"2024-09-05T02:16:45.072318+0000","last_clean":"2024-09-05T02:16:45.072318+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:16:45.072318+0000","last_undegraded":"2024-09-05T02:16:45.072318+0000","last_fullsized":"2024-09-05T02:16:45.072318+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'964","last_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_deep_scrub":"264'964","last_deep_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.072096+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:26:16.793459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'419","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.916620+0000","last_change":"2024-09-05T02:16:28.916620+0000","last_active":"2024-09-05T02:16:28.916620+0000","last_peered":"2024-09-05T02:16:28.916620+0000","last_clean":"2024-09-05T02:16:28.916620+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:28.916620+0000","last_undegraded":"2024-09-05T02:16:28.916620+0000","last_fullsized":"2024-09-05T02:16:28.916620+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'419","last_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_deep_scrub":"264'419","last_deep_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.916405+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:38.195772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":754,"num_read_kb":36692,"num_write":1433,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.366495+0000","last_change":"2024-09-05T02:16:28.366495+0000","last_active":"2024-09-05T02:16:28.366495+0000","last_peered":"2024-09-05T02:16:28.366495+0000","last_clean":"2024-09-05T02:16:28.366495+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:16:28.366495+0000","last_undegraded":"2024-09-05T02:16:28.366495+0000","last_fullsized":"2024-09-05T02:16:28.366495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.366407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:29:33.144478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.215403+0000","last_change":"2024-09-05T00:49:31.916181+0000","last_active":"2024-09-05T02:12:51.215403+0000","last_peered":"2024-09-05T02:12:51.215403+0000","last_clean":"2024-09-05T02:12:51.215403+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:12:51.215403+0000","last_undegraded":"2024-09-05T02:12:51.215403+0000","last_fullsized":"2024-09-05T02:12:51.215403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:16:28.018466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'156","reported_seq":732,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.216578+0000","last_change":"2024-09-05T00:49:33.919913+0000","last_active":"2024-09-05T02:12:56.216578+0000","last_peered":"2024-09-05T02:12:56.216578+0000","last_clean":"2024-09-05T02:12:56.216578+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:12:56.216578+0000","last_undegraded":"2024-09-05T02:12:56.216578+0000","last_fullsized":"2024-09-05T02:12:56.216578+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:48.393350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'802","reported_seq":2788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.387607+0000","last_change":"2024-09-05T00:49:35.938148+0000","last_active":"2024-09-05T02:16:22.387607+0000","last_peered":"2024-09-05T02:16:22.387607+0000","last_clean":"2024-09-05T02:16:22.387607+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:22.387607+0000","last_undegraded":"2024-09-05T02:16:22.387607+0000","last_fullsized":"2024-09-05T02:16:22.387607+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:51:27.051091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'174","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.452197+0000","last_change":"2024-09-05T00:49:37.954318+0000","last_active":"2024-09-05T02:12:55.452197+0000","last_peered":"2024-09-05T02:12:55.452197+0000","last_clean":"2024-09-05T02:12:55.452197+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:12:55.452197+0000","last_undegraded":"2024-09-05T02:12:55.452197+0000","last_fullsized":"2024-09-05T02:12:55.452197+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:51.538774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'567","reported_seq":2087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.473476+0000","last_change":"2024-09-05T02:16:33.473476+0000","last_active":"2024-09-05T02:16:33.473476+0000","last_peered":"2024-09-05T02:16:33.473476+0000","last_clean":"2024-09-05T02:16:33.473476+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:16:33.473476+0000","last_undegraded":"2024-09-05T02:16:33.473476+0000","last_fullsized":"2024-09-05T02:16:33.473476+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'567","last_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_deep_scrub":"264'567","last_deep_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.473297+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:11.125295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":876,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'379","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.461633+0000","last_change":"2024-09-05T02:16:27.461633+0000","last_active":"2024-09-05T02:16:27.461633+0000","last_peered":"2024-09-05T02:16:27.461633+0000","last_clean":"2024-09-05T02:16:27.461633+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:16:27.461633+0000","last_undegraded":"2024-09-05T02:16:27.461633+0000","last_fullsized":"2024-09-05T02:16:27.461633+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'379","last_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_deep_scrub":"264'379","last_deep_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.461448+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:09.203614+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306547,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":1286,"num_write":1063,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.797643+0000","last_change":"2024-09-05T02:16:30.797643+0000","last_active":"2024-09-05T02:16:30.797643+0000","last_peered":"2024-09-05T02:16:30.797643+0000","last_clean":"2024-09-05T02:16:30.797643+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:16:30.797643+0000","last_undegraded":"2024-09-05T02:16:30.797643+0000","last_fullsized":"2024-09-05T02:16:30.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.797468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:12.858645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.487854+0000","last_change":"2024-09-05T00:49:31.913300+0000","last_active":"2024-09-05T02:13:51.487854+0000","last_peered":"2024-09-05T02:13:51.487854+0000","last_clean":"2024-09-05T02:13:51.487854+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:13:51.487854+0000","last_undegraded":"2024-09-05T02:13:51.487854+0000","last_fullsized":"2024-09-05T02:13:51.487854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:25.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'759","reported_seq":1520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.732576+0000","last_change":"2024-09-05T00:49:34.054583+0000","last_active":"2024-09-05T02:16:22.732576+0000","last_peered":"2024-09-05T02:16:22.732576+0000","last_clean":"2024-09-05T02:16:22.732576+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:22.732576+0000","last_undegraded":"2024-09-05T02:16:22.732576+0000","last_fullsized":"2024-09-05T02:16:22.732576+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:41.332842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142523,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1322,"num_read_kb":3088,"num_write":1054,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.474955+0000","last_change":"2024-09-05T00:49:35.934315+0000","last_active":"2024-09-05T02:12:56.474955+0000","last_peered":"2024-09-05T02:12:56.474955+0000","last_clean":"2024-09-05T02:12:56.474955+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:12:56.474955+0000","last_undegraded":"2024-09-05T02:12:56.474955+0000","last_fullsized":"2024-09-05T02:12:56.474955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:47.877686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'119","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:55.213128+0000","last_change":"2024-09-05T00:49:37.942217+0000","last_active":"2024-09-05T02:12:55.213128+0000","last_peered":"2024-09-05T02:12:55.213128+0000","last_clean":"2024-09-05T02:12:55.213128+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:12:55.213128+0000","last_undegraded":"2024-09-05T02:12:55.213128+0000","last_fullsized":"2024-09-05T02:12:55.213128+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:07:48.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'136","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.069901+0000","last_change":"2024-09-05T00:49:37.943464+0000","last_active":"2024-09-05T02:14:30.069901+0000","last_peered":"2024-09-05T02:14:30.069901+0000","last_clean":"2024-09-05T02:14:30.069901+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:14:30.069901+0000","last_undegraded":"2024-09-05T02:14:30.069901+0000","last_fullsized":"2024-09-05T02:14:30.069901+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:53.999125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'584","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.467016+0000","last_change":"2024-09-05T02:16:38.467016+0000","last_active":"2024-09-05T02:16:38.467016+0000","last_peered":"2024-09-05T02:16:38.467016+0000","last_clean":"2024-09-05T02:16:38.467016+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:16:38.467016+0000","last_undegraded":"2024-09-05T02:16:38.467016+0000","last_fullsized":"2024-09-05T02:16:38.467016+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.466831+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:09.713439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'310","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.564836+0000","last_change":"2024-09-05T02:16:28.564836+0000","last_active":"2024-09-05T02:16:28.564836+0000","last_peered":"2024-09-05T02:16:28.564836+0000","last_clean":"2024-09-05T02:16:28.564836+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:28.564836+0000","last_undegraded":"2024-09-05T02:16:28.564836+0000","last_fullsized":"2024-09-05T02:16:28.564836+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.564631+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:46:10.085984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524318,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":27235,"num_write":955,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.151032+0000","last_change":"2024-09-05T02:16:45.151032+0000","last_active":"2024-09-05T02:16:45.151032+0000","last_peered":"2024-09-05T02:16:45.151032+0000","last_clean":"2024-09-05T02:16:45.151032+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:16:45.151032+0000","last_undegraded":"2024-09-05T02:16:45.151032+0000","last_fullsized":"2024-09-05T02:16:45.151032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.150846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:14.522761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'315","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.870697+0000","last_change":"2024-09-05T00:49:33.930112+0000","last_active":"2024-09-05T02:16:21.870697+0000","last_peered":"2024-09-05T02:16:21.870697+0000","last_clean":"2024-09-05T02:16:21.870697+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:16:21.870697+0000","last_undegraded":"2024-09-05T02:16:21.870697+0000","last_fullsized":"2024-09-05T02:16:21.870697+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:23:14.000620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43168,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1204,"num_write":426,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.484298+0000","last_change":"2024-09-05T00:49:35.939413+0000","last_active":"2024-09-05T02:13:36.484298+0000","last_peered":"2024-09-05T02:13:36.484298+0000","last_clean":"2024-09-05T02:13:36.484298+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:13:36.484298+0000","last_undegraded":"2024-09-05T02:13:36.484298+0000","last_fullsized":"2024-09-05T02:13:36.484298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:49:13.914012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'373","reported_seq":1845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.199178+0000","last_change":"2024-09-05T02:16:41.199178+0000","last_active":"2024-09-05T02:16:41.199178+0000","last_peered":"2024-09-05T02:16:41.199178+0000","last_clean":"2024-09-05T02:16:41.199178+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:16:41.199178+0000","last_undegraded":"2024-09-05T02:16:41.199178+0000","last_fullsized":"2024-09-05T02:16:41.199178+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.198938+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:49.138470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'308","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.040013+0000","last_change":"2024-09-05T02:16:38.040013+0000","last_active":"2024-09-05T02:16:38.040013+0000","last_peered":"2024-09-05T02:16:38.040013+0000","last_clean":"2024-09-05T02:16:38.040013+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:38.040013+0000","last_undegraded":"2024-09-05T02:16:38.040013+0000","last_fullsized":"2024-09-05T02:16:38.040013+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.039781+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:04:40.447440+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":54962,"num_write":1038,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.483453+0000","last_change":"2024-09-05T00:49:31.910668+0000","last_active":"2024-09-05T02:13:31.483453+0000","last_peered":"2024-09-05T02:13:31.483453+0000","last_clean":"2024-09-05T02:13:31.483453+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:13:31.483453+0000","last_undegraded":"2024-09-05T02:13:31.483453+0000","last_fullsized":"2024-09-05T02:13:31.483453+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:49.146827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'69","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461072+0000","last_change":"2024-09-05T00:49:33.915459+0000","last_active":"2024-09-05T02:13:35.461072+0000","last_peered":"2024-09-05T02:13:35.461072+0000","last_clean":"2024-09-05T02:13:35.461072+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:13:35.461072+0000","last_undegraded":"2024-09-05T02:13:35.461072+0000","last_fullsized":"2024-09-05T02:13:35.461072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:37.227238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626911+0000","last_change":"2024-09-05T00:49:35.935530+0000","last_active":"2024-09-05T02:13:36.626911+0000","last_peered":"2024-09-05T02:13:36.626911+0000","last_clean":"2024-09-05T02:13:36.626911+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:13:36.626911+0000","last_undegraded":"2024-09-05T02:13:36.626911+0000","last_fullsized":"2024-09-05T02:13:36.626911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:22:34.688053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'228","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.905325+0000","last_change":"2024-09-05T00:49:37.926241+0000","last_active":"2024-09-05T02:14:29.905325+0000","last_peered":"2024-09-05T02:14:29.905325+0000","last_clean":"2024-09-05T02:14:29.905325+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:14:29.905325+0000","last_undegraded":"2024-09-05T02:14:29.905325+0000","last_fullsized":"2024-09-05T02:14:29.905325+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:25.119785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'413","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.001539+0000","last_change":"2024-09-05T02:16:37.001539+0000","last_active":"2024-09-05T02:16:37.001539+0000","last_peered":"2024-09-05T02:16:37.001539+0000","last_clean":"2024-09-05T02:16:37.001539+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:16:37.001539+0000","last_undegraded":"2024-09-05T02:16:37.001539+0000","last_fullsized":"2024-09-05T02:16:37.001539+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.001348+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:37:09.716022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'312","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.491656+0000","last_change":"2024-09-05T02:16:33.491656+0000","last_active":"2024-09-05T02:16:33.491656+0000","last_peered":"2024-09-05T02:16:33.491656+0000","last_clean":"2024-09-05T02:16:33.491656+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:16:33.491656+0000","last_undegraded":"2024-09-05T02:16:33.491656+0000","last_fullsized":"2024-09-05T02:16:33.491656+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.491428+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:05.829040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":91576,"num_write":1030,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:31.836079+0000","last_change":"2024-09-05T00:49:31.926718+0000","last_active":"2024-09-05T02:13:31.836079+0000","last_peered":"2024-09-05T02:13:31.836079+0000","last_clean":"2024-09-05T02:13:31.836079+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:13:31.836079+0000","last_undegraded":"2024-09-05T02:13:31.836079+0000","last_fullsized":"2024-09-05T02:13:31.836079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:51:03.171626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'334","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.174204+0000","last_change":"2024-09-05T00:49:33.930627+0000","last_active":"2024-09-05T02:16:21.174204+0000","last_peered":"2024-09-05T02:16:21.174204+0000","last_clean":"2024-09-05T02:16:21.174204+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:21.174204+0000","last_undegraded":"2024-09-05T02:16:21.174204+0000","last_fullsized":"2024-09-05T02:16:21.174204+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:57:28.849294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.407690+0000","last_change":"2024-09-05T00:49:35.948016+0000","last_active":"2024-09-05T02:13:36.407690+0000","last_peered":"2024-09-05T02:13:36.407690+0000","last_clean":"2024-09-05T02:13:36.407690+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:13:36.407690+0000","last_undegraded":"2024-09-05T02:13:36.407690+0000","last_fullsized":"2024-09-05T02:13:36.407690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:11:21.382939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'121","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.587514+0000","last_change":"2024-09-05T00:49:37.946851+0000","last_active":"2024-09-05T02:14:29.587514+0000","last_peered":"2024-09-05T02:14:29.587514+0000","last_clean":"2024-09-05T02:14:29.587514+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:14:29.587514+0000","last_undegraded":"2024-09-05T02:14:29.587514+0000","last_fullsized":"2024-09-05T02:14:29.587514+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:30:32.621811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.065795+0000","last_change":"2024-09-05T02:16:46.065795+0000","last_active":"2024-09-05T02:16:46.065795+0000","last_peered":"2024-09-05T02:16:46.065795+0000","last_clean":"2024-09-05T02:16:46.065795+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:16:46.065795+0000","last_undegraded":"2024-09-05T02:16:46.065795+0000","last_fullsized":"2024-09-05T02:16:46.065795+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1176","last_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_deep_scrub":"264'1176","last_deep_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.065600+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:12.655472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'343","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.487651+0000","last_change":"2024-09-05T02:16:28.487518+0000","last_active":"2024-09-05T02:16:28.487651+0000","last_peered":"2024-09-05T02:16:28.487651+0000","last_clean":"2024-09-05T02:16:28.487651+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:16:28.487651+0000","last_undegraded":"2024-09-05T02:16:28.487651+0000","last_fullsized":"2024-09-05T02:16:28.487651+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.487300+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:13:55.683962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342090,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":6648,"num_write":1112,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.908314+0000","last_change":"2024-09-05T02:16:41.908314+0000","last_active":"2024-09-05T02:16:41.908314+0000","last_peered":"2024-09-05T02:16:41.908314+0000","last_clean":"2024-09-05T02:16:41.908314+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:16:41.908314+0000","last_undegraded":"2024-09-05T02:16:41.908314+0000","last_fullsized":"2024-09-05T02:16:41.908314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.908112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:02.070944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'298","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.936100+0000","last_change":"2024-09-05T00:49:33.908585+0000","last_active":"2024-09-05T02:16:22.936100+0000","last_peered":"2024-09-05T02:16:22.936100+0000","last_clean":"2024-09-05T02:16:22.936100+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:16:22.936100+0000","last_undegraded":"2024-09-05T02:16:22.936100+0000","last_fullsized":"2024-09-05T02:16:22.936100+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:52.420648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1205,"num_write":416,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461188+0000","last_change":"2024-09-05T00:49:35.943952+0000","last_active":"2024-09-05T02:13:35.461188+0000","last_peered":"2024-09-05T02:13:35.461188+0000","last_clean":"2024-09-05T02:13:35.461188+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:13:35.461188+0000","last_undegraded":"2024-09-05T02:13:35.461188+0000","last_fullsized":"2024-09-05T02:13:35.461188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:37:48.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'401","reported_seq":1942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.833608+0000","last_change":"2024-09-05T02:16:38.833608+0000","last_active":"2024-09-05T02:16:38.833608+0000","last_peered":"2024-09-05T02:16:38.833608+0000","last_clean":"2024-09-05T02:16:38.833608+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:16:38.833608+0000","last_undegraded":"2024-09-05T02:16:38.833608+0000","last_fullsized":"2024-09-05T02:16:38.833608+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.833404+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:32:18.954201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'332","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.909052+0000","last_change":"2024-09-05T02:16:30.908902+0000","last_active":"2024-09-05T02:16:30.909052+0000","last_peered":"2024-09-05T02:16:30.909052+0000","last_clean":"2024-09-05T02:16:30.909052+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:30.909052+0000","last_undegraded":"2024-09-05T02:16:30.909052+0000","last_fullsized":"2024-09-05T02:16:30.909052+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.908658+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:38.710026+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":908,"num_read_kb":44981,"num_write":1071,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"35'5","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.574981+0000","last_change":"2024-09-05T00:49:31.915305+0000","last_active":"2024-09-05T02:16:20.574981+0000","last_peered":"2024-09-05T02:16:20.574981+0000","last_clean":"2024-09-05T02:16:20.574981+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:16:20.574981+0000","last_undegraded":"2024-09-05T02:16:20.574981+0000","last_fullsized":"2024-09-05T02:16:20.574981+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:46.356538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'534","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.876628+0000","last_change":"2024-09-05T00:49:33.912309+0000","last_active":"2024-09-05T02:16:22.876628+0000","last_peered":"2024-09-05T02:16:22.876628+0000","last_clean":"2024-09-05T02:16:22.876628+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:22.876628+0000","last_undegraded":"2024-09-05T02:16:22.876628+0000","last_fullsized":"2024-09-05T02:16:22.876628+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:19:37.409372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90605,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":950,"num_read_kb":2270,"num_write":820,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.201299+0000","last_change":"2024-09-05T00:49:35.938332+0000","last_active":"2024-09-05T02:12:05.201299+0000","last_peered":"2024-09-05T02:12:05.201299+0000","last_clean":"2024-09-05T02:12:05.201299+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:12:05.201299+0000","last_undegraded":"2024-09-05T02:12:05.201299+0000","last_fullsized":"2024-09-05T02:12:05.201299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T00:56:14.582023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'181","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485412+0000","last_change":"2024-09-05T00:49:37.953067+0000","last_active":"2024-09-05T02:13:41.485412+0000","last_peered":"2024-09-05T02:13:41.485412+0000","last_clean":"2024-09-05T02:13:41.485412+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:13:41.485412+0000","last_undegraded":"2024-09-05T02:13:41.485412+0000","last_fullsized":"2024-09-05T02:13:41.485412+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:56.679412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'421","reported_seq":1999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.325824+0000","last_change":"2024-09-05T02:16:41.325824+0000","last_active":"2024-09-05T02:16:41.325824+0000","last_peered":"2024-09-05T02:16:41.325824+0000","last_clean":"2024-09-05T02:16:41.325824+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:16:41.325824+0000","last_undegraded":"2024-09-05T02:16:41.325824+0000","last_fullsized":"2024-09-05T02:16:41.325824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.325623+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:24.604460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'348","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.380399+0000","last_change":"2024-09-05T02:16:31.380143+0000","last_active":"2024-09-05T02:16:31.380399+0000","last_peered":"2024-09-05T02:16:31.380399+0000","last_clean":"2024-09-05T02:16:31.380399+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:31.380399+0000","last_undegraded":"2024-09-05T02:16:31.380399+0000","last_fullsized":"2024-09-05T02:16:31.380399+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.379870+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.538823+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":27594,"num_write":1025,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.915915+0000","last_change":"2024-09-05T02:16:44.915915+0000","last_active":"2024-09-05T02:16:44.915915+0000","last_peered":"2024-09-05T02:16:44.915915+0000","last_clean":"2024-09-05T02:16:44.915915+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:16:44.915915+0000","last_undegraded":"2024-09-05T02:16:44.915915+0000","last_fullsized":"2024-09-05T02:16:44.915915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.915627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:46:19.249723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'334","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.028866+0000","last_change":"2024-09-05T00:49:33.917339+0000","last_active":"2024-09-05T02:16:21.028866+0000","last_peered":"2024-09-05T02:16:21.028866+0000","last_clean":"2024-09-05T02:16:21.028866+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:21.028866+0000","last_undegraded":"2024-09-05T02:16:21.028866+0000","last_fullsized":"2024-09-05T02:16:21.028866+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:34.348566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.770357+0000","last_change":"2024-09-05T00:49:35.924621+0000","last_active":"2024-09-05T02:12:06.770357+0000","last_peered":"2024-09-05T02:12:06.770357+0000","last_clean":"2024-09-05T02:12:06.770357+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:12:06.770357+0000","last_undegraded":"2024-09-05T02:12:06.770357+0000","last_fullsized":"2024-09-05T02:12:06.770357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:49:29.284134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.408737+0000","last_change":"2024-09-05T00:49:37.931246+0000","last_active":"2024-09-05T02:13:41.408737+0000","last_peered":"2024-09-05T02:13:41.408737+0000","last_clean":"2024-09-05T02:13:41.408737+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:13:41.408737+0000","last_undegraded":"2024-09-05T02:13:41.408737+0000","last_fullsized":"2024-09-05T02:13:41.408737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:20.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'494","reported_seq":2156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.037772+0000","last_change":"2024-09-05T02:16:41.037772+0000","last_active":"2024-09-05T02:16:41.037772+0000","last_peered":"2024-09-05T02:16:41.037772+0000","last_clean":"2024-09-05T02:16:41.037772+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:16:41.037772+0000","last_undegraded":"2024-09-05T02:16:41.037772+0000","last_fullsized":"2024-09-05T02:16:41.037772+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'494","last_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_deep_scrub":"264'494","last_deep_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.037536+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:37:11.731456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'324","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.560869+0000","last_change":"2024-09-05T02:16:30.560869+0000","last_active":"2024-09-05T02:16:30.560869+0000","last_peered":"2024-09-05T02:16:30.560869+0000","last_clean":"2024-09-05T02:16:30.560869+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:30.560869+0000","last_undegraded":"2024-09-05T02:16:30.560869+0000","last_fullsized":"2024-09-05T02:16:30.560869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.560663+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:40.454373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":39348,"num_write":968,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.204119+0000","last_change":"2024-09-05T00:49:31.923994+0000","last_active":"2024-09-05T02:12:01.204119+0000","last_peered":"2024-09-05T02:12:01.204119+0000","last_clean":"2024-09-05T02:12:01.204119+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:12:01.204119+0000","last_undegraded":"2024-09-05T02:12:01.204119+0000","last_fullsized":"2024-09-05T02:12:01.204119+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:07:56.251468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'320","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.098002+0000","last_change":"2024-09-05T00:49:34.055772+0000","last_active":"2024-09-05T02:16:22.098002+0000","last_peered":"2024-09-05T02:16:22.098002+0000","last_clean":"2024-09-05T02:16:22.098002+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:16:22.098002+0000","last_undegraded":"2024-09-05T02:16:22.098002+0000","last_fullsized":"2024-09-05T02:16:22.098002+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:58.530198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":1207,"num_write":432,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.792016+0000","last_change":"2024-09-05T00:49:35.935059+0000","last_active":"2024-09-05T02:13:46.792016+0000","last_peered":"2024-09-05T02:13:46.792016+0000","last_clean":"2024-09-05T02:13:46.792016+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:13:46.792016+0000","last_undegraded":"2024-09-05T02:13:46.792016+0000","last_fullsized":"2024-09-05T02:13:46.792016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:18:31.249785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'106","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.686139+0000","last_change":"2024-09-05T00:49:37.938971+0000","last_active":"2024-09-05T02:15:49.686139+0000","last_peered":"2024-09-05T02:15:49.686139+0000","last_clean":"2024-09-05T02:15:49.686139+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:15:49.686139+0000","last_undegraded":"2024-09-05T02:15:49.686139+0000","last_fullsized":"2024-09-05T02:15:49.686139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:05:26.724944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'326","reported_seq":1649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.800307+0000","last_change":"2024-09-05T02:16:34.800307+0000","last_active":"2024-09-05T02:16:34.800307+0000","last_peered":"2024-09-05T02:16:34.800307+0000","last_clean":"2024-09-05T02:16:34.800307+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:16:34.800307+0000","last_undegraded":"2024-09-05T02:16:34.800307+0000","last_fullsized":"2024-09-05T02:16:34.800307+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.800111+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:39.707710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'405","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.365125+0000","last_change":"2024-09-05T02:16:38.365125+0000","last_active":"2024-09-05T02:16:38.365125+0000","last_peered":"2024-09-05T02:16:38.365125+0000","last_clean":"2024-09-05T02:16:38.365125+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:16:38.365125+0000","last_undegraded":"2024-09-05T02:16:38.365125+0000","last_fullsized":"2024-09-05T02:16:38.365125+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.364894+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:52.067211+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642858,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":739,"num_read_kb":25030,"num_write":1256,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.769113+0000","last_change":"2024-09-05T00:49:31.926005+0000","last_active":"2024-09-05T02:12:01.769113+0000","last_peered":"2024-09-05T02:12:01.769113+0000","last_clean":"2024-09-05T02:12:01.769113+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:12:01.769113+0000","last_undegraded":"2024-09-05T02:12:01.769113+0000","last_fullsized":"2024-09-05T02:12:01.769113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:56.548346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'145","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:51.228677+0000","last_change":"2024-09-05T00:49:34.053064+0000","last_active":"2024-09-05T02:13:51.228677+0000","last_peered":"2024-09-05T02:13:51.228677+0000","last_clean":"2024-09-05T02:13:51.228677+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:13:51.228677+0000","last_undegraded":"2024-09-05T02:13:51.228677+0000","last_fullsized":"2024-09-05T02:13:51.228677+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:16.077623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'771","reported_seq":2981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.389771+0000","last_change":"2024-09-05T00:49:35.932657+0000","last_active":"2024-09-05T02:16:22.389771+0000","last_peered":"2024-09-05T02:16:22.389771+0000","last_clean":"2024-09-05T02:16:22.389771+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:22.389771+0000","last_undegraded":"2024-09-05T02:16:22.389771+0000","last_fullsized":"2024-09-05T02:16:22.389771+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:55.080143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.628035+0000","last_change":"2024-09-05T00:49:37.942533+0000","last_active":"2024-09-05T02:13:41.628035+0000","last_peered":"2024-09-05T02:13:41.628035+0000","last_clean":"2024-09-05T02:13:41.628035+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:13:41.628035+0000","last_undegraded":"2024-09-05T02:13:41.628035+0000","last_fullsized":"2024-09-05T02:13:41.628035+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:02:29.740359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'870","reported_seq":2420,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.444001+0000","last_change":"2024-09-05T02:16:40.444001+0000","last_active":"2024-09-05T02:16:40.444001+0000","last_peered":"2024-09-05T02:16:40.444001+0000","last_clean":"2024-09-05T02:16:40.444001+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:16:40.444001+0000","last_undegraded":"2024-09-05T02:16:40.444001+0000","last_fullsized":"2024-09-05T02:16:40.444001+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.443792+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:41:30.425677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'289","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.482628+0000","last_change":"2024-09-05T02:16:34.482628+0000","last_active":"2024-09-05T02:16:34.482628+0000","last_peered":"2024-09-05T02:16:34.482628+0000","last_clean":"2024-09-05T02:16:34.482628+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:16:34.482628+0000","last_undegraded":"2024-09-05T02:16:34.482628+0000","last_fullsized":"2024-09-05T02:16:34.482628+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.482431+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:08:51.964548+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":6339,"num_write":869,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:01.814573+0000","last_change":"2024-09-05T00:49:31.924947+0000","last_active":"2024-09-05T02:12:01.814573+0000","last_peered":"2024-09-05T02:12:01.814573+0000","last_clean":"2024-09-05T02:12:01.814573+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:12:01.814573+0000","last_undegraded":"2024-09-05T02:12:01.814573+0000","last_fullsized":"2024-09-05T02:12:01.814573+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:00:06.551471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'382","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.483412+0000","last_change":"2024-09-05T00:49:33.910494+0000","last_active":"2024-09-05T02:16:22.483412+0000","last_peered":"2024-09-05T02:16:22.483412+0000","last_clean":"2024-09-05T02:16:22.483412+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:16:22.483412+0000","last_undegraded":"2024-09-05T02:16:22.483412+0000","last_fullsized":"2024-09-05T02:16:22.483412+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:46.890368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47763,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":623,"num_read_kb":1294,"num_write":490,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:10.470030+0000","last_change":"2024-09-05T00:49:35.941463+0000","last_active":"2024-09-05T02:14:10.470030+0000","last_peered":"2024-09-05T02:14:10.470030+0000","last_clean":"2024-09-05T02:14:10.470030+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:14:10.470030+0000","last_undegraded":"2024-09-05T02:14:10.470030+0000","last_fullsized":"2024-09-05T02:14:10.470030+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'194","reported_seq":755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:49.671282+0000","last_change":"2024-09-05T00:49:37.946192+0000","last_active":"2024-09-05T02:15:49.671282+0000","last_peered":"2024-09-05T02:15:49.671282+0000","last_clean":"2024-09-05T02:15:49.671282+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:15:49.671282+0000","last_undegraded":"2024-09-05T02:15:49.671282+0000","last_fullsized":"2024-09-05T02:15:49.671282+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'736","reported_seq":2532,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.487412+0000","last_change":"2024-09-05T02:16:41.487412+0000","last_active":"2024-09-05T02:16:41.487412+0000","last_peered":"2024-09-05T02:16:41.487412+0000","last_clean":"2024-09-05T02:16:41.487412+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:16:41.487412+0000","last_undegraded":"2024-09-05T02:16:41.487412+0000","last_fullsized":"2024-09-05T02:16:41.487412+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'736","last_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_deep_scrub":"264'736","last_deep_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.487221+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:01.507115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1182,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'414","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.532666+0000","last_change":"2024-09-05T02:16:35.532666+0000","last_active":"2024-09-05T02:16:35.532666+0000","last_peered":"2024-09-05T02:16:35.532666+0000","last_clean":"2024-09-05T02:16:35.532666+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:16:35.532666+0000","last_undegraded":"2024-09-05T02:16:35.532666+0000","last_fullsized":"2024-09-05T02:16:35.532666+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.532436+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:12:38.507010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080041,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":137827,"num_write":1317,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"35'3","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:20.574873+0000","last_change":"2024-09-05T00:49:31.903883+0000","last_active":"2024-09-05T02:16:20.574873+0000","last_peered":"2024-09-05T02:16:20.574873+0000","last_clean":"2024-09-05T02:16:20.574873+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:16:20.574873+0000","last_undegraded":"2024-09-05T02:16:20.574873+0000","last_fullsized":"2024-09-05T02:16:20.574873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:46.830057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'300","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.551918+0000","last_change":"2024-09-05T00:49:33.909608+0000","last_active":"2024-09-05T02:16:22.551918+0000","last_peered":"2024-09-05T02:16:22.551918+0000","last_clean":"2024-09-05T02:16:22.551918+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:16:22.551918+0000","last_undegraded":"2024-09-05T02:16:22.551918+0000","last_fullsized":"2024-09-05T02:16:22.551918+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47523,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":500,"num_read_kb":1144,"num_write":402,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.388458+0000","last_change":"2024-09-05T00:49:35.941006+0000","last_active":"2024-09-05T02:12:06.388458+0000","last_peered":"2024-09-05T02:12:06.388458+0000","last_clean":"2024-09-05T02:12:06.388458+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:12:06.388458+0000","last_undegraded":"2024-09-05T02:12:06.388458+0000","last_fullsized":"2024-09-05T02:12:06.388458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:09.389985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:16.492885+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:14:16.492885+0000","last_peered":"2024-09-05T02:14:16.492885+0000","last_clean":"2024-09-05T02:14:16.492885+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:14:16.492885+0000","last_undegraded":"2024-09-05T02:14:16.492885+0000","last_fullsized":"2024-09-05T02:14:16.492885+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'476","reported_seq":2074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.011129+0000","last_change":"2024-09-05T02:16:40.011129+0000","last_active":"2024-09-05T02:16:40.011129+0000","last_peered":"2024-09-05T02:16:40.011129+0000","last_clean":"2024-09-05T02:16:40.011129+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:16:40.011129+0000","last_undegraded":"2024-09-05T02:16:40.011129+0000","last_fullsized":"2024-09-05T02:16:40.011129+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.010943+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:14:00.723241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'319","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.936309+0000","last_change":"2024-09-05T02:16:33.936309+0000","last_active":"2024-09-05T02:16:33.936309+0000","last_peered":"2024-09-05T02:16:33.936309+0000","last_clean":"2024-09-05T02:16:33.936309+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:33.936309+0000","last_undegraded":"2024-09-05T02:16:33.936309+0000","last_fullsized":"2024-09-05T02:16:33.936309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.936126+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:20:49.975373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":12836,"num_write":1013,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:06.231973+0000","last_change":"2024-09-05T00:49:31.918942+0000","last_active":"2024-09-05T02:14:06.231973+0000","last_peered":"2024-09-05T02:14:06.231973+0000","last_clean":"2024-09-05T02:14:06.231973+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:14:06.231973+0000","last_undegraded":"2024-09-05T02:14:06.231973+0000","last_fullsized":"2024-09-05T02:14:06.231973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:30.870880+0000","last_clean_scrub_stamp":"2024-09-05T00:49:30.870880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.979102+0000","last_change":"2024-09-05T00:49:33.927237+0000","last_active":"2024-09-05T02:16:21.979102+0000","last_peered":"2024-09-05T02:16:21.979102+0000","last_clean":"2024-09-05T02:16:21.979102+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:16:21.979102+0000","last_undegraded":"2024-09-05T02:16:21.979102+0000","last_fullsized":"2024-09-05T02:16:21.979102+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:38:43.233584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47269,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1091,"num_write":358,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:06.205283+0000","last_change":"2024-09-05T00:49:35.925928+0000","last_active":"2024-09-05T02:12:06.205283+0000","last_peered":"2024-09-05T02:12:06.205283+0000","last_clean":"2024-09-05T02:12:06.205283+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:12:06.205283+0000","last_undegraded":"2024-09-05T02:12:06.205283+0000","last_fullsized":"2024-09-05T02:12:06.205283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:21.943807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'165","reported_seq":1644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:29.603054+0000","last_change":"2024-09-05T00:49:37.943592+0000","last_active":"2024-09-05T02:14:29.603054+0000","last_peered":"2024-09-05T02:14:29.603054+0000","last_clean":"2024-09-05T02:14:29.603054+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:14:29.603054+0000","last_undegraded":"2024-09-05T02:14:29.603054+0000","last_fullsized":"2024-09-05T02:14:29.603054+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'346","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.488577+0000","last_change":"2024-09-05T02:16:39.488577+0000","last_active":"2024-09-05T02:16:39.488577+0000","last_peered":"2024-09-05T02:16:39.488577+0000","last_clean":"2024-09-05T02:16:39.488577+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:16:39.488577+0000","last_undegraded":"2024-09-05T02:16:39.488577+0000","last_fullsized":"2024-09-05T02:16:39.488577+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.488358+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:26.414847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'356","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.518195+0000","last_change":"2024-09-05T02:16:30.518195+0000","last_active":"2024-09-05T02:16:30.518195+0000","last_peered":"2024-09-05T02:16:30.518195+0000","last_clean":"2024-09-05T02:16:30.518195+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:16:30.518195+0000","last_undegraded":"2024-09-05T02:16:30.518195+0000","last_fullsized":"2024-09-05T02:16:30.518195+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.517946+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:33:37.139871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8860,"num_write":1095,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.170684+0000","last_change":"2024-09-05T02:16:44.170684+0000","last_active":"2024-09-05T02:16:44.170684+0000","last_peered":"2024-09-05T02:16:44.170684+0000","last_clean":"2024-09-05T02:16:44.170684+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:16:44.170684+0000","last_undegraded":"2024-09-05T02:16:44.170684+0000","last_fullsized":"2024-09-05T02:16:44.170684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.170506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:33.236636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'337","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.172371+0000","last_change":"2024-09-05T00:49:33.908269+0000","last_active":"2024-09-05T02:16:22.172371+0000","last_peered":"2024-09-05T02:16:22.172371+0000","last_clean":"2024-09-05T02:16:22.172371+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:16:22.172371+0000","last_undegraded":"2024-09-05T02:16:22.172371+0000","last_fullsized":"2024-09-05T02:16:22.172371+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:32.882101+0000","last_clean_scrub_stamp":"2024-09-05T00:49:32.882101+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:50.246291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":1162,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:05.439359+0000","last_change":"2024-09-05T00:49:35.940921+0000","last_active":"2024-09-05T02:12:05.439359+0000","last_peered":"2024-09-05T02:12:05.439359+0000","last_clean":"2024-09-05T02:12:05.439359+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:12:05.439359+0000","last_undegraded":"2024-09-05T02:12:05.439359+0000","last_fullsized":"2024-09-05T02:12:05.439359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:34.887691+0000","last_clean_scrub_stamp":"2024-09-05T00:49:34.887691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:45:23.954287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:48.723417+0000","last_change":"2024-09-05T00:49:37.929472+0000","last_active":"2024-09-05T02:15:48.723417+0000","last_peered":"2024-09-05T02:15:48.723417+0000","last_clean":"2024-09-05T02:15:48.723417+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:15:48.723417+0000","last_undegraded":"2024-09-05T02:15:48.723417+0000","last_fullsized":"2024-09-05T02:15:48.723417+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:25.886624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'435","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.163976+0000","last_change":"2024-09-05T02:16:43.163976+0000","last_active":"2024-09-05T02:16:43.163976+0000","last_peered":"2024-09-05T02:16:43.163976+0000","last_clean":"2024-09-05T02:16:43.163976+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:16:43.163976+0000","last_undegraded":"2024-09-05T02:16:43.163976+0000","last_fullsized":"2024-09-05T02:16:43.163976+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.163765+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:41.045947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4549,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'378","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.805135+0000","last_change":"2024-09-05T02:16:32.805135+0000","last_active":"2024-09-05T02:16:32.805135+0000","last_peered":"2024-09-05T02:16:32.805135+0000","last_clean":"2024-09-05T02:16:32.805135+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:32.805135+0000","last_undegraded":"2024-09-05T02:16:32.805135+0000","last_fullsized":"2024-09-05T02:16:32.805135+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.804912+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:04.484010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":487,"num_read_kb":8853,"num_write":1134,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1144","reported_seq":2643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.267542+0000","last_change":"2024-09-05T02:16:37.267542+0000","last_active":"2024-09-05T02:16:37.267542+0000","last_peered":"2024-09-05T02:16:37.267542+0000","last_clean":"2024-09-05T02:16:37.267542+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:16:37.267542+0000","last_undegraded":"2024-09-05T02:16:37.267542+0000","last_fullsized":"2024-09-05T02:16:37.267542+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1144","last_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_deep_scrub":"264'1144","last_deep_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.267346+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:22:33.530651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'332","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.795215+0000","last_change":"2024-09-05T02:16:30.795215+0000","last_active":"2024-09-05T02:16:30.795215+0000","last_peered":"2024-09-05T02:16:30.795215+0000","last_clean":"2024-09-05T02:16:30.795215+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:30.795215+0000","last_undegraded":"2024-09-05T02:16:30.795215+0000","last_fullsized":"2024-09-05T02:16:30.795215+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.794997+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:04:12.891688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":102142,"num_write":1127,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228410+0000","last_change":"2024-09-05T00:49:29.905701+0000","last_active":"2024-09-05T02:14:00.228410+0000","last_peered":"2024-09-05T02:14:00.228410+0000","last_clean":"2024-09-05T02:14:00.228410+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:14:00.228410+0000","last_undegraded":"2024-09-05T02:14:00.228410+0000","last_fullsized":"2024-09-05T02:14:00.228410+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:35:29.645920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'312","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.518851+0000","last_change":"2024-09-05T02:16:36.518851+0000","last_active":"2024-09-05T02:16:36.518851+0000","last_peered":"2024-09-05T02:16:36.518851+0000","last_clean":"2024-09-05T02:16:36.518851+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:16:36.518851+0000","last_undegraded":"2024-09-05T02:16:36.518851+0000","last_fullsized":"2024-09-05T02:16:36.518851+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.518501+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:55.497838+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":411,"num_write":976,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'418","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.226428+0000","last_change":"2024-09-05T02:16:38.226428+0000","last_active":"2024-09-05T02:16:38.226428+0000","last_peered":"2024-09-05T02:16:38.226428+0000","last_clean":"2024-09-05T02:16:38.226428+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:16:38.226428+0000","last_undegraded":"2024-09-05T02:16:38.226428+0000","last_fullsized":"2024-09-05T02:16:38.226428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.226250+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:52.035389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'318","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.490696+0000","last_change":"2024-09-05T02:16:33.490696+0000","last_active":"2024-09-05T02:16:33.490696+0000","last_peered":"2024-09-05T02:16:33.490696+0000","last_clean":"2024-09-05T02:16:33.490696+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:16:33.490696+0000","last_undegraded":"2024-09-05T02:16:33.490696+0000","last_fullsized":"2024-09-05T02:16:33.490696+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.490479+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:04.157446+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":737,"num_read_kb":8229,"num_write":1002,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1684","reported_seq":3539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.037729+0000","last_change":"2024-09-05T02:16:42.037729+0000","last_active":"2024-09-05T02:16:42.037729+0000","last_peered":"2024-09-05T02:16:42.037729+0000","last_clean":"2024-09-05T02:16:42.037729+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:16:42.037729+0000","last_undegraded":"2024-09-05T02:16:42.037729+0000","last_fullsized":"2024-09-05T02:16:42.037729+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1684","last_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_deep_scrub":"264'1684","last_deep_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.037537+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":1600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:08.464426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'362","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.923360+0000","last_change":"2024-09-05T02:16:31.923360+0000","last_active":"2024-09-05T02:16:31.923360+0000","last_peered":"2024-09-05T02:16:31.923360+0000","last_clean":"2024-09-05T02:16:31.923360+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:31.923360+0000","last_undegraded":"2024-09-05T02:16:31.923360+0000","last_fullsized":"2024-09-05T02:16:31.923360+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.923168+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:09.796286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":75263,"num_write":1071,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'626","reported_seq":2267,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.513367+0000","last_change":"2024-09-05T02:16:42.513367+0000","last_active":"2024-09-05T02:16:42.513367+0000","last_peered":"2024-09-05T02:16:42.513367+0000","last_clean":"2024-09-05T02:16:42.513367+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:16:42.513367+0000","last_undegraded":"2024-09-05T02:16:42.513367+0000","last_fullsized":"2024-09-05T02:16:42.513367+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.513129+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:25.607651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'360","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.345367+0000","last_change":"2024-09-05T02:16:32.345367+0000","last_active":"2024-09-05T02:16:32.345367+0000","last_peered":"2024-09-05T02:16:32.345367+0000","last_clean":"2024-09-05T02:16:32.345367+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:32.345367+0000","last_undegraded":"2024-09-05T02:16:32.345367+0000","last_fullsized":"2024-09-05T02:16:32.345367+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.345077+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:46.067374+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453457,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":27144,"num_write":1118,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'685","reported_seq":2369,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.065049+0000","last_change":"2024-09-05T02:16:44.065049+0000","last_active":"2024-09-05T02:16:44.065049+0000","last_peered":"2024-09-05T02:16:44.065049+0000","last_clean":"2024-09-05T02:16:44.065049+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:16:44.065049+0000","last_undegraded":"2024-09-05T02:16:44.065049+0000","last_fullsized":"2024-09-05T02:16:44.065049+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.064848+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:18.934798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'376","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.778588+0000","last_change":"2024-09-05T02:16:33.778588+0000","last_active":"2024-09-05T02:16:33.778588+0000","last_peered":"2024-09-05T02:16:33.778588+0000","last_clean":"2024-09-05T02:16:33.778588+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:33.778588+0000","last_undegraded":"2024-09-05T02:16:33.778588+0000","last_fullsized":"2024-09-05T02:16:33.778588+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.778363+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:27.507514+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":588,"num_read_kb":10940,"num_write":1274,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'477","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.911914+0000","last_change":"2024-09-05T02:16:40.911914+0000","last_active":"2024-09-05T02:16:40.911914+0000","last_peered":"2024-09-05T02:16:40.911914+0000","last_clean":"2024-09-05T02:16:40.911914+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:16:40.911914+0000","last_undegraded":"2024-09-05T02:16:40.911914+0000","last_fullsized":"2024-09-05T02:16:40.911914+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.911681+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:52.589997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.936616+0000","last_change":"2024-09-05T02:16:32.936616+0000","last_active":"2024-09-05T02:16:32.936616+0000","last_peered":"2024-09-05T02:16:32.936616+0000","last_clean":"2024-09-05T02:16:32.936616+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:32.936616+0000","last_undegraded":"2024-09-05T02:16:32.936616+0000","last_fullsized":"2024-09-05T02:16:32.936616+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.936402+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:04.969865+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461798,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":29011,"num_write":1195,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1110","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.389653+0000","last_change":"2024-09-05T02:16:37.389653+0000","last_active":"2024-09-05T02:16:37.389653+0000","last_peered":"2024-09-05T02:16:37.389653+0000","last_clean":"2024-09-05T02:16:37.389653+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:16:37.389653+0000","last_undegraded":"2024-09-05T02:16:37.389653+0000","last_fullsized":"2024-09-05T02:16:37.389653+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1110","last_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_deep_scrub":"264'1110","last_deep_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.389478+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:32.651447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'366","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.545413+0000","last_change":"2024-09-05T02:16:37.545413+0000","last_active":"2024-09-05T02:16:37.545413+0000","last_peered":"2024-09-05T02:16:37.545413+0000","last_clean":"2024-09-05T02:16:37.545413+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:16:37.545413+0000","last_undegraded":"2024-09-05T02:16:37.545413+0000","last_fullsized":"2024-09-05T02:16:37.545413+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.545206+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.687864+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":61900,"num_write":1145,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'622","reported_seq":2305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.495551+0000","last_change":"2024-09-05T02:16:44.495551+0000","last_active":"2024-09-05T02:16:44.495551+0000","last_peered":"2024-09-05T02:16:44.495551+0000","last_clean":"2024-09-05T02:16:44.495551+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:16:44.495551+0000","last_undegraded":"2024-09-05T02:16:44.495551+0000","last_fullsized":"2024-09-05T02:16:44.495551+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'622","last_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_deep_scrub":"264'622","last_deep_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.495326+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:02.043865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'350","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.044641+0000","last_change":"2024-09-05T02:16:36.044641+0000","last_active":"2024-09-05T02:16:36.044641+0000","last_peered":"2024-09-05T02:16:36.044641+0000","last_clean":"2024-09-05T02:16:36.044641+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:36.044641+0000","last_undegraded":"2024-09-05T02:16:36.044641+0000","last_fullsized":"2024-09-05T02:16:36.044641+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.044432+0000","objects_scrubbed":13,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:25.636296+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953006,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":484,"num_read_kb":25097,"num_write":1158,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'543","reported_seq":2196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.752884+0000","last_change":"2024-09-05T02:16:35.752884+0000","last_active":"2024-09-05T02:16:35.752884+0000","last_peered":"2024-09-05T02:16:35.752884+0000","last_clean":"2024-09-05T02:16:35.752884+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:16:35.752884+0000","last_undegraded":"2024-09-05T02:16:35.752884+0000","last_fullsized":"2024-09-05T02:16:35.752884+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.752698+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:45.155213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'410","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.779143+0000","last_change":"2024-09-05T02:16:29.779143+0000","last_active":"2024-09-05T02:16:29.779143+0000","last_peered":"2024-09-05T02:16:29.779143+0000","last_clean":"2024-09-05T02:16:29.779143+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:29.779143+0000","last_undegraded":"2024-09-05T02:16:29.779143+0000","last_fullsized":"2024-09-05T02:16:29.779143+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'410","last_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_deep_scrub":"264'410","last_deep_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.778934+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:09.661610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262234,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":5699,"num_write":1247,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1185","reported_seq":2844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.510341+0000","last_change":"2024-09-05T02:16:43.510341+0000","last_active":"2024-09-05T02:16:43.510341+0000","last_peered":"2024-09-05T02:16:43.510341+0000","last_clean":"2024-09-05T02:16:43.510341+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:16:43.510341+0000","last_undegraded":"2024-09-05T02:16:43.510341+0000","last_fullsized":"2024-09-05T02:16:43.510341+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1185","last_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_deep_scrub":"264'1185","last_deep_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.510160+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":1100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:51.275393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'336","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.452295+0000","last_change":"2024-09-05T02:16:36.452295+0000","last_active":"2024-09-05T02:16:36.452295+0000","last_peered":"2024-09-05T02:16:36.452295+0000","last_clean":"2024-09-05T02:16:36.452295+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:16:36.452295+0000","last_undegraded":"2024-09-05T02:16:36.452295+0000","last_fullsized":"2024-09-05T02:16:36.452295+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.451991+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:44.484998+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":5076,"num_write":1193,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'491","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.060842+0000","last_change":"2024-09-05T02:16:43.060842+0000","last_active":"2024-09-05T02:16:43.060842+0000","last_peered":"2024-09-05T02:16:43.060842+0000","last_clean":"2024-09-05T02:16:43.060842+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:16:43.060842+0000","last_undegraded":"2024-09-05T02:16:43.060842+0000","last_fullsized":"2024-09-05T02:16:43.060842+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'491","last_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_deep_scrub":"264'491","last_deep_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.060647+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.428329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'374","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.790296+0000","last_change":"2024-09-05T02:16:34.790296+0000","last_active":"2024-09-05T02:16:34.790296+0000","last_peered":"2024-09-05T02:16:34.790296+0000","last_clean":"2024-09-05T02:16:34.790296+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:34.790296+0000","last_undegraded":"2024-09-05T02:16:34.790296+0000","last_fullsized":"2024-09-05T02:16:34.790296+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'374","last_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_deep_scrub":"264'374","last_deep_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.790058+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:13.589152+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":31375,"num_write":1285,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'688","reported_seq":2241,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.444760+0000","last_change":"2024-09-05T02:16:34.444760+0000","last_active":"2024-09-05T02:16:34.444760+0000","last_peered":"2024-09-05T02:16:34.444760+0000","last_clean":"2024-09-05T02:16:34.444760+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:16:34.444760+0000","last_undegraded":"2024-09-05T02:16:34.444760+0000","last_fullsized":"2024-09-05T02:16:34.444760+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'688","last_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_deep_scrub":"264'688","last_deep_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.444577+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:27.270344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'349","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.051570+0000","last_change":"2024-09-05T02:16:39.051570+0000","last_active":"2024-09-05T02:16:39.051570+0000","last_peered":"2024-09-05T02:16:39.051570+0000","last_clean":"2024-09-05T02:16:39.051570+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:39.051570+0000","last_undegraded":"2024-09-05T02:16:39.051570+0000","last_fullsized":"2024-09-05T02:16:39.051570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.051218+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:07.873190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":11105,"num_write":1131,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'524","reported_seq":2133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.037635+0000","last_change":"2024-09-05T02:16:43.037635+0000","last_active":"2024-09-05T02:16:43.037635+0000","last_peered":"2024-09-05T02:16:43.037635+0000","last_clean":"2024-09-05T02:16:43.037635+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:16:43.037635+0000","last_undegraded":"2024-09-05T02:16:43.037635+0000","last_fullsized":"2024-09-05T02:16:43.037635+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'524","last_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_deep_scrub":"264'524","last_deep_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.037438+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:01.180965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'332","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.770992+0000","last_change":"2024-09-05T02:16:31.770992+0000","last_active":"2024-09-05T02:16:31.770992+0000","last_peered":"2024-09-05T02:16:31.770992+0000","last_clean":"2024-09-05T02:16:31.770992+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:31.770992+0000","last_undegraded":"2024-09-05T02:16:31.770992+0000","last_fullsized":"2024-09-05T02:16:31.770992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.770780+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:08.517290+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":115088,"num_write":1048,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.964444+0000","last_change":"2024-09-05T02:16:44.964444+0000","last_active":"2024-09-05T02:16:44.964444+0000","last_peered":"2024-09-05T02:16:44.964444+0000","last_clean":"2024-09-05T02:16:44.964444+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:16:44.964444+0000","last_undegraded":"2024-09-05T02:16:44.964444+0000","last_fullsized":"2024-09-05T02:16:44.964444+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.964260+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:25.779977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'313","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.588790+0000","last_change":"2024-09-05T02:16:38.588790+0000","last_active":"2024-09-05T02:16:38.588790+0000","last_peered":"2024-09-05T02:16:38.588790+0000","last_clean":"2024-09-05T02:16:38.588790+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:16:38.588790+0000","last_undegraded":"2024-09-05T02:16:38.588790+0000","last_fullsized":"2024-09-05T02:16:38.588790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.588599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:12.567380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":641,"num_write":1040,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'421","reported_seq":1128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.547611+0000","last_change":"2024-09-05T02:16:40.547611+0000","last_active":"2024-09-05T02:16:40.547611+0000","last_peered":"2024-09-05T02:16:40.547611+0000","last_clean":"2024-09-05T02:16:40.547611+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:16:40.547611+0000","last_undegraded":"2024-09-05T02:16:40.547611+0000","last_fullsized":"2024-09-05T02:16:40.547611+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.547395+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:27.409142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":738,"num_read_kb":35471,"num_write":1283,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'408","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.357127+0000","last_change":"2024-09-05T02:16:39.357127+0000","last_active":"2024-09-05T02:16:39.357127+0000","last_peered":"2024-09-05T02:16:39.357127+0000","last_clean":"2024-09-05T02:16:39.357127+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:16:39.357127+0000","last_undegraded":"2024-09-05T02:16:39.357127+0000","last_fullsized":"2024-09-05T02:16:39.357127+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.356925+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:00.382840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2486,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'378","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.318136+0000","last_change":"2024-09-05T02:16:33.318136+0000","last_active":"2024-09-05T02:16:33.318136+0000","last_peered":"2024-09-05T02:16:33.318136+0000","last_clean":"2024-09-05T02:16:33.318136+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:33.318136+0000","last_undegraded":"2024-09-05T02:16:33.318136+0000","last_fullsized":"2024-09-05T02:16:33.318136+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.317918+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:08.472687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":26073,"num_write":1194,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'871","reported_seq":2434,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.229620+0000","last_change":"2024-09-05T00:49:29.908617+0000","last_active":"2024-09-05T02:14:05.229620+0000","last_peered":"2024-09-05T02:14:05.229620+0000","last_clean":"2024-09-05T02:14:05.229620+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:14:05.229620+0000","last_undegraded":"2024-09-05T02:14:05.229620+0000","last_fullsized":"2024-09-05T02:14:05.229620+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:28.855795+0000","last_clean_scrub_stamp":"2024-09-05T00:49:28.855795+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":800,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1020,"ondisk_log_size":1020,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1859,"ondisk_log_size":1859,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":665,"ondisk_log_size":665,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1550994,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19804,"num_read_kb":40130,"num_write":16519,"num_write_kb":12075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1869,"ondisk_log_size":1869,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36270,"num_omap_keys":148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4171,"ondisk_log_size":4171,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66708448,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36139,"num_read_kb":2043809,"num_write":71843,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134676480,"data_stored":133416896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3567,"ondisk_log_size":3567,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174352,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174298,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510498,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285436,"kb_used_data":23788,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94086404,"statfs":{"total":96636764160,"available":96344477696,"internally_reserved":0,"allocated":24358912,"data_stored":22640434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510497,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":238124,"kb_used_data":13980,"kb_used_omap":1,"kb_used_meta":224126,"kb_avail":94133716,"statfs":{"total":96636764160,"available":96392925184,"internally_reserved":0,"allocated":14315520,"data_stored":12734941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":229505478},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510494,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120456,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94251384,"statfs":{"total":96636764160,"available":96513417216,"internally_reserved":0,"allocated":31711232,"data_stored":30061356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510498,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":35928,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":36790272,"data_stored":35092545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510496,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103096,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94268744,"statfs":{"total":96636764160,"available":96531193856,"internally_reserved":0,"allocated":9740288,"data_stored":8176150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510497,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145768,"kb_used_data":10520,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94226072,"statfs":{"total":96636764160,"available":96487497728,"internally_reserved":0,"allocated":10772480,"data_stored":9180748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543200,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146632,"kb_used_data":16952,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94225208,"statfs":{"total":96636764160,"available":96486612992,"internally_reserved":0,"allocated":17358848,"data_stored":15590745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543201,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271424,"kb_used_data":19568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100416,"statfs":{"total":96636764160,"available":96358825984,"internally_reserved":0,"allocated":20037632,"data_stored":18279783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15736832,"data_stored":15540753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":7036545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6131712,"data_stored":6032468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33136640,"data_stored":32946939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28102656,"data_stored":27918588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":13446327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":10591792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20078592,"data_stored":19903484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:16:50.424 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.424 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.425 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.426 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.427 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.428 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.429 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.430 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.431 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.432 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.433 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.434 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.435 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.436 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.437 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.438 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.439 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.440 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.441 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.442 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.443 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.444 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.445 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.446 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.447 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.447 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.447 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.447 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.447 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.448 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.449 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.450 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.451 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.452 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-05T00:49:30.870880+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=30, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.453 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.454 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-05T00:49:32.882101+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=32, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.454 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-05T00:49:34.887691+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=34, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.454 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.454 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.454 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-05T00:49:28.855795+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=28, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:16:50.455 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T02:17:10.455 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:17:10.811 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:17:10.848 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:17:10.850 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2896,"stamp":"2024-09-05T02:17:10.539802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68867067,"num_objects":856,"num_object_clones":0,"num_object_copies":1712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":856,"num_whiteouts":0,"num_read":292554,"num_read_kb":2648548,"num_write":162836,"num_write_kb":2503589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724384,"num_omap_keys":1772,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13535,"ondisk_log_size":13535,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1600128,"kb_used_data":161216,"kb_used_omap":12,"kb_used_meta":1438771,"kb_avail":753374592,"statfs":{"total":773094113280,"available":771455582208,"internally_reserved":0,"allocated":165085184,"data_stored":151756702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1473302064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":601608,"num_omap_keys":1412,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009527"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210603+0000","last_change":"2024-09-05T01:30:15.666227+0000","last_active":"2024-09-05T02:12:45.210603+0000","last_peered":"2024-09-05T02:12:45.210603+0000","last_clean":"2024-09-05T02:12:45.210603+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:12:45.210603+0000","last_undegraded":"2024-09-05T02:12:45.210603+0000","last_fullsized":"2024-09-05T02:12:45.210603+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:09.850469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:30.235546+0000","last_change":"2024-09-05T01:09:26.334043+0000","last_active":"2024-09-05T02:14:30.235546+0000","last_peered":"2024-09-05T02:14:30.235546+0000","last_clean":"2024-09-05T02:14:30.235546+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:14:30.235546+0000","last_undegraded":"2024-09-05T02:14:30.235546+0000","last_fullsized":"2024-09-05T02:14:30.235546+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'8","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.884084+0000","last_change":"2024-09-05T01:09:22.201279+0000","last_active":"2024-09-05T02:16:22.884084+0000","last_peered":"2024-09-05T02:16:22.884084+0000","last_clean":"2024-09-05T02:16:22.884084+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:16:22.884084+0000","last_undegraded":"2024-09-05T02:16:22.884084+0000","last_fullsized":"2024-09-05T02:16:22.884084+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:55.466746+0000","last_change":"2024-09-05T01:05:07.120360+0000","last_active":"2024-09-05T02:13:55.466746+0000","last_peered":"2024-09-05T02:13:55.466746+0000","last_clean":"2024-09-05T02:13:55.466746+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:13:55.466746+0000","last_undegraded":"2024-09-05T02:13:55.466746+0000","last_fullsized":"2024-09-05T02:13:55.466746+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:09:51.159009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.728112+0000","last_change":"2024-09-05T02:16:57.728112+0000","last_active":"2024-09-05T02:16:57.728112+0000","last_peered":"2024-09-05T02:16:57.728112+0000","last_clean":"2024-09-05T02:16:57.728112+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:16:57.728112+0000","last_undegraded":"2024-09-05T02:16:57.728112+0000","last_fullsized":"2024-09-05T02:16:57.728112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.727939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:18.941355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.357131+0000","last_change":"2024-09-05T01:09:26.326901+0000","last_active":"2024-09-05T02:16:21.357131+0000","last_peered":"2024-09-05T02:16:21.357131+0000","last_clean":"2024-09-05T02:16:21.357131+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:16:21.357131+0000","last_undegraded":"2024-09-05T02:16:21.357131+0000","last_fullsized":"2024-09-05T02:16:21.357131+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.338018+0000","last_change":"2024-09-05T02:17:03.338018+0000","last_active":"2024-09-05T02:17:03.338018+0000","last_peered":"2024-09-05T02:17:03.338018+0000","last_clean":"2024-09-05T02:17:03.338018+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:17:03.338018+0000","last_undegraded":"2024-09-05T02:17:03.338018+0000","last_fullsized":"2024-09-05T02:17:03.338018+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.337834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:07.730190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.716953+0000","last_change":"2024-09-05T02:16:49.716953+0000","last_active":"2024-09-05T02:16:49.716953+0000","last_peered":"2024-09-05T02:16:49.716953+0000","last_clean":"2024-09-05T02:16:49.716953+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:16:49.716953+0000","last_undegraded":"2024-09-05T02:16:49.716953+0000","last_fullsized":"2024-09-05T02:16:49.716953+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.716771+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:00.343321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.409851+0000","last_change":"2024-09-05T01:30:15.672141+0000","last_active":"2024-09-05T02:13:46.409851+0000","last_peered":"2024-09-05T02:13:46.409851+0000","last_clean":"2024-09-05T02:13:46.409851+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:13:46.409851+0000","last_undegraded":"2024-09-05T02:13:46.409851+0000","last_fullsized":"2024-09-05T02:13:46.409851+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:38.146488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:10.495204+0000","last_change":"2024-09-05T01:09:26.332549+0000","last_active":"2024-09-05T02:16:10.495204+0000","last_peered":"2024-09-05T02:16:10.495204+0000","last_clean":"2024-09-05T02:16:10.495204+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:16:10.495204+0000","last_undegraded":"2024-09-05T02:16:10.495204+0000","last_fullsized":"2024-09-05T02:16:10.495204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:00.959295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":53,"num_write":4,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.795230+0000","last_change":"2024-09-05T02:16:55.795230+0000","last_active":"2024-09-05T02:16:55.795230+0000","last_peered":"2024-09-05T02:16:55.795230+0000","last_clean":"2024-09-05T02:16:55.795230+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:16:55.795230+0000","last_undegraded":"2024-09-05T02:16:55.795230+0000","last_fullsized":"2024-09-05T02:16:55.795230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.795045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:42:15.586272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.419370+0000","last_change":"2024-09-05T02:17:10.419370+0000","last_active":"2024-09-05T02:17:10.419370+0000","last_peered":"2024-09-05T02:17:10.419370+0000","last_clean":"2024-09-05T02:17:10.419370+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:17:10.419370+0000","last_undegraded":"2024-09-05T02:17:10.419370+0000","last_fullsized":"2024-09-05T02:17:10.419370+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.419204+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:14:09.371937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:41.485586+0000","last_change":"2024-09-05T01:09:26.341275+0000","last_active":"2024-09-05T02:13:41.485586+0000","last_peered":"2024-09-05T02:13:41.485586+0000","last_clean":"2024-09-05T02:13:41.485586+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:13:41.485586+0000","last_undegraded":"2024-09-05T02:13:41.485586+0000","last_fullsized":"2024-09-05T02:13:41.485586+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:27:54.726182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.229819+0000","last_change":"2024-09-05T01:09:22.180667+0000","last_active":"2024-09-05T02:13:56.229819+0000","last_peered":"2024-09-05T02:13:56.229819+0000","last_clean":"2024-09-05T02:13:56.229819+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:13:56.229819+0000","last_undegraded":"2024-09-05T02:13:56.229819+0000","last_fullsized":"2024-09-05T02:13:56.229819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:29.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469900+0000","last_change":"2024-09-05T01:05:07.102782+0000","last_active":"2024-09-05T02:12:36.469900+0000","last_peered":"2024-09-05T02:12:36.469900+0000","last_clean":"2024-09-05T02:12:36.469900+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:12:36.469900+0000","last_undegraded":"2024-09-05T02:12:36.469900+0000","last_fullsized":"2024-09-05T02:12:36.469900+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:12:47.611316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495387+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:14:26.495387+0000","last_peered":"2024-09-05T02:14:26.495387+0000","last_clean":"2024-09-05T02:14:26.495387+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:14:26.495387+0000","last_undegraded":"2024-09-05T02:14:26.495387+0000","last_fullsized":"2024-09-05T02:14:26.495387+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'9","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:05.243459+0000","last_change":"2024-09-05T01:09:26.329802+0000","last_active":"2024-09-05T02:15:05.243459+0000","last_peered":"2024-09-05T02:15:05.243459+0000","last_clean":"2024-09-05T02:15:05.243459+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:15:05.243459+0000","last_undegraded":"2024-09-05T02:15:05.243459+0000","last_fullsized":"2024-09-05T02:15:05.243459+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:23.699832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":22528,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:40.476651+0000","last_change":"2024-09-05T01:09:22.175516+0000","last_active":"2024-09-05T02:14:40.476651+0000","last_peered":"2024-09-05T02:14:40.476651+0000","last_clean":"2024-09-05T02:14:40.476651+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:14:40.476651+0000","last_undegraded":"2024-09-05T02:14:40.476651+0000","last_fullsized":"2024-09-05T02:14:40.476651+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'82","reported_seq":354,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:36.469828+0000","last_change":"2024-09-05T01:05:07.113219+0000","last_active":"2024-09-05T02:12:36.469828+0000","last_peered":"2024-09-05T02:12:36.469828+0000","last_clean":"2024-09-05T02:12:36.469828+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:12:36.469828+0000","last_undegraded":"2024-09-05T02:12:36.469828+0000","last_fullsized":"2024-09-05T02:12:36.469828+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:10:56.550157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.794713+0000","last_change":"2024-09-05T01:30:15.648820+0000","last_active":"2024-09-05T02:14:01.794713+0000","last_peered":"2024-09-05T02:14:01.794713+0000","last_clean":"2024-09-05T02:14:01.794713+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:14:01.794713+0000","last_undegraded":"2024-09-05T02:14:01.794713+0000","last_fullsized":"2024-09-05T02:14:01.794713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:48:57.585289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.172642+0000","last_change":"2024-09-05T02:17:04.172386+0000","last_active":"2024-09-05T02:17:04.172642+0000","last_peered":"2024-09-05T02:17:04.172642+0000","last_clean":"2024-09-05T02:17:04.172642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:17:04.172642+0000","last_undegraded":"2024-09-05T02:17:04.172642+0000","last_fullsized":"2024-09-05T02:17:04.172642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.172168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:25.385664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:51.242584+0000","last_change":"2024-09-05T01:09:22.174856+0000","last_active":"2024-09-05T02:14:51.242584+0000","last_peered":"2024-09-05T02:14:51.242584+0000","last_clean":"2024-09-05T02:14:51.242584+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:14:51.242584+0000","last_undegraded":"2024-09-05T02:14:51.242584+0000","last_fullsized":"2024-09-05T02:14:51.242584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:37.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.054295+0000","last_change":"2024-09-05T02:16:59.054295+0000","last_active":"2024-09-05T02:16:59.054295+0000","last_peered":"2024-09-05T02:16:59.054295+0000","last_clean":"2024-09-05T02:16:59.054295+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:16:59.054295+0000","last_undegraded":"2024-09-05T02:16:59.054295+0000","last_fullsized":"2024-09-05T02:16:59.054295+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.053968+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:36.825922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825313+0000","last_change":"2024-09-05T01:30:15.665481+0000","last_active":"2024-09-05T02:12:46.825313+0000","last_peered":"2024-09-05T02:12:46.825313+0000","last_clean":"2024-09-05T02:12:46.825313+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:12:46.825313+0000","last_undegraded":"2024-09-05T02:12:46.825313+0000","last_fullsized":"2024-09-05T02:12:46.825313+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:58.014337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.215417+0000","last_change":"2024-09-05T02:17:05.215417+0000","last_active":"2024-09-05T02:17:05.215417+0000","last_peered":"2024-09-05T02:17:05.215417+0000","last_clean":"2024-09-05T02:17:05.215417+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:17:05.215417+0000","last_undegraded":"2024-09-05T02:17:05.215417+0000","last_fullsized":"2024-09-05T02:17:05.215417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.215205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:38.050614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:21.235510+0000","last_change":"2024-09-05T01:09:22.186390+0000","last_active":"2024-09-05T02:14:21.235510+0000","last_peered":"2024-09-05T02:14:21.235510+0000","last_clean":"2024-09-05T02:14:21.235510+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:14:21.235510+0000","last_undegraded":"2024-09-05T02:14:21.235510+0000","last_fullsized":"2024-09-05T02:14:21.235510+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.376977+0000","last_change":"2024-09-05T02:17:09.376977+0000","last_active":"2024-09-05T02:17:09.376977+0000","last_peered":"2024-09-05T02:17:09.376977+0000","last_clean":"2024-09-05T02:17:09.376977+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:17:09.376977+0000","last_undegraded":"2024-09-05T02:17:09.376977+0000","last_fullsized":"2024-09-05T02:17:09.376977+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.376801+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:37.688382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825441+0000","last_change":"2024-09-05T01:30:15.672226+0000","last_active":"2024-09-05T02:12:46.825441+0000","last_peered":"2024-09-05T02:12:46.825441+0000","last_clean":"2024-09-05T02:12:46.825441+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:12:46.825441+0000","last_undegraded":"2024-09-05T02:12:46.825441+0000","last_fullsized":"2024-09-05T02:12:46.825441+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:33:11.264675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.796259+0000","last_change":"2024-09-05T01:09:26.324884+0000","last_active":"2024-09-05T02:16:22.796259+0000","last_peered":"2024-09-05T02:16:22.796259+0000","last_clean":"2024-09-05T02:16:22.796259+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:16:22.796259+0000","last_undegraded":"2024-09-05T02:16:22.796259+0000","last_fullsized":"2024-09-05T02:16:22.796259+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.882726+0000","last_change":"2024-09-05T01:09:22.205005+0000","last_active":"2024-09-05T02:16:22.882726+0000","last_peered":"2024-09-05T02:16:22.882726+0000","last_clean":"2024-09-05T02:16:22.882726+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:16:22.882726+0000","last_undegraded":"2024-09-05T02:16:22.882726+0000","last_fullsized":"2024-09-05T02:16:22.882726+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":23604,"num_write":14,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.239705+0000","last_change":"2024-09-05T02:16:57.239705+0000","last_active":"2024-09-05T02:16:57.239705+0000","last_peered":"2024-09-05T02:16:57.239705+0000","last_clean":"2024-09-05T02:16:57.239705+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:16:57.239705+0000","last_undegraded":"2024-09-05T02:16:57.239705+0000","last_fullsized":"2024-09-05T02:16:57.239705+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.239525+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:44.031261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.801870+0000","last_change":"2024-09-05T01:30:15.663993+0000","last_active":"2024-09-05T02:14:36.801870+0000","last_peered":"2024-09-05T02:14:36.801870+0000","last_clean":"2024-09-05T02:14:36.801870+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:14:36.801870+0000","last_undegraded":"2024-09-05T02:14:36.801870+0000","last_fullsized":"2024-09-05T02:14:36.801870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.107540+0000","last_change":"2024-09-05T01:09:26.351136+0000","last_active":"2024-09-05T02:16:22.107540+0000","last_peered":"2024-09-05T02:16:22.107540+0000","last_clean":"2024-09-05T02:16:22.107540+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:16:22.107540+0000","last_undegraded":"2024-09-05T02:16:22.107540+0000","last_fullsized":"2024-09-05T02:16:22.107540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:45.210703+0000","last_change":"2024-09-05T01:09:22.178065+0000","last_active":"2024-09-05T02:12:45.210703+0000","last_peered":"2024-09-05T02:12:45.210703+0000","last_clean":"2024-09-05T02:12:45.210703+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:12:45.210703+0000","last_undegraded":"2024-09-05T02:12:45.210703+0000","last_fullsized":"2024-09-05T02:12:45.210703+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:42:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:50.451097+0000","last_change":"2024-09-05T01:05:07.115510+0000","last_active":"2024-09-05T02:12:50.451097+0000","last_peered":"2024-09-05T02:12:50.451097+0000","last_clean":"2024-09-05T02:12:50.451097+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:12:50.451097+0000","last_undegraded":"2024-09-05T02:12:50.451097+0000","last_fullsized":"2024-09-05T02:12:50.451097+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:14:32.613603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.759428+0000","last_change":"2024-09-05T02:16:58.759428+0000","last_active":"2024-09-05T02:16:58.759428+0000","last_peered":"2024-09-05T02:16:58.759428+0000","last_clean":"2024-09-05T02:16:58.759428+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:16:58.759428+0000","last_undegraded":"2024-09-05T02:16:58.759428+0000","last_fullsized":"2024-09-05T02:16:58.759428+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.759204+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:12.620338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'10","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.427502+0000","last_change":"2024-09-05T01:09:26.340188+0000","last_active":"2024-09-05T02:16:22.427502+0000","last_peered":"2024-09-05T02:16:22.427502+0000","last_clean":"2024-09-05T02:16:22.427502+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:16:22.427502+0000","last_undegraded":"2024-09-05T02:16:22.427502+0000","last_fullsized":"2024-09-05T02:16:22.427502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:24.383566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28674,"num_write":15,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.641800+0000","last_change":"2024-09-05T01:09:22.172284+0000","last_active":"2024-09-05T02:14:36.641800+0000","last_peered":"2024-09-05T02:14:36.641800+0000","last_clean":"2024-09-05T02:14:36.641800+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:14:36.641800+0000","last_undegraded":"2024-09-05T02:14:36.641800+0000","last_fullsized":"2024-09-05T02:14:36.641800+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472803+0000","last_change":"2024-09-05T01:05:07.095129+0000","last_active":"2024-09-05T02:12:46.472803+0000","last_peered":"2024-09-05T02:12:46.472803+0000","last_clean":"2024-09-05T02:12:46.472803+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:12:46.472803+0000","last_undegraded":"2024-09-05T02:12:46.472803+0000","last_fullsized":"2024-09-05T02:12:46.472803+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:46.472544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.641479+0000","last_change":"2024-09-05T01:30:15.664278+0000","last_active":"2024-09-05T02:14:36.641479+0000","last_peered":"2024-09-05T02:14:36.641479+0000","last_clean":"2024-09-05T02:14:36.641479+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:14:36.641479+0000","last_undegraded":"2024-09-05T02:14:36.641479+0000","last_fullsized":"2024-09-05T02:14:36.641479+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.499096+0000","last_change":"2024-09-05T01:09:26.332621+0000","last_active":"2024-09-05T02:14:41.499096+0000","last_peered":"2024-09-05T02:14:41.499096+0000","last_clean":"2024-09-05T02:14:41.499096+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:14:41.499096+0000","last_undegraded":"2024-09-05T02:14:41.499096+0000","last_fullsized":"2024-09-05T02:14:41.499096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.759403+0000","last_change":"2024-09-05T02:16:51.759263+0000","last_active":"2024-09-05T02:16:51.759403+0000","last_peered":"2024-09-05T02:16:51.759403+0000","last_clean":"2024-09-05T02:16:51.759403+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:16:51.759403+0000","last_undegraded":"2024-09-05T02:16:51.759403+0000","last_fullsized":"2024-09-05T02:16:51.759403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.759077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:34.310502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.731755+0000","last_change":"2024-09-05T02:16:50.731755+0000","last_active":"2024-09-05T02:16:50.731755+0000","last_peered":"2024-09-05T02:16:50.731755+0000","last_clean":"2024-09-05T02:16:50.731755+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:16:50.731755+0000","last_undegraded":"2024-09-05T02:16:50.731755+0000","last_fullsized":"2024-09-05T02:16:50.731755+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.731551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:35:18.587423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:35.236569+0000","last_change":"2024-09-05T01:30:15.667291+0000","last_active":"2024-09-05T02:14:35.236569+0000","last_peered":"2024-09-05T02:14:35.236569+0000","last_clean":"2024-09-05T02:14:35.236569+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:14:35.236569+0000","last_undegraded":"2024-09-05T02:14:35.236569+0000","last_fullsized":"2024-09-05T02:14:35.236569+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.240477+0000","last_change":"2024-09-05T01:09:26.315062+0000","last_active":"2024-09-05T02:14:41.240477+0000","last_peered":"2024-09-05T02:14:41.240477+0000","last_clean":"2024-09-05T02:14:41.240477+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:14:41.240477+0000","last_undegraded":"2024-09-05T02:14:41.240477+0000","last_fullsized":"2024-09-05T02:14:41.240477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.880600+0000","last_change":"2024-09-05T01:09:22.177059+0000","last_active":"2024-09-05T02:16:21.880600+0000","last_peered":"2024-09-05T02:16:21.880600+0000","last_clean":"2024-09-05T02:16:21.880600+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:16:21.880600+0000","last_undegraded":"2024-09-05T02:16:21.880600+0000","last_fullsized":"2024-09-05T02:16:21.880600+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:56.827863+0000","last_change":"2024-09-05T01:05:07.088212+0000","last_active":"2024-09-05T02:12:56.827863+0000","last_peered":"2024-09-05T02:12:56.827863+0000","last_clean":"2024-09-05T02:12:56.827863+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:12:56.827863+0000","last_undegraded":"2024-09-05T02:12:56.827863+0000","last_fullsized":"2024-09-05T02:12:56.827863+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:42.298180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:46.804163+0000","last_change":"2024-09-05T01:09:26.325983+0000","last_active":"2024-09-05T02:14:46.804163+0000","last_peered":"2024-09-05T02:14:46.804163+0000","last_clean":"2024-09-05T02:14:46.804163+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:14:46.804163+0000","last_undegraded":"2024-09-05T02:14:46.804163+0000","last_fullsized":"2024-09-05T02:14:46.804163+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.240196+0000","last_change":"2024-09-05T01:09:22.190856+0000","last_active":"2024-09-05T02:14:41.240196+0000","last_peered":"2024-09-05T02:14:41.240196+0000","last_clean":"2024-09-05T02:14:41.240196+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:14:41.240196+0000","last_undegraded":"2024-09-05T02:14:41.240196+0000","last_fullsized":"2024-09-05T02:14:41.240196+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.825172+0000","last_change":"2024-09-05T01:05:07.099335+0000","last_active":"2024-09-05T02:12:46.825172+0000","last_peered":"2024-09-05T02:12:46.825172+0000","last_clean":"2024-09-05T02:12:46.825172+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:12:46.825172+0000","last_undegraded":"2024-09-05T02:12:46.825172+0000","last_fullsized":"2024-09-05T02:12:46.825172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:43:12.344785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:45.464417+0000","last_change":"2024-09-05T01:30:15.662101+0000","last_active":"2024-09-05T02:13:45.464417+0000","last_peered":"2024-09-05T02:13:45.464417+0000","last_clean":"2024-09-05T02:13:45.464417+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:13:45.464417+0000","last_undegraded":"2024-09-05T02:13:45.464417+0000","last_fullsized":"2024-09-05T02:13:45.464417+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:58:45.784422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.316513+0000","last_change":"2024-09-05T02:17:06.316376+0000","last_active":"2024-09-05T02:17:06.316513+0000","last_peered":"2024-09-05T02:17:06.316513+0000","last_clean":"2024-09-05T02:17:06.316513+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:17:06.316513+0000","last_undegraded":"2024-09-05T02:17:06.316513+0000","last_fullsized":"2024-09-05T02:17:06.316513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.316187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:15.545632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.881578+0000","last_change":"2024-09-05T01:09:22.195654+0000","last_active":"2024-09-05T02:16:21.881578+0000","last_peered":"2024-09-05T02:16:21.881578+0000","last_clean":"2024-09-05T02:16:21.881578+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:16:21.881578+0000","last_undegraded":"2024-09-05T02:16:21.881578+0000","last_fullsized":"2024-09-05T02:16:21.881578+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'117","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.337648+0000","last_change":"2024-09-05T02:17:08.337648+0000","last_active":"2024-09-05T02:17:08.337648+0000","last_peered":"2024-09-05T02:17:08.337648+0000","last_clean":"2024-09-05T02:17:08.337648+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:17:08.337648+0000","last_undegraded":"2024-09-05T02:17:08.337648+0000","last_fullsized":"2024-09-05T02:17:08.337648+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.337473+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:56.312725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:45.478095+0000","last_change":"2024-09-05T01:30:15.653629+0000","last_active":"2024-09-05T02:14:45.478095+0000","last_peered":"2024-09-05T02:14:45.478095+0000","last_clean":"2024-09-05T02:14:45.478095+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:14:45.478095+0000","last_undegraded":"2024-09-05T02:14:45.478095+0000","last_fullsized":"2024-09-05T02:14:45.478095+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.795932+0000","last_change":"2024-09-05T01:09:26.344442+0000","last_active":"2024-09-05T02:16:22.795932+0000","last_peered":"2024-09-05T02:16:22.795932+0000","last_clean":"2024-09-05T02:16:22.795932+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:16:22.795932+0000","last_undegraded":"2024-09-05T02:16:22.795932+0000","last_fullsized":"2024-09-05T02:16:22.795932+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.128550+0000","last_change":"2024-09-05T02:17:02.128550+0000","last_active":"2024-09-05T02:17:02.128550+0000","last_peered":"2024-09-05T02:17:02.128550+0000","last_clean":"2024-09-05T02:17:02.128550+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:17:02.128550+0000","last_undegraded":"2024-09-05T02:17:02.128550+0000","last_fullsized":"2024-09-05T02:17:02.128550+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.128361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:30.574482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.214069+0000","last_change":"2024-09-05T01:05:07.105238+0000","last_active":"2024-09-05T02:12:46.214069+0000","last_peered":"2024-09-05T02:12:46.214069+0000","last_clean":"2024-09-05T02:12:46.214069+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:12:46.214069+0000","last_undegraded":"2024-09-05T02:12:46.214069+0000","last_fullsized":"2024-09-05T02:12:46.214069+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:27.303551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.128289+0000","last_change":"2024-09-05T02:17:03.128122+0000","last_active":"2024-09-05T02:17:03.128289+0000","last_peered":"2024-09-05T02:17:03.128289+0000","last_clean":"2024-09-05T02:17:03.128289+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:17:03.128289+0000","last_undegraded":"2024-09-05T02:17:03.128289+0000","last_fullsized":"2024-09-05T02:17:03.128289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.127940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:28:30.698265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.628636+0000","last_change":"2024-09-05T02:17:09.628636+0000","last_active":"2024-09-05T02:17:09.628636+0000","last_peered":"2024-09-05T02:17:09.628636+0000","last_clean":"2024-09-05T02:17:09.628636+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:17:09.628636+0000","last_undegraded":"2024-09-05T02:17:09.628636+0000","last_fullsized":"2024-09-05T02:17:09.628636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.628448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:13.486705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:46.472509+0000","last_change":"2024-09-05T01:05:07.112450+0000","last_active":"2024-09-05T02:12:46.472509+0000","last_peered":"2024-09-05T02:12:46.472509+0000","last_clean":"2024-09-05T02:12:46.472509+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:12:46.472509+0000","last_undegraded":"2024-09-05T02:12:46.472509+0000","last_fullsized":"2024-09-05T02:12:46.472509+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:11.167918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.751960+0000","last_change":"2024-09-05T02:16:56.751960+0000","last_active":"2024-09-05T02:16:56.751960+0000","last_peered":"2024-09-05T02:16:56.751960+0000","last_clean":"2024-09-05T02:16:56.751960+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:16:56.751960+0000","last_undegraded":"2024-09-05T02:16:56.751960+0000","last_fullsized":"2024-09-05T02:16:56.751960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.751614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:10.647303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.499022+0000","last_change":"2024-09-05T01:09:26.339953+0000","last_active":"2024-09-05T02:14:41.499022+0000","last_peered":"2024-09-05T02:14:41.499022+0000","last_clean":"2024-09-05T02:14:41.499022+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:14:41.499022+0000","last_undegraded":"2024-09-05T02:14:41.499022+0000","last_fullsized":"2024-09-05T02:14:41.499022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.641667+0000","last_change":"2024-09-05T01:09:22.191390+0000","last_active":"2024-09-05T02:14:36.641667+0000","last_peered":"2024-09-05T02:14:36.641667+0000","last_clean":"2024-09-05T02:14:36.641667+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:14:36.641667+0000","last_undegraded":"2024-09-05T02:14:36.641667+0000","last_fullsized":"2024-09-05T02:14:36.641667+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:12:51.473718+0000","last_change":"2024-09-05T01:05:07.109685+0000","last_active":"2024-09-05T02:12:51.473718+0000","last_peered":"2024-09-05T02:12:51.473718+0000","last_clean":"2024-09-05T02:12:51.473718+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:12:51.473718+0000","last_undegraded":"2024-09-05T02:12:51.473718+0000","last_fullsized":"2024-09-05T02:12:51.473718+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:53:23.227287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.828997+0000","last_change":"2024-09-05T01:30:15.651832+0000","last_active":"2024-09-05T02:13:01.828997+0000","last_peered":"2024-09-05T02:13:01.828997+0000","last_clean":"2024-09-05T02:13:01.828997+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:13:01.828997+0000","last_undegraded":"2024-09-05T02:13:01.828997+0000","last_fullsized":"2024-09-05T02:13:01.828997+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:44:58.776526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:41.498939+0000","last_change":"2024-09-05T01:09:26.328069+0000","last_active":"2024-09-05T02:14:41.498939+0000","last_peered":"2024-09-05T02:14:41.498939+0000","last_clean":"2024-09-05T02:14:41.498939+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:14:41.498939+0000","last_undegraded":"2024-09-05T02:14:41.498939+0000","last_fullsized":"2024-09-05T02:14:41.498939+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.772516+0000","last_change":"2024-09-05T02:16:53.772516+0000","last_active":"2024-09-05T02:16:53.772516+0000","last_peered":"2024-09-05T02:16:53.772516+0000","last_clean":"2024-09-05T02:16:53.772516+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:16:53.772516+0000","last_undegraded":"2024-09-05T02:16:53.772516+0000","last_fullsized":"2024-09-05T02:16:53.772516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.772339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:26.528640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.555603+0000","last_change":"2024-09-05T02:17:07.555411+0000","last_active":"2024-09-05T02:17:07.555603+0000","last_peered":"2024-09-05T02:17:07.555603+0000","last_clean":"2024-09-05T02:17:07.555603+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:17:07.555603+0000","last_undegraded":"2024-09-05T02:17:07.555603+0000","last_fullsized":"2024-09-05T02:17:07.555603+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.555220+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:28.608854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.191473+0000","last_change":"2024-09-05T02:17:06.191473+0000","last_active":"2024-09-05T02:17:06.191473+0000","last_peered":"2024-09-05T02:17:06.191473+0000","last_clean":"2024-09-05T02:17:06.191473+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:17:06.191473+0000","last_undegraded":"2024-09-05T02:17:06.191473+0000","last_fullsized":"2024-09-05T02:17:06.191473+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.191257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:33:00.620408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.291061+0000","last_change":"2024-09-05T02:17:02.290922+0000","last_active":"2024-09-05T02:17:02.291061+0000","last_peered":"2024-09-05T02:17:02.291061+0000","last_clean":"2024-09-05T02:17:02.291061+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:17:02.291061+0000","last_undegraded":"2024-09-05T02:17:02.291061+0000","last_fullsized":"2024-09-05T02:17:02.291061+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.290717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:26.594431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.741590+0000","last_change":"2024-09-05T01:09:22.190347+0000","last_active":"2024-09-05T02:16:22.741590+0000","last_peered":"2024-09-05T02:16:22.741590+0000","last_clean":"2024-09-05T02:16:22.741590+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:16:22.741590+0000","last_undegraded":"2024-09-05T02:16:22.741590+0000","last_fullsized":"2024-09-05T02:16:22.741590+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":88,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.006759+0000","last_change":"2024-09-05T02:16:58.006578+0000","last_active":"2024-09-05T02:16:58.006759+0000","last_peered":"2024-09-05T02:16:58.006759+0000","last_clean":"2024-09-05T02:16:58.006759+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:16:58.006759+0000","last_undegraded":"2024-09-05T02:16:58.006759+0000","last_fullsized":"2024-09-05T02:16:58.006759+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.006393+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:22.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:36.626860+0000","last_change":"2024-09-05T01:30:15.672016+0000","last_active":"2024-09-05T02:13:36.626860+0000","last_peered":"2024-09-05T02:13:36.626860+0000","last_clean":"2024-09-05T02:13:36.626860+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:13:36.626860+0000","last_undegraded":"2024-09-05T02:13:36.626860+0000","last_fullsized":"2024-09-05T02:13:36.626860+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:04:18.455522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.429930+0000","last_change":"2024-09-05T01:09:26.348550+0000","last_active":"2024-09-05T02:16:22.429930+0000","last_peered":"2024-09-05T02:16:22.429930+0000","last_clean":"2024-09-05T02:16:22.429930+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:16:22.429930+0000","last_undegraded":"2024-09-05T02:16:22.429930+0000","last_fullsized":"2024-09-05T02:16:22.429930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.295444+0000","last_change":"2024-09-05T02:17:01.295286+0000","last_active":"2024-09-05T02:17:01.295444+0000","last_peered":"2024-09-05T02:17:01.295444+0000","last_clean":"2024-09-05T02:17:01.295444+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:17:01.295444+0000","last_undegraded":"2024-09-05T02:17:01.295444+0000","last_fullsized":"2024-09-05T02:17:01.295444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.295090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.543229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.760320+0000","last_change":"2024-09-05T02:16:48.760175+0000","last_active":"2024-09-05T02:16:48.760320+0000","last_peered":"2024-09-05T02:16:48.760320+0000","last_clean":"2024-09-05T02:16:48.760320+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:16:48.760320+0000","last_undegraded":"2024-09-05T02:16:48.760320+0000","last_fullsized":"2024-09-05T02:16:48.760320+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.759982+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:14.996988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.476639+0000","last_change":"2024-09-05T01:30:15.665424+0000","last_active":"2024-09-05T02:13:01.476639+0000","last_peered":"2024-09-05T02:13:01.476639+0000","last_clean":"2024-09-05T02:13:01.476639+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:13:01.476639+0000","last_undegraded":"2024-09-05T02:13:01.476639+0000","last_fullsized":"2024-09-05T02:13:01.476639+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:58.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.793917+0000","last_change":"2024-09-05T01:10:05.431245+0000","last_active":"2024-09-05T02:16:22.793917+0000","last_peered":"2024-09-05T02:16:22.793917+0000","last_clean":"2024-09-05T02:16:22.793917+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:16:22.793917+0000","last_undegraded":"2024-09-05T02:16:22.793917+0000","last_fullsized":"2024-09-05T02:16:22.793917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:25.473153+0000","last_change":"2024-09-05T01:09:22.190678+0000","last_active":"2024-09-05T02:14:25.473153+0000","last_peered":"2024-09-05T02:14:25.473153+0000","last_clean":"2024-09-05T02:14:25.473153+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:14:25.473153+0000","last_undegraded":"2024-09-05T02:14:25.473153+0000","last_fullsized":"2024-09-05T02:14:25.473153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.294839+0000","last_change":"2024-09-05T02:17:06.294692+0000","last_active":"2024-09-05T02:17:06.294839+0000","last_peered":"2024-09-05T02:17:06.294839+0000","last_clean":"2024-09-05T02:17:06.294839+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:17:06.294839+0000","last_undegraded":"2024-09-05T02:17:06.294839+0000","last_fullsized":"2024-09-05T02:17:06.294839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.294519+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:04.814706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:06.830307+0000","last_change":"2024-09-05T01:30:15.673422+0000","last_active":"2024-09-05T02:13:06.830307+0000","last_peered":"2024-09-05T02:13:06.830307+0000","last_clean":"2024-09-05T02:13:06.830307+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:13:06.830307+0000","last_undegraded":"2024-09-05T02:13:06.830307+0000","last_fullsized":"2024-09-05T02:13:06.830307+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:54:22.468568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.794616+0000","last_change":"2024-09-05T01:09:26.297078+0000","last_active":"2024-09-05T02:16:22.794616+0000","last_peered":"2024-09-05T02:16:22.794616+0000","last_clean":"2024-09-05T02:16:22.794616+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:16:22.794616+0000","last_undegraded":"2024-09-05T02:16:22.794616+0000","last_fullsized":"2024-09-05T02:16:22.794616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.272686+0000","last_change":"2024-09-05T02:17:00.272686+0000","last_active":"2024-09-05T02:17:00.272686+0000","last_peered":"2024-09-05T02:17:00.272686+0000","last_clean":"2024-09-05T02:17:00.272686+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:17:00.272686+0000","last_undegraded":"2024-09-05T02:17:00.272686+0000","last_fullsized":"2024-09-05T02:17:00.272686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.272504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:00:35.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.862626+0000","last_change":"2024-09-05T02:17:05.862626+0000","last_active":"2024-09-05T02:17:05.862626+0000","last_peered":"2024-09-05T02:17:05.862626+0000","last_clean":"2024-09-05T02:17:05.862626+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:17:05.862626+0000","last_undegraded":"2024-09-05T02:17:05.862626+0000","last_fullsized":"2024-09-05T02:17:05.862626+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.862443+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:45:23.459892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:01.829057+0000","last_change":"2024-09-05T01:30:15.673518+0000","last_active":"2024-09-05T02:13:01.829057+0000","last_peered":"2024-09-05T02:13:01.829057+0000","last_clean":"2024-09-05T02:13:01.829057+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:13:01.829057+0000","last_undegraded":"2024-09-05T02:13:01.829057+0000","last_fullsized":"2024-09-05T02:13:01.829057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:32.978618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.300389+0000","last_change":"2024-09-05T02:17:05.300389+0000","last_active":"2024-09-05T02:17:05.300389+0000","last_peered":"2024-09-05T02:17:05.300389+0000","last_clean":"2024-09-05T02:17:05.300389+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:17:05.300389+0000","last_undegraded":"2024-09-05T02:17:05.300389+0000","last_fullsized":"2024-09-05T02:17:05.300389+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.300194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:03.393835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'9","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.804561+0000","last_change":"2024-09-05T01:09:22.181826+0000","last_active":"2024-09-05T02:16:21.804561+0000","last_peered":"2024-09-05T02:16:21.804561+0000","last_clean":"2024-09-05T02:16:21.804561+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:16:21.804561+0000","last_undegraded":"2024-09-05T02:16:21.804561+0000","last_fullsized":"2024-09-05T02:16:21.804561+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495035+0000","last_change":"2024-09-05T01:05:07.107971+0000","last_active":"2024-09-05T02:14:26.495035+0000","last_peered":"2024-09-05T02:14:26.495035+0000","last_clean":"2024-09-05T02:14:26.495035+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:14:26.495035+0000","last_undegraded":"2024-09-05T02:14:26.495035+0000","last_fullsized":"2024-09-05T02:14:26.495035+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:05:06.059919+0000","last_clean_scrub_stamp":"2024-09-05T01:05:06.059919+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:00.453329+0000","last_change":"2024-09-05T01:30:15.646539+0000","last_active":"2024-09-05T02:13:00.453329+0000","last_peered":"2024-09-05T02:13:00.453329+0000","last_clean":"2024-09-05T02:13:00.453329+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:13:00.453329+0000","last_undegraded":"2024-09-05T02:13:00.453329+0000","last_fullsized":"2024-09-05T02:13:00.453329+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:59.751294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:22.794844+0000","last_change":"2024-09-05T01:09:26.323451+0000","last_active":"2024-09-05T02:16:22.794844+0000","last_peered":"2024-09-05T02:16:22.794844+0000","last_clean":"2024-09-05T02:16:22.794844+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:16:22.794844+0000","last_undegraded":"2024-09-05T02:16:22.794844+0000","last_fullsized":"2024-09-05T02:16:22.794844+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:36.239165+0000","last_change":"2024-09-05T01:09:22.179884+0000","last_active":"2024-09-05T02:14:36.239165+0000","last_peered":"2024-09-05T02:14:36.239165+0000","last_clean":"2024-09-05T02:14:36.239165+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:14:36.239165+0000","last_undegraded":"2024-09-05T02:14:36.239165+0000","last_fullsized":"2024-09-05T02:14:36.239165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.974334+0000","last_change":"2024-09-05T02:16:56.974334+0000","last_active":"2024-09-05T02:16:56.974334+0000","last_peered":"2024-09-05T02:16:56.974334+0000","last_clean":"2024-09-05T02:16:56.974334+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:16:56.974334+0000","last_undegraded":"2024-09-05T02:16:56.974334+0000","last_fullsized":"2024-09-05T02:16:56.974334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.974112+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:45:03.463271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.632872+0000","last_change":"2024-09-05T01:30:15.672035+0000","last_active":"2024-09-05T02:14:01.632872+0000","last_peered":"2024-09-05T02:14:01.632872+0000","last_clean":"2024-09-05T02:14:01.632872+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:14:01.632872+0000","last_undegraded":"2024-09-05T02:14:01.632872+0000","last_fullsized":"2024-09-05T02:14:01.632872+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:45:22.290381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:20.472251+0000","last_change":"2024-09-05T01:09:26.337405+0000","last_active":"2024-09-05T02:14:20.472251+0000","last_peered":"2024-09-05T02:14:20.472251+0000","last_clean":"2024-09-05T02:14:20.472251+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:14:20.472251+0000","last_undegraded":"2024-09-05T02:14:20.472251+0000","last_fullsized":"2024-09-05T02:14:20.472251+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:55.972617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631777+0000","last_change":"2024-09-05T01:09:22.166931+0000","last_active":"2024-09-05T02:13:56.631777+0000","last_peered":"2024-09-05T02:13:56.631777+0000","last_clean":"2024-09-05T02:13:56.631777+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:13:56.631777+0000","last_undegraded":"2024-09-05T02:13:56.631777+0000","last_fullsized":"2024-09-05T02:13:56.631777+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:16:21.268715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.244575+0000","last_change":"2024-09-05T02:17:05.244575+0000","last_active":"2024-09-05T02:17:05.244575+0000","last_peered":"2024-09-05T02:17:05.244575+0000","last_clean":"2024-09-05T02:17:05.244575+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:17:05.244575+0000","last_undegraded":"2024-09-05T02:17:05.244575+0000","last_fullsized":"2024-09-05T02:17:05.244575+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.244395+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:52:14.456469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.228294+0000","last_change":"2024-09-05T01:30:15.666768+0000","last_active":"2024-09-05T02:14:00.228294+0000","last_peered":"2024-09-05T02:14:00.228294+0000","last_clean":"2024-09-05T02:14:00.228294+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:14:00.228294+0000","last_undegraded":"2024-09-05T02:14:00.228294+0000","last_fullsized":"2024-09-05T02:14:00.228294+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:47:53.553805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:05.468848+0000","last_change":"2024-09-05T01:09:26.318145+0000","last_active":"2024-09-05T02:14:05.468848+0000","last_peered":"2024-09-05T02:14:05.468848+0000","last_clean":"2024-09-05T02:14:05.468848+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:14:05.468848+0000","last_undegraded":"2024-09-05T02:14:05.468848+0000","last_fullsized":"2024-09-05T02:14:05.468848+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:38:35.431159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.776089+0000","last_change":"2024-09-05T02:16:52.776089+0000","last_active":"2024-09-05T02:16:52.776089+0000","last_peered":"2024-09-05T02:16:52.776089+0000","last_clean":"2024-09-05T02:16:52.776089+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:16:52.776089+0000","last_undegraded":"2024-09-05T02:16:52.776089+0000","last_fullsized":"2024-09-05T02:16:52.776089+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.775909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:19.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.976839+0000","last_change":"2024-09-05T02:16:55.976839+0000","last_active":"2024-09-05T02:16:55.976839+0000","last_peered":"2024-09-05T02:16:55.976839+0000","last_clean":"2024-09-05T02:16:55.976839+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:16:55.976839+0000","last_undegraded":"2024-09-05T02:16:55.976839+0000","last_fullsized":"2024-09-05T02:16:55.976839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.976604+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:49.837443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.799675+0000","last_change":"2024-09-05T01:30:15.660626+0000","last_active":"2024-09-05T02:14:26.799675+0000","last_peered":"2024-09-05T02:14:26.799675+0000","last_clean":"2024-09-05T02:14:26.799675+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:14:26.799675+0000","last_undegraded":"2024-09-05T02:14:26.799675+0000","last_fullsized":"2024-09-05T02:14:26.799675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.639096+0000","last_change":"2024-09-05T01:09:26.303163+0000","last_active":"2024-09-05T02:14:26.639096+0000","last_peered":"2024-09-05T02:14:26.639096+0000","last_clean":"2024-09-05T02:14:26.639096+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:14:26.639096+0000","last_undegraded":"2024-09-05T02:14:26.639096+0000","last_fullsized":"2024-09-05T02:14:26.639096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.580373+0000","last_change":"2024-09-05T02:17:08.580373+0000","last_active":"2024-09-05T02:17:08.580373+0000","last_peered":"2024-09-05T02:17:08.580373+0000","last_clean":"2024-09-05T02:17:08.580373+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:17:08.580373+0000","last_undegraded":"2024-09-05T02:17:08.580373+0000","last_fullsized":"2024-09-05T02:17:08.580373+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.580196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:28.347538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.830880+0000","last_change":"2024-09-05T02:17:04.830880+0000","last_active":"2024-09-05T02:17:04.830880+0000","last_peered":"2024-09-05T02:17:04.830880+0000","last_clean":"2024-09-05T02:17:04.830880+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:17:04.830880+0000","last_undegraded":"2024-09-05T02:17:04.830880+0000","last_fullsized":"2024-09-05T02:17:04.830880+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.830648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:29.585319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230765+0000","last_change":"2024-09-05T01:30:15.661865+0000","last_active":"2024-09-05T02:14:01.230765+0000","last_peered":"2024-09-05T02:14:01.230765+0000","last_clean":"2024-09-05T02:14:01.230765+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:14:01.230765+0000","last_undegraded":"2024-09-05T02:14:01.230765+0000","last_fullsized":"2024-09-05T02:14:01.230765+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:38:04.818287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.236666+0000","last_change":"2024-09-05T01:09:26.313186+0000","last_active":"2024-09-05T02:14:26.236666+0000","last_peered":"2024-09-05T02:14:26.236666+0000","last_clean":"2024-09-05T02:14:26.236666+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:14:26.236666+0000","last_undegraded":"2024-09-05T02:14:26.236666+0000","last_fullsized":"2024-09-05T02:14:26.236666+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:21.432405+0000","last_change":"2024-09-05T01:09:22.199051+0000","last_active":"2024-09-05T02:16:21.432405+0000","last_peered":"2024-09-05T02:16:21.432405+0000","last_clean":"2024-09-05T02:16:21.432405+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:16:21.432405+0000","last_undegraded":"2024-09-05T02:16:21.432405+0000","last_fullsized":"2024-09-05T02:16:21.432405+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.146987+0000","last_change":"2024-09-05T02:16:55.146987+0000","last_active":"2024-09-05T02:16:55.146987+0000","last_peered":"2024-09-05T02:16:55.146987+0000","last_clean":"2024-09-05T02:16:55.146987+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:16:55.146987+0000","last_undegraded":"2024-09-05T02:16:55.146987+0000","last_fullsized":"2024-09-05T02:16:55.146987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.146799+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:52:09.173061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.765175+0000","last_change":"2024-09-05T02:16:54.765175+0000","last_active":"2024-09-05T02:16:54.765175+0000","last_peered":"2024-09-05T02:16:54.765175+0000","last_clean":"2024-09-05T02:16:54.765175+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:16:54.765175+0000","last_undegraded":"2024-09-05T02:16:54.765175+0000","last_fullsized":"2024-09-05T02:16:54.765175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.764967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:33.575826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.341502+0000","last_change":"2024-09-05T02:17:04.341502+0000","last_active":"2024-09-05T02:17:04.341502+0000","last_peered":"2024-09-05T02:17:04.341502+0000","last_clean":"2024-09-05T02:17:04.341502+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:17:04.341502+0000","last_undegraded":"2024-09-05T02:17:04.341502+0000","last_fullsized":"2024-09-05T02:17:04.341502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.341302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:07.810567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:15:36.656379+0000","last_change":"2024-09-05T01:09:22.169432+0000","last_active":"2024-09-05T02:15:36.656379+0000","last_peered":"2024-09-05T02:15:36.656379+0000","last_clean":"2024-09-05T02:15:36.656379+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:15:36.656379+0000","last_undegraded":"2024-09-05T02:15:36.656379+0000","last_fullsized":"2024-09-05T02:15:36.656379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.250734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.505895+0000","last_change":"2024-09-05T02:17:03.505895+0000","last_active":"2024-09-05T02:17:03.505895+0000","last_peered":"2024-09-05T02:17:03.505895+0000","last_clean":"2024-09-05T02:17:03.505895+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:17:03.505895+0000","last_undegraded":"2024-09-05T02:17:03.505895+0000","last_fullsized":"2024-09-05T02:17:03.505895+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.505610+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:48.894550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:35.461350+0000","last_change":"2024-09-05T01:30:15.663570+0000","last_active":"2024-09-05T02:13:35.461350+0000","last_peered":"2024-09-05T02:13:35.461350+0000","last_clean":"2024-09-05T02:13:35.461350+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:13:35.461350+0000","last_undegraded":"2024-09-05T02:13:35.461350+0000","last_fullsized":"2024-09-05T02:13:35.461350+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:14:33.654866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:50.225693+0000","last_change":"2024-09-05T01:09:26.317005+0000","last_active":"2024-09-05T02:13:50.225693+0000","last_peered":"2024-09-05T02:13:50.225693+0000","last_clean":"2024-09-05T02:13:50.225693+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:13:50.225693+0000","last_undegraded":"2024-09-05T02:13:50.225693+0000","last_fullsized":"2024-09-05T02:13:50.225693+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:13:18.956869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.631672+0000","last_change":"2024-09-05T01:09:22.199231+0000","last_active":"2024-09-05T02:13:56.631672+0000","last_peered":"2024-09-05T02:13:56.631672+0000","last_clean":"2024-09-05T02:13:56.631672+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:13:56.631672+0000","last_undegraded":"2024-09-05T02:13:56.631672+0000","last_fullsized":"2024-09-05T02:13:56.631672+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:21.142155+0000","last_clean_scrub_stamp":"2024-09-05T01:09:21.142155+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:49:11.294630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.515155+0000","last_change":"2024-09-05T02:17:04.515155+0000","last_active":"2024-09-05T02:17:04.515155+0000","last_peered":"2024-09-05T02:17:04.515155+0000","last_clean":"2024-09-05T02:17:04.515155+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:17:04.515155+0000","last_undegraded":"2024-09-05T02:17:04.515155+0000","last_fullsized":"2024-09-05T02:17:04.515155+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.514980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:00.467675+0000","last_change":"2024-09-05T01:30:15.653545+0000","last_active":"2024-09-05T02:14:00.467675+0000","last_peered":"2024-09-05T02:14:00.467675+0000","last_clean":"2024-09-05T02:14:00.467675+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:14:00.467675+0000","last_undegraded":"2024-09-05T02:14:00.467675+0000","last_fullsized":"2024-09-05T02:14:00.467675+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:17:12.506523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.090864+0000","last_change":"2024-09-05T02:17:01.090864+0000","last_active":"2024-09-05T02:17:01.090864+0000","last_peered":"2024-09-05T02:17:01.090864+0000","last_clean":"2024-09-05T02:17:01.090864+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:17:01.090864+0000","last_undegraded":"2024-09-05T02:17:01.090864+0000","last_fullsized":"2024-09-05T02:17:01.090864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.090683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:16.047191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.155440+0000","last_change":"2024-09-05T02:16:54.155440+0000","last_active":"2024-09-05T02:16:54.155440+0000","last_peered":"2024-09-05T02:16:54.155440+0000","last_clean":"2024-09-05T02:16:54.155440+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:16:54.155440+0000","last_undegraded":"2024-09-05T02:16:54.155440+0000","last_fullsized":"2024-09-05T02:16:54.155440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.155147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:02.845734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.980140+0000","last_change":"2024-09-05T02:16:54.980140+0000","last_active":"2024-09-05T02:16:54.980140+0000","last_peered":"2024-09-05T02:16:54.980140+0000","last_clean":"2024-09-05T02:16:54.980140+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:16:54.980140+0000","last_undegraded":"2024-09-05T02:16:54.980140+0000","last_fullsized":"2024-09-05T02:16:54.980140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.979911+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:13.094203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:11.635298+0000","last_change":"2024-09-05T01:30:15.672731+0000","last_active":"2024-09-05T02:14:11.635298+0000","last_peered":"2024-09-05T02:14:11.635298+0000","last_clean":"2024-09-05T02:14:11.635298+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:14:11.635298+0000","last_undegraded":"2024-09-05T02:14:11.635298+0000","last_fullsized":"2024-09-05T02:14:11.635298+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:06:19.944182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:01.230876+0000","last_change":"2024-09-05T01:09:26.318167+0000","last_active":"2024-09-05T02:14:01.230876+0000","last_peered":"2024-09-05T02:14:01.230876+0000","last_clean":"2024-09-05T02:14:01.230876+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:14:01.230876+0000","last_undegraded":"2024-09-05T02:14:01.230876+0000","last_fullsized":"2024-09-05T02:14:01.230876+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:09:25.254935+0000","last_clean_scrub_stamp":"2024-09-05T01:09:25.254935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:39.204013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.088692+0000","last_change":"2024-09-05T02:17:00.088692+0000","last_active":"2024-09-05T02:17:00.088692+0000","last_peered":"2024-09-05T02:17:00.088692+0000","last_clean":"2024-09-05T02:17:00.088692+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:17:00.088692+0000","last_undegraded":"2024-09-05T02:17:00.088692+0000","last_fullsized":"2024-09-05T02:17:00.088692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.088515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:15.940853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.811009+0000","last_change":"2024-09-05T02:17:03.811009+0000","last_active":"2024-09-05T02:17:03.811009+0000","last_peered":"2024-09-05T02:17:03.811009+0000","last_clean":"2024-09-05T02:17:03.811009+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:17:03.811009+0000","last_undegraded":"2024-09-05T02:17:03.811009+0000","last_fullsized":"2024-09-05T02:17:03.811009+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.810788+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:32:45.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'377","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.819483+0000","last_change":"2024-09-05T02:16:32.819483+0000","last_active":"2024-09-05T02:16:32.819483+0000","last_peered":"2024-09-05T02:16:32.819483+0000","last_clean":"2024-09-05T02:16:32.819483+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:32.819483+0000","last_undegraded":"2024-09-05T02:16:32.819483+0000","last_fullsized":"2024-09-05T02:16:32.819483+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.819228+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:06.348956+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":47646,"num_write":1216,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.516932+0000","last_change":"2024-09-05T02:16:46.516781+0000","last_active":"2024-09-05T02:16:46.516932+0000","last_peered":"2024-09-05T02:16:46.516932+0000","last_clean":"2024-09-05T02:16:46.516932+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:16:46.516932+0000","last_undegraded":"2024-09-05T02:16:46.516932+0000","last_fullsized":"2024-09-05T02:16:46.516932+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.516577+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:11.618374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'384","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.308155+0000","last_change":"2024-09-05T02:16:34.307989+0000","last_active":"2024-09-05T02:16:34.308155+0000","last_peered":"2024-09-05T02:16:34.308155+0000","last_clean":"2024-09-05T02:16:34.308155+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:34.308155+0000","last_undegraded":"2024-09-05T02:16:34.308155+0000","last_fullsized":"2024-09-05T02:16:34.308155+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.307761+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:07.165023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":565,"num_read_kb":74894,"num_write":1179,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'450","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.926481+0000","last_change":"2024-09-05T02:16:45.926317+0000","last_active":"2024-09-05T02:16:45.926481+0000","last_peered":"2024-09-05T02:16:45.926481+0000","last_clean":"2024-09-05T02:16:45.926481+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:16:45.926481+0000","last_undegraded":"2024-09-05T02:16:45.926481+0000","last_fullsized":"2024-09-05T02:16:45.926481+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.926073+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:34.170133+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'393","reported_seq":1060,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.517995+0000","last_change":"2024-09-05T02:16:32.517827+0000","last_active":"2024-09-05T02:16:32.517995+0000","last_peered":"2024-09-05T02:16:32.517995+0000","last_clean":"2024-09-05T02:16:32.517995+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:16:32.517995+0000","last_undegraded":"2024-09-05T02:16:32.517995+0000","last_fullsized":"2024-09-05T02:16:32.517995+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.517629+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:14.484505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":743,"num_write":1140,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'857","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.487707+0000","last_change":"2024-09-05T02:16:46.487548+0000","last_active":"2024-09-05T02:16:46.487707+0000","last_peered":"2024-09-05T02:16:46.487707+0000","last_clean":"2024-09-05T02:16:46.487707+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:16:46.487707+0000","last_undegraded":"2024-09-05T02:16:46.487707+0000","last_fullsized":"2024-09-05T02:16:46.487707+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'857","last_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_deep_scrub":"264'857","last_deep_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.487350+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:48:26.885564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":457,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'380","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.511848+0000","last_change":"2024-09-05T02:16:41.511848+0000","last_active":"2024-09-05T02:16:41.511848+0000","last_peered":"2024-09-05T02:16:41.511848+0000","last_clean":"2024-09-05T02:16:41.511848+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:16:41.511848+0000","last_undegraded":"2024-09-05T02:16:41.511848+0000","last_fullsized":"2024-09-05T02:16:41.511848+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.511651+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:25.215125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":68502,"num_write":1310,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.257591+0000","last_change":"2024-09-05T02:16:51.257332+0000","last_active":"2024-09-05T02:16:51.257591+0000","last_peered":"2024-09-05T02:16:51.257591+0000","last_clean":"2024-09-05T02:16:51.257591+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:16:51.257591+0000","last_undegraded":"2024-09-05T02:16:51.257591+0000","last_fullsized":"2024-09-05T02:16:51.257591+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1273","last_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_deep_scrub":"264'1273","last_deep_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.257106+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:16.442936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'363","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.081565+0000","last_change":"2024-09-05T02:16:42.081318+0000","last_active":"2024-09-05T02:16:42.081565+0000","last_peered":"2024-09-05T02:16:42.081565+0000","last_clean":"2024-09-05T02:16:42.081565+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:42.081565+0000","last_undegraded":"2024-09-05T02:16:42.081565+0000","last_fullsized":"2024-09-05T02:16:42.081565+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.081062+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:53:18.173817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":9059,"num_write":1154,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'447","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.875774+0000","last_change":"2024-09-05T02:16:42.875774+0000","last_active":"2024-09-05T02:16:42.875774+0000","last_peered":"2024-09-05T02:16:42.875774+0000","last_clean":"2024-09-05T02:16:42.875774+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:16:42.875774+0000","last_undegraded":"2024-09-05T02:16:42.875774+0000","last_fullsized":"2024-09-05T02:16:42.875774+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'447","last_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_deep_scrub":"264'447","last_deep_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.875583+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:30.938475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'324","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.541002+0000","last_change":"2024-09-05T02:16:39.540870+0000","last_active":"2024-09-05T02:16:39.541002+0000","last_peered":"2024-09-05T02:16:39.541002+0000","last_clean":"2024-09-05T02:16:39.541002+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:16:39.541002+0000","last_undegraded":"2024-09-05T02:16:39.541002+0000","last_fullsized":"2024-09-05T02:16:39.541002+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.540684+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:25.366090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":472,"num_write":1089,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'505","reported_seq":2152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.476440+0000","last_change":"2024-09-05T02:16:49.476308+0000","last_active":"2024-09-05T02:16:49.476440+0000","last_peered":"2024-09-05T02:16:49.476440+0000","last_clean":"2024-09-05T02:16:49.476440+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:16:49.476440+0000","last_undegraded":"2024-09-05T02:16:49.476440+0000","last_fullsized":"2024-09-05T02:16:49.476440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.476121+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:30:55.880313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'353","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.087473+0000","last_change":"2024-09-05T02:16:41.087320+0000","last_active":"2024-09-05T02:16:41.087473+0000","last_peered":"2024-09-05T02:16:41.087473+0000","last_clean":"2024-09-05T02:16:41.087473+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:41.087473+0000","last_undegraded":"2024-09-05T02:16:41.087473+0000","last_fullsized":"2024-09-05T02:16:41.087473+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.087096+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:59:56.430971+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495269,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":507,"num_read_kb":57163,"num_write":1112,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'474","reported_seq":2175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.586174+0000","last_change":"2024-09-05T02:16:48.586021+0000","last_active":"2024-09-05T02:16:48.586174+0000","last_peered":"2024-09-05T02:16:48.586174+0000","last_clean":"2024-09-05T02:16:48.586174+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:16:48.586174+0000","last_undegraded":"2024-09-05T02:16:48.586174+0000","last_fullsized":"2024-09-05T02:16:48.586174+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.585842+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:05:53.161158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'355","reported_seq":1193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.003064+0000","last_change":"2024-09-05T02:16:39.002926+0000","last_active":"2024-09-05T02:16:39.003064+0000","last_peered":"2024-09-05T02:16:39.003064+0000","last_clean":"2024-09-05T02:16:39.003064+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:39.003064+0000","last_undegraded":"2024-09-05T02:16:39.003064+0000","last_fullsized":"2024-09-05T02:16:39.003064+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.002732+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:17.177395+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":814,"num_read_kb":7164,"num_write":1128,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'453","reported_seq":2037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.824734+0000","last_change":"2024-09-05T02:16:38.824593+0000","last_active":"2024-09-05T02:16:38.824734+0000","last_peered":"2024-09-05T02:16:38.824734+0000","last_clean":"2024-09-05T02:16:38.824734+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:16:38.824734+0000","last_undegraded":"2024-09-05T02:16:38.824734+0000","last_fullsized":"2024-09-05T02:16:38.824734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.824400+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:46.210785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'747","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.472094+0000","last_change":"2024-09-05T02:16:45.472094+0000","last_active":"2024-09-05T02:16:45.472094+0000","last_peered":"2024-09-05T02:16:45.472094+0000","last_clean":"2024-09-05T02:16:45.472094+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:16:45.472094+0000","last_undegraded":"2024-09-05T02:16:45.472094+0000","last_fullsized":"2024-09-05T02:16:45.472094+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.471918+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:16.977832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'356","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.061665+0000","last_change":"2024-09-05T02:16:40.061510+0000","last_active":"2024-09-05T02:16:40.061665+0000","last_peered":"2024-09-05T02:16:40.061665+0000","last_clean":"2024-09-05T02:16:40.061665+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:40.061665+0000","last_undegraded":"2024-09-05T02:16:40.061665+0000","last_fullsized":"2024-09-05T02:16:40.061665+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.061289+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:56:17.879080+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1733359,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":485,"num_read_kb":16771,"num_write":1085,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'435","reported_seq":1966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.012421+0000","last_change":"2024-09-05T02:16:44.012421+0000","last_active":"2024-09-05T02:16:44.012421+0000","last_peered":"2024-09-05T02:16:44.012421+0000","last_clean":"2024-09-05T02:16:44.012421+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:16:44.012421+0000","last_undegraded":"2024-09-05T02:16:44.012421+0000","last_fullsized":"2024-09-05T02:16:44.012421+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.012213+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:25.759917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'350","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.815192+0000","last_change":"2024-09-05T02:16:36.815192+0000","last_active":"2024-09-05T02:16:36.815192+0000","last_peered":"2024-09-05T02:16:36.815192+0000","last_clean":"2024-09-05T02:16:36.815192+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:36.815192+0000","last_undegraded":"2024-09-05T02:16:36.815192+0000","last_fullsized":"2024-09-05T02:16:36.815192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.814965+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:24.655143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":5849,"num_write":1054,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'463","reported_seq":2003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.501298+0000","last_change":"2024-09-05T02:16:44.501298+0000","last_active":"2024-09-05T02:16:44.501298+0000","last_peered":"2024-09-05T02:16:44.501298+0000","last_clean":"2024-09-05T02:16:44.501298+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:16:44.501298+0000","last_undegraded":"2024-09-05T02:16:44.501298+0000","last_fullsized":"2024-09-05T02:16:44.501298+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.501076+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:51.917233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'361","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.812670+0000","last_change":"2024-09-05T02:16:35.812670+0000","last_active":"2024-09-05T02:16:35.812670+0000","last_peered":"2024-09-05T02:16:35.812670+0000","last_clean":"2024-09-05T02:16:35.812670+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:35.812670+0000","last_undegraded":"2024-09-05T02:16:35.812670+0000","last_fullsized":"2024-09-05T02:16:35.812670+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.812463+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:35.464351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":7060,"num_write":1221,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'493","reported_seq":2161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.766824+0000","last_change":"2024-09-05T02:16:36.766824+0000","last_active":"2024-09-05T02:16:36.766824+0000","last_peered":"2024-09-05T02:16:36.766824+0000","last_clean":"2024-09-05T02:16:36.766824+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:16:36.766824+0000","last_undegraded":"2024-09-05T02:16:36.766824+0000","last_fullsized":"2024-09-05T02:16:36.766824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'493","last_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_deep_scrub":"264'493","last_deep_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.766629+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:02:04.726199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'358","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.529586+0000","last_change":"2024-09-05T02:16:32.529586+0000","last_active":"2024-09-05T02:16:32.529586+0000","last_peered":"2024-09-05T02:16:32.529586+0000","last_clean":"2024-09-05T02:16:32.529586+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:32.529586+0000","last_undegraded":"2024-09-05T02:16:32.529586+0000","last_fullsized":"2024-09-05T02:16:32.529586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.529382+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:38.596982+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":17342,"num_write":1226,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'408","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.779690+0000","last_change":"2024-09-05T02:16:37.779690+0000","last_active":"2024-09-05T02:16:37.779690+0000","last_peered":"2024-09-05T02:16:37.779690+0000","last_clean":"2024-09-05T02:16:37.779690+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:16:37.779690+0000","last_undegraded":"2024-09-05T02:16:37.779690+0000","last_fullsized":"2024-09-05T02:16:37.779690+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.779509+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:37.394227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'353","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.985816+0000","last_change":"2024-09-05T02:16:34.985816+0000","last_active":"2024-09-05T02:16:34.985816+0000","last_peered":"2024-09-05T02:16:34.985816+0000","last_clean":"2024-09-05T02:16:34.985816+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:34.985816+0000","last_undegraded":"2024-09-05T02:16:34.985816+0000","last_fullsized":"2024-09-05T02:16:34.985816+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.985621+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:35.048288+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":1528,"num_write":1229,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'751","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.482525+0000","last_change":"2024-09-05T02:16:47.482525+0000","last_active":"2024-09-05T02:16:47.482525+0000","last_peered":"2024-09-05T02:16:47.482525+0000","last_clean":"2024-09-05T02:16:47.482525+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:16:47.482525+0000","last_undegraded":"2024-09-05T02:16:47.482525+0000","last_fullsized":"2024-09-05T02:16:47.482525+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'751","last_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_deep_scrub":"264'751","last_deep_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.482313+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:15.492660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'340","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.555210+0000","last_change":"2024-09-05T02:16:31.555210+0000","last_active":"2024-09-05T02:16:31.555210+0000","last_peered":"2024-09-05T02:16:31.555210+0000","last_clean":"2024-09-05T02:16:31.555210+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:16:31.555210+0000","last_undegraded":"2024-09-05T02:16:31.555210+0000","last_fullsized":"2024-09-05T02:16:31.555210+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.555009+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:13.682055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":32081,"num_write":1077,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'129","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.545088+0000","last_change":"2024-09-05T02:17:03.545088+0000","last_active":"2024-09-05T02:17:03.545088+0000","last_peered":"2024-09-05T02:17:03.545088+0000","last_clean":"2024-09-05T02:17:03.545088+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:17:03.545088+0000","last_undegraded":"2024-09-05T02:17:03.545088+0000","last_fullsized":"2024-09-05T02:17:03.545088+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.544858+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:33.897822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.810201+0000","last_change":"2024-09-05T02:16:33.810064+0000","last_active":"2024-09-05T02:16:33.810201+0000","last_peered":"2024-09-05T02:16:33.810201+0000","last_clean":"2024-09-05T02:16:33.810201+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:16:33.810201+0000","last_undegraded":"2024-09-05T02:16:33.810201+0000","last_fullsized":"2024-09-05T02:16:33.810201+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.809886+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:56.483637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'351","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.079623+0000","last_change":"2024-09-05T02:16:37.079623+0000","last_active":"2024-09-05T02:16:37.079623+0000","last_peered":"2024-09-05T02:16:37.079623+0000","last_clean":"2024-09-05T02:16:37.079623+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:37.079623+0000","last_undegraded":"2024-09-05T02:16:37.079623+0000","last_fullsized":"2024-09-05T02:16:37.079623+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.079302+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:25:10.945666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":5561,"num_write":1118,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.589865+0000","last_change":"2024-09-05T02:16:51.589865+0000","last_active":"2024-09-05T02:16:51.589865+0000","last_peered":"2024-09-05T02:16:51.589865+0000","last_clean":"2024-09-05T02:16:51.589865+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:16:51.589865+0000","last_undegraded":"2024-09-05T02:16:51.589865+0000","last_fullsized":"2024-09-05T02:16:51.589865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.589683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:12.569819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'373","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.248678+0000","last_change":"2024-09-05T02:16:55.248678+0000","last_active":"2024-09-05T02:16:55.248678+0000","last_peered":"2024-09-05T02:16:55.248678+0000","last_clean":"2024-09-05T02:16:55.248678+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:16:55.248678+0000","last_undegraded":"2024-09-05T02:16:55.248678+0000","last_fullsized":"2024-09-05T02:16:55.248678+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.248481+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:24:12.292604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":585,"num_read_kb":1187,"num_write":454,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.803463+0000","last_change":"2024-09-05T02:16:57.803463+0000","last_active":"2024-09-05T02:16:57.803463+0000","last_peered":"2024-09-05T02:16:57.803463+0000","last_clean":"2024-09-05T02:16:57.803463+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:16:57.803463+0000","last_undegraded":"2024-09-05T02:16:57.803463+0000","last_fullsized":"2024-09-05T02:16:57.803463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.803282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:25.367667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2472","reported_seq":4389,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.524861+0000","last_change":"2024-09-05T02:17:04.524711+0000","last_active":"2024-09-05T02:17:04.524861+0000","last_peered":"2024-09-05T02:17:04.524861+0000","last_clean":"2024-09-05T02:17:04.524861+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:17:04.524861+0000","last_undegraded":"2024-09-05T02:17:04.524861+0000","last_fullsized":"2024-09-05T02:17:04.524861+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2472","last_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_deep_scrub":"264'2472","last_deep_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.524509+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:48.550803+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.488036+0000","last_change":"2024-09-05T02:16:43.488036+0000","last_active":"2024-09-05T02:16:43.488036+0000","last_peered":"2024-09-05T02:16:43.488036+0000","last_clean":"2024-09-05T02:16:43.488036+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:16:43.488036+0000","last_undegraded":"2024-09-05T02:16:43.488036+0000","last_fullsized":"2024-09-05T02:16:43.488036+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'752","last_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_deep_scrub":"264'752","last_deep_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.487849+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:28.339919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'326","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.495350+0000","last_change":"2024-09-05T02:16:29.495350+0000","last_active":"2024-09-05T02:16:29.495350+0000","last_peered":"2024-09-05T02:16:29.495350+0000","last_clean":"2024-09-05T02:16:29.495350+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:16:29.495350+0000","last_undegraded":"2024-09-05T02:16:29.495350+0000","last_fullsized":"2024-09-05T02:16:29.495350+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.495167+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:19:45.662775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":61922,"num_write":915,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.147689+0000","last_change":"2024-09-05T02:16:48.147689+0000","last_active":"2024-09-05T02:16:48.147689+0000","last_peered":"2024-09-05T02:16:48.147689+0000","last_clean":"2024-09-05T02:16:48.147689+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:16:48.147689+0000","last_undegraded":"2024-09-05T02:16:48.147689+0000","last_fullsized":"2024-09-05T02:16:48.147689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.147489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:34.064672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'110","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.527062+0000","last_change":"2024-09-05T02:16:56.527062+0000","last_active":"2024-09-05T02:16:56.527062+0000","last_peered":"2024-09-05T02:16:56.527062+0000","last_clean":"2024-09-05T02:16:56.527062+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:16:56.527062+0000","last_undegraded":"2024-09-05T02:16:56.527062+0000","last_fullsized":"2024-09-05T02:16:56.527062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.526730+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:52.832215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.481410+0000","last_change":"2024-09-05T02:16:59.481410+0000","last_active":"2024-09-05T02:16:59.481410+0000","last_peered":"2024-09-05T02:16:59.481410+0000","last_clean":"2024-09-05T02:16:59.481410+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:16:59.481410+0000","last_undegraded":"2024-09-05T02:16:59.481410+0000","last_fullsized":"2024-09-05T02:16:59.481410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.481224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:23.052575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'110","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.211744+0000","last_change":"2024-09-05T02:16:59.211606+0000","last_active":"2024-09-05T02:16:59.211744+0000","last_peered":"2024-09-05T02:16:59.211744+0000","last_clean":"2024-09-05T02:16:59.211744+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:16:59.211744+0000","last_undegraded":"2024-09-05T02:16:59.211744+0000","last_fullsized":"2024-09-05T02:16:59.211744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.211408+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:46.901389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1224","reported_seq":2918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.299022+0000","last_change":"2024-09-05T02:16:42.299022+0000","last_active":"2024-09-05T02:16:42.299022+0000","last_peered":"2024-09-05T02:16:42.299022+0000","last_clean":"2024-09-05T02:16:42.299022+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:16:42.299022+0000","last_undegraded":"2024-09-05T02:16:42.299022+0000","last_fullsized":"2024-09-05T02:16:42.299022+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1224","last_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_deep_scrub":"264'1224","last_deep_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.298827+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:49.318161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.081594+0000","last_change":"2024-09-05T02:16:35.081594+0000","last_active":"2024-09-05T02:16:35.081594+0000","last_peered":"2024-09-05T02:16:35.081594+0000","last_clean":"2024-09-05T02:16:35.081594+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:35.081594+0000","last_undegraded":"2024-09-05T02:16:35.081594+0000","last_fullsized":"2024-09-05T02:16:35.081594+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.081383+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:56:51.256314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":6929,"num_write":1016,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.111742+0000","last_change":"2024-09-05T02:16:50.111742+0000","last_active":"2024-09-05T02:16:50.111742+0000","last_peered":"2024-09-05T02:16:50.111742+0000","last_clean":"2024-09-05T02:16:50.111742+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:16:50.111742+0000","last_undegraded":"2024-09-05T02:16:50.111742+0000","last_fullsized":"2024-09-05T02:16:50.111742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.111667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:39.242968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'188","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.799623+0000","last_change":"2024-09-05T02:16:45.799623+0000","last_active":"2024-09-05T02:16:45.799623+0000","last_peered":"2024-09-05T02:16:45.799623+0000","last_clean":"2024-09-05T02:16:45.799623+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:16:45.799623+0000","last_undegraded":"2024-09-05T02:16:45.799623+0000","last_fullsized":"2024-09-05T02:16:45.799623+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.799431+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:29.922191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'788","reported_seq":4961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.789188+0000","last_change":"2024-09-05T02:16:59.789188+0000","last_active":"2024-09-05T02:16:59.789188+0000","last_peered":"2024-09-05T02:16:59.789188+0000","last_clean":"2024-09-05T02:16:59.789188+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:59.789188+0000","last_undegraded":"2024-09-05T02:16:59.789188+0000","last_fullsized":"2024-09-05T02:16:59.789188+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.789001+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:42.866750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'236","reported_seq":1086,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.568317+0000","last_change":"2024-09-05T02:17:05.568317+0000","last_active":"2024-09-05T02:17:05.568317+0000","last_peered":"2024-09-05T02:17:05.568317+0000","last_clean":"2024-09-05T02:17:05.568317+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:17:05.568317+0000","last_undegraded":"2024-09-05T02:17:05.568317+0000","last_fullsized":"2024-09-05T02:17:05.568317+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.568123+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:46:23.769683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'685","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.979024+0000","last_change":"2024-09-05T02:16:37.979024+0000","last_active":"2024-09-05T02:16:37.979024+0000","last_peered":"2024-09-05T02:16:37.979024+0000","last_clean":"2024-09-05T02:16:37.979024+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:16:37.979024+0000","last_undegraded":"2024-09-05T02:16:37.979024+0000","last_fullsized":"2024-09-05T02:16:37.979024+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.978839+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:33.371371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'362","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.834992+0000","last_change":"2024-09-05T02:16:31.834992+0000","last_active":"2024-09-05T02:16:31.834992+0000","last_peered":"2024-09-05T02:16:31.834992+0000","last_clean":"2024-09-05T02:16:31.834992+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:31.834992+0000","last_undegraded":"2024-09-05T02:16:31.834992+0000","last_fullsized":"2024-09-05T02:16:31.834992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.834772+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:22.380162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":55829,"num_write":1110,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.629506+0000","last_change":"2024-09-05T02:16:52.629506+0000","last_active":"2024-09-05T02:16:52.629506+0000","last_peered":"2024-09-05T02:16:52.629506+0000","last_clean":"2024-09-05T02:16:52.629506+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:16:52.629506+0000","last_undegraded":"2024-09-05T02:16:52.629506+0000","last_fullsized":"2024-09-05T02:16:52.629506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.629320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:02:54.194725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'331","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.873220+0000","last_change":"2024-09-05T02:16:54.873220+0000","last_active":"2024-09-05T02:16:54.873220+0000","last_peered":"2024-09-05T02:16:54.873220+0000","last_clean":"2024-09-05T02:16:54.873220+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:54.873220+0000","last_undegraded":"2024-09-05T02:16:54.873220+0000","last_fullsized":"2024-09-05T02:16:54.873220+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'331","last_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_deep_scrub":"264'331","last_deep_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.873017+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:39:46.622589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":4548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.272266+0000","last_change":"2024-09-05T02:17:02.272266+0000","last_active":"2024-09-05T02:17:02.272266+0000","last_peered":"2024-09-05T02:17:02.272266+0000","last_clean":"2024-09-05T02:17:02.272266+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:17:02.272266+0000","last_undegraded":"2024-09-05T02:17:02.272266+0000","last_fullsized":"2024-09-05T02:17:02.272266+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.272095+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:47.154810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'747","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.480047+0000","last_change":"2024-09-05T02:16:42.480047+0000","last_active":"2024-09-05T02:16:42.480047+0000","last_peered":"2024-09-05T02:16:42.480047+0000","last_clean":"2024-09-05T02:16:42.480047+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:16:42.480047+0000","last_undegraded":"2024-09-05T02:16:42.480047+0000","last_fullsized":"2024-09-05T02:16:42.480047+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.479861+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:12.117260+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5103,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'440","reported_seq":1158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.122895+0000","last_change":"2024-09-05T02:16:36.122895+0000","last_active":"2024-09-05T02:16:36.122895+0000","last_peered":"2024-09-05T02:16:36.122895+0000","last_clean":"2024-09-05T02:16:36.122895+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:36.122895+0000","last_undegraded":"2024-09-05T02:16:36.122895+0000","last_fullsized":"2024-09-05T02:16:36.122895+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.122675+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:51.397953+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":823,"num_read_kb":4743,"num_write":1412,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.929007+0000","last_change":"2024-09-05T02:16:46.929007+0000","last_active":"2024-09-05T02:16:46.929007+0000","last_peered":"2024-09-05T02:16:46.929007+0000","last_clean":"2024-09-05T02:16:46.929007+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:16:46.929007+0000","last_undegraded":"2024-09-05T02:16:46.929007+0000","last_fullsized":"2024-09-05T02:16:46.929007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.928820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:33.551292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'430","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.607595+0000","last_change":"2024-09-05T02:16:54.607595+0000","last_active":"2024-09-05T02:16:54.607595+0000","last_peered":"2024-09-05T02:16:54.607595+0000","last_clean":"2024-09-05T02:16:54.607595+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:16:54.607595+0000","last_undegraded":"2024-09-05T02:16:54.607595+0000","last_fullsized":"2024-09-05T02:16:54.607595+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.607309+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:02:15.232596+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":700,"num_read_kb":1390,"num_write":540,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.186545+0000","last_change":"2024-09-05T02:16:50.186545+0000","last_active":"2024-09-05T02:16:50.186545+0000","last_peered":"2024-09-05T02:16:50.186545+0000","last_clean":"2024-09-05T02:16:50.186545+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:16:50.186545+0000","last_undegraded":"2024-09-05T02:16:50.186545+0000","last_fullsized":"2024-09-05T02:16:50.186545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.186319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:46:00.104169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'587","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.544434+0000","last_change":"2024-09-05T02:17:00.544151+0000","last_active":"2024-09-05T02:17:00.544434+0000","last_peered":"2024-09-05T02:17:00.544434+0000","last_clean":"2024-09-05T02:17:00.544434+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:17:00.544434+0000","last_undegraded":"2024-09-05T02:17:00.544434+0000","last_fullsized":"2024-09-05T02:17:00.544434+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'587","last_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_deep_scrub":"264'587","last_deep_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.543906+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:10:51.028073+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'439","reported_seq":1983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.464369+0000","last_change":"2024-09-05T02:16:35.464369+0000","last_active":"2024-09-05T02:16:35.464369+0000","last_peered":"2024-09-05T02:16:35.464369+0000","last_clean":"2024-09-05T02:16:35.464369+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:16:35.464369+0000","last_undegraded":"2024-09-05T02:16:35.464369+0000","last_fullsized":"2024-09-05T02:16:35.464369+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.464163+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:34.736676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'305","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.125280+0000","last_change":"2024-09-05T02:16:33.125280+0000","last_active":"2024-09-05T02:16:33.125280+0000","last_peered":"2024-09-05T02:16:33.125280+0000","last_clean":"2024-09-05T02:16:33.125280+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:33.125280+0000","last_undegraded":"2024-09-05T02:16:33.125280+0000","last_fullsized":"2024-09-05T02:16:33.125280+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.125091+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:46.538429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":6807,"num_write":872,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.791859+0000","last_change":"2024-09-05T02:16:40.791859+0000","last_active":"2024-09-05T02:16:40.791859+0000","last_peered":"2024-09-05T02:16:40.791859+0000","last_clean":"2024-09-05T02:16:40.791859+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:16:40.791859+0000","last_undegraded":"2024-09-05T02:16:40.791859+0000","last_fullsized":"2024-09-05T02:16:40.791859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.791659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:00:07.109747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'302","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.114066+0000","last_change":"2024-09-05T02:16:52.114066+0000","last_active":"2024-09-05T02:16:52.114066+0000","last_peered":"2024-09-05T02:16:52.114066+0000","last_clean":"2024-09-05T02:16:52.114066+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:16:52.114066+0000","last_undegraded":"2024-09-05T02:16:52.114066+0000","last_fullsized":"2024-09-05T02:16:52.114066+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.113869+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:18:23.318378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45431,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1122,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.195296+0000","last_change":"2024-09-05T02:17:00.195296+0000","last_active":"2024-09-05T02:17:00.195296+0000","last_peered":"2024-09-05T02:17:00.195296+0000","last_clean":"2024-09-05T02:17:00.195296+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:17:00.195296+0000","last_undegraded":"2024-09-05T02:17:00.195296+0000","last_fullsized":"2024-09-05T02:17:00.195296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.195111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:11:19.830376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.912916+0000","last_change":"2024-09-05T02:16:51.912916+0000","last_active":"2024-09-05T02:16:51.912916+0000","last_peered":"2024-09-05T02:16:51.912916+0000","last_clean":"2024-09-05T02:16:51.912916+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:16:51.912916+0000","last_undegraded":"2024-09-05T02:16:51.912916+0000","last_fullsized":"2024-09-05T02:16:51.912916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.912736+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:24.736846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'480","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.873624+0000","last_change":"2024-09-05T02:16:39.873624+0000","last_active":"2024-09-05T02:16:39.873624+0000","last_peered":"2024-09-05T02:16:39.873624+0000","last_clean":"2024-09-05T02:16:39.873624+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:16:39.873624+0000","last_undegraded":"2024-09-05T02:16:39.873624+0000","last_fullsized":"2024-09-05T02:16:39.873624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'480","last_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_deep_scrub":"264'480","last_deep_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.873409+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:34.456533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.108848+0000","last_change":"2024-09-05T02:16:34.108848+0000","last_active":"2024-09-05T02:16:34.108848+0000","last_peered":"2024-09-05T02:16:34.108848+0000","last_clean":"2024-09-05T02:16:34.108848+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:34.108848+0000","last_undegraded":"2024-09-05T02:16:34.108848+0000","last_fullsized":"2024-09-05T02:16:34.108848+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.108657+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:36:55.603566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":11870,"num_write":1072,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.767880+0000","last_change":"2024-09-05T02:16:42.767880+0000","last_active":"2024-09-05T02:16:42.767880+0000","last_peered":"2024-09-05T02:16:42.767880+0000","last_clean":"2024-09-05T02:16:42.767880+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:16:42.767880+0000","last_undegraded":"2024-09-05T02:16:42.767880+0000","last_fullsized":"2024-09-05T02:16:42.767880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.767694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:58:50.029710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'373","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.963277+0000","last_change":"2024-09-05T02:16:51.963277+0000","last_active":"2024-09-05T02:16:51.963277+0000","last_peered":"2024-09-05T02:16:51.963277+0000","last_clean":"2024-09-05T02:16:51.963277+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:51.963277+0000","last_undegraded":"2024-09-05T02:16:51.963277+0000","last_fullsized":"2024-09-05T02:16:51.963277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.963126+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:39:27.577793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1153,"num_write":442,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.239500+0000","last_change":"2024-09-05T02:16:44.239500+0000","last_active":"2024-09-05T02:16:44.239500+0000","last_peered":"2024-09-05T02:16:44.239500+0000","last_clean":"2024-09-05T02:16:44.239500+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:16:44.239500+0000","last_undegraded":"2024-09-05T02:16:44.239500+0000","last_fullsized":"2024-09-05T02:16:44.239500+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.239280+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:22:58.554723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'99","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.241222+0000","last_change":"2024-09-05T02:17:02.241222+0000","last_active":"2024-09-05T02:17:02.241222+0000","last_peered":"2024-09-05T02:17:02.241222+0000","last_clean":"2024-09-05T02:17:02.241222+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:17:02.241222+0000","last_undegraded":"2024-09-05T02:17:02.241222+0000","last_fullsized":"2024-09-05T02:17:02.241222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.241039+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:28.434401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'807","reported_seq":2410,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.277310+0000","last_change":"2024-09-05T02:16:45.277310+0000","last_active":"2024-09-05T02:16:45.277310+0000","last_peered":"2024-09-05T02:16:45.277310+0000","last_clean":"2024-09-05T02:16:45.277310+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:16:45.277310+0000","last_undegraded":"2024-09-05T02:16:45.277310+0000","last_fullsized":"2024-09-05T02:16:45.277310+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'807","last_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_deep_scrub":"264'807","last_deep_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.277038+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:50.324780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3282,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'325","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.512680+0000","last_change":"2024-09-05T02:16:32.512680+0000","last_active":"2024-09-05T02:16:32.512680+0000","last_peered":"2024-09-05T02:16:32.512680+0000","last_clean":"2024-09-05T02:16:32.512680+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:16:32.512680+0000","last_undegraded":"2024-09-05T02:16:32.512680+0000","last_fullsized":"2024-09-05T02:16:32.512680+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.512392+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:51.415971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":126733,"num_write":975,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.758161+0000","last_change":"2024-09-05T02:16:41.758161+0000","last_active":"2024-09-05T02:16:41.758161+0000","last_peered":"2024-09-05T02:16:41.758161+0000","last_clean":"2024-09-05T02:16:41.758161+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:16:41.758161+0000","last_undegraded":"2024-09-05T02:16:41.758161+0000","last_fullsized":"2024-09-05T02:16:41.758161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.757955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:26.539921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'553","reported_seq":1233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.317795+0000","last_change":"2024-09-05T02:16:40.317795+0000","last_active":"2024-09-05T02:16:40.317795+0000","last_peered":"2024-09-05T02:16:40.317795+0000","last_clean":"2024-09-05T02:16:40.317795+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:16:40.317795+0000","last_undegraded":"2024-09-05T02:16:40.317795+0000","last_fullsized":"2024-09-05T02:16:40.317795+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.317611+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:00:06.774339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101782,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":984,"num_read_kb":2420,"num_write":814,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.774119+0000","last_change":"2024-09-05T02:16:46.774119+0000","last_active":"2024-09-05T02:16:46.774119+0000","last_peered":"2024-09-05T02:16:46.774119+0000","last_clean":"2024-09-05T02:16:46.774119+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:16:46.774119+0000","last_undegraded":"2024-09-05T02:16:46.774119+0000","last_fullsized":"2024-09-05T02:16:46.774119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.773927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:33.369118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'124","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.193863+0000","last_change":"2024-09-05T02:16:51.193863+0000","last_active":"2024-09-05T02:16:51.193863+0000","last_peered":"2024-09-05T02:16:51.193863+0000","last_clean":"2024-09-05T02:16:51.193863+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:16:51.193863+0000","last_undegraded":"2024-09-05T02:16:51.193863+0000","last_fullsized":"2024-09-05T02:16:51.193863+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.193637+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:46.253889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'959","reported_seq":2795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.496164+0000","last_change":"2024-09-05T02:16:34.496164+0000","last_active":"2024-09-05T02:16:34.496164+0000","last_peered":"2024-09-05T02:16:34.496164+0000","last_clean":"2024-09-05T02:16:34.496164+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:16:34.496164+0000","last_undegraded":"2024-09-05T02:16:34.496164+0000","last_fullsized":"2024-09-05T02:16:34.496164+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'959","last_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_deep_scrub":"264'959","last_deep_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.495992+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:04.831466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'591","reported_seq":1421,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.881841+0000","last_change":"2024-09-05T02:16:27.881841+0000","last_active":"2024-09-05T02:16:27.881841+0000","last_peered":"2024-09-05T02:16:27.881841+0000","last_clean":"2024-09-05T02:16:27.881841+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:27.881841+0000","last_undegraded":"2024-09-05T02:16:27.881841+0000","last_fullsized":"2024-09-05T02:16:27.881841+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'591","last_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_deep_scrub":"264'591","last_deep_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.881626+0000","objects_scrubbed":10,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:45.891183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1279,"num_read_kb":93816,"num_write":1779,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.755375+0000","last_change":"2024-09-05T02:16:43.755375+0000","last_active":"2024-09-05T02:16:43.755375+0000","last_peered":"2024-09-05T02:16:43.755375+0000","last_clean":"2024-09-05T02:16:43.755375+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:16:43.755375+0000","last_undegraded":"2024-09-05T02:16:43.755375+0000","last_fullsized":"2024-09-05T02:16:43.755375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.755186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:44.890636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'324","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.459431+0000","last_change":"2024-09-05T02:16:54.459431+0000","last_active":"2024-09-05T02:16:54.459431+0000","last_peered":"2024-09-05T02:16:54.459431+0000","last_clean":"2024-09-05T02:16:54.459431+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:16:54.459431+0000","last_undegraded":"2024-09-05T02:16:54.459431+0000","last_fullsized":"2024-09-05T02:16:54.459431+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.459229+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:23.961491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":1083,"num_write":458,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.250313+0000","last_change":"2024-09-05T02:16:48.250313+0000","last_active":"2024-09-05T02:16:48.250313+0000","last_peered":"2024-09-05T02:16:48.250313+0000","last_clean":"2024-09-05T02:16:48.250313+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:16:48.250313+0000","last_undegraded":"2024-09-05T02:16:48.250313+0000","last_fullsized":"2024-09-05T02:16:48.250313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.250133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:07.642699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'105","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.238867+0000","last_change":"2024-09-05T02:17:03.238867+0000","last_active":"2024-09-05T02:17:03.238867+0000","last_peered":"2024-09-05T02:17:03.238867+0000","last_clean":"2024-09-05T02:17:03.238867+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:17:03.238867+0000","last_undegraded":"2024-09-05T02:17:03.238867+0000","last_fullsized":"2024-09-05T02:17:03.238867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.238583+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:20:30.549216+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'497","reported_seq":2127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.495522+0000","last_change":"2024-09-05T02:16:36.495522+0000","last_active":"2024-09-05T02:16:36.495522+0000","last_peered":"2024-09-05T02:16:36.495522+0000","last_clean":"2024-09-05T02:16:36.495522+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:16:36.495522+0000","last_undegraded":"2024-09-05T02:16:36.495522+0000","last_fullsized":"2024-09-05T02:16:36.495522+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.495268+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:26.514116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'382","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.836546+0000","last_change":"2024-09-05T02:16:29.836399+0000","last_active":"2024-09-05T02:16:29.836546+0000","last_peered":"2024-09-05T02:16:29.836546+0000","last_clean":"2024-09-05T02:16:29.836546+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:29.836546+0000","last_undegraded":"2024-09-05T02:16:29.836546+0000","last_fullsized":"2024-09-05T02:16:29.836546+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.836204+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:59.305574+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250145,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":21240,"num_write":1224,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.186623+0000","last_change":"2024-09-05T02:16:42.186623+0000","last_active":"2024-09-05T02:16:42.186623+0000","last_peered":"2024-09-05T02:16:42.186623+0000","last_clean":"2024-09-05T02:16:42.186623+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:16:42.186623+0000","last_undegraded":"2024-09-05T02:16:42.186623+0000","last_fullsized":"2024-09-05T02:16:42.186623+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.186438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:10.931784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'353","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.751783+0000","last_change":"2024-09-05T02:16:44.751783+0000","last_active":"2024-09-05T02:16:44.751783+0000","last_peered":"2024-09-05T02:16:44.751783+0000","last_clean":"2024-09-05T02:16:44.751783+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:16:44.751783+0000","last_undegraded":"2024-09-05T02:16:44.751783+0000","last_fullsized":"2024-09-05T02:16:44.751783+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.751562+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:24.105318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":1068,"num_write":416,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.743669+0000","last_change":"2024-09-05T02:16:47.743669+0000","last_active":"2024-09-05T02:16:47.743669+0000","last_peered":"2024-09-05T02:16:47.743669+0000","last_clean":"2024-09-05T02:16:47.743669+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:47.743669+0000","last_undegraded":"2024-09-05T02:16:47.743669+0000","last_fullsized":"2024-09-05T02:16:47.743669+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.743487+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:46.001538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'119","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.160196+0000","last_change":"2024-09-05T02:16:49.160196+0000","last_active":"2024-09-05T02:16:49.160196+0000","last_peered":"2024-09-05T02:16:49.160196+0000","last_clean":"2024-09-05T02:16:49.160196+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:16:49.160196+0000","last_undegraded":"2024-09-05T02:16:49.160196+0000","last_fullsized":"2024-09-05T02:16:49.160196+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.160002+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:41:09.578917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'394","reported_seq":1896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.447326+0000","last_change":"2024-09-05T02:16:37.447326+0000","last_active":"2024-09-05T02:16:37.447326+0000","last_peered":"2024-09-05T02:16:37.447326+0000","last_clean":"2024-09-05T02:16:37.447326+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:16:37.447326+0000","last_undegraded":"2024-09-05T02:16:37.447326+0000","last_fullsized":"2024-09-05T02:16:37.447326+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.447142+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:57.480162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.517777+0000","last_change":"2024-09-05T02:16:29.517777+0000","last_active":"2024-09-05T02:16:29.517777+0000","last_peered":"2024-09-05T02:16:29.517777+0000","last_clean":"2024-09-05T02:16:29.517777+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:29.517777+0000","last_undegraded":"2024-09-05T02:16:29.517777+0000","last_fullsized":"2024-09-05T02:16:29.517777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.517556+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:02:11.732840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":32430,"num_write":1082,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.602492+0000","last_change":"2024-09-05T02:16:50.602492+0000","last_active":"2024-09-05T02:16:50.602492+0000","last_peered":"2024-09-05T02:16:50.602492+0000","last_clean":"2024-09-05T02:16:50.602492+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:16:50.602492+0000","last_undegraded":"2024-09-05T02:16:50.602492+0000","last_fullsized":"2024-09-05T02:16:50.602492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.602255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:23.593095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'120","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.113589+0000","last_change":"2024-09-05T02:16:53.113589+0000","last_active":"2024-09-05T02:16:53.113589+0000","last_peered":"2024-09-05T02:16:53.113589+0000","last_clean":"2024-09-05T02:16:53.113589+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:16:53.113589+0000","last_undegraded":"2024-09-05T02:16:53.113589+0000","last_fullsized":"2024-09-05T02:16:53.113589+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.113378+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:32.124763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'771","reported_seq":2816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.889325+0000","last_change":"2024-09-05T02:16:48.889325+0000","last_active":"2024-09-05T02:16:48.889325+0000","last_peered":"2024-09-05T02:16:48.889325+0000","last_clean":"2024-09-05T02:16:48.889325+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:48.889325+0000","last_undegraded":"2024-09-05T02:16:48.889325+0000","last_fullsized":"2024-09-05T02:16:48.889325+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.889140+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:40.831468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.527328+0000","last_change":"2024-09-05T02:17:00.527328+0000","last_active":"2024-09-05T02:17:00.527328+0000","last_peered":"2024-09-05T02:17:00.527328+0000","last_clean":"2024-09-05T02:17:00.527328+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:17:00.527328+0000","last_undegraded":"2024-09-05T02:17:00.527328+0000","last_fullsized":"2024-09-05T02:17:00.527328+0000","mapping_epoch":33,"log_start":"264'101","ondisk_log_start":"264'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.527142+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:06.769067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1291","reported_seq":3055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.244971+0000","last_change":"2024-09-05T02:16:39.244971+0000","last_active":"2024-09-05T02:16:39.244971+0000","last_peered":"2024-09-05T02:16:39.244971+0000","last_clean":"2024-09-05T02:16:39.244971+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:16:39.244971+0000","last_undegraded":"2024-09-05T02:16:39.244971+0000","last_fullsized":"2024-09-05T02:16:39.244971+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1291","last_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_deep_scrub":"264'1291","last_deep_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.244780+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:47.585141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'361","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.900274+0000","last_change":"2024-09-05T02:16:29.900274+0000","last_active":"2024-09-05T02:16:29.900274+0000","last_peered":"2024-09-05T02:16:29.900274+0000","last_clean":"2024-09-05T02:16:29.900274+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:29.900274+0000","last_undegraded":"2024-09-05T02:16:29.900274+0000","last_fullsized":"2024-09-05T02:16:29.900274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.900193+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:20.281068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":2332,"num_write":1185,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.482268+0000","last_change":"2024-09-05T02:16:50.482268+0000","last_active":"2024-09-05T02:16:50.482268+0000","last_peered":"2024-09-05T02:16:50.482268+0000","last_clean":"2024-09-05T02:16:50.482268+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:16:50.482268+0000","last_undegraded":"2024-09-05T02:16:50.482268+0000","last_fullsized":"2024-09-05T02:16:50.482268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.482092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:18.769975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'462","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.580931+0000","last_change":"2024-09-05T02:16:55.580931+0000","last_active":"2024-09-05T02:16:55.580931+0000","last_peered":"2024-09-05T02:16:55.580931+0000","last_clean":"2024-09-05T02:16:55.580931+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:16:55.580931+0000","last_undegraded":"2024-09-05T02:16:55.580931+0000","last_fullsized":"2024-09-05T02:16:55.580931+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.580686+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:43.482301+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49653,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1315,"num_read_kb":1876,"num_write":1876,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.932041+0000","last_change":"2024-09-05T02:16:45.932041+0000","last_active":"2024-09-05T02:16:45.932041+0000","last_peered":"2024-09-05T02:16:45.932041+0000","last_clean":"2024-09-05T02:16:45.932041+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:16:45.932041+0000","last_undegraded":"2024-09-05T02:16:45.932041+0000","last_fullsized":"2024-09-05T02:16:45.932041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.931862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:22.195208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'154","reported_seq":678,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.274647+0000","last_change":"2024-09-05T02:16:58.274647+0000","last_active":"2024-09-05T02:16:58.274647+0000","last_peered":"2024-09-05T02:16:58.274647+0000","last_clean":"2024-09-05T02:16:58.274647+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:16:58.274647+0000","last_undegraded":"2024-09-05T02:16:58.274647+0000","last_fullsized":"2024-09-05T02:16:58.274647+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.274456+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:59.540758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'895","reported_seq":2577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.837031+0000","last_change":"2024-09-05T02:16:37.837031+0000","last_active":"2024-09-05T02:16:37.837031+0000","last_peered":"2024-09-05T02:16:37.837031+0000","last_clean":"2024-09-05T02:16:37.837031+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:16:37.837031+0000","last_undegraded":"2024-09-05T02:16:37.837031+0000","last_fullsized":"2024-09-05T02:16:37.837031+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'895","last_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_deep_scrub":"264'895","last_deep_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.836840+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:26.109909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1433,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.175725+0000","last_change":"2024-09-05T02:16:30.175725+0000","last_active":"2024-09-05T02:16:30.175725+0000","last_peered":"2024-09-05T02:16:30.175725+0000","last_clean":"2024-09-05T02:16:30.175725+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:16:30.175725+0000","last_undegraded":"2024-09-05T02:16:30.175725+0000","last_fullsized":"2024-09-05T02:16:30.175725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.175528+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:42:10.298718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.463168+0000","last_change":"2024-09-05T02:16:30.462900+0000","last_active":"2024-09-05T02:16:30.463168+0000","last_peered":"2024-09-05T02:16:30.463168+0000","last_clean":"2024-09-05T02:16:30.463168+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:16:30.463168+0000","last_undegraded":"2024-09-05T02:16:30.463168+0000","last_fullsized":"2024-09-05T02:16:30.463168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.462683+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.227113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'307","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.764633+0000","last_change":"2024-09-05T02:16:27.764633+0000","last_active":"2024-09-05T02:16:27.764633+0000","last_peered":"2024-09-05T02:16:27.764633+0000","last_clean":"2024-09-05T02:16:27.764633+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:27.764633+0000","last_undegraded":"2024-09-05T02:16:27.764633+0000","last_fullsized":"2024-09-05T02:16:27.764633+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.764568+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.844822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306176,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":457,"num_read_kb":14472,"num_write":870,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.976545+0000","last_change":"2024-09-05T02:16:50.976318+0000","last_active":"2024-09-05T02:16:50.976545+0000","last_peered":"2024-09-05T02:16:50.976545+0000","last_clean":"2024-09-05T02:16:50.976545+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:16:50.976545+0000","last_undegraded":"2024-09-05T02:16:50.976545+0000","last_fullsized":"2024-09-05T02:16:50.976545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.976113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:48:12.941027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'794","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.533155+0000","last_change":"2024-09-05T02:16:56.533155+0000","last_active":"2024-09-05T02:16:56.533155+0000","last_peered":"2024-09-05T02:16:56.533155+0000","last_clean":"2024-09-05T02:16:56.533155+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:16:56.533155+0000","last_undegraded":"2024-09-05T02:16:56.533155+0000","last_fullsized":"2024-09-05T02:16:56.533155+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.532937+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:46.840785+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157356,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1541,"num_read_kb":3609,"num_write":1452,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89058,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.222761+0000","last_change":"2024-09-05T02:16:56.222761+0000","last_active":"2024-09-05T02:16:56.222761+0000","last_peered":"2024-09-05T02:16:56.222761+0000","last_clean":"2024-09-05T02:16:56.222761+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:16:56.222761+0000","last_undegraded":"2024-09-05T02:16:56.222761+0000","last_fullsized":"2024-09-05T02:16:56.222761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.222553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:59.389821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'203","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.947987+0000","last_change":"2024-09-05T02:16:52.947987+0000","last_active":"2024-09-05T02:16:52.947987+0000","last_peered":"2024-09-05T02:16:52.947987+0000","last_clean":"2024-09-05T02:16:52.947987+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:16:52.947987+0000","last_undegraded":"2024-09-05T02:16:52.947987+0000","last_fullsized":"2024-09-05T02:16:52.947987+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.947749+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:13.134156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'785","reported_seq":2290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.420146+0000","last_change":"2024-09-05T02:16:35.420146+0000","last_active":"2024-09-05T02:16:35.420146+0000","last_peered":"2024-09-05T02:16:35.420146+0000","last_clean":"2024-09-05T02:16:35.420146+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:16:35.420146+0000","last_undegraded":"2024-09-05T02:16:35.420146+0000","last_fullsized":"2024-09-05T02:16:35.420146+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.419887+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:06.326976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.122749+0000","last_change":"2024-09-05T02:16:32.122749+0000","last_active":"2024-09-05T02:16:32.122749+0000","last_peered":"2024-09-05T02:16:32.122749+0000","last_clean":"2024-09-05T02:16:32.122749+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:16:32.122749+0000","last_undegraded":"2024-09-05T02:16:32.122749+0000","last_fullsized":"2024-09-05T02:16:32.122749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.122554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:52.851366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'314","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:26.509714+0000","last_change":"2024-09-05T02:16:26.509558+0000","last_active":"2024-09-05T02:16:26.509714+0000","last_peered":"2024-09-05T02:16:26.509714+0000","last_clean":"2024-09-05T02:16:26.509714+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:16:26.509714+0000","last_undegraded":"2024-09-05T02:16:26.509714+0000","last_fullsized":"2024-09-05T02:16:26.509714+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_clean_scrub_stamp":"2024-09-05T02:16:26.509242+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:07.832980+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":5706,"num_write":1068,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.588668+0000","last_change":"2024-09-05T02:16:49.588668+0000","last_active":"2024-09-05T02:16:49.588668+0000","last_peered":"2024-09-05T02:16:49.588668+0000","last_clean":"2024-09-05T02:16:49.588668+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:16:49.588668+0000","last_undegraded":"2024-09-05T02:16:49.588668+0000","last_fullsized":"2024-09-05T02:16:49.588668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.588378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:16.006275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1382","reported_seq":3406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.209063+0000","last_change":"2024-09-05T02:16:46.208830+0000","last_active":"2024-09-05T02:16:46.209063+0000","last_peered":"2024-09-05T02:16:46.209063+0000","last_clean":"2024-09-05T02:16:46.209063+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:46.209063+0000","last_undegraded":"2024-09-05T02:16:46.209063+0000","last_fullsized":"2024-09-05T02:16:46.209063+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1382","last_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_deep_scrub":"264'1382","last_deep_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.208570+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":1300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:04.028834+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2121,"num_read_kb":3935,"num_write":1230,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.825989+0000","last_change":"2024-09-05T02:16:58.825989+0000","last_active":"2024-09-05T02:16:58.825989+0000","last_peered":"2024-09-05T02:16:58.825989+0000","last_clean":"2024-09-05T02:16:58.825989+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:16:58.825989+0000","last_undegraded":"2024-09-05T02:16:58.825989+0000","last_fullsized":"2024-09-05T02:16:58.825989+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.825724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.747695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'252","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.159330+0000","last_change":"2024-09-05T02:16:52.159330+0000","last_active":"2024-09-05T02:16:52.159330+0000","last_peered":"2024-09-05T02:16:52.159330+0000","last_clean":"2024-09-05T02:16:52.159330+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:16:52.159330+0000","last_undegraded":"2024-09-05T02:16:52.159330+0000","last_fullsized":"2024-09-05T02:16:52.159330+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.159103+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:01:00.496206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'413","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.210253+0000","last_change":"2024-09-05T02:16:40.210253+0000","last_active":"2024-09-05T02:16:40.210253+0000","last_peered":"2024-09-05T02:16:40.210253+0000","last_clean":"2024-09-05T02:16:40.210253+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:16:40.210253+0000","last_undegraded":"2024-09-05T02:16:40.210253+0000","last_fullsized":"2024-09-05T02:16:40.210253+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.210048+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:40.273557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":912,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.788046+0000","last_change":"2024-09-05T02:16:28.787900+0000","last_active":"2024-09-05T02:16:28.788046+0000","last_peered":"2024-09-05T02:16:28.788046+0000","last_clean":"2024-09-05T02:16:28.788046+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:16:28.788046+0000","last_undegraded":"2024-09-05T02:16:28.788046+0000","last_fullsized":"2024-09-05T02:16:28.788046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.787731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:26:43.122051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'335","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.326044+0000","last_change":"2024-09-05T02:16:29.326044+0000","last_active":"2024-09-05T02:16:29.326044+0000","last_peered":"2024-09-05T02:16:29.326044+0000","last_clean":"2024-09-05T02:16:29.326044+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:29.326044+0000","last_undegraded":"2024-09-05T02:16:29.326044+0000","last_fullsized":"2024-09-05T02:16:29.326044+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.325952+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:55.516960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":23361,"num_write":910,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.842874+0000","last_change":"2024-09-05T02:16:39.842874+0000","last_active":"2024-09-05T02:16:39.842874+0000","last_peered":"2024-09-05T02:16:39.842874+0000","last_clean":"2024-09-05T02:16:39.842874+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:16:39.842874+0000","last_undegraded":"2024-09-05T02:16:39.842874+0000","last_fullsized":"2024-09-05T02:16:39.842874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.842690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:16:19.549189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'355","reported_seq":1963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.918210+0000","last_change":"2024-09-05T02:16:53.918210+0000","last_active":"2024-09-05T02:16:53.918210+0000","last_peered":"2024-09-05T02:16:53.918210+0000","last_clean":"2024-09-05T02:16:53.918210+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:16:53.918210+0000","last_undegraded":"2024-09-05T02:16:53.918210+0000","last_fullsized":"2024-09-05T02:16:53.918210+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.917978+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:01:50.088462+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.287896+0000","last_change":"2024-09-05T02:16:43.287761+0000","last_active":"2024-09-05T02:16:43.287896+0000","last_peered":"2024-09-05T02:16:43.287896+0000","last_clean":"2024-09-05T02:16:43.287896+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:16:43.287896+0000","last_undegraded":"2024-09-05T02:16:43.287896+0000","last_fullsized":"2024-09-05T02:16:43.287896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.287581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:02.058137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'245","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.257720+0000","last_change":"2024-09-05T02:17:04.257720+0000","last_active":"2024-09-05T02:17:04.257720+0000","last_peered":"2024-09-05T02:17:04.257720+0000","last_clean":"2024-09-05T02:17:04.257720+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:17:04.257720+0000","last_undegraded":"2024-09-05T02:17:04.257720+0000","last_fullsized":"2024-09-05T02:17:04.257720+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.257502+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:51:50.338750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1278","reported_seq":2936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.277311+0000","last_change":"2024-09-05T02:16:36.277149+0000","last_active":"2024-09-05T02:16:36.277311+0000","last_peered":"2024-09-05T02:16:36.277311+0000","last_clean":"2024-09-05T02:16:36.277311+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:16:36.277311+0000","last_undegraded":"2024-09-05T02:16:36.277311+0000","last_fullsized":"2024-09-05T02:16:36.277311+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1278","last_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_deep_scrub":"264'1278","last_deep_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.276963+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:10.284570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1616,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.467029+0000","last_change":"2024-09-05T02:16:29.466902+0000","last_active":"2024-09-05T02:16:29.467029+0000","last_peered":"2024-09-05T02:16:29.467029+0000","last_clean":"2024-09-05T02:16:29.467029+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:16:29.467029+0000","last_undegraded":"2024-09-05T02:16:29.467029+0000","last_fullsized":"2024-09-05T02:16:29.467029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.466718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:17.729741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'367","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.515860+0000","last_change":"2024-09-05T02:16:31.515719+0000","last_active":"2024-09-05T02:16:31.515860+0000","last_peered":"2024-09-05T02:16:31.515860+0000","last_clean":"2024-09-05T02:16:31.515860+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:31.515860+0000","last_undegraded":"2024-09-05T02:16:31.515860+0000","last_fullsized":"2024-09-05T02:16:31.515860+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.515456+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:25:12.133378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":46632,"num_write":1174,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.271828+0000","last_change":"2024-09-05T02:16:46.271828+0000","last_active":"2024-09-05T02:16:46.271828+0000","last_peered":"2024-09-05T02:16:46.271828+0000","last_clean":"2024-09-05T02:16:46.271828+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:16:46.271828+0000","last_undegraded":"2024-09-05T02:16:46.271828+0000","last_fullsized":"2024-09-05T02:16:46.271828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.271644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:40.777056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'171","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.128445+0000","last_change":"2024-09-05T02:16:51.128445+0000","last_active":"2024-09-05T02:16:51.128445+0000","last_peered":"2024-09-05T02:16:51.128445+0000","last_clean":"2024-09-05T02:16:51.128445+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:16:51.128445+0000","last_undegraded":"2024-09-05T02:16:51.128445+0000","last_fullsized":"2024-09-05T02:16:51.128445+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.128239+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:54.774325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.884813+0000","last_change":"2024-09-05T02:16:46.884813+0000","last_active":"2024-09-05T02:16:46.884813+0000","last_peered":"2024-09-05T02:16:46.884813+0000","last_clean":"2024-09-05T02:16:46.884813+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:16:46.884813+0000","last_undegraded":"2024-09-05T02:16:46.884813+0000","last_fullsized":"2024-09-05T02:16:46.884813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.884632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:28:31.243635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'118","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.562825+0000","last_change":"2024-09-05T02:17:06.562825+0000","last_active":"2024-09-05T02:17:06.562825+0000","last_peered":"2024-09-05T02:17:06.562825+0000","last_clean":"2024-09-05T02:17:06.562825+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:17:06.562825+0000","last_undegraded":"2024-09-05T02:17:06.562825+0000","last_fullsized":"2024-09-05T02:17:06.562825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.562629+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:51.442782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'542","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.258808+0000","last_change":"2024-09-05T02:16:35.258563+0000","last_active":"2024-09-05T02:16:35.258808+0000","last_peered":"2024-09-05T02:16:35.258808+0000","last_clean":"2024-09-05T02:16:35.258808+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:16:35.258808+0000","last_undegraded":"2024-09-05T02:16:35.258808+0000","last_fullsized":"2024-09-05T02:16:35.258808+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.258316+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:30.208156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'306","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.502349+0000","last_change":"2024-09-05T02:16:31.502349+0000","last_active":"2024-09-05T02:16:31.502349+0000","last_peered":"2024-09-05T02:16:31.502349+0000","last_clean":"2024-09-05T02:16:31.502349+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:16:31.502349+0000","last_undegraded":"2024-09-05T02:16:31.502349+0000","last_fullsized":"2024-09-05T02:16:31.502349+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.502116+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:28.057536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":39042,"num_write":920,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.404422+0000","last_change":"2024-09-05T02:16:27.404366+0000","last_active":"2024-09-05T02:16:27.404422+0000","last_peered":"2024-09-05T02:16:27.404422+0000","last_clean":"2024-09-05T02:16:27.404422+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:16:27.404422+0000","last_undegraded":"2024-09-05T02:16:27.404422+0000","last_fullsized":"2024-09-05T02:16:27.404422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.404292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:45:52.441484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.217437+0000","last_change":"2024-09-05T02:16:57.217285+0000","last_active":"2024-09-05T02:16:57.217437+0000","last_peered":"2024-09-05T02:16:57.217437+0000","last_clean":"2024-09-05T02:16:57.217437+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:16:57.217437+0000","last_undegraded":"2024-09-05T02:16:57.217437+0000","last_fullsized":"2024-09-05T02:16:57.217437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.217067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:42.886187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'687","reported_seq":1413,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.284135+0000","last_change":"2024-09-05T02:16:47.284135+0000","last_active":"2024-09-05T02:16:47.284135+0000","last_peered":"2024-09-05T02:16:47.284135+0000","last_clean":"2024-09-05T02:16:47.284135+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:16:47.284135+0000","last_undegraded":"2024-09-05T02:16:47.284135+0000","last_fullsized":"2024-09-05T02:16:47.284135+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'687","last_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_deep_scrub":"264'687","last_deep_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.283917+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:28.307016+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1139,"num_read_kb":2483,"num_write":1010,"num_write_kb":799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.532489+0000","last_change":"2024-09-05T02:16:57.532254+0000","last_active":"2024-09-05T02:16:57.532489+0000","last_peered":"2024-09-05T02:16:57.532489+0000","last_clean":"2024-09-05T02:16:57.532489+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:16:57.532489+0000","last_undegraded":"2024-09-05T02:16:57.532489+0000","last_fullsized":"2024-09-05T02:16:57.532489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.531985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:20.408235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'189","reported_seq":719,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.243320+0000","last_change":"2024-09-05T02:17:03.243320+0000","last_active":"2024-09-05T02:17:03.243320+0000","last_peered":"2024-09-05T02:17:03.243320+0000","last_clean":"2024-09-05T02:17:03.243320+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:17:03.243320+0000","last_undegraded":"2024-09-05T02:17:03.243320+0000","last_fullsized":"2024-09-05T02:17:03.243320+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.243122+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:29:13.048015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'886","reported_seq":2362,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.267735+0000","last_change":"2024-09-05T02:16:54.267603+0000","last_active":"2024-09-05T02:16:54.267735+0000","last_peered":"2024-09-05T02:16:54.267735+0000","last_clean":"2024-09-05T02:16:54.267735+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:16:54.267735+0000","last_undegraded":"2024-09-05T02:16:54.267735+0000","last_fullsized":"2024-09-05T02:16:54.267735+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'886","last_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_deep_scrub":"264'886","last_deep_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.267422+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:10:42.442657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'324","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.373091+0000","last_change":"2024-09-05T02:16:30.372916+0000","last_active":"2024-09-05T02:16:30.373091+0000","last_peered":"2024-09-05T02:16:30.373091+0000","last_clean":"2024-09-05T02:16:30.373091+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:30.373091+0000","last_undegraded":"2024-09-05T02:16:30.373091+0000","last_fullsized":"2024-09-05T02:16:30.373091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.372709+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:12:13.999885+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":37378,"num_write":1055,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.124745+0000","last_change":"2024-09-05T02:16:31.124622+0000","last_active":"2024-09-05T02:16:31.124745+0000","last_peered":"2024-09-05T02:16:31.124745+0000","last_clean":"2024-09-05T02:16:31.124745+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:16:31.124745+0000","last_undegraded":"2024-09-05T02:16:31.124745+0000","last_fullsized":"2024-09-05T02:16:31.124745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.124439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:31.003902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.885018+0000","last_change":"2024-09-05T02:16:43.884773+0000","last_active":"2024-09-05T02:16:43.885018+0000","last_peered":"2024-09-05T02:16:43.885018+0000","last_clean":"2024-09-05T02:16:43.885018+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:16:43.885018+0000","last_undegraded":"2024-09-05T02:16:43.885018+0000","last_fullsized":"2024-09-05T02:16:43.885018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.884568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:16:44.961807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'212","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.198882+0000","last_change":"2024-09-05T02:16:47.198716+0000","last_active":"2024-09-05T02:16:47.198882+0000","last_peered":"2024-09-05T02:16:47.198882+0000","last_clean":"2024-09-05T02:16:47.198882+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:16:47.198882+0000","last_undegraded":"2024-09-05T02:16:47.198882+0000","last_fullsized":"2024-09-05T02:16:47.198882+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.198502+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:34.874131+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'798","reported_seq":3287,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.552427+0000","last_change":"2024-09-05T02:16:57.552427+0000","last_active":"2024-09-05T02:16:57.552427+0000","last_peered":"2024-09-05T02:16:57.552427+0000","last_clean":"2024-09-05T02:16:57.552427+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:16:57.552427+0000","last_undegraded":"2024-09-05T02:16:57.552427+0000","last_fullsized":"2024-09-05T02:16:57.552427+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'798","last_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_deep_scrub":"264'798","last_deep_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.552252+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.995961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.239397+0000","last_change":"2024-09-05T02:17:06.239397+0000","last_active":"2024-09-05T02:17:06.239397+0000","last_peered":"2024-09-05T02:17:06.239397+0000","last_clean":"2024-09-05T02:17:06.239397+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:17:06.239397+0000","last_undegraded":"2024-09-05T02:17:06.239397+0000","last_fullsized":"2024-09-05T02:17:06.239397+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.239206+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:46.358129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'964","reported_seq":2560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.072318+0000","last_change":"2024-09-05T02:16:45.072318+0000","last_active":"2024-09-05T02:16:45.072318+0000","last_peered":"2024-09-05T02:16:45.072318+0000","last_clean":"2024-09-05T02:16:45.072318+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:16:45.072318+0000","last_undegraded":"2024-09-05T02:16:45.072318+0000","last_fullsized":"2024-09-05T02:16:45.072318+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'964","last_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_deep_scrub":"264'964","last_deep_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.072096+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:26:16.793459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'419","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.916620+0000","last_change":"2024-09-05T02:16:28.916620+0000","last_active":"2024-09-05T02:16:28.916620+0000","last_peered":"2024-09-05T02:16:28.916620+0000","last_clean":"2024-09-05T02:16:28.916620+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:28.916620+0000","last_undegraded":"2024-09-05T02:16:28.916620+0000","last_fullsized":"2024-09-05T02:16:28.916620+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'419","last_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_deep_scrub":"264'419","last_deep_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.916405+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:38.195772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":754,"num_read_kb":36692,"num_write":1433,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.366495+0000","last_change":"2024-09-05T02:16:28.366495+0000","last_active":"2024-09-05T02:16:28.366495+0000","last_peered":"2024-09-05T02:16:28.366495+0000","last_clean":"2024-09-05T02:16:28.366495+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:16:28.366495+0000","last_undegraded":"2024-09-05T02:16:28.366495+0000","last_fullsized":"2024-09-05T02:16:28.366495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.366407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:29:33.144478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.448189+0000","last_change":"2024-09-05T02:16:48.448071+0000","last_active":"2024-09-05T02:16:48.448189+0000","last_peered":"2024-09-05T02:16:48.448189+0000","last_clean":"2024-09-05T02:16:48.448189+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:16:48.448189+0000","last_undegraded":"2024-09-05T02:16:48.448189+0000","last_fullsized":"2024-09-05T02:16:48.448189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.447892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:42:23.569052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'162","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.478714+0000","last_change":"2024-09-05T02:16:53.478566+0000","last_active":"2024-09-05T02:16:53.478714+0000","last_peered":"2024-09-05T02:16:53.478714+0000","last_clean":"2024-09-05T02:16:53.478714+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:16:53.478714+0000","last_undegraded":"2024-09-05T02:16:53.478714+0000","last_fullsized":"2024-09-05T02:16:53.478714+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.478364+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:22.605913+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.133922+0000","last_change":"2024-09-05T02:16:58.133765+0000","last_active":"2024-09-05T02:16:58.133922+0000","last_peered":"2024-09-05T02:16:58.133922+0000","last_clean":"2024-09-05T02:16:58.133922+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:58.133922+0000","last_undegraded":"2024-09-05T02:16:58.133922+0000","last_fullsized":"2024-09-05T02:16:58.133922+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.133593+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:25.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'177","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.235179+0000","last_change":"2024-09-05T02:16:53.235179+0000","last_active":"2024-09-05T02:16:53.235179+0000","last_peered":"2024-09-05T02:16:53.235179+0000","last_clean":"2024-09-05T02:16:53.235179+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:16:53.235179+0000","last_undegraded":"2024-09-05T02:16:53.235179+0000","last_fullsized":"2024-09-05T02:16:53.235179+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.234979+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:35.819811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'567","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.473632+0000","last_change":"2024-09-05T02:16:33.473476+0000","last_active":"2024-09-05T02:16:33.473632+0000","last_peered":"2024-09-05T02:16:33.473632+0000","last_clean":"2024-09-05T02:16:33.473632+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:16:33.473632+0000","last_undegraded":"2024-09-05T02:16:33.473632+0000","last_fullsized":"2024-09-05T02:16:33.473632+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'567","last_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_deep_scrub":"264'567","last_deep_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.473297+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:11.125295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":876,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'379","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.461633+0000","last_change":"2024-09-05T02:16:27.461633+0000","last_active":"2024-09-05T02:16:27.461633+0000","last_peered":"2024-09-05T02:16:27.461633+0000","last_clean":"2024-09-05T02:16:27.461633+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:16:27.461633+0000","last_undegraded":"2024-09-05T02:16:27.461633+0000","last_fullsized":"2024-09-05T02:16:27.461633+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'379","last_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_deep_scrub":"264'379","last_deep_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.461448+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:09.203614+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306547,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":1286,"num_write":1063,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.797643+0000","last_change":"2024-09-05T02:16:30.797643+0000","last_active":"2024-09-05T02:16:30.797643+0000","last_peered":"2024-09-05T02:16:30.797643+0000","last_clean":"2024-09-05T02:16:30.797643+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:16:30.797643+0000","last_undegraded":"2024-09-05T02:16:30.797643+0000","last_fullsized":"2024-09-05T02:16:30.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.797468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:12.858645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.140192+0000","last_change":"2024-09-05T02:16:49.140192+0000","last_active":"2024-09-05T02:16:49.140192+0000","last_peered":"2024-09-05T02:16:49.140192+0000","last_clean":"2024-09-05T02:16:49.140192+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:16:49.140192+0000","last_undegraded":"2024-09-05T02:16:49.140192+0000","last_fullsized":"2024-09-05T02:16:49.140192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.140009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:59:04.745264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'765","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.015988+0000","last_change":"2024-09-05T02:16:50.015732+0000","last_active":"2024-09-05T02:16:50.015988+0000","last_peered":"2024-09-05T02:16:50.015988+0000","last_clean":"2024-09-05T02:16:50.015988+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:50.015988+0000","last_undegraded":"2024-09-05T02:16:50.015988+0000","last_fullsized":"2024-09-05T02:16:50.015988+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.015404+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:41:52.046842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142523,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1322,"num_read_kb":3088,"num_write":1054,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.146385+0000","last_change":"2024-09-05T02:16:57.146257+0000","last_active":"2024-09-05T02:16:57.146385+0000","last_peered":"2024-09-05T02:16:57.146385+0000","last_clean":"2024-09-05T02:16:57.146385+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:16:57.146385+0000","last_undegraded":"2024-09-05T02:16:57.146385+0000","last_fullsized":"2024-09-05T02:16:57.146385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.146070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:02.238780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'121","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.576899+0000","last_change":"2024-09-05T02:17:01.576899+0000","last_active":"2024-09-05T02:17:01.576899+0000","last_peered":"2024-09-05T02:17:01.576899+0000","last_clean":"2024-09-05T02:17:01.576899+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:17:01.576899+0000","last_undegraded":"2024-09-05T02:17:01.576899+0000","last_fullsized":"2024-09-05T02:17:01.576899+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.576713+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:14.801974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.249645+0000","last_change":"2024-09-05T02:17:04.249509+0000","last_active":"2024-09-05T02:17:04.249645+0000","last_peered":"2024-09-05T02:17:04.249645+0000","last_clean":"2024-09-05T02:17:04.249645+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:17:04.249645+0000","last_undegraded":"2024-09-05T02:17:04.249645+0000","last_fullsized":"2024-09-05T02:17:04.249645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.249322+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:38.397612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'584","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.467016+0000","last_change":"2024-09-05T02:16:38.467016+0000","last_active":"2024-09-05T02:16:38.467016+0000","last_peered":"2024-09-05T02:16:38.467016+0000","last_clean":"2024-09-05T02:16:38.467016+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:16:38.467016+0000","last_undegraded":"2024-09-05T02:16:38.467016+0000","last_fullsized":"2024-09-05T02:16:38.467016+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.466831+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:09.713439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'310","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.564836+0000","last_change":"2024-09-05T02:16:28.564836+0000","last_active":"2024-09-05T02:16:28.564836+0000","last_peered":"2024-09-05T02:16:28.564836+0000","last_clean":"2024-09-05T02:16:28.564836+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:28.564836+0000","last_undegraded":"2024-09-05T02:16:28.564836+0000","last_fullsized":"2024-09-05T02:16:28.564836+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.564631+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:46:10.085984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524318,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":27235,"num_write":955,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.151032+0000","last_change":"2024-09-05T02:16:45.151032+0000","last_active":"2024-09-05T02:16:45.151032+0000","last_peered":"2024-09-05T02:16:45.151032+0000","last_clean":"2024-09-05T02:16:45.151032+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:16:45.151032+0000","last_undegraded":"2024-09-05T02:16:45.151032+0000","last_fullsized":"2024-09-05T02:16:45.151032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.150846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:14.522761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'321","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.164900+0000","last_change":"2024-09-05T02:16:54.164900+0000","last_active":"2024-09-05T02:16:54.164900+0000","last_peered":"2024-09-05T02:16:54.164900+0000","last_clean":"2024-09-05T02:16:54.164900+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:16:54.164900+0000","last_undegraded":"2024-09-05T02:16:54.164900+0000","last_fullsized":"2024-09-05T02:16:54.164900+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.164706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:59.874764+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43168,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1204,"num_write":426,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.235619+0000","last_change":"2024-09-05T02:17:01.235619+0000","last_active":"2024-09-05T02:17:01.235619+0000","last_peered":"2024-09-05T02:17:01.235619+0000","last_clean":"2024-09-05T02:17:01.235619+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:17:01.235619+0000","last_undegraded":"2024-09-05T02:17:01.235619+0000","last_fullsized":"2024-09-05T02:17:01.235619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.235436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:04.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'133","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:24.315499+0000","last_change":"2024-09-05T00:49:37.950610+0000","last_active":"2024-09-05T02:14:24.315499+0000","last_peered":"2024-09-05T02:14:24.315499+0000","last_clean":"2024-09-05T02:14:24.315499+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:14:24.315499+0000","last_undegraded":"2024-09-05T02:14:24.315499+0000","last_fullsized":"2024-09-05T02:14:24.315499+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:50:45.434579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'373","reported_seq":1845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.199178+0000","last_change":"2024-09-05T02:16:41.199178+0000","last_active":"2024-09-05T02:16:41.199178+0000","last_peered":"2024-09-05T02:16:41.199178+0000","last_clean":"2024-09-05T02:16:41.199178+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:16:41.199178+0000","last_undegraded":"2024-09-05T02:16:41.199178+0000","last_fullsized":"2024-09-05T02:16:41.199178+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.198938+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:49.138470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'308","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.040013+0000","last_change":"2024-09-05T02:16:38.040013+0000","last_active":"2024-09-05T02:16:38.040013+0000","last_peered":"2024-09-05T02:16:38.040013+0000","last_clean":"2024-09-05T02:16:38.040013+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:38.040013+0000","last_undegraded":"2024-09-05T02:16:38.040013+0000","last_fullsized":"2024-09-05T02:16:38.040013+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.039781+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:04:40.447440+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":54962,"num_write":1038,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.110479+0000","last_change":"2024-09-05T02:16:47.110479+0000","last_active":"2024-09-05T02:16:47.110479+0000","last_peered":"2024-09-05T02:16:47.110479+0000","last_clean":"2024-09-05T02:16:47.110479+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:16:47.110479+0000","last_undegraded":"2024-09-05T02:16:47.110479+0000","last_fullsized":"2024-09-05T02:16:47.110479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.110272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:03:15.952888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'72","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.241593+0000","last_change":"2024-09-05T02:16:49.241593+0000","last_active":"2024-09-05T02:16:49.241593+0000","last_peered":"2024-09-05T02:16:49.241593+0000","last_clean":"2024-09-05T02:16:49.241593+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:16:49.241593+0000","last_undegraded":"2024-09-05T02:16:49.241593+0000","last_fullsized":"2024-09-05T02:16:49.241593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'72","last_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_deep_scrub":"264'72","last_deep_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.241369+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:27.076422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.848918+0000","last_change":"2024-09-05T02:16:56.848918+0000","last_active":"2024-09-05T02:16:56.848918+0000","last_peered":"2024-09-05T02:16:56.848918+0000","last_clean":"2024-09-05T02:16:56.848918+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:16:56.848918+0000","last_undegraded":"2024-09-05T02:16:56.848918+0000","last_fullsized":"2024-09-05T02:16:56.848918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.848710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:51.306857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'232","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.345550+0000","last_change":"2024-09-05T02:17:07.345360+0000","last_active":"2024-09-05T02:17:07.345550+0000","last_peered":"2024-09-05T02:17:07.345550+0000","last_clean":"2024-09-05T02:17:07.345550+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:17:07.345550+0000","last_undegraded":"2024-09-05T02:17:07.345550+0000","last_fullsized":"2024-09-05T02:17:07.345550+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.345041+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:31:05.231444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'413","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.001539+0000","last_change":"2024-09-05T02:16:37.001539+0000","last_active":"2024-09-05T02:16:37.001539+0000","last_peered":"2024-09-05T02:16:37.001539+0000","last_clean":"2024-09-05T02:16:37.001539+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:16:37.001539+0000","last_undegraded":"2024-09-05T02:16:37.001539+0000","last_fullsized":"2024-09-05T02:16:37.001539+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.001348+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:37:09.716022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'312","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.491656+0000","last_change":"2024-09-05T02:16:33.491656+0000","last_active":"2024-09-05T02:16:33.491656+0000","last_peered":"2024-09-05T02:16:33.491656+0000","last_clean":"2024-09-05T02:16:33.491656+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:16:33.491656+0000","last_undegraded":"2024-09-05T02:16:33.491656+0000","last_fullsized":"2024-09-05T02:16:33.491656+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.491428+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:05.829040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":91576,"num_write":1030,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.005253+0000","last_change":"2024-09-05T02:16:49.005253+0000","last_active":"2024-09-05T02:16:49.005253+0000","last_peered":"2024-09-05T02:16:49.005253+0000","last_clean":"2024-09-05T02:16:49.005253+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:16:49.005253+0000","last_undegraded":"2024-09-05T02:16:49.005253+0000","last_fullsized":"2024-09-05T02:16:49.005253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.005040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:33.592652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'339","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.135170+0000","last_change":"2024-09-05T02:16:55.135170+0000","last_active":"2024-09-05T02:16:55.135170+0000","last_peered":"2024-09-05T02:16:55.135170+0000","last_clean":"2024-09-05T02:16:55.135170+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:55.135170+0000","last_undegraded":"2024-09-05T02:16:55.135170+0000","last_fullsized":"2024-09-05T02:16:55.135170+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.134979+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:11:41.547516+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.885736+0000","last_change":"2024-09-05T02:16:47.885736+0000","last_active":"2024-09-05T02:16:47.885736+0000","last_peered":"2024-09-05T02:16:47.885736+0000","last_clean":"2024-09-05T02:16:47.885736+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:16:47.885736+0000","last_undegraded":"2024-09-05T02:16:47.885736+0000","last_fullsized":"2024-09-05T02:16:47.885736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.885547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:38:52.795987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'122","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.556768+0000","last_change":"2024-09-05T02:17:05.556619+0000","last_active":"2024-09-05T02:17:05.556768+0000","last_peered":"2024-09-05T02:17:05.556768+0000","last_clean":"2024-09-05T02:17:05.556768+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:17:05.556768+0000","last_undegraded":"2024-09-05T02:17:05.556768+0000","last_fullsized":"2024-09-05T02:17:05.556768+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.556414+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:18.944327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.065795+0000","last_change":"2024-09-05T02:16:46.065795+0000","last_active":"2024-09-05T02:16:46.065795+0000","last_peered":"2024-09-05T02:16:46.065795+0000","last_clean":"2024-09-05T02:16:46.065795+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:16:46.065795+0000","last_undegraded":"2024-09-05T02:16:46.065795+0000","last_fullsized":"2024-09-05T02:16:46.065795+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1176","last_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_deep_scrub":"264'1176","last_deep_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.065600+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:12.655472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'343","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.487651+0000","last_change":"2024-09-05T02:16:28.487518+0000","last_active":"2024-09-05T02:16:28.487651+0000","last_peered":"2024-09-05T02:16:28.487651+0000","last_clean":"2024-09-05T02:16:28.487651+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:16:28.487651+0000","last_undegraded":"2024-09-05T02:16:28.487651+0000","last_fullsized":"2024-09-05T02:16:28.487651+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.487300+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:13:55.683962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342090,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":6648,"num_write":1112,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.908314+0000","last_change":"2024-09-05T02:16:41.908314+0000","last_active":"2024-09-05T02:16:41.908314+0000","last_peered":"2024-09-05T02:16:41.908314+0000","last_clean":"2024-09-05T02:16:41.908314+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:16:41.908314+0000","last_undegraded":"2024-09-05T02:16:41.908314+0000","last_fullsized":"2024-09-05T02:16:41.908314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.908112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:02.070944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'302","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.957155+0000","last_change":"2024-09-05T02:16:52.957155+0000","last_active":"2024-09-05T02:16:52.957155+0000","last_peered":"2024-09-05T02:16:52.957155+0000","last_clean":"2024-09-05T02:16:52.957155+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:16:52.957155+0000","last_undegraded":"2024-09-05T02:16:52.957155+0000","last_fullsized":"2024-09-05T02:16:52.957155+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.956962+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:52.321946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1205,"num_write":416,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.218254+0000","last_change":"2024-09-05T02:16:58.218254+0000","last_active":"2024-09-05T02:16:58.218254+0000","last_peered":"2024-09-05T02:16:58.218254+0000","last_clean":"2024-09-05T02:16:58.218254+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:16:58.218254+0000","last_undegraded":"2024-09-05T02:16:58.218254+0000","last_fullsized":"2024-09-05T02:16:58.218254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.218069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:28.921690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'401","reported_seq":1943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.833763+0000","last_change":"2024-09-05T02:16:38.833608+0000","last_active":"2024-09-05T02:16:38.833763+0000","last_peered":"2024-09-05T02:16:38.833763+0000","last_clean":"2024-09-05T02:16:38.833763+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:16:38.833763+0000","last_undegraded":"2024-09-05T02:16:38.833763+0000","last_fullsized":"2024-09-05T02:16:38.833763+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.833404+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:32:18.954201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'332","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.909052+0000","last_change":"2024-09-05T02:16:30.908902+0000","last_active":"2024-09-05T02:16:30.909052+0000","last_peered":"2024-09-05T02:16:30.909052+0000","last_clean":"2024-09-05T02:16:30.909052+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:30.909052+0000","last_undegraded":"2024-09-05T02:16:30.909052+0000","last_fullsized":"2024-09-05T02:16:30.909052+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.908658+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:38.710026+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":908,"num_read_kb":44981,"num_write":1071,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.283913+0000","last_change":"2024-09-05T02:16:50.283913+0000","last_active":"2024-09-05T02:16:50.283913+0000","last_peered":"2024-09-05T02:16:50.283913+0000","last_clean":"2024-09-05T02:16:50.283913+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:16:50.283913+0000","last_undegraded":"2024-09-05T02:16:50.283913+0000","last_fullsized":"2024-09-05T02:16:50.283913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.283841+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:07.764546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'541","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.119138+0000","last_change":"2024-09-05T02:16:53.118919+0000","last_active":"2024-09-05T02:16:53.119138+0000","last_peered":"2024-09-05T02:16:53.119138+0000","last_clean":"2024-09-05T02:16:53.119138+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:53.119138+0000","last_undegraded":"2024-09-05T02:16:53.119138+0000","last_fullsized":"2024-09-05T02:16:53.119138+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'541","last_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_deep_scrub":"264'541","last_deep_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.118675+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:17.667696+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90605,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":950,"num_read_kb":2270,"num_write":820,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.525571+0000","last_change":"2024-09-05T02:16:59.525336+0000","last_active":"2024-09-05T02:16:59.525571+0000","last_peered":"2024-09-05T02:16:59.525571+0000","last_clean":"2024-09-05T02:16:59.525571+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:16:59.525571+0000","last_undegraded":"2024-09-05T02:16:59.525571+0000","last_fullsized":"2024-09-05T02:16:59.525571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.525078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:01.095440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'184","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.223600+0000","last_change":"2024-09-05T02:17:05.223600+0000","last_active":"2024-09-05T02:17:05.223600+0000","last_peered":"2024-09-05T02:17:05.223600+0000","last_clean":"2024-09-05T02:17:05.223600+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:17:05.223600+0000","last_undegraded":"2024-09-05T02:17:05.223600+0000","last_fullsized":"2024-09-05T02:17:05.223600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.223412+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:39.805729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'421","reported_seq":1999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.325824+0000","last_change":"2024-09-05T02:16:41.325824+0000","last_active":"2024-09-05T02:16:41.325824+0000","last_peered":"2024-09-05T02:16:41.325824+0000","last_clean":"2024-09-05T02:16:41.325824+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:16:41.325824+0000","last_undegraded":"2024-09-05T02:16:41.325824+0000","last_fullsized":"2024-09-05T02:16:41.325824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.325623+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:24.604460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'348","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.380399+0000","last_change":"2024-09-05T02:16:31.380143+0000","last_active":"2024-09-05T02:16:31.380399+0000","last_peered":"2024-09-05T02:16:31.380399+0000","last_clean":"2024-09-05T02:16:31.380399+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:31.380399+0000","last_undegraded":"2024-09-05T02:16:31.380399+0000","last_fullsized":"2024-09-05T02:16:31.380399+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.379870+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.538823+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":27594,"num_write":1025,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.916164+0000","last_change":"2024-09-05T02:16:44.915915+0000","last_active":"2024-09-05T02:16:44.916164+0000","last_peered":"2024-09-05T02:16:44.916164+0000","last_clean":"2024-09-05T02:16:44.916164+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:16:44.916164+0000","last_undegraded":"2024-09-05T02:16:44.916164+0000","last_fullsized":"2024-09-05T02:16:44.916164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.915627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:46:19.249723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'342","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.876390+0000","last_change":"2024-09-05T02:16:55.876250+0000","last_active":"2024-09-05T02:16:55.876390+0000","last_peered":"2024-09-05T02:16:55.876390+0000","last_clean":"2024-09-05T02:16:55.876390+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:55.876390+0000","last_undegraded":"2024-09-05T02:16:55.876390+0000","last_fullsized":"2024-09-05T02:16:55.876390+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.876025+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:35.582439+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.303250+0000","last_change":"2024-09-05T02:16:59.302978+0000","last_active":"2024-09-05T02:16:59.303250+0000","last_peered":"2024-09-05T02:16:59.303250+0000","last_clean":"2024-09-05T02:16:59.303250+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:16:59.303250+0000","last_undegraded":"2024-09-05T02:16:59.303250+0000","last_fullsized":"2024-09-05T02:16:59.303250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.302762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:13.771230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'165","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.968209+0000","last_change":"2024-09-05T02:16:53.968209+0000","last_active":"2024-09-05T02:16:53.968209+0000","last_peered":"2024-09-05T02:16:53.968209+0000","last_clean":"2024-09-05T02:16:53.968209+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:16:53.968209+0000","last_undegraded":"2024-09-05T02:16:53.968209+0000","last_fullsized":"2024-09-05T02:16:53.968209+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.967993+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:11.198975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'494","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.038028+0000","last_change":"2024-09-05T02:16:41.037772+0000","last_active":"2024-09-05T02:16:41.038028+0000","last_peered":"2024-09-05T02:16:41.038028+0000","last_clean":"2024-09-05T02:16:41.038028+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:16:41.038028+0000","last_undegraded":"2024-09-05T02:16:41.038028+0000","last_fullsized":"2024-09-05T02:16:41.038028+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'494","last_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_deep_scrub":"264'494","last_deep_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.037536+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:37:11.731456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'324","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.561005+0000","last_change":"2024-09-05T02:16:30.560869+0000","last_active":"2024-09-05T02:16:30.561005+0000","last_peered":"2024-09-05T02:16:30.561005+0000","last_clean":"2024-09-05T02:16:30.561005+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:30.561005+0000","last_undegraded":"2024-09-05T02:16:30.561005+0000","last_fullsized":"2024-09-05T02:16:30.561005+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.560663+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:40.454373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":39348,"num_write":968,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.505123+0000","last_change":"2024-09-05T02:16:52.504988+0000","last_active":"2024-09-05T02:16:52.505123+0000","last_peered":"2024-09-05T02:16:52.505123+0000","last_clean":"2024-09-05T02:16:52.505123+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:16:52.505123+0000","last_undegraded":"2024-09-05T02:16:52.505123+0000","last_fullsized":"2024-09-05T02:16:52.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.504809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:12.255051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'326","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.114823+0000","last_change":"2024-09-05T02:16:56.114678+0000","last_active":"2024-09-05T02:16:56.114823+0000","last_peered":"2024-09-05T02:16:56.114823+0000","last_clean":"2024-09-05T02:16:56.114823+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:16:56.114823+0000","last_undegraded":"2024-09-05T02:16:56.114823+0000","last_fullsized":"2024-09-05T02:16:56.114823+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.114479+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:21.147000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":1207,"num_write":432,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.192453+0000","last_change":"2024-09-05T02:16:56.192453+0000","last_active":"2024-09-05T02:16:56.192453+0000","last_peered":"2024-09-05T02:16:56.192453+0000","last_clean":"2024-09-05T02:16:56.192453+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:16:56.192453+0000","last_undegraded":"2024-09-05T02:16:56.192453+0000","last_fullsized":"2024-09-05T02:16:56.192453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.192269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:47:46.160471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'110","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.537213+0000","last_change":"2024-09-05T02:17:02.537213+0000","last_active":"2024-09-05T02:17:02.537213+0000","last_peered":"2024-09-05T02:17:02.537213+0000","last_clean":"2024-09-05T02:17:02.537213+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:17:02.537213+0000","last_undegraded":"2024-09-05T02:17:02.537213+0000","last_fullsized":"2024-09-05T02:17:02.537213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.537031+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:09:20.213705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'326","reported_seq":1650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.800451+0000","last_change":"2024-09-05T02:16:34.800307+0000","last_active":"2024-09-05T02:16:34.800451+0000","last_peered":"2024-09-05T02:16:34.800451+0000","last_clean":"2024-09-05T02:16:34.800451+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:16:34.800451+0000","last_undegraded":"2024-09-05T02:16:34.800451+0000","last_fullsized":"2024-09-05T02:16:34.800451+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.800111+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:39.707710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'405","reported_seq":1114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.365306+0000","last_change":"2024-09-05T02:16:38.365125+0000","last_active":"2024-09-05T02:16:38.365306+0000","last_peered":"2024-09-05T02:16:38.365306+0000","last_clean":"2024-09-05T02:16:38.365306+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:16:38.365306+0000","last_undegraded":"2024-09-05T02:16:38.365306+0000","last_fullsized":"2024-09-05T02:16:38.365306+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.364894+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:52.067211+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642858,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":739,"num_read_kb":25030,"num_write":1256,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.191125+0000","last_change":"2024-09-05T02:16:48.190992+0000","last_active":"2024-09-05T02:16:48.191125+0000","last_peered":"2024-09-05T02:16:48.191125+0000","last_clean":"2024-09-05T02:16:48.191125+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:16:48.191125+0000","last_undegraded":"2024-09-05T02:16:48.191125+0000","last_fullsized":"2024-09-05T02:16:48.191125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.190800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:24:46.556049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'153","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.525793+0000","last_change":"2024-09-05T02:16:58.525793+0000","last_active":"2024-09-05T02:16:58.525793+0000","last_peered":"2024-09-05T02:16:58.525793+0000","last_clean":"2024-09-05T02:16:58.525793+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:16:58.525793+0000","last_undegraded":"2024-09-05T02:16:58.525793+0000","last_fullsized":"2024-09-05T02:16:58.525793+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.525607+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:32:05.887270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'771","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.883984+0000","last_change":"2024-09-05T02:16:50.883737+0000","last_active":"2024-09-05T02:16:50.883984+0000","last_peered":"2024-09-05T02:16:50.883984+0000","last_clean":"2024-09-05T02:16:50.883984+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:50.883984+0000","last_undegraded":"2024-09-05T02:16:50.883984+0000","last_fullsized":"2024-09-05T02:16:50.883984+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.883511+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:56.045690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.820599+0000","last_change":"2024-09-05T02:17:00.820599+0000","last_active":"2024-09-05T02:17:00.820599+0000","last_peered":"2024-09-05T02:17:00.820599+0000","last_clean":"2024-09-05T02:17:00.820599+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:17:00.820599+0000","last_undegraded":"2024-09-05T02:17:00.820599+0000","last_fullsized":"2024-09-05T02:17:00.820599+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.820416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:24.728201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'870","reported_seq":2421,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.444135+0000","last_change":"2024-09-05T02:16:40.444001+0000","last_active":"2024-09-05T02:16:40.444135+0000","last_peered":"2024-09-05T02:16:40.444135+0000","last_clean":"2024-09-05T02:16:40.444135+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:16:40.444135+0000","last_undegraded":"2024-09-05T02:16:40.444135+0000","last_fullsized":"2024-09-05T02:16:40.444135+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.443792+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:41:30.425677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'289","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.482772+0000","last_change":"2024-09-05T02:16:34.482628+0000","last_active":"2024-09-05T02:16:34.482772+0000","last_peered":"2024-09-05T02:16:34.482772+0000","last_clean":"2024-09-05T02:16:34.482772+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:16:34.482772+0000","last_undegraded":"2024-09-05T02:16:34.482772+0000","last_fullsized":"2024-09-05T02:16:34.482772+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.482431+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:08:51.964548+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":6339,"num_write":869,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.956925+0000","last_change":"2024-09-05T02:16:47.956779+0000","last_active":"2024-09-05T02:16:47.956925+0000","last_peered":"2024-09-05T02:16:47.956925+0000","last_clean":"2024-09-05T02:16:47.956925+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:16:47.956925+0000","last_undegraded":"2024-09-05T02:16:47.956925+0000","last_fullsized":"2024-09-05T02:16:47.956925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.956598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:02:38.985311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'393","reported_seq":1044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.534799+0000","last_change":"2024-09-05T02:16:58.534659+0000","last_active":"2024-09-05T02:16:58.534799+0000","last_peered":"2024-09-05T02:16:58.534799+0000","last_clean":"2024-09-05T02:16:58.534799+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:16:58.534799+0000","last_undegraded":"2024-09-05T02:16:58.534799+0000","last_fullsized":"2024-09-05T02:16:58.534799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.534448+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.086187+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47763,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":623,"num_read_kb":1294,"num_write":490,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.199718+0000","last_change":"2024-09-05T02:17:01.199718+0000","last_active":"2024-09-05T02:17:01.199718+0000","last_peered":"2024-09-05T02:17:01.199718+0000","last_clean":"2024-09-05T02:17:01.199718+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:17:01.199718+0000","last_undegraded":"2024-09-05T02:17:01.199718+0000","last_fullsized":"2024-09-05T02:17:01.199718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.199508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:39.811372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'201","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.829744+0000","last_change":"2024-09-05T02:17:02.829744+0000","last_active":"2024-09-05T02:17:02.829744+0000","last_peered":"2024-09-05T02:17:02.829744+0000","last_clean":"2024-09-05T02:17:02.829744+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:17:02.829744+0000","last_undegraded":"2024-09-05T02:17:02.829744+0000","last_fullsized":"2024-09-05T02:17:02.829744+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.829553+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:12.703178+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'736","reported_seq":2533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.487574+0000","last_change":"2024-09-05T02:16:41.487412+0000","last_active":"2024-09-05T02:16:41.487574+0000","last_peered":"2024-09-05T02:16:41.487574+0000","last_clean":"2024-09-05T02:16:41.487574+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:16:41.487574+0000","last_undegraded":"2024-09-05T02:16:41.487574+0000","last_fullsized":"2024-09-05T02:16:41.487574+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'736","last_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_deep_scrub":"264'736","last_deep_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.487221+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:01.507115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1182,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'414","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.532824+0000","last_change":"2024-09-05T02:16:35.532666+0000","last_active":"2024-09-05T02:16:35.532824+0000","last_peered":"2024-09-05T02:16:35.532824+0000","last_clean":"2024-09-05T02:16:35.532824+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:16:35.532824+0000","last_undegraded":"2024-09-05T02:16:35.532824+0000","last_fullsized":"2024-09-05T02:16:35.532824+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.532436+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:12:38.507010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080041,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":137827,"num_write":1317,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"264'4","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.624622+0000","last_change":"2024-09-05T02:16:53.624429+0000","last_active":"2024-09-05T02:16:53.624622+0000","last_peered":"2024-09-05T02:16:53.624622+0000","last_clean":"2024-09-05T02:16:53.624622+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:16:53.624622+0000","last_undegraded":"2024-09-05T02:16:53.624622+0000","last_fullsized":"2024-09-05T02:16:53.624622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.624247+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:06:48.307668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'304","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.262641+0000","last_change":"2024-09-05T02:16:52.262641+0000","last_active":"2024-09-05T02:16:52.262641+0000","last_peered":"2024-09-05T02:16:52.262641+0000","last_clean":"2024-09-05T02:16:52.262641+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:16:52.262641+0000","last_undegraded":"2024-09-05T02:16:52.262641+0000","last_fullsized":"2024-09-05T02:16:52.262641+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.262443+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:39:11.098650+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47523,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":500,"num_read_kb":1144,"num_write":402,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.860529+0000","last_change":"2024-09-05T02:16:49.860353+0000","last_active":"2024-09-05T02:16:49.860529+0000","last_peered":"2024-09-05T02:16:49.860529+0000","last_clean":"2024-09-05T02:16:49.860529+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:16:49.860529+0000","last_undegraded":"2024-09-05T02:16:49.860529+0000","last_fullsized":"2024-09-05T02:16:49.860529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.860160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:40.431987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'112","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:16.492885+0000","last_change":"2024-09-05T00:49:37.948842+0000","last_active":"2024-09-05T02:14:16.492885+0000","last_peered":"2024-09-05T02:14:16.492885+0000","last_clean":"2024-09-05T02:14:16.492885+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:14:16.492885+0000","last_undegraded":"2024-09-05T02:14:16.492885+0000","last_fullsized":"2024-09-05T02:14:16.492885+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T00:49:36.899470+0000","last_clean_scrub_stamp":"2024-09-05T00:49:36.899470+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'476","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.011288+0000","last_change":"2024-09-05T02:16:40.011129+0000","last_active":"2024-09-05T02:16:40.011288+0000","last_peered":"2024-09-05T02:16:40.011288+0000","last_clean":"2024-09-05T02:16:40.011288+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:16:40.011288+0000","last_undegraded":"2024-09-05T02:16:40.011288+0000","last_fullsized":"2024-09-05T02:16:40.011288+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.010943+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:14:00.723241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'319","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.936309+0000","last_change":"2024-09-05T02:16:33.936309+0000","last_active":"2024-09-05T02:16:33.936309+0000","last_peered":"2024-09-05T02:16:33.936309+0000","last_clean":"2024-09-05T02:16:33.936309+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:33.936309+0000","last_undegraded":"2024-09-05T02:16:33.936309+0000","last_fullsized":"2024-09-05T02:16:33.936309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.936126+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:20:49.975373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":12836,"num_write":1013,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.503184+0000","last_change":"2024-09-05T02:16:51.503184+0000","last_active":"2024-09-05T02:16:51.503184+0000","last_peered":"2024-09-05T02:16:51.503184+0000","last_clean":"2024-09-05T02:16:51.503184+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:16:51.503184+0000","last_undegraded":"2024-09-05T02:16:51.503184+0000","last_fullsized":"2024-09-05T02:16:51.503184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.503000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:52.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'268","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.169369+0000","last_change":"2024-09-05T02:16:59.169192+0000","last_active":"2024-09-05T02:16:59.169369+0000","last_peered":"2024-09-05T02:16:59.169369+0000","last_clean":"2024-09-05T02:16:59.169369+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:16:59.169369+0000","last_undegraded":"2024-09-05T02:16:59.169369+0000","last_fullsized":"2024-09-05T02:16:59.169369+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.168997+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:49.788871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47269,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1091,"num_write":358,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.522236+0000","last_change":"2024-09-05T02:17:01.522113+0000","last_active":"2024-09-05T02:17:01.522236+0000","last_peered":"2024-09-05T02:17:01.522236+0000","last_clean":"2024-09-05T02:17:01.522236+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:17:01.522236+0000","last_undegraded":"2024-09-05T02:17:01.522236+0000","last_fullsized":"2024-09-05T02:17:01.522236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.521917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:55.686761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.873479+0000","last_change":"2024-09-05T02:17:01.873479+0000","last_active":"2024-09-05T02:17:01.873479+0000","last_peered":"2024-09-05T02:17:01.873479+0000","last_clean":"2024-09-05T02:17:01.873479+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:17:01.873479+0000","last_undegraded":"2024-09-05T02:17:01.873479+0000","last_fullsized":"2024-09-05T02:17:01.873479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.873172+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:47.785372+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'346","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.488577+0000","last_change":"2024-09-05T02:16:39.488577+0000","last_active":"2024-09-05T02:16:39.488577+0000","last_peered":"2024-09-05T02:16:39.488577+0000","last_clean":"2024-09-05T02:16:39.488577+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:16:39.488577+0000","last_undegraded":"2024-09-05T02:16:39.488577+0000","last_fullsized":"2024-09-05T02:16:39.488577+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.488358+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:26.414847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'356","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.518422+0000","last_change":"2024-09-05T02:16:30.518195+0000","last_active":"2024-09-05T02:16:30.518422+0000","last_peered":"2024-09-05T02:16:30.518422+0000","last_clean":"2024-09-05T02:16:30.518422+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:16:30.518422+0000","last_undegraded":"2024-09-05T02:16:30.518422+0000","last_fullsized":"2024-09-05T02:16:30.518422+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.517946+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:33:37.139871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8860,"num_write":1095,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.170684+0000","last_change":"2024-09-05T02:16:44.170684+0000","last_active":"2024-09-05T02:16:44.170684+0000","last_peered":"2024-09-05T02:16:44.170684+0000","last_clean":"2024-09-05T02:16:44.170684+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:16:44.170684+0000","last_undegraded":"2024-09-05T02:16:44.170684+0000","last_fullsized":"2024-09-05T02:16:44.170684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.170506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:33.236636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'343","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.485820+0000","last_change":"2024-09-05T02:16:55.485686+0000","last_active":"2024-09-05T02:16:55.485820+0000","last_peered":"2024-09-05T02:16:55.485820+0000","last_clean":"2024-09-05T02:16:55.485820+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:16:55.485820+0000","last_undegraded":"2024-09-05T02:16:55.485820+0000","last_fullsized":"2024-09-05T02:16:55.485820+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.485485+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:32.153291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":1162,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.170798+0000","last_change":"2024-09-05T02:17:00.170568+0000","last_active":"2024-09-05T02:17:00.170798+0000","last_peered":"2024-09-05T02:17:00.170798+0000","last_clean":"2024-09-05T02:17:00.170798+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:17:00.170798+0000","last_undegraded":"2024-09-05T02:17:00.170798+0000","last_fullsized":"2024-09-05T02:17:00.170798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.170359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:22:09.289364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'133","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.526116+0000","last_change":"2024-09-05T02:17:02.526116+0000","last_active":"2024-09-05T02:17:02.526116+0000","last_peered":"2024-09-05T02:17:02.526116+0000","last_clean":"2024-09-05T02:17:02.526116+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:17:02.526116+0000","last_undegraded":"2024-09-05T02:17:02.526116+0000","last_fullsized":"2024-09-05T02:17:02.526116+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.525900+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:34.211908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'435","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.163976+0000","last_change":"2024-09-05T02:16:43.163976+0000","last_active":"2024-09-05T02:16:43.163976+0000","last_peered":"2024-09-05T02:16:43.163976+0000","last_clean":"2024-09-05T02:16:43.163976+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:16:43.163976+0000","last_undegraded":"2024-09-05T02:16:43.163976+0000","last_fullsized":"2024-09-05T02:16:43.163976+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.163765+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:41.045947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4549,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'378","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.805267+0000","last_change":"2024-09-05T02:16:32.805135+0000","last_active":"2024-09-05T02:16:32.805267+0000","last_peered":"2024-09-05T02:16:32.805267+0000","last_clean":"2024-09-05T02:16:32.805267+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:32.805267+0000","last_undegraded":"2024-09-05T02:16:32.805267+0000","last_fullsized":"2024-09-05T02:16:32.805267+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.804912+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:04.484010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":487,"num_read_kb":8853,"num_write":1134,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1144","reported_seq":2643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.267542+0000","last_change":"2024-09-05T02:16:37.267542+0000","last_active":"2024-09-05T02:16:37.267542+0000","last_peered":"2024-09-05T02:16:37.267542+0000","last_clean":"2024-09-05T02:16:37.267542+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:16:37.267542+0000","last_undegraded":"2024-09-05T02:16:37.267542+0000","last_fullsized":"2024-09-05T02:16:37.267542+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1144","last_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_deep_scrub":"264'1144","last_deep_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.267346+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:22:33.530651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'332","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.795376+0000","last_change":"2024-09-05T02:16:30.795215+0000","last_active":"2024-09-05T02:16:30.795376+0000","last_peered":"2024-09-05T02:16:30.795376+0000","last_clean":"2024-09-05T02:16:30.795376+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:30.795376+0000","last_undegraded":"2024-09-05T02:16:30.795376+0000","last_fullsized":"2024-09-05T02:16:30.795376+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.794997+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:04:12.891688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":102142,"num_write":1127,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.550350+0000","last_change":"2024-09-05T02:16:47.550350+0000","last_active":"2024-09-05T02:16:47.550350+0000","last_peered":"2024-09-05T02:16:47.550350+0000","last_clean":"2024-09-05T02:16:47.550350+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:16:47.550350+0000","last_undegraded":"2024-09-05T02:16:47.550350+0000","last_fullsized":"2024-09-05T02:16:47.550350+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'694","last_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_deep_scrub":"264'694","last_deep_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.550157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:09.741807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'312","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.519094+0000","last_change":"2024-09-05T02:16:36.518851+0000","last_active":"2024-09-05T02:16:36.519094+0000","last_peered":"2024-09-05T02:16:36.519094+0000","last_clean":"2024-09-05T02:16:36.519094+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:16:36.519094+0000","last_undegraded":"2024-09-05T02:16:36.519094+0000","last_fullsized":"2024-09-05T02:16:36.519094+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.518501+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:55.497838+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":411,"num_write":976,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'418","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.226428+0000","last_change":"2024-09-05T02:16:38.226428+0000","last_active":"2024-09-05T02:16:38.226428+0000","last_peered":"2024-09-05T02:16:38.226428+0000","last_clean":"2024-09-05T02:16:38.226428+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:16:38.226428+0000","last_undegraded":"2024-09-05T02:16:38.226428+0000","last_fullsized":"2024-09-05T02:16:38.226428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.226250+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:52.035389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'318","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.490696+0000","last_change":"2024-09-05T02:16:33.490696+0000","last_active":"2024-09-05T02:16:33.490696+0000","last_peered":"2024-09-05T02:16:33.490696+0000","last_clean":"2024-09-05T02:16:33.490696+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:16:33.490696+0000","last_undegraded":"2024-09-05T02:16:33.490696+0000","last_fullsized":"2024-09-05T02:16:33.490696+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.490479+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:04.157446+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":737,"num_read_kb":8229,"num_write":1002,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1684","reported_seq":3539,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.037729+0000","last_change":"2024-09-05T02:16:42.037729+0000","last_active":"2024-09-05T02:16:42.037729+0000","last_peered":"2024-09-05T02:16:42.037729+0000","last_clean":"2024-09-05T02:16:42.037729+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:16:42.037729+0000","last_undegraded":"2024-09-05T02:16:42.037729+0000","last_fullsized":"2024-09-05T02:16:42.037729+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1684","last_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_deep_scrub":"264'1684","last_deep_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.037537+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":1600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:08.464426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'362","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.923360+0000","last_change":"2024-09-05T02:16:31.923360+0000","last_active":"2024-09-05T02:16:31.923360+0000","last_peered":"2024-09-05T02:16:31.923360+0000","last_clean":"2024-09-05T02:16:31.923360+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:31.923360+0000","last_undegraded":"2024-09-05T02:16:31.923360+0000","last_fullsized":"2024-09-05T02:16:31.923360+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.923168+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:09.796286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":75263,"num_write":1071,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'626","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.513628+0000","last_change":"2024-09-05T02:16:42.513367+0000","last_active":"2024-09-05T02:16:42.513628+0000","last_peered":"2024-09-05T02:16:42.513628+0000","last_clean":"2024-09-05T02:16:42.513628+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:16:42.513628+0000","last_undegraded":"2024-09-05T02:16:42.513628+0000","last_fullsized":"2024-09-05T02:16:42.513628+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.513129+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:25.607651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'360","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.345367+0000","last_change":"2024-09-05T02:16:32.345367+0000","last_active":"2024-09-05T02:16:32.345367+0000","last_peered":"2024-09-05T02:16:32.345367+0000","last_clean":"2024-09-05T02:16:32.345367+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:32.345367+0000","last_undegraded":"2024-09-05T02:16:32.345367+0000","last_fullsized":"2024-09-05T02:16:32.345367+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.345077+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:46.067374+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453457,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":27144,"num_write":1118,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'685","reported_seq":2370,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.065195+0000","last_change":"2024-09-05T02:16:44.065049+0000","last_active":"2024-09-05T02:16:44.065195+0000","last_peered":"2024-09-05T02:16:44.065195+0000","last_clean":"2024-09-05T02:16:44.065195+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:16:44.065195+0000","last_undegraded":"2024-09-05T02:16:44.065195+0000","last_fullsized":"2024-09-05T02:16:44.065195+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.064848+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:18.934798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'376","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.778588+0000","last_change":"2024-09-05T02:16:33.778588+0000","last_active":"2024-09-05T02:16:33.778588+0000","last_peered":"2024-09-05T02:16:33.778588+0000","last_clean":"2024-09-05T02:16:33.778588+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:33.778588+0000","last_undegraded":"2024-09-05T02:16:33.778588+0000","last_fullsized":"2024-09-05T02:16:33.778588+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.778363+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:27.507514+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":588,"num_read_kb":10940,"num_write":1274,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'477","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.912137+0000","last_change":"2024-09-05T02:16:40.911914+0000","last_active":"2024-09-05T02:16:40.912137+0000","last_peered":"2024-09-05T02:16:40.912137+0000","last_clean":"2024-09-05T02:16:40.912137+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:16:40.912137+0000","last_undegraded":"2024-09-05T02:16:40.912137+0000","last_fullsized":"2024-09-05T02:16:40.912137+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.911681+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:52.589997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.936616+0000","last_change":"2024-09-05T02:16:32.936616+0000","last_active":"2024-09-05T02:16:32.936616+0000","last_peered":"2024-09-05T02:16:32.936616+0000","last_clean":"2024-09-05T02:16:32.936616+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:32.936616+0000","last_undegraded":"2024-09-05T02:16:32.936616+0000","last_fullsized":"2024-09-05T02:16:32.936616+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.936402+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:04.969865+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461798,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":29011,"num_write":1195,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1110","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.389653+0000","last_change":"2024-09-05T02:16:37.389653+0000","last_active":"2024-09-05T02:16:37.389653+0000","last_peered":"2024-09-05T02:16:37.389653+0000","last_clean":"2024-09-05T02:16:37.389653+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:16:37.389653+0000","last_undegraded":"2024-09-05T02:16:37.389653+0000","last_fullsized":"2024-09-05T02:16:37.389653+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1110","last_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_deep_scrub":"264'1110","last_deep_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.389478+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:32.651447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'366","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.545413+0000","last_change":"2024-09-05T02:16:37.545413+0000","last_active":"2024-09-05T02:16:37.545413+0000","last_peered":"2024-09-05T02:16:37.545413+0000","last_clean":"2024-09-05T02:16:37.545413+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:16:37.545413+0000","last_undegraded":"2024-09-05T02:16:37.545413+0000","last_fullsized":"2024-09-05T02:16:37.545413+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.545206+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.687864+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":61900,"num_write":1145,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'622","reported_seq":2305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.495551+0000","last_change":"2024-09-05T02:16:44.495551+0000","last_active":"2024-09-05T02:16:44.495551+0000","last_peered":"2024-09-05T02:16:44.495551+0000","last_clean":"2024-09-05T02:16:44.495551+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:16:44.495551+0000","last_undegraded":"2024-09-05T02:16:44.495551+0000","last_fullsized":"2024-09-05T02:16:44.495551+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'622","last_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_deep_scrub":"264'622","last_deep_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.495326+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:02.043865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'350","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.044641+0000","last_change":"2024-09-05T02:16:36.044641+0000","last_active":"2024-09-05T02:16:36.044641+0000","last_peered":"2024-09-05T02:16:36.044641+0000","last_clean":"2024-09-05T02:16:36.044641+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:36.044641+0000","last_undegraded":"2024-09-05T02:16:36.044641+0000","last_fullsized":"2024-09-05T02:16:36.044641+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.044432+0000","objects_scrubbed":13,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:25.636296+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953006,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":484,"num_read_kb":25097,"num_write":1158,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'543","reported_seq":2196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.752884+0000","last_change":"2024-09-05T02:16:35.752884+0000","last_active":"2024-09-05T02:16:35.752884+0000","last_peered":"2024-09-05T02:16:35.752884+0000","last_clean":"2024-09-05T02:16:35.752884+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:16:35.752884+0000","last_undegraded":"2024-09-05T02:16:35.752884+0000","last_fullsized":"2024-09-05T02:16:35.752884+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.752698+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:45.155213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'410","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.779143+0000","last_change":"2024-09-05T02:16:29.779143+0000","last_active":"2024-09-05T02:16:29.779143+0000","last_peered":"2024-09-05T02:16:29.779143+0000","last_clean":"2024-09-05T02:16:29.779143+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:29.779143+0000","last_undegraded":"2024-09-05T02:16:29.779143+0000","last_fullsized":"2024-09-05T02:16:29.779143+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'410","last_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_deep_scrub":"264'410","last_deep_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.778934+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:09.661610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262234,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":5699,"num_write":1247,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1185","reported_seq":2844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.510341+0000","last_change":"2024-09-05T02:16:43.510341+0000","last_active":"2024-09-05T02:16:43.510341+0000","last_peered":"2024-09-05T02:16:43.510341+0000","last_clean":"2024-09-05T02:16:43.510341+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:16:43.510341+0000","last_undegraded":"2024-09-05T02:16:43.510341+0000","last_fullsized":"2024-09-05T02:16:43.510341+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1185","last_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_deep_scrub":"264'1185","last_deep_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.510160+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":1100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:51.275393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'336","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.452295+0000","last_change":"2024-09-05T02:16:36.452295+0000","last_active":"2024-09-05T02:16:36.452295+0000","last_peered":"2024-09-05T02:16:36.452295+0000","last_clean":"2024-09-05T02:16:36.452295+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:16:36.452295+0000","last_undegraded":"2024-09-05T02:16:36.452295+0000","last_fullsized":"2024-09-05T02:16:36.452295+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.451991+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:44.484998+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":5076,"num_write":1193,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'491","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.060842+0000","last_change":"2024-09-05T02:16:43.060842+0000","last_active":"2024-09-05T02:16:43.060842+0000","last_peered":"2024-09-05T02:16:43.060842+0000","last_clean":"2024-09-05T02:16:43.060842+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:16:43.060842+0000","last_undegraded":"2024-09-05T02:16:43.060842+0000","last_fullsized":"2024-09-05T02:16:43.060842+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'491","last_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_deep_scrub":"264'491","last_deep_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.060647+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.428329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'374","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.790296+0000","last_change":"2024-09-05T02:16:34.790296+0000","last_active":"2024-09-05T02:16:34.790296+0000","last_peered":"2024-09-05T02:16:34.790296+0000","last_clean":"2024-09-05T02:16:34.790296+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:34.790296+0000","last_undegraded":"2024-09-05T02:16:34.790296+0000","last_fullsized":"2024-09-05T02:16:34.790296+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'374","last_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_deep_scrub":"264'374","last_deep_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.790058+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:13.589152+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":31375,"num_write":1285,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'688","reported_seq":2241,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.444760+0000","last_change":"2024-09-05T02:16:34.444760+0000","last_active":"2024-09-05T02:16:34.444760+0000","last_peered":"2024-09-05T02:16:34.444760+0000","last_clean":"2024-09-05T02:16:34.444760+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:16:34.444760+0000","last_undegraded":"2024-09-05T02:16:34.444760+0000","last_fullsized":"2024-09-05T02:16:34.444760+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'688","last_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_deep_scrub":"264'688","last_deep_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.444577+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:27.270344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'349","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.051570+0000","last_change":"2024-09-05T02:16:39.051570+0000","last_active":"2024-09-05T02:16:39.051570+0000","last_peered":"2024-09-05T02:16:39.051570+0000","last_clean":"2024-09-05T02:16:39.051570+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:39.051570+0000","last_undegraded":"2024-09-05T02:16:39.051570+0000","last_fullsized":"2024-09-05T02:16:39.051570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.051218+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:07.873190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":11105,"num_write":1131,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'524","reported_seq":2133,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.037635+0000","last_change":"2024-09-05T02:16:43.037635+0000","last_active":"2024-09-05T02:16:43.037635+0000","last_peered":"2024-09-05T02:16:43.037635+0000","last_clean":"2024-09-05T02:16:43.037635+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:16:43.037635+0000","last_undegraded":"2024-09-05T02:16:43.037635+0000","last_fullsized":"2024-09-05T02:16:43.037635+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'524","last_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_deep_scrub":"264'524","last_deep_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.037438+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:01.180965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'332","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.770992+0000","last_change":"2024-09-05T02:16:31.770992+0000","last_active":"2024-09-05T02:16:31.770992+0000","last_peered":"2024-09-05T02:16:31.770992+0000","last_clean":"2024-09-05T02:16:31.770992+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:31.770992+0000","last_undegraded":"2024-09-05T02:16:31.770992+0000","last_fullsized":"2024-09-05T02:16:31.770992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.770780+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:08.517290+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":115088,"num_write":1048,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.964444+0000","last_change":"2024-09-05T02:16:44.964444+0000","last_active":"2024-09-05T02:16:44.964444+0000","last_peered":"2024-09-05T02:16:44.964444+0000","last_clean":"2024-09-05T02:16:44.964444+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:16:44.964444+0000","last_undegraded":"2024-09-05T02:16:44.964444+0000","last_fullsized":"2024-09-05T02:16:44.964444+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.964260+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:25.779977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'313","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.588790+0000","last_change":"2024-09-05T02:16:38.588790+0000","last_active":"2024-09-05T02:16:38.588790+0000","last_peered":"2024-09-05T02:16:38.588790+0000","last_clean":"2024-09-05T02:16:38.588790+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:16:38.588790+0000","last_undegraded":"2024-09-05T02:16:38.588790+0000","last_fullsized":"2024-09-05T02:16:38.588790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.588599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:12.567380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":641,"num_write":1040,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'421","reported_seq":1128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.547611+0000","last_change":"2024-09-05T02:16:40.547611+0000","last_active":"2024-09-05T02:16:40.547611+0000","last_peered":"2024-09-05T02:16:40.547611+0000","last_clean":"2024-09-05T02:16:40.547611+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:16:40.547611+0000","last_undegraded":"2024-09-05T02:16:40.547611+0000","last_fullsized":"2024-09-05T02:16:40.547611+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.547395+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:27.409142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":738,"num_read_kb":35471,"num_write":1283,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'408","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.357291+0000","last_change":"2024-09-05T02:16:39.357127+0000","last_active":"2024-09-05T02:16:39.357291+0000","last_peered":"2024-09-05T02:16:39.357291+0000","last_clean":"2024-09-05T02:16:39.357291+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:16:39.357291+0000","last_undegraded":"2024-09-05T02:16:39.357291+0000","last_fullsized":"2024-09-05T02:16:39.357291+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.356925+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:00.382840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2486,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'378","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.318136+0000","last_change":"2024-09-05T02:16:33.318136+0000","last_active":"2024-09-05T02:16:33.318136+0000","last_peered":"2024-09-05T02:16:33.318136+0000","last_clean":"2024-09-05T02:16:33.318136+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:33.318136+0000","last_undegraded":"2024-09-05T02:16:33.318136+0000","last_fullsized":"2024-09-05T02:16:33.318136+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.317918+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:08.472687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":26073,"num_write":1194,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'875","reported_seq":2446,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.477942+0000","last_change":"2024-09-05T02:16:45.477942+0000","last_active":"2024-09-05T02:16:45.477942+0000","last_peered":"2024-09-05T02:16:45.477942+0000","last_clean":"2024-09-05T02:16:45.477942+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:16:45.477942+0000","last_undegraded":"2024-09-05T02:16:45.477942+0000","last_fullsized":"2024-09-05T02:16:45.477942+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.477756+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:50:07.361494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1021,"ondisk_log_size":1021,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1844,"ondisk_log_size":1844,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1550994,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19804,"num_read_kb":40130,"num_write":16519,"num_write_kb":12075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675288,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1951,"ondisk_log_size":1951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43016,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66708448,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36139,"num_read_kb":2043809,"num_write":71843,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134676480,"data_stored":133416896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3567,"ondisk_log_size":3567,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174352,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174298,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510502,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285436,"kb_used_data":23788,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94086404,"statfs":{"total":96636764160,"available":96344477696,"internally_reserved":0,"allocated":24358912,"data_stored":22640434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510501,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221484,"kb_used_data":13980,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94150356,"statfs":{"total":96636764160,"available":96409964544,"internally_reserved":0,"allocated":14315520,"data_stored":12734941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510498,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120456,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94251384,"statfs":{"total":96636764160,"available":96513417216,"internally_reserved":0,"allocated":31711232,"data_stored":30061356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510502,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":35928,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":36790272,"data_stored":35092545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510500,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103096,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94268744,"statfs":{"total":96636764160,"available":96531193856,"internally_reserved":0,"allocated":9740288,"data_stored":8176150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510501,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149928,"kb_used_data":10520,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94221912,"statfs":{"total":96636764160,"available":96483237888,"internally_reserved":0,"allocated":10772480,"data_stored":9180748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543205,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150792,"kb_used_data":16952,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94221048,"statfs":{"total":96636764160,"available":96482353152,"internally_reserved":0,"allocated":17358848,"data_stored":15590745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543206,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271424,"kb_used_data":19568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100416,"statfs":{"total":96636764160,"available":96358825984,"internally_reserved":0,"allocated":20037632,"data_stored":18279783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15736832,"data_stored":15540753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":7036545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6131712,"data_stored":6032468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33136640,"data_stored":32946939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28102656,"data_stored":27918588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":13446327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":10591792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20078592,"data_stored":19903484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:17:10.866 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.866 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.867 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.868 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.869 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.870 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.871 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.872 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.873 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-05T01:05:06.059919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=5, tm_sec=6, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.874 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.875 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-05T01:09:21.142155+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=21, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.876 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.877 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-05T01:09:25.254935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=9, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.879 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.879 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-05T00:49:36.899470+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=0, tm_min=49, tm_sec=36, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:10.880 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T02:17:30.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:17:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:17:31.259 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:17:31.266 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2906,"stamp":"2024-09-05T02:17:30.553674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68867067,"num_objects":856,"num_object_clones":0,"num_object_copies":1712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":856,"num_whiteouts":0,"num_read":292554,"num_read_kb":2648548,"num_write":162836,"num_write_kb":2503589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727936,"num_omap_keys":1784,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13541,"ondisk_log_size":13541,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1600128,"kb_used_data":161216,"kb_used_omap":12,"kb_used_meta":1438771,"kb_avail":753374592,"statfs":{"total":773094113280,"available":771455582208,"internally_reserved":0,"allocated":165085184,"data_stored":151756702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1473302064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008156"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.586222+0000","last_change":"2024-09-05T02:17:15.586222+0000","last_active":"2024-09-05T02:17:15.586222+0000","last_peered":"2024-09-05T02:17:15.586222+0000","last_clean":"2024-09-05T02:17:15.586222+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:17:15.586222+0000","last_undegraded":"2024-09-05T02:17:15.586222+0000","last_fullsized":"2024-09-05T02:17:15.586222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:15.586006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:15.586006+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.586006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:36.857545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.642450+0000","last_change":"2024-09-05T02:17:13.642450+0000","last_active":"2024-09-05T02:17:13.642450+0000","last_peered":"2024-09-05T02:17:13.642450+0000","last_clean":"2024-09-05T02:17:13.642450+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:17:13.642450+0000","last_undegraded":"2024-09-05T02:17:13.642450+0000","last_fullsized":"2024-09-05T02:17:13.642450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.642267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.642267+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.642267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:58.045503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'8","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.167962+0000","last_change":"2024-09-05T02:17:17.167962+0000","last_active":"2024-09-05T02:17:17.167962+0000","last_peered":"2024-09-05T02:17:17.167962+0000","last_clean":"2024-09-05T02:17:17.167962+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:17:17.167962+0000","last_undegraded":"2024-09-05T02:17:17.167962+0000","last_fullsized":"2024-09-05T02:17:17.167962+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:17.167782+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:17.167782+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.167782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:05:11.423168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.346952+0000","last_change":"2024-09-05T02:17:13.346952+0000","last_active":"2024-09-05T02:17:13.346952+0000","last_peered":"2024-09-05T02:17:13.346952+0000","last_clean":"2024-09-05T02:17:13.346952+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:17:13.346952+0000","last_undegraded":"2024-09-05T02:17:13.346952+0000","last_fullsized":"2024-09-05T02:17:13.346952+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-05T02:17:13.346771+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-05T02:17:13.346771+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.346771+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:43.772880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.728112+0000","last_change":"2024-09-05T02:16:57.728112+0000","last_active":"2024-09-05T02:16:57.728112+0000","last_peered":"2024-09-05T02:16:57.728112+0000","last_clean":"2024-09-05T02:16:57.728112+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:16:57.728112+0000","last_undegraded":"2024-09-05T02:16:57.728112+0000","last_fullsized":"2024-09-05T02:16:57.728112+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.727939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:18.941355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.409189+0000","last_change":"2024-09-05T02:17:16.409189+0000","last_active":"2024-09-05T02:17:16.409189+0000","last_peered":"2024-09-05T02:17:16.409189+0000","last_clean":"2024-09-05T02:17:16.409189+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:17:16.409189+0000","last_undegraded":"2024-09-05T02:17:16.409189+0000","last_fullsized":"2024-09-05T02:17:16.409189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:16.409003+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:16.409003+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.409003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:12.597151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.338018+0000","last_change":"2024-09-05T02:17:03.338018+0000","last_active":"2024-09-05T02:17:03.338018+0000","last_peered":"2024-09-05T02:17:03.338018+0000","last_clean":"2024-09-05T02:17:03.338018+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:17:03.338018+0000","last_undegraded":"2024-09-05T02:17:03.338018+0000","last_fullsized":"2024-09-05T02:17:03.338018+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.337834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:07.730190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.717095+0000","last_change":"2024-09-05T02:16:49.716953+0000","last_active":"2024-09-05T02:16:49.717095+0000","last_peered":"2024-09-05T02:16:49.717095+0000","last_clean":"2024-09-05T02:16:49.717095+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:16:49.717095+0000","last_undegraded":"2024-09-05T02:16:49.717095+0000","last_fullsized":"2024-09-05T02:16:49.717095+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.716771+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:00.343321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.194130+0000","last_change":"2024-09-05T02:17:07.194130+0000","last_active":"2024-09-05T02:17:07.194130+0000","last_peered":"2024-09-05T02:17:07.194130+0000","last_clean":"2024-09-05T02:17:07.194130+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:17:07.194130+0000","last_undegraded":"2024-09-05T02:17:07.194130+0000","last_fullsized":"2024-09-05T02:17:07.194130+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:07.193950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:07.193950+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.193950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:06.859491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.414593+0000","last_change":"2024-09-05T02:17:20.414593+0000","last_active":"2024-09-05T02:17:20.414593+0000","last_peered":"2024-09-05T02:17:20.414593+0000","last_clean":"2024-09-05T02:17:20.414593+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:17:20.414593+0000","last_undegraded":"2024-09-05T02:17:20.414593+0000","last_fullsized":"2024-09-05T02:17:20.414593+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:17:20.414408+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:17:20.414408+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.414408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:13.162364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":53,"num_write":4,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.795230+0000","last_change":"2024-09-05T02:16:55.795230+0000","last_active":"2024-09-05T02:16:55.795230+0000","last_peered":"2024-09-05T02:16:55.795230+0000","last_clean":"2024-09-05T02:16:55.795230+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:16:55.795230+0000","last_undegraded":"2024-09-05T02:16:55.795230+0000","last_fullsized":"2024-09-05T02:16:55.795230+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.795045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:42:15.586272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.419370+0000","last_change":"2024-09-05T02:17:10.419370+0000","last_active":"2024-09-05T02:17:10.419370+0000","last_peered":"2024-09-05T02:17:10.419370+0000","last_clean":"2024-09-05T02:17:10.419370+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:17:10.419370+0000","last_undegraded":"2024-09-05T02:17:10.419370+0000","last_fullsized":"2024-09-05T02:17:10.419370+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.419204+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:14:09.371937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:56.488984+0000","last_change":"2024-09-05T01:30:15.668600+0000","last_active":"2024-09-05T02:13:56.488984+0000","last_peered":"2024-09-05T02:13:56.488984+0000","last_clean":"2024-09-05T02:13:56.488984+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:13:56.488984+0000","last_undegraded":"2024-09-05T02:13:56.488984+0000","last_fullsized":"2024-09-05T02:13:56.488984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:33:17.035438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.224589+0000","last_change":"2024-09-05T02:17:24.224589+0000","last_active":"2024-09-05T02:17:24.224589+0000","last_peered":"2024-09-05T02:17:24.224589+0000","last_clean":"2024-09-05T02:17:24.224589+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:17:24.224589+0000","last_undegraded":"2024-09-05T02:17:24.224589+0000","last_fullsized":"2024-09-05T02:17:24.224589+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-05T02:17:24.224397+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-05T02:17:24.224397+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.224397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:01.179980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.408483+0000","last_change":"2024-09-05T02:17:11.408483+0000","last_active":"2024-09-05T02:17:11.408483+0000","last_peered":"2024-09-05T02:17:11.408483+0000","last_clean":"2024-09-05T02:17:11.408483+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:17:11.408483+0000","last_undegraded":"2024-09-05T02:17:11.408483+0000","last_fullsized":"2024-09-05T02:17:11.408483+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:11.408291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:11.408291+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.408291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:39.451154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.175425+0000","last_change":"2024-09-05T02:17:14.175425+0000","last_active":"2024-09-05T02:17:14.175425+0000","last_peered":"2024-09-05T02:17:14.175425+0000","last_clean":"2024-09-05T02:17:14.175425+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:17:14.175425+0000","last_undegraded":"2024-09-05T02:17:14.175425+0000","last_fullsized":"2024-09-05T02:17:14.175425+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-05T02:17:14.175238+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-05T02:17:14.175238+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.175238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:10.537670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:14:26.495387+0000","last_change":"2024-09-05T01:30:15.666179+0000","last_active":"2024-09-05T02:14:26.495387+0000","last_peered":"2024-09-05T02:14:26.495387+0000","last_clean":"2024-09-05T02:14:26.495387+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:14:26.495387+0000","last_undegraded":"2024-09-05T02:14:26.495387+0000","last_fullsized":"2024-09-05T02:14:26.495387+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:42.013641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'9","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.629392+0000","last_change":"2024-09-05T02:17:11.629251+0000","last_active":"2024-09-05T02:17:11.629392+0000","last_peered":"2024-09-05T02:17:11.629392+0000","last_clean":"2024-09-05T02:17:11.629392+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:17:11.629392+0000","last_undegraded":"2024-09-05T02:17:11.629392+0000","last_fullsized":"2024-09-05T02:17:11.629392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:11.629055+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:11.629055+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.629055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:47.522659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":22528,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.438067+0000","last_change":"2024-09-05T02:17:16.438067+0000","last_active":"2024-09-05T02:17:16.438067+0000","last_peered":"2024-09-05T02:17:16.438067+0000","last_clean":"2024-09-05T02:17:16.438067+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:17:16.438067+0000","last_undegraded":"2024-09-05T02:17:16.438067+0000","last_fullsized":"2024-09-05T02:17:16.438067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.437893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.437893+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.437893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.038786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'83","reported_seq":363,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.187986+0000","last_change":"2024-09-05T02:17:13.187986+0000","last_active":"2024-09-05T02:17:13.187986+0000","last_peered":"2024-09-05T02:17:13.187986+0000","last_clean":"2024-09-05T02:17:13.187986+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:17:13.187986+0000","last_undegraded":"2024-09-05T02:17:13.187986+0000","last_fullsized":"2024-09-05T02:17:13.187986+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-05T02:17:13.187794+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-05T02:17:13.187794+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.187794+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:03:10.510308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.414606+0000","last_change":"2024-09-05T02:17:10.414606+0000","last_active":"2024-09-05T02:17:10.414606+0000","last_peered":"2024-09-05T02:17:10.414606+0000","last_clean":"2024-09-05T02:17:10.414606+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:17:10.414606+0000","last_undegraded":"2024-09-05T02:17:10.414606+0000","last_fullsized":"2024-09-05T02:17:10.414606+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.414408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.414408+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.414408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:47.837044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.172642+0000","last_change":"2024-09-05T02:17:04.172386+0000","last_active":"2024-09-05T02:17:04.172642+0000","last_peered":"2024-09-05T02:17:04.172642+0000","last_clean":"2024-09-05T02:17:04.172642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:17:04.172642+0000","last_undegraded":"2024-09-05T02:17:04.172642+0000","last_fullsized":"2024-09-05T02:17:04.172642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.172168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:25.385664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.436721+0000","last_change":"2024-09-05T02:17:09.436523+0000","last_active":"2024-09-05T02:17:09.436721+0000","last_peered":"2024-09-05T02:17:09.436721+0000","last_clean":"2024-09-05T02:17:09.436721+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:17:09.436721+0000","last_undegraded":"2024-09-05T02:17:09.436721+0000","last_fullsized":"2024-09-05T02:17:09.436721+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:09.436341+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:09.436341+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.436341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:32.438055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.054295+0000","last_change":"2024-09-05T02:16:59.054295+0000","last_active":"2024-09-05T02:16:59.054295+0000","last_peered":"2024-09-05T02:16:59.054295+0000","last_clean":"2024-09-05T02:16:59.054295+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:16:59.054295+0000","last_undegraded":"2024-09-05T02:16:59.054295+0000","last_fullsized":"2024-09-05T02:16:59.054295+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.053968+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:36.825922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.918565+0000","last_change":"2024-09-05T02:17:24.918565+0000","last_active":"2024-09-05T02:17:24.918565+0000","last_peered":"2024-09-05T02:17:24.918565+0000","last_clean":"2024-09-05T02:17:24.918565+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:17:24.918565+0000","last_undegraded":"2024-09-05T02:17:24.918565+0000","last_fullsized":"2024-09-05T02:17:24.918565+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:24.918352+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:24.918352+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.918352+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:43:39.242996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.215417+0000","last_change":"2024-09-05T02:17:05.215417+0000","last_active":"2024-09-05T02:17:05.215417+0000","last_peered":"2024-09-05T02:17:05.215417+0000","last_clean":"2024-09-05T02:17:05.215417+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:17:05.215417+0000","last_undegraded":"2024-09-05T02:17:05.215417+0000","last_fullsized":"2024-09-05T02:17:05.215417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.215205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:38.050614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.441926+0000","last_change":"2024-09-05T02:17:10.441926+0000","last_active":"2024-09-05T02:17:10.441926+0000","last_peered":"2024-09-05T02:17:10.441926+0000","last_clean":"2024-09-05T02:17:10.441926+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:17:10.441926+0000","last_undegraded":"2024-09-05T02:17:10.441926+0000","last_fullsized":"2024-09-05T02:17:10.441926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.441721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.441721+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.441721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:54.348907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.376977+0000","last_change":"2024-09-05T02:17:09.376977+0000","last_active":"2024-09-05T02:17:09.376977+0000","last_peered":"2024-09-05T02:17:09.376977+0000","last_clean":"2024-09-05T02:17:09.376977+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:17:09.376977+0000","last_undegraded":"2024-09-05T02:17:09.376977+0000","last_fullsized":"2024-09-05T02:17:09.376977+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.376801+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:37.688382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.867144+0000","last_change":"2024-09-05T02:17:25.867144+0000","last_active":"2024-09-05T02:17:25.867144+0000","last_peered":"2024-09-05T02:17:25.867144+0000","last_clean":"2024-09-05T02:17:25.867144+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:17:25.867144+0000","last_undegraded":"2024-09-05T02:17:25.867144+0000","last_fullsized":"2024-09-05T02:17:25.867144+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.866861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.866861+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.866861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:13.452320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:26.249942+0000","last_change":"2024-09-05T02:17:26.249942+0000","last_active":"2024-09-05T02:17:26.249942+0000","last_peered":"2024-09-05T02:17:26.249942+0000","last_clean":"2024-09-05T02:17:26.249942+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:17:26.249942+0000","last_undegraded":"2024-09-05T02:17:26.249942+0000","last_fullsized":"2024-09-05T02:17:26.249942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:26.249748+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:26.249748+0000","last_clean_scrub_stamp":"2024-09-05T02:17:26.249748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:31:45.121481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.428645+0000","last_change":"2024-09-05T02:17:18.428645+0000","last_active":"2024-09-05T02:17:18.428645+0000","last_peered":"2024-09-05T02:17:18.428645+0000","last_clean":"2024-09-05T02:17:18.428645+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:17:18.428645+0000","last_undegraded":"2024-09-05T02:17:18.428645+0000","last_fullsized":"2024-09-05T02:17:18.428645+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:18.428458+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:18.428458+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.428458+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:34:42.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":23604,"num_write":14,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.239705+0000","last_change":"2024-09-05T02:16:57.239705+0000","last_active":"2024-09-05T02:16:57.239705+0000","last_peered":"2024-09-05T02:16:57.239705+0000","last_clean":"2024-09-05T02:16:57.239705+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:16:57.239705+0000","last_undegraded":"2024-09-05T02:16:57.239705+0000","last_fullsized":"2024-09-05T02:16:57.239705+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.239525+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:44.031261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.380425+0000","last_change":"2024-09-05T02:17:08.380425+0000","last_active":"2024-09-05T02:17:08.380425+0000","last_peered":"2024-09-05T02:17:08.380425+0000","last_clean":"2024-09-05T02:17:08.380425+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:17:08.380425+0000","last_undegraded":"2024-09-05T02:17:08.380425+0000","last_fullsized":"2024-09-05T02:17:08.380425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:08.380201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:08.380201+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.380201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:10.596628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.236687+0000","last_change":"2024-09-05T02:17:22.236687+0000","last_active":"2024-09-05T02:17:22.236687+0000","last_peered":"2024-09-05T02:17:22.236687+0000","last_clean":"2024-09-05T02:17:22.236687+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:17:22.236687+0000","last_undegraded":"2024-09-05T02:17:22.236687+0000","last_fullsized":"2024-09-05T02:17:22.236687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-05T02:17:22.236456+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-05T02:17:22.236456+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.236456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.669166+0000","last_change":"2024-09-05T02:17:12.669027+0000","last_active":"2024-09-05T02:17:12.669166+0000","last_peered":"2024-09-05T02:17:12.669166+0000","last_clean":"2024-09-05T02:17:12.669166+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:17:12.669166+0000","last_undegraded":"2024-09-05T02:17:12.669166+0000","last_fullsized":"2024-09-05T02:17:12.669166+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:12.668836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:12.668836+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.668836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:47:12.036044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.382188+0000","last_change":"2024-09-05T02:17:11.382188+0000","last_active":"2024-09-05T02:17:11.382188+0000","last_peered":"2024-09-05T02:17:11.382188+0000","last_clean":"2024-09-05T02:17:11.382188+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:17:11.382188+0000","last_undegraded":"2024-09-05T02:17:11.382188+0000","last_fullsized":"2024-09-05T02:17:11.382188+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-05T02:17:11.382012+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-05T02:17:11.382012+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.382012+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:00.703296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.759428+0000","last_change":"2024-09-05T02:16:58.759428+0000","last_active":"2024-09-05T02:16:58.759428+0000","last_peered":"2024-09-05T02:16:58.759428+0000","last_clean":"2024-09-05T02:16:58.759428+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:16:58.759428+0000","last_undegraded":"2024-09-05T02:16:58.759428+0000","last_fullsized":"2024-09-05T02:16:58.759428+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.759204+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:12.620338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'10","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.223140+0000","last_change":"2024-09-05T02:17:21.222865+0000","last_active":"2024-09-05T02:17:21.223140+0000","last_peered":"2024-09-05T02:17:21.223140+0000","last_clean":"2024-09-05T02:17:21.223140+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:17:21.223140+0000","last_undegraded":"2024-09-05T02:17:21.223140+0000","last_fullsized":"2024-09-05T02:17:21.223140+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-05T02:17:21.222647+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-05T02:17:21.222647+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.222647+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:29.043695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28674,"num_write":15,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.835841+0000","last_change":"2024-09-05T02:17:13.835841+0000","last_active":"2024-09-05T02:17:13.835841+0000","last_peered":"2024-09-05T02:17:13.835841+0000","last_clean":"2024-09-05T02:17:13.835841+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:17:13.835841+0000","last_undegraded":"2024-09-05T02:17:13.835841+0000","last_fullsized":"2024-09-05T02:17:13.835841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.835635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.835635+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.835635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:02.090975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.233245+0000","last_change":"2024-09-05T02:17:12.233245+0000","last_active":"2024-09-05T02:17:12.233245+0000","last_peered":"2024-09-05T02:17:12.233245+0000","last_clean":"2024-09-05T02:17:12.233245+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:17:12.233245+0000","last_undegraded":"2024-09-05T02:17:12.233245+0000","last_fullsized":"2024-09-05T02:17:12.233245+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-05T02:17:12.233061+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-05T02:17:12.233061+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.233061+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:54.922850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.921614+0000","last_change":"2024-09-05T02:17:23.921614+0000","last_active":"2024-09-05T02:17:23.921614+0000","last_peered":"2024-09-05T02:17:23.921614+0000","last_clean":"2024-09-05T02:17:23.921614+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:17:23.921614+0000","last_undegraded":"2024-09-05T02:17:23.921614+0000","last_fullsized":"2024-09-05T02:17:23.921614+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.921423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.921423+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.921423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:03.013268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.198430+0000","last_change":"2024-09-05T02:17:23.198430+0000","last_active":"2024-09-05T02:17:23.198430+0000","last_peered":"2024-09-05T02:17:23.198430+0000","last_clean":"2024-09-05T02:17:23.198430+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:17:23.198430+0000","last_undegraded":"2024-09-05T02:17:23.198430+0000","last_fullsized":"2024-09-05T02:17:23.198430+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.198245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.198245+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.198245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:19:01.252673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.759403+0000","last_change":"2024-09-05T02:16:51.759263+0000","last_active":"2024-09-05T02:16:51.759403+0000","last_peered":"2024-09-05T02:16:51.759403+0000","last_clean":"2024-09-05T02:16:51.759403+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:16:51.759403+0000","last_undegraded":"2024-09-05T02:16:51.759403+0000","last_fullsized":"2024-09-05T02:16:51.759403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.759077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:34.310502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.731755+0000","last_change":"2024-09-05T02:16:50.731755+0000","last_active":"2024-09-05T02:16:50.731755+0000","last_peered":"2024-09-05T02:16:50.731755+0000","last_clean":"2024-09-05T02:16:50.731755+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:16:50.731755+0000","last_undegraded":"2024-09-05T02:16:50.731755+0000","last_fullsized":"2024-09-05T02:16:50.731755+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.731551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:35:18.587423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.591984+0000","last_change":"2024-09-05T02:17:16.591984+0000","last_active":"2024-09-05T02:17:16.591984+0000","last_peered":"2024-09-05T02:17:16.591984+0000","last_clean":"2024-09-05T02:17:16.591984+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:17:16.591984+0000","last_undegraded":"2024-09-05T02:17:16.591984+0000","last_fullsized":"2024-09-05T02:17:16.591984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.591806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.591806+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.591806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:31:59.637744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.411861+0000","last_change":"2024-09-05T02:17:15.411861+0000","last_active":"2024-09-05T02:17:15.411861+0000","last_peered":"2024-09-05T02:17:15.411861+0000","last_clean":"2024-09-05T02:17:15.411861+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:17:15.411861+0000","last_undegraded":"2024-09-05T02:17:15.411861+0000","last_fullsized":"2024-09-05T02:17:15.411861+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:15.411653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:15.411653+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.411653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:21:44.133238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.410669+0000","last_change":"2024-09-05T02:17:17.410669+0000","last_active":"2024-09-05T02:17:17.410669+0000","last_peered":"2024-09-05T02:17:17.410669+0000","last_clean":"2024-09-05T02:17:17.410669+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:17:17.410669+0000","last_undegraded":"2024-09-05T02:17:17.410669+0000","last_fullsized":"2024-09-05T02:17:17.410669+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:17.410475+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:17.410475+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.410475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:06:28.023340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":160,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.839721+0000","last_change":"2024-09-05T02:17:07.839721+0000","last_active":"2024-09-05T02:17:07.839721+0000","last_peered":"2024-09-05T02:17:07.839721+0000","last_clean":"2024-09-05T02:17:07.839721+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:17:07.839721+0000","last_undegraded":"2024-09-05T02:17:07.839721+0000","last_fullsized":"2024-09-05T02:17:07.839721+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-05T02:17:07.839528+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-05T02:17:07.839528+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.839528+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:29:24.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486844+0000","last_change":"2024-09-05T01:30:15.665584+0000","last_active":"2024-09-05T02:13:46.486844+0000","last_peered":"2024-09-05T02:13:46.486844+0000","last_clean":"2024-09-05T02:13:46.486844+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:13:46.486844+0000","last_undegraded":"2024-09-05T02:13:46.486844+0000","last_fullsized":"2024-09-05T02:13:46.486844+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:26.977420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.430192+0000","last_change":"2024-09-05T02:17:09.430192+0000","last_active":"2024-09-05T02:17:09.430192+0000","last_peered":"2024-09-05T02:17:09.430192+0000","last_clean":"2024-09-05T02:17:09.430192+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:17:09.430192+0000","last_undegraded":"2024-09-05T02:17:09.430192+0000","last_fullsized":"2024-09-05T02:17:09.430192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:09.430004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:09.430004+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.430004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:18.621474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.573211+0000","last_change":"2024-09-05T02:17:06.573211+0000","last_active":"2024-09-05T02:17:06.573211+0000","last_peered":"2024-09-05T02:17:06.573211+0000","last_clean":"2024-09-05T02:17:06.573211+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:17:06.573211+0000","last_undegraded":"2024-09-05T02:17:06.573211+0000","last_fullsized":"2024-09-05T02:17:06.573211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:06.573024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:06.573024+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.573024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:41.082783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.877547+0000","last_change":"2024-09-05T02:17:06.877374+0000","last_active":"2024-09-05T02:17:06.877547+0000","last_peered":"2024-09-05T02:17:06.877547+0000","last_clean":"2024-09-05T02:17:06.877547+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:17:06.877547+0000","last_undegraded":"2024-09-05T02:17:06.877547+0000","last_fullsized":"2024-09-05T02:17:06.877547+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-05T02:17:06.877190+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-05T02:17:06.877190+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.877190+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:01.895449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.403067+0000","last_change":"2024-09-05T02:17:25.403067+0000","last_active":"2024-09-05T02:17:25.403067+0000","last_peered":"2024-09-05T02:17:25.403067+0000","last_clean":"2024-09-05T02:17:25.403067+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:17:25.403067+0000","last_undegraded":"2024-09-05T02:17:25.403067+0000","last_fullsized":"2024-09-05T02:17:25.403067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.402888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.402888+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.402888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:16:46.216426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.316513+0000","last_change":"2024-09-05T02:17:06.316376+0000","last_active":"2024-09-05T02:17:06.316513+0000","last_peered":"2024-09-05T02:17:06.316513+0000","last_clean":"2024-09-05T02:17:06.316513+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:17:06.316513+0000","last_undegraded":"2024-09-05T02:17:06.316513+0000","last_fullsized":"2024-09-05T02:17:06.316513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.316187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:15.545632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'5","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.184092+0000","last_change":"2024-09-05T02:17:15.184092+0000","last_active":"2024-09-05T02:17:15.184092+0000","last_peered":"2024-09-05T02:17:15.184092+0000","last_clean":"2024-09-05T02:17:15.184092+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:17:15.184092+0000","last_undegraded":"2024-09-05T02:17:15.184092+0000","last_fullsized":"2024-09-05T02:17:15.184092+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-05T02:17:15.183920+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-05T02:17:15.183920+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.183920+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:51.742695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'117","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.337782+0000","last_change":"2024-09-05T02:17:08.337648+0000","last_active":"2024-09-05T02:17:08.337782+0000","last_peered":"2024-09-05T02:17:08.337782+0000","last_clean":"2024-09-05T02:17:08.337782+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:17:08.337782+0000","last_undegraded":"2024-09-05T02:17:08.337782+0000","last_fullsized":"2024-09-05T02:17:08.337782+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.337473+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:56.312725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:26.449188+0000","last_change":"2024-09-05T02:17:26.449188+0000","last_active":"2024-09-05T02:17:26.449188+0000","last_peered":"2024-09-05T02:17:26.449188+0000","last_clean":"2024-09-05T02:17:26.449188+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:17:26.449188+0000","last_undegraded":"2024-09-05T02:17:26.449188+0000","last_fullsized":"2024-09-05T02:17:26.449188+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:26.448986+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:26.448986+0000","last_clean_scrub_stamp":"2024-09-05T02:17:26.448986+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:12.020262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.173052+0000","last_change":"2024-09-05T02:17:20.173052+0000","last_active":"2024-09-05T02:17:20.173052+0000","last_peered":"2024-09-05T02:17:20.173052+0000","last_clean":"2024-09-05T02:17:20.173052+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:17:20.173052+0000","last_undegraded":"2024-09-05T02:17:20.173052+0000","last_fullsized":"2024-09-05T02:17:20.173052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:20.172862+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:20.172862+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.172862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:26.246248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.128550+0000","last_change":"2024-09-05T02:17:02.128550+0000","last_active":"2024-09-05T02:17:02.128550+0000","last_peered":"2024-09-05T02:17:02.128550+0000","last_clean":"2024-09-05T02:17:02.128550+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:17:02.128550+0000","last_undegraded":"2024-09-05T02:17:02.128550+0000","last_fullsized":"2024-09-05T02:17:02.128550+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.128361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:30.574482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.480255+0000","last_change":"2024-09-05T02:17:08.479939+0000","last_active":"2024-09-05T02:17:08.480255+0000","last_peered":"2024-09-05T02:17:08.480255+0000","last_clean":"2024-09-05T02:17:08.480255+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:17:08.480255+0000","last_undegraded":"2024-09-05T02:17:08.480255+0000","last_fullsized":"2024-09-05T02:17:08.480255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-05T02:17:08.479674+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-05T02:17:08.479674+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.479674+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:12:58.229303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:13:46.486761+0000","last_change":"2024-09-05T01:30:15.663805+0000","last_active":"2024-09-05T02:13:46.486761+0000","last_peered":"2024-09-05T02:13:46.486761+0000","last_clean":"2024-09-05T02:13:46.486761+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:13:46.486761+0000","last_undegraded":"2024-09-05T02:13:46.486761+0000","last_fullsized":"2024-09-05T02:13:46.486761+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:30:14.615410+0000","last_clean_scrub_stamp":"2024-09-05T01:30:14.615410+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:30:51.769620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.128289+0000","last_change":"2024-09-05T02:17:03.128122+0000","last_active":"2024-09-05T02:17:03.128289+0000","last_peered":"2024-09-05T02:17:03.128289+0000","last_clean":"2024-09-05T02:17:03.128289+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:17:03.128289+0000","last_undegraded":"2024-09-05T02:17:03.128289+0000","last_fullsized":"2024-09-05T02:17:03.128289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.127940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:28:30.698265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.628636+0000","last_change":"2024-09-05T02:17:09.628636+0000","last_active":"2024-09-05T02:17:09.628636+0000","last_peered":"2024-09-05T02:17:09.628636+0000","last_clean":"2024-09-05T02:17:09.628636+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:17:09.628636+0000","last_undegraded":"2024-09-05T02:17:09.628636+0000","last_fullsized":"2024-09-05T02:17:09.628636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.628448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:13.486705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.227110+0000","last_change":"2024-09-05T02:17:11.226946+0000","last_active":"2024-09-05T02:17:11.227110+0000","last_peered":"2024-09-05T02:17:11.227110+0000","last_clean":"2024-09-05T02:17:11.227110+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:17:11.227110+0000","last_undegraded":"2024-09-05T02:17:11.227110+0000","last_fullsized":"2024-09-05T02:17:11.227110+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-05T02:17:11.226761+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-05T02:17:11.226761+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.226761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:40:34.540750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.751960+0000","last_change":"2024-09-05T02:16:56.751960+0000","last_active":"2024-09-05T02:16:56.751960+0000","last_peered":"2024-09-05T02:16:56.751960+0000","last_clean":"2024-09-05T02:16:56.751960+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:16:56.751960+0000","last_undegraded":"2024-09-05T02:16:56.751960+0000","last_fullsized":"2024-09-05T02:16:56.751960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.751614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:10.647303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.180469+0000","last_change":"2024-09-05T02:17:18.180469+0000","last_active":"2024-09-05T02:17:18.180469+0000","last_peered":"2024-09-05T02:17:18.180469+0000","last_clean":"2024-09-05T02:17:18.180469+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:17:18.180469+0000","last_undegraded":"2024-09-05T02:17:18.180469+0000","last_fullsized":"2024-09-05T02:17:18.180469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:18.180301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:18.180301+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.180301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:32.430802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.854537+0000","last_change":"2024-09-05T02:17:12.854537+0000","last_active":"2024-09-05T02:17:12.854537+0000","last_peered":"2024-09-05T02:17:12.854537+0000","last_clean":"2024-09-05T02:17:12.854537+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:17:12.854537+0000","last_undegraded":"2024-09-05T02:17:12.854537+0000","last_fullsized":"2024-09-05T02:17:12.854537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:12.854342+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:12.854342+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.854342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:54:51.250695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.238023+0000","last_change":"2024-09-05T02:17:10.237844+0000","last_active":"2024-09-05T02:17:10.238023+0000","last_peered":"2024-09-05T02:17:10.238023+0000","last_clean":"2024-09-05T02:17:10.238023+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:17:10.238023+0000","last_undegraded":"2024-09-05T02:17:10.238023+0000","last_fullsized":"2024-09-05T02:17:10.238023+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-05T02:17:10.237655+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-05T02:17:10.237655+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.237655+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:41.328707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.965052+0000","last_change":"2024-09-05T02:17:20.965052+0000","last_active":"2024-09-05T02:17:20.965052+0000","last_peered":"2024-09-05T02:17:20.965052+0000","last_clean":"2024-09-05T02:17:20.965052+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:17:20.965052+0000","last_undegraded":"2024-09-05T02:17:20.965052+0000","last_fullsized":"2024-09-05T02:17:20.965052+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:20.964858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:20.964858+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.964858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:11:14.189425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.204873+0000","last_change":"2024-09-05T02:17:16.204873+0000","last_active":"2024-09-05T02:17:16.204873+0000","last_peered":"2024-09-05T02:17:16.204873+0000","last_clean":"2024-09-05T02:17:16.204873+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:17:16.204873+0000","last_undegraded":"2024-09-05T02:17:16.204873+0000","last_fullsized":"2024-09-05T02:17:16.204873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.204662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.204662+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.204662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:43:32.227468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.772516+0000","last_change":"2024-09-05T02:16:53.772516+0000","last_active":"2024-09-05T02:16:53.772516+0000","last_peered":"2024-09-05T02:16:53.772516+0000","last_clean":"2024-09-05T02:16:53.772516+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:16:53.772516+0000","last_undegraded":"2024-09-05T02:16:53.772516+0000","last_fullsized":"2024-09-05T02:16:53.772516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.772339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:26.528640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.555603+0000","last_change":"2024-09-05T02:17:07.555411+0000","last_active":"2024-09-05T02:17:07.555603+0000","last_peered":"2024-09-05T02:17:07.555603+0000","last_clean":"2024-09-05T02:17:07.555603+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:17:07.555603+0000","last_undegraded":"2024-09-05T02:17:07.555603+0000","last_fullsized":"2024-09-05T02:17:07.555603+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.555220+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:28.608854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.191473+0000","last_change":"2024-09-05T02:17:06.191473+0000","last_active":"2024-09-05T02:17:06.191473+0000","last_peered":"2024-09-05T02:17:06.191473+0000","last_clean":"2024-09-05T02:17:06.191473+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:17:06.191473+0000","last_undegraded":"2024-09-05T02:17:06.191473+0000","last_fullsized":"2024-09-05T02:17:06.191473+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.191257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:33:00.620408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.291061+0000","last_change":"2024-09-05T02:17:02.290922+0000","last_active":"2024-09-05T02:17:02.291061+0000","last_peered":"2024-09-05T02:17:02.291061+0000","last_clean":"2024-09-05T02:17:02.291061+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:17:02.291061+0000","last_undegraded":"2024-09-05T02:17:02.291061+0000","last_fullsized":"2024-09-05T02:17:02.291061+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.290717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:26.594431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.417543+0000","last_change":"2024-09-05T02:17:15.417543+0000","last_active":"2024-09-05T02:17:15.417543+0000","last_peered":"2024-09-05T02:17:15.417543+0000","last_clean":"2024-09-05T02:17:15.417543+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:17:15.417543+0000","last_undegraded":"2024-09-05T02:17:15.417543+0000","last_fullsized":"2024-09-05T02:17:15.417543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:17:15.417237+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:17:15.417237+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.417237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:16.539323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":88,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.006759+0000","last_change":"2024-09-05T02:16:58.006578+0000","last_active":"2024-09-05T02:16:58.006759+0000","last_peered":"2024-09-05T02:16:58.006759+0000","last_clean":"2024-09-05T02:16:58.006759+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:16:58.006759+0000","last_undegraded":"2024-09-05T02:16:58.006759+0000","last_fullsized":"2024-09-05T02:16:58.006759+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.006393+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:22.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.957136+0000","last_change":"2024-09-05T02:17:19.957136+0000","last_active":"2024-09-05T02:17:19.957136+0000","last_peered":"2024-09-05T02:17:19.957136+0000","last_clean":"2024-09-05T02:17:19.957136+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:17:19.957136+0000","last_undegraded":"2024-09-05T02:17:19.957136+0000","last_fullsized":"2024-09-05T02:17:19.957136+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:19.956943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:19.956943+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.956943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:34.998852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.156383+0000","last_change":"2024-09-05T02:17:19.156383+0000","last_active":"2024-09-05T02:17:19.156383+0000","last_peered":"2024-09-05T02:17:19.156383+0000","last_clean":"2024-09-05T02:17:19.156383+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:17:19.156383+0000","last_undegraded":"2024-09-05T02:17:19.156383+0000","last_fullsized":"2024-09-05T02:17:19.156383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:19.156193+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:19.156193+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.156193+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:25:55.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.295444+0000","last_change":"2024-09-05T02:17:01.295286+0000","last_active":"2024-09-05T02:17:01.295444+0000","last_peered":"2024-09-05T02:17:01.295444+0000","last_clean":"2024-09-05T02:17:01.295444+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:17:01.295444+0000","last_undegraded":"2024-09-05T02:17:01.295444+0000","last_fullsized":"2024-09-05T02:17:01.295444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.295090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.543229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.760320+0000","last_change":"2024-09-05T02:16:48.760175+0000","last_active":"2024-09-05T02:16:48.760320+0000","last_peered":"2024-09-05T02:16:48.760320+0000","last_clean":"2024-09-05T02:16:48.760320+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:16:48.760320+0000","last_undegraded":"2024-09-05T02:16:48.760320+0000","last_fullsized":"2024-09-05T02:16:48.760320+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.759982+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:14.996988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.272974+0000","last_change":"2024-09-05T02:17:25.272974+0000","last_active":"2024-09-05T02:17:25.272974+0000","last_peered":"2024-09-05T02:17:25.272974+0000","last_clean":"2024-09-05T02:17:25.272974+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:17:25.272974+0000","last_undegraded":"2024-09-05T02:17:25.272974+0000","last_fullsized":"2024-09-05T02:17:25.272974+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.272786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.272786+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.272786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:09:33.593269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.399639+0000","last_change":"2024-09-05T02:17:14.399639+0000","last_active":"2024-09-05T02:17:14.399639+0000","last_peered":"2024-09-05T02:17:14.399639+0000","last_clean":"2024-09-05T02:17:14.399639+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:17:14.399639+0000","last_undegraded":"2024-09-05T02:17:14.399639+0000","last_fullsized":"2024-09-05T02:17:14.399639+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:14.399438+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:14.399438+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.399438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:53.494303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.373823+0000","last_change":"2024-09-05T02:17:12.373823+0000","last_active":"2024-09-05T02:17:12.373823+0000","last_peered":"2024-09-05T02:17:12.373823+0000","last_clean":"2024-09-05T02:17:12.373823+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:17:12.373823+0000","last_undegraded":"2024-09-05T02:17:12.373823+0000","last_fullsized":"2024-09-05T02:17:12.373823+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:12.373641+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:12.373641+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.373641+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:57:38.374692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.294839+0000","last_change":"2024-09-05T02:17:06.294692+0000","last_active":"2024-09-05T02:17:06.294839+0000","last_peered":"2024-09-05T02:17:06.294839+0000","last_clean":"2024-09-05T02:17:06.294839+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:17:06.294839+0000","last_undegraded":"2024-09-05T02:17:06.294839+0000","last_fullsized":"2024-09-05T02:17:06.294839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.294519+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:04.814706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.902785+0000","last_change":"2024-09-05T02:17:22.902785+0000","last_active":"2024-09-05T02:17:22.902785+0000","last_peered":"2024-09-05T02:17:22.902785+0000","last_clean":"2024-09-05T02:17:22.902785+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:17:22.902785+0000","last_undegraded":"2024-09-05T02:17:22.902785+0000","last_fullsized":"2024-09-05T02:17:22.902785+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:22.902590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:22.902590+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.902590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:34:45.823413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.914827+0000","last_change":"2024-09-05T02:17:15.914827+0000","last_active":"2024-09-05T02:17:15.914827+0000","last_peered":"2024-09-05T02:17:15.914827+0000","last_clean":"2024-09-05T02:17:15.914827+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:17:15.914827+0000","last_undegraded":"2024-09-05T02:17:15.914827+0000","last_fullsized":"2024-09-05T02:17:15.914827+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:15.914652+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:15.914652+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.914652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:08.427922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.272686+0000","last_change":"2024-09-05T02:17:00.272686+0000","last_active":"2024-09-05T02:17:00.272686+0000","last_peered":"2024-09-05T02:17:00.272686+0000","last_clean":"2024-09-05T02:17:00.272686+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:17:00.272686+0000","last_undegraded":"2024-09-05T02:17:00.272686+0000","last_fullsized":"2024-09-05T02:17:00.272686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.272504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:00:35.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.862626+0000","last_change":"2024-09-05T02:17:05.862626+0000","last_active":"2024-09-05T02:17:05.862626+0000","last_peered":"2024-09-05T02:17:05.862626+0000","last_clean":"2024-09-05T02:17:05.862626+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:17:05.862626+0000","last_undegraded":"2024-09-05T02:17:05.862626+0000","last_fullsized":"2024-09-05T02:17:05.862626+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.862443+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:45:23.459892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.924704+0000","last_change":"2024-09-05T02:17:21.924704+0000","last_active":"2024-09-05T02:17:21.924704+0000","last_peered":"2024-09-05T02:17:21.924704+0000","last_clean":"2024-09-05T02:17:21.924704+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:17:21.924704+0000","last_undegraded":"2024-09-05T02:17:21.924704+0000","last_fullsized":"2024-09-05T02:17:21.924704+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:21.924475+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:21.924475+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.924475+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:43:57.527333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.300389+0000","last_change":"2024-09-05T02:17:05.300389+0000","last_active":"2024-09-05T02:17:05.300389+0000","last_peered":"2024-09-05T02:17:05.300389+0000","last_clean":"2024-09-05T02:17:05.300389+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:17:05.300389+0000","last_undegraded":"2024-09-05T02:17:05.300389+0000","last_fullsized":"2024-09-05T02:17:05.300389+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.300194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:03.393835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'9","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.393834+0000","last_change":"2024-09-05T02:17:14.393834+0000","last_active":"2024-09-05T02:17:14.393834+0000","last_peered":"2024-09-05T02:17:14.393834+0000","last_clean":"2024-09-05T02:17:14.393834+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:17:14.393834+0000","last_undegraded":"2024-09-05T02:17:14.393834+0000","last_fullsized":"2024-09-05T02:17:14.393834+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:14.393659+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:14.393659+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.393659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:25.557357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.255214+0000","last_change":"2024-09-05T02:17:09.255214+0000","last_active":"2024-09-05T02:17:09.255214+0000","last_peered":"2024-09-05T02:17:09.255214+0000","last_clean":"2024-09-05T02:17:09.255214+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:17:09.255214+0000","last_undegraded":"2024-09-05T02:17:09.255214+0000","last_fullsized":"2024-09-05T02:17:09.255214+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-05T02:17:09.254979+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-05T02:17:09.254979+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.254979+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:09.520326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.391882+0000","last_change":"2024-09-05T02:17:24.391748+0000","last_active":"2024-09-05T02:17:24.391882+0000","last_peered":"2024-09-05T02:17:24.391882+0000","last_clean":"2024-09-05T02:17:24.391882+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:17:24.391882+0000","last_undegraded":"2024-09-05T02:17:24.391882+0000","last_fullsized":"2024-09-05T02:17:24.391882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:24.391574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:24.391574+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.391574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:56:20.884046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.927579+0000","last_change":"2024-09-05T02:17:16.927579+0000","last_active":"2024-09-05T02:17:16.927579+0000","last_peered":"2024-09-05T02:17:16.927579+0000","last_clean":"2024-09-05T02:17:16.927579+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:17:16.927579+0000","last_undegraded":"2024-09-05T02:17:16.927579+0000","last_fullsized":"2024-09-05T02:17:16.927579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:16.927345+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:16.927345+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.927345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:09:23.649427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.527210+0000","last_change":"2024-09-05T02:17:07.527210+0000","last_active":"2024-09-05T02:17:07.527210+0000","last_peered":"2024-09-05T02:17:07.527210+0000","last_clean":"2024-09-05T02:17:07.527210+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:17:07.527210+0000","last_undegraded":"2024-09-05T02:17:07.527210+0000","last_fullsized":"2024-09-05T02:17:07.527210+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:07.527014+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:07.527014+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.527014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:33:56.247730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.974334+0000","last_change":"2024-09-05T02:16:56.974334+0000","last_active":"2024-09-05T02:16:56.974334+0000","last_peered":"2024-09-05T02:16:56.974334+0000","last_clean":"2024-09-05T02:16:56.974334+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:16:56.974334+0000","last_undegraded":"2024-09-05T02:16:56.974334+0000","last_fullsized":"2024-09-05T02:16:56.974334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.974112+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:45:03.463271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.967623+0000","last_change":"2024-09-05T02:17:17.967623+0000","last_active":"2024-09-05T02:17:17.967623+0000","last_peered":"2024-09-05T02:17:17.967623+0000","last_clean":"2024-09-05T02:17:17.967623+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:17:17.967623+0000","last_undegraded":"2024-09-05T02:17:17.967623+0000","last_fullsized":"2024-09-05T02:17:17.967623+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:17.967348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:17.967348+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.967348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:36.603744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.415865+0000","last_change":"2024-09-05T02:17:19.415865+0000","last_active":"2024-09-05T02:17:19.415865+0000","last_peered":"2024-09-05T02:17:19.415865+0000","last_clean":"2024-09-05T02:17:19.415865+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:17:19.415865+0000","last_undegraded":"2024-09-05T02:17:19.415865+0000","last_fullsized":"2024-09-05T02:17:19.415865+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:19.415679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:19.415679+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.415679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:48.869642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.815629+0000","last_change":"2024-09-05T02:17:10.815629+0000","last_active":"2024-09-05T02:17:10.815629+0000","last_peered":"2024-09-05T02:17:10.815629+0000","last_clean":"2024-09-05T02:17:10.815629+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:17:10.815629+0000","last_undegraded":"2024-09-05T02:17:10.815629+0000","last_fullsized":"2024-09-05T02:17:10.815629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:10.815414+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:10.815414+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.815414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:32:24.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.244575+0000","last_change":"2024-09-05T02:17:05.244575+0000","last_active":"2024-09-05T02:17:05.244575+0000","last_peered":"2024-09-05T02:17:05.244575+0000","last_clean":"2024-09-05T02:17:05.244575+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:17:05.244575+0000","last_undegraded":"2024-09-05T02:17:05.244575+0000","last_fullsized":"2024-09-05T02:17:05.244575+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.244395+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:52:14.456469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.630218+0000","last_change":"2024-09-05T02:17:14.630218+0000","last_active":"2024-09-05T02:17:14.630218+0000","last_peered":"2024-09-05T02:17:14.630218+0000","last_clean":"2024-09-05T02:17:14.630218+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:17:14.630218+0000","last_undegraded":"2024-09-05T02:17:14.630218+0000","last_fullsized":"2024-09-05T02:17:14.630218+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:14.630016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:14.630016+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.630016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:33:22.419131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.426146+0000","last_change":"2024-09-05T02:17:21.426146+0000","last_active":"2024-09-05T02:17:21.426146+0000","last_peered":"2024-09-05T02:17:21.426146+0000","last_clean":"2024-09-05T02:17:21.426146+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:17:21.426146+0000","last_undegraded":"2024-09-05T02:17:21.426146+0000","last_fullsized":"2024-09-05T02:17:21.426146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:21.425960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:21.425960+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.425960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:14:00.799924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.776089+0000","last_change":"2024-09-05T02:16:52.776089+0000","last_active":"2024-09-05T02:16:52.776089+0000","last_peered":"2024-09-05T02:16:52.776089+0000","last_clean":"2024-09-05T02:16:52.776089+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:16:52.776089+0000","last_undegraded":"2024-09-05T02:16:52.776089+0000","last_fullsized":"2024-09-05T02:16:52.776089+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.775909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:19.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.976839+0000","last_change":"2024-09-05T02:16:55.976839+0000","last_active":"2024-09-05T02:16:55.976839+0000","last_peered":"2024-09-05T02:16:55.976839+0000","last_clean":"2024-09-05T02:16:55.976839+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:16:55.976839+0000","last_undegraded":"2024-09-05T02:16:55.976839+0000","last_fullsized":"2024-09-05T02:16:55.976839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.976604+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:49.837443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.344726+0000","last_change":"2024-09-05T02:17:07.344726+0000","last_active":"2024-09-05T02:17:07.344726+0000","last_peered":"2024-09-05T02:17:07.344726+0000","last_clean":"2024-09-05T02:17:07.344726+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:17:07.344726+0000","last_undegraded":"2024-09-05T02:17:07.344726+0000","last_fullsized":"2024-09-05T02:17:07.344726+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:07.344455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:07.344455+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.344455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.769861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.870555+0000","last_change":"2024-09-05T02:17:14.870555+0000","last_active":"2024-09-05T02:17:14.870555+0000","last_peered":"2024-09-05T02:17:14.870555+0000","last_clean":"2024-09-05T02:17:14.870555+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:17:14.870555+0000","last_undegraded":"2024-09-05T02:17:14.870555+0000","last_fullsized":"2024-09-05T02:17:14.870555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:14.870271+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:14.870271+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.870271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:20.820103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.580373+0000","last_change":"2024-09-05T02:17:08.580373+0000","last_active":"2024-09-05T02:17:08.580373+0000","last_peered":"2024-09-05T02:17:08.580373+0000","last_clean":"2024-09-05T02:17:08.580373+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:17:08.580373+0000","last_undegraded":"2024-09-05T02:17:08.580373+0000","last_fullsized":"2024-09-05T02:17:08.580373+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.580196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:28.347538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.830880+0000","last_change":"2024-09-05T02:17:04.830880+0000","last_active":"2024-09-05T02:17:04.830880+0000","last_peered":"2024-09-05T02:17:04.830880+0000","last_clean":"2024-09-05T02:17:04.830880+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:17:04.830880+0000","last_undegraded":"2024-09-05T02:17:04.830880+0000","last_fullsized":"2024-09-05T02:17:04.830880+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.830648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:29.585319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.428971+0000","last_change":"2024-09-05T02:17:17.428971+0000","last_active":"2024-09-05T02:17:17.428971+0000","last_peered":"2024-09-05T02:17:17.428971+0000","last_clean":"2024-09-05T02:17:17.428971+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:17:17.428971+0000","last_undegraded":"2024-09-05T02:17:17.428971+0000","last_fullsized":"2024-09-05T02:17:17.428971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:17.428792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:17.428792+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.428792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:32:54.516889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.393906+0000","last_change":"2024-09-05T02:17:13.393906+0000","last_active":"2024-09-05T02:17:13.393906+0000","last_peered":"2024-09-05T02:17:13.393906+0000","last_clean":"2024-09-05T02:17:13.393906+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:17:13.393906+0000","last_undegraded":"2024-09-05T02:17:13.393906+0000","last_fullsized":"2024-09-05T02:17:13.393906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.393731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.393731+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.393731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:28.956286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.833096+0000","last_change":"2024-09-05T02:17:11.833096+0000","last_active":"2024-09-05T02:17:11.833096+0000","last_peered":"2024-09-05T02:17:11.833096+0000","last_clean":"2024-09-05T02:17:11.833096+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:17:11.833096+0000","last_undegraded":"2024-09-05T02:17:11.833096+0000","last_fullsized":"2024-09-05T02:17:11.833096+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:11.832881+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:11.832881+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.832881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:13:08.376387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.146987+0000","last_change":"2024-09-05T02:16:55.146987+0000","last_active":"2024-09-05T02:16:55.146987+0000","last_peered":"2024-09-05T02:16:55.146987+0000","last_clean":"2024-09-05T02:16:55.146987+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:16:55.146987+0000","last_undegraded":"2024-09-05T02:16:55.146987+0000","last_fullsized":"2024-09-05T02:16:55.146987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.146799+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:52:09.173061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.765175+0000","last_change":"2024-09-05T02:16:54.765175+0000","last_active":"2024-09-05T02:16:54.765175+0000","last_peered":"2024-09-05T02:16:54.765175+0000","last_clean":"2024-09-05T02:16:54.765175+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:16:54.765175+0000","last_undegraded":"2024-09-05T02:16:54.765175+0000","last_fullsized":"2024-09-05T02:16:54.765175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.764967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:33.575826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.341502+0000","last_change":"2024-09-05T02:17:04.341502+0000","last_active":"2024-09-05T02:17:04.341502+0000","last_peered":"2024-09-05T02:17:04.341502+0000","last_clean":"2024-09-05T02:17:04.341502+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:17:04.341502+0000","last_undegraded":"2024-09-05T02:17:04.341502+0000","last_fullsized":"2024-09-05T02:17:04.341502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.341302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:07.810567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.871572+0000","last_change":"2024-09-05T02:17:08.871572+0000","last_active":"2024-09-05T02:17:08.871572+0000","last_peered":"2024-09-05T02:17:08.871572+0000","last_clean":"2024-09-05T02:17:08.871572+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:17:08.871572+0000","last_undegraded":"2024-09-05T02:17:08.871572+0000","last_fullsized":"2024-09-05T02:17:08.871572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:08.871354+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:08.871354+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.871354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:38:22.298118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.505895+0000","last_change":"2024-09-05T02:17:03.505895+0000","last_active":"2024-09-05T02:17:03.505895+0000","last_peered":"2024-09-05T02:17:03.505895+0000","last_clean":"2024-09-05T02:17:03.505895+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:17:03.505895+0000","last_undegraded":"2024-09-05T02:17:03.505895+0000","last_fullsized":"2024-09-05T02:17:03.505895+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.505610+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:48.894550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.360695+0000","last_change":"2024-09-05T02:17:23.360695+0000","last_active":"2024-09-05T02:17:23.360695+0000","last_peered":"2024-09-05T02:17:23.360695+0000","last_clean":"2024-09-05T02:17:23.360695+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:17:23.360695+0000","last_undegraded":"2024-09-05T02:17:23.360695+0000","last_fullsized":"2024-09-05T02:17:23.360695+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.360519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.360519+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.360519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.834939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.664086+0000","last_change":"2024-09-05T02:17:10.664086+0000","last_active":"2024-09-05T02:17:10.664086+0000","last_peered":"2024-09-05T02:17:10.664086+0000","last_clean":"2024-09-05T02:17:10.664086+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:17:10.664086+0000","last_undegraded":"2024-09-05T02:17:10.664086+0000","last_fullsized":"2024-09-05T02:17:10.664086+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.663894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.663894+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.663894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:39.440002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.830224+0000","last_change":"2024-09-05T02:17:09.830224+0000","last_active":"2024-09-05T02:17:09.830224+0000","last_peered":"2024-09-05T02:17:09.830224+0000","last_clean":"2024-09-05T02:17:09.830224+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:17:09.830224+0000","last_undegraded":"2024-09-05T02:17:09.830224+0000","last_fullsized":"2024-09-05T02:17:09.830224+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:09.830010+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:09.830010+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.830010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:40.926655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.515155+0000","last_change":"2024-09-05T02:17:04.515155+0000","last_active":"2024-09-05T02:17:04.515155+0000","last_peered":"2024-09-05T02:17:04.515155+0000","last_clean":"2024-09-05T02:17:04.515155+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:17:04.515155+0000","last_undegraded":"2024-09-05T02:17:04.515155+0000","last_fullsized":"2024-09-05T02:17:04.515155+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.514980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.403228+0000","last_change":"2024-09-05T02:17:22.403228+0000","last_active":"2024-09-05T02:17:22.403228+0000","last_peered":"2024-09-05T02:17:22.403228+0000","last_clean":"2024-09-05T02:17:22.403228+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:17:22.403228+0000","last_undegraded":"2024-09-05T02:17:22.403228+0000","last_fullsized":"2024-09-05T02:17:22.403228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:22.403052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:22.403052+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.403052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:20.733360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.090864+0000","last_change":"2024-09-05T02:17:01.090864+0000","last_active":"2024-09-05T02:17:01.090864+0000","last_peered":"2024-09-05T02:17:01.090864+0000","last_clean":"2024-09-05T02:17:01.090864+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:17:01.090864+0000","last_undegraded":"2024-09-05T02:17:01.090864+0000","last_fullsized":"2024-09-05T02:17:01.090864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.090683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:16.047191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.155440+0000","last_change":"2024-09-05T02:16:54.155440+0000","last_active":"2024-09-05T02:16:54.155440+0000","last_peered":"2024-09-05T02:16:54.155440+0000","last_clean":"2024-09-05T02:16:54.155440+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:16:54.155440+0000","last_undegraded":"2024-09-05T02:16:54.155440+0000","last_fullsized":"2024-09-05T02:16:54.155440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.155147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:02.845734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.980140+0000","last_change":"2024-09-05T02:16:54.980140+0000","last_active":"2024-09-05T02:16:54.980140+0000","last_peered":"2024-09-05T02:16:54.980140+0000","last_clean":"2024-09-05T02:16:54.980140+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:16:54.980140+0000","last_undegraded":"2024-09-05T02:16:54.980140+0000","last_fullsized":"2024-09-05T02:16:54.980140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.979911+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:13.094203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.936122+0000","last_change":"2024-09-05T02:17:18.936122+0000","last_active":"2024-09-05T02:17:18.936122+0000","last_peered":"2024-09-05T02:17:18.936122+0000","last_clean":"2024-09-05T02:17:18.936122+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:17:18.936122+0000","last_undegraded":"2024-09-05T02:17:18.936122+0000","last_fullsized":"2024-09-05T02:17:18.936122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:18.935934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:18.935934+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.935934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:38:07.815726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.374915+0000","last_change":"2024-09-05T02:17:12.374915+0000","last_active":"2024-09-05T02:17:12.374915+0000","last_peered":"2024-09-05T02:17:12.374915+0000","last_clean":"2024-09-05T02:17:12.374915+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:17:12.374915+0000","last_undegraded":"2024-09-05T02:17:12.374915+0000","last_fullsized":"2024-09-05T02:17:12.374915+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:12.374736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:12.374736+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.374736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:23.935553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.088692+0000","last_change":"2024-09-05T02:17:00.088692+0000","last_active":"2024-09-05T02:17:00.088692+0000","last_peered":"2024-09-05T02:17:00.088692+0000","last_clean":"2024-09-05T02:17:00.088692+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:17:00.088692+0000","last_undegraded":"2024-09-05T02:17:00.088692+0000","last_fullsized":"2024-09-05T02:17:00.088692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.088515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:15.940853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.811174+0000","last_change":"2024-09-05T02:17:03.811009+0000","last_active":"2024-09-05T02:17:03.811174+0000","last_peered":"2024-09-05T02:17:03.811174+0000","last_clean":"2024-09-05T02:17:03.811174+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:17:03.811174+0000","last_undegraded":"2024-09-05T02:17:03.811174+0000","last_fullsized":"2024-09-05T02:17:03.811174+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.810788+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:32:45.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'377","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.819483+0000","last_change":"2024-09-05T02:16:32.819483+0000","last_active":"2024-09-05T02:16:32.819483+0000","last_peered":"2024-09-05T02:16:32.819483+0000","last_clean":"2024-09-05T02:16:32.819483+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:32.819483+0000","last_undegraded":"2024-09-05T02:16:32.819483+0000","last_fullsized":"2024-09-05T02:16:32.819483+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.819228+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:06.348956+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":47646,"num_write":1216,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.516932+0000","last_change":"2024-09-05T02:16:46.516781+0000","last_active":"2024-09-05T02:16:46.516932+0000","last_peered":"2024-09-05T02:16:46.516932+0000","last_clean":"2024-09-05T02:16:46.516932+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:16:46.516932+0000","last_undegraded":"2024-09-05T02:16:46.516932+0000","last_fullsized":"2024-09-05T02:16:46.516932+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.516577+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:11.618374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'384","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.308155+0000","last_change":"2024-09-05T02:16:34.307989+0000","last_active":"2024-09-05T02:16:34.308155+0000","last_peered":"2024-09-05T02:16:34.308155+0000","last_clean":"2024-09-05T02:16:34.308155+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:34.308155+0000","last_undegraded":"2024-09-05T02:16:34.308155+0000","last_fullsized":"2024-09-05T02:16:34.308155+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.307761+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:07.165023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":565,"num_read_kb":74894,"num_write":1179,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'450","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.926481+0000","last_change":"2024-09-05T02:16:45.926317+0000","last_active":"2024-09-05T02:16:45.926481+0000","last_peered":"2024-09-05T02:16:45.926481+0000","last_clean":"2024-09-05T02:16:45.926481+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:16:45.926481+0000","last_undegraded":"2024-09-05T02:16:45.926481+0000","last_fullsized":"2024-09-05T02:16:45.926481+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.926073+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:34.170133+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'393","reported_seq":1060,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.517995+0000","last_change":"2024-09-05T02:16:32.517827+0000","last_active":"2024-09-05T02:16:32.517995+0000","last_peered":"2024-09-05T02:16:32.517995+0000","last_clean":"2024-09-05T02:16:32.517995+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:16:32.517995+0000","last_undegraded":"2024-09-05T02:16:32.517995+0000","last_fullsized":"2024-09-05T02:16:32.517995+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.517629+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:14.484505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":743,"num_write":1140,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'857","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.487707+0000","last_change":"2024-09-05T02:16:46.487548+0000","last_active":"2024-09-05T02:16:46.487707+0000","last_peered":"2024-09-05T02:16:46.487707+0000","last_clean":"2024-09-05T02:16:46.487707+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:16:46.487707+0000","last_undegraded":"2024-09-05T02:16:46.487707+0000","last_fullsized":"2024-09-05T02:16:46.487707+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'857","last_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_deep_scrub":"264'857","last_deep_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.487350+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:48:26.885564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":457,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'380","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.511848+0000","last_change":"2024-09-05T02:16:41.511848+0000","last_active":"2024-09-05T02:16:41.511848+0000","last_peered":"2024-09-05T02:16:41.511848+0000","last_clean":"2024-09-05T02:16:41.511848+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:16:41.511848+0000","last_undegraded":"2024-09-05T02:16:41.511848+0000","last_fullsized":"2024-09-05T02:16:41.511848+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.511651+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:25.215125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":68502,"num_write":1310,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.257591+0000","last_change":"2024-09-05T02:16:51.257332+0000","last_active":"2024-09-05T02:16:51.257591+0000","last_peered":"2024-09-05T02:16:51.257591+0000","last_clean":"2024-09-05T02:16:51.257591+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:16:51.257591+0000","last_undegraded":"2024-09-05T02:16:51.257591+0000","last_fullsized":"2024-09-05T02:16:51.257591+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1273","last_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_deep_scrub":"264'1273","last_deep_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.257106+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:16.442936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'363","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.081565+0000","last_change":"2024-09-05T02:16:42.081318+0000","last_active":"2024-09-05T02:16:42.081565+0000","last_peered":"2024-09-05T02:16:42.081565+0000","last_clean":"2024-09-05T02:16:42.081565+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:42.081565+0000","last_undegraded":"2024-09-05T02:16:42.081565+0000","last_fullsized":"2024-09-05T02:16:42.081565+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.081062+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:53:18.173817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":9059,"num_write":1154,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'447","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.875774+0000","last_change":"2024-09-05T02:16:42.875774+0000","last_active":"2024-09-05T02:16:42.875774+0000","last_peered":"2024-09-05T02:16:42.875774+0000","last_clean":"2024-09-05T02:16:42.875774+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:16:42.875774+0000","last_undegraded":"2024-09-05T02:16:42.875774+0000","last_fullsized":"2024-09-05T02:16:42.875774+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'447","last_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_deep_scrub":"264'447","last_deep_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.875583+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:30.938475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'324","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.541002+0000","last_change":"2024-09-05T02:16:39.540870+0000","last_active":"2024-09-05T02:16:39.541002+0000","last_peered":"2024-09-05T02:16:39.541002+0000","last_clean":"2024-09-05T02:16:39.541002+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:16:39.541002+0000","last_undegraded":"2024-09-05T02:16:39.541002+0000","last_fullsized":"2024-09-05T02:16:39.541002+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.540684+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:25.366090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":472,"num_write":1089,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'505","reported_seq":2152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.476440+0000","last_change":"2024-09-05T02:16:49.476308+0000","last_active":"2024-09-05T02:16:49.476440+0000","last_peered":"2024-09-05T02:16:49.476440+0000","last_clean":"2024-09-05T02:16:49.476440+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:16:49.476440+0000","last_undegraded":"2024-09-05T02:16:49.476440+0000","last_fullsized":"2024-09-05T02:16:49.476440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.476121+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:30:55.880313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'353","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.087473+0000","last_change":"2024-09-05T02:16:41.087320+0000","last_active":"2024-09-05T02:16:41.087473+0000","last_peered":"2024-09-05T02:16:41.087473+0000","last_clean":"2024-09-05T02:16:41.087473+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:41.087473+0000","last_undegraded":"2024-09-05T02:16:41.087473+0000","last_fullsized":"2024-09-05T02:16:41.087473+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.087096+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:59:56.430971+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495269,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":507,"num_read_kb":57163,"num_write":1112,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'474","reported_seq":2175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.586174+0000","last_change":"2024-09-05T02:16:48.586021+0000","last_active":"2024-09-05T02:16:48.586174+0000","last_peered":"2024-09-05T02:16:48.586174+0000","last_clean":"2024-09-05T02:16:48.586174+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:16:48.586174+0000","last_undegraded":"2024-09-05T02:16:48.586174+0000","last_fullsized":"2024-09-05T02:16:48.586174+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.585842+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:05:53.161158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'355","reported_seq":1193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.003064+0000","last_change":"2024-09-05T02:16:39.002926+0000","last_active":"2024-09-05T02:16:39.003064+0000","last_peered":"2024-09-05T02:16:39.003064+0000","last_clean":"2024-09-05T02:16:39.003064+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:39.003064+0000","last_undegraded":"2024-09-05T02:16:39.003064+0000","last_fullsized":"2024-09-05T02:16:39.003064+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.002732+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:17.177395+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":814,"num_read_kb":7164,"num_write":1128,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'453","reported_seq":2037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.824734+0000","last_change":"2024-09-05T02:16:38.824593+0000","last_active":"2024-09-05T02:16:38.824734+0000","last_peered":"2024-09-05T02:16:38.824734+0000","last_clean":"2024-09-05T02:16:38.824734+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:16:38.824734+0000","last_undegraded":"2024-09-05T02:16:38.824734+0000","last_fullsized":"2024-09-05T02:16:38.824734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.824400+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:46.210785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'747","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.472094+0000","last_change":"2024-09-05T02:16:45.472094+0000","last_active":"2024-09-05T02:16:45.472094+0000","last_peered":"2024-09-05T02:16:45.472094+0000","last_clean":"2024-09-05T02:16:45.472094+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:16:45.472094+0000","last_undegraded":"2024-09-05T02:16:45.472094+0000","last_fullsized":"2024-09-05T02:16:45.472094+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.471918+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:16.977832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'356","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.061665+0000","last_change":"2024-09-05T02:16:40.061510+0000","last_active":"2024-09-05T02:16:40.061665+0000","last_peered":"2024-09-05T02:16:40.061665+0000","last_clean":"2024-09-05T02:16:40.061665+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:40.061665+0000","last_undegraded":"2024-09-05T02:16:40.061665+0000","last_fullsized":"2024-09-05T02:16:40.061665+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.061289+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:56:17.879080+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1733359,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":485,"num_read_kb":16771,"num_write":1085,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'435","reported_seq":1966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.012421+0000","last_change":"2024-09-05T02:16:44.012421+0000","last_active":"2024-09-05T02:16:44.012421+0000","last_peered":"2024-09-05T02:16:44.012421+0000","last_clean":"2024-09-05T02:16:44.012421+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:16:44.012421+0000","last_undegraded":"2024-09-05T02:16:44.012421+0000","last_fullsized":"2024-09-05T02:16:44.012421+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.012213+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:25.759917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'350","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.815192+0000","last_change":"2024-09-05T02:16:36.815192+0000","last_active":"2024-09-05T02:16:36.815192+0000","last_peered":"2024-09-05T02:16:36.815192+0000","last_clean":"2024-09-05T02:16:36.815192+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:36.815192+0000","last_undegraded":"2024-09-05T02:16:36.815192+0000","last_fullsized":"2024-09-05T02:16:36.815192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.814965+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:24.655143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":5849,"num_write":1054,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'463","reported_seq":2003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.501298+0000","last_change":"2024-09-05T02:16:44.501298+0000","last_active":"2024-09-05T02:16:44.501298+0000","last_peered":"2024-09-05T02:16:44.501298+0000","last_clean":"2024-09-05T02:16:44.501298+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:16:44.501298+0000","last_undegraded":"2024-09-05T02:16:44.501298+0000","last_fullsized":"2024-09-05T02:16:44.501298+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.501076+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:51.917233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'361","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.812670+0000","last_change":"2024-09-05T02:16:35.812670+0000","last_active":"2024-09-05T02:16:35.812670+0000","last_peered":"2024-09-05T02:16:35.812670+0000","last_clean":"2024-09-05T02:16:35.812670+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:35.812670+0000","last_undegraded":"2024-09-05T02:16:35.812670+0000","last_fullsized":"2024-09-05T02:16:35.812670+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.812463+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:35.464351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":7060,"num_write":1221,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'493","reported_seq":2161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.766824+0000","last_change":"2024-09-05T02:16:36.766824+0000","last_active":"2024-09-05T02:16:36.766824+0000","last_peered":"2024-09-05T02:16:36.766824+0000","last_clean":"2024-09-05T02:16:36.766824+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:16:36.766824+0000","last_undegraded":"2024-09-05T02:16:36.766824+0000","last_fullsized":"2024-09-05T02:16:36.766824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'493","last_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_deep_scrub":"264'493","last_deep_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.766629+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:02:04.726199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'358","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.529586+0000","last_change":"2024-09-05T02:16:32.529586+0000","last_active":"2024-09-05T02:16:32.529586+0000","last_peered":"2024-09-05T02:16:32.529586+0000","last_clean":"2024-09-05T02:16:32.529586+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:32.529586+0000","last_undegraded":"2024-09-05T02:16:32.529586+0000","last_fullsized":"2024-09-05T02:16:32.529586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.529382+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:38.596982+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":17342,"num_write":1226,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'408","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.779690+0000","last_change":"2024-09-05T02:16:37.779690+0000","last_active":"2024-09-05T02:16:37.779690+0000","last_peered":"2024-09-05T02:16:37.779690+0000","last_clean":"2024-09-05T02:16:37.779690+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:16:37.779690+0000","last_undegraded":"2024-09-05T02:16:37.779690+0000","last_fullsized":"2024-09-05T02:16:37.779690+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.779509+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:37.394227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'353","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.985816+0000","last_change":"2024-09-05T02:16:34.985816+0000","last_active":"2024-09-05T02:16:34.985816+0000","last_peered":"2024-09-05T02:16:34.985816+0000","last_clean":"2024-09-05T02:16:34.985816+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:34.985816+0000","last_undegraded":"2024-09-05T02:16:34.985816+0000","last_fullsized":"2024-09-05T02:16:34.985816+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.985621+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:35.048288+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":1528,"num_write":1229,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'751","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.482525+0000","last_change":"2024-09-05T02:16:47.482525+0000","last_active":"2024-09-05T02:16:47.482525+0000","last_peered":"2024-09-05T02:16:47.482525+0000","last_clean":"2024-09-05T02:16:47.482525+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:16:47.482525+0000","last_undegraded":"2024-09-05T02:16:47.482525+0000","last_fullsized":"2024-09-05T02:16:47.482525+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'751","last_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_deep_scrub":"264'751","last_deep_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.482313+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:15.492660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'340","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.555210+0000","last_change":"2024-09-05T02:16:31.555210+0000","last_active":"2024-09-05T02:16:31.555210+0000","last_peered":"2024-09-05T02:16:31.555210+0000","last_clean":"2024-09-05T02:16:31.555210+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:16:31.555210+0000","last_undegraded":"2024-09-05T02:16:31.555210+0000","last_fullsized":"2024-09-05T02:16:31.555210+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.555009+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:13.682055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":32081,"num_write":1077,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'129","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.545088+0000","last_change":"2024-09-05T02:17:03.545088+0000","last_active":"2024-09-05T02:17:03.545088+0000","last_peered":"2024-09-05T02:17:03.545088+0000","last_clean":"2024-09-05T02:17:03.545088+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:17:03.545088+0000","last_undegraded":"2024-09-05T02:17:03.545088+0000","last_fullsized":"2024-09-05T02:17:03.545088+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.544858+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:33.897822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.810201+0000","last_change":"2024-09-05T02:16:33.810064+0000","last_active":"2024-09-05T02:16:33.810201+0000","last_peered":"2024-09-05T02:16:33.810201+0000","last_clean":"2024-09-05T02:16:33.810201+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:16:33.810201+0000","last_undegraded":"2024-09-05T02:16:33.810201+0000","last_fullsized":"2024-09-05T02:16:33.810201+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.809886+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:56.483637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'351","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.079623+0000","last_change":"2024-09-05T02:16:37.079623+0000","last_active":"2024-09-05T02:16:37.079623+0000","last_peered":"2024-09-05T02:16:37.079623+0000","last_clean":"2024-09-05T02:16:37.079623+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:37.079623+0000","last_undegraded":"2024-09-05T02:16:37.079623+0000","last_fullsized":"2024-09-05T02:16:37.079623+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.079302+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:25:10.945666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":5561,"num_write":1118,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.589865+0000","last_change":"2024-09-05T02:16:51.589865+0000","last_active":"2024-09-05T02:16:51.589865+0000","last_peered":"2024-09-05T02:16:51.589865+0000","last_clean":"2024-09-05T02:16:51.589865+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:16:51.589865+0000","last_undegraded":"2024-09-05T02:16:51.589865+0000","last_fullsized":"2024-09-05T02:16:51.589865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.589683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:12.569819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'373","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.248678+0000","last_change":"2024-09-05T02:16:55.248678+0000","last_active":"2024-09-05T02:16:55.248678+0000","last_peered":"2024-09-05T02:16:55.248678+0000","last_clean":"2024-09-05T02:16:55.248678+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:16:55.248678+0000","last_undegraded":"2024-09-05T02:16:55.248678+0000","last_fullsized":"2024-09-05T02:16:55.248678+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.248481+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:24:12.292604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":585,"num_read_kb":1187,"num_write":454,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.803463+0000","last_change":"2024-09-05T02:16:57.803463+0000","last_active":"2024-09-05T02:16:57.803463+0000","last_peered":"2024-09-05T02:16:57.803463+0000","last_clean":"2024-09-05T02:16:57.803463+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:16:57.803463+0000","last_undegraded":"2024-09-05T02:16:57.803463+0000","last_fullsized":"2024-09-05T02:16:57.803463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.803282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:25.367667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2472","reported_seq":4389,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.524861+0000","last_change":"2024-09-05T02:17:04.524711+0000","last_active":"2024-09-05T02:17:04.524861+0000","last_peered":"2024-09-05T02:17:04.524861+0000","last_clean":"2024-09-05T02:17:04.524861+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:17:04.524861+0000","last_undegraded":"2024-09-05T02:17:04.524861+0000","last_fullsized":"2024-09-05T02:17:04.524861+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2472","last_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_deep_scrub":"264'2472","last_deep_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.524509+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:48.550803+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.488036+0000","last_change":"2024-09-05T02:16:43.488036+0000","last_active":"2024-09-05T02:16:43.488036+0000","last_peered":"2024-09-05T02:16:43.488036+0000","last_clean":"2024-09-05T02:16:43.488036+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:16:43.488036+0000","last_undegraded":"2024-09-05T02:16:43.488036+0000","last_fullsized":"2024-09-05T02:16:43.488036+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'752","last_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_deep_scrub":"264'752","last_deep_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.487849+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:28.339919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'326","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.495350+0000","last_change":"2024-09-05T02:16:29.495350+0000","last_active":"2024-09-05T02:16:29.495350+0000","last_peered":"2024-09-05T02:16:29.495350+0000","last_clean":"2024-09-05T02:16:29.495350+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:16:29.495350+0000","last_undegraded":"2024-09-05T02:16:29.495350+0000","last_fullsized":"2024-09-05T02:16:29.495350+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.495167+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:19:45.662775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":61922,"num_write":915,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.147689+0000","last_change":"2024-09-05T02:16:48.147689+0000","last_active":"2024-09-05T02:16:48.147689+0000","last_peered":"2024-09-05T02:16:48.147689+0000","last_clean":"2024-09-05T02:16:48.147689+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:16:48.147689+0000","last_undegraded":"2024-09-05T02:16:48.147689+0000","last_fullsized":"2024-09-05T02:16:48.147689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.147489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:34.064672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'110","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.527062+0000","last_change":"2024-09-05T02:16:56.527062+0000","last_active":"2024-09-05T02:16:56.527062+0000","last_peered":"2024-09-05T02:16:56.527062+0000","last_clean":"2024-09-05T02:16:56.527062+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:16:56.527062+0000","last_undegraded":"2024-09-05T02:16:56.527062+0000","last_fullsized":"2024-09-05T02:16:56.527062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.526730+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:52.832215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.481410+0000","last_change":"2024-09-05T02:16:59.481410+0000","last_active":"2024-09-05T02:16:59.481410+0000","last_peered":"2024-09-05T02:16:59.481410+0000","last_clean":"2024-09-05T02:16:59.481410+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:16:59.481410+0000","last_undegraded":"2024-09-05T02:16:59.481410+0000","last_fullsized":"2024-09-05T02:16:59.481410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.481224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:23.052575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'110","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.211744+0000","last_change":"2024-09-05T02:16:59.211606+0000","last_active":"2024-09-05T02:16:59.211744+0000","last_peered":"2024-09-05T02:16:59.211744+0000","last_clean":"2024-09-05T02:16:59.211744+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:16:59.211744+0000","last_undegraded":"2024-09-05T02:16:59.211744+0000","last_fullsized":"2024-09-05T02:16:59.211744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.211408+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:46.901389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1224","reported_seq":2918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.299022+0000","last_change":"2024-09-05T02:16:42.299022+0000","last_active":"2024-09-05T02:16:42.299022+0000","last_peered":"2024-09-05T02:16:42.299022+0000","last_clean":"2024-09-05T02:16:42.299022+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:16:42.299022+0000","last_undegraded":"2024-09-05T02:16:42.299022+0000","last_fullsized":"2024-09-05T02:16:42.299022+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1224","last_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_deep_scrub":"264'1224","last_deep_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.298827+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:49.318161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.081594+0000","last_change":"2024-09-05T02:16:35.081594+0000","last_active":"2024-09-05T02:16:35.081594+0000","last_peered":"2024-09-05T02:16:35.081594+0000","last_clean":"2024-09-05T02:16:35.081594+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:35.081594+0000","last_undegraded":"2024-09-05T02:16:35.081594+0000","last_fullsized":"2024-09-05T02:16:35.081594+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.081383+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:56:51.256314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":6929,"num_write":1016,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.111742+0000","last_change":"2024-09-05T02:16:50.111742+0000","last_active":"2024-09-05T02:16:50.111742+0000","last_peered":"2024-09-05T02:16:50.111742+0000","last_clean":"2024-09-05T02:16:50.111742+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:16:50.111742+0000","last_undegraded":"2024-09-05T02:16:50.111742+0000","last_fullsized":"2024-09-05T02:16:50.111742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.111667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:39.242968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'188","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.799623+0000","last_change":"2024-09-05T02:16:45.799623+0000","last_active":"2024-09-05T02:16:45.799623+0000","last_peered":"2024-09-05T02:16:45.799623+0000","last_clean":"2024-09-05T02:16:45.799623+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:16:45.799623+0000","last_undegraded":"2024-09-05T02:16:45.799623+0000","last_fullsized":"2024-09-05T02:16:45.799623+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.799431+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:29.922191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'788","reported_seq":4961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.789188+0000","last_change":"2024-09-05T02:16:59.789188+0000","last_active":"2024-09-05T02:16:59.789188+0000","last_peered":"2024-09-05T02:16:59.789188+0000","last_clean":"2024-09-05T02:16:59.789188+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:59.789188+0000","last_undegraded":"2024-09-05T02:16:59.789188+0000","last_fullsized":"2024-09-05T02:16:59.789188+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.789001+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:42.866750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'236","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.568466+0000","last_change":"2024-09-05T02:17:05.568317+0000","last_active":"2024-09-05T02:17:05.568466+0000","last_peered":"2024-09-05T02:17:05.568466+0000","last_clean":"2024-09-05T02:17:05.568466+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:17:05.568466+0000","last_undegraded":"2024-09-05T02:17:05.568466+0000","last_fullsized":"2024-09-05T02:17:05.568466+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.568123+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:46:23.769683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'685","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.979024+0000","last_change":"2024-09-05T02:16:37.979024+0000","last_active":"2024-09-05T02:16:37.979024+0000","last_peered":"2024-09-05T02:16:37.979024+0000","last_clean":"2024-09-05T02:16:37.979024+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:16:37.979024+0000","last_undegraded":"2024-09-05T02:16:37.979024+0000","last_fullsized":"2024-09-05T02:16:37.979024+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.978839+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:33.371371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'362","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.834992+0000","last_change":"2024-09-05T02:16:31.834992+0000","last_active":"2024-09-05T02:16:31.834992+0000","last_peered":"2024-09-05T02:16:31.834992+0000","last_clean":"2024-09-05T02:16:31.834992+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:31.834992+0000","last_undegraded":"2024-09-05T02:16:31.834992+0000","last_fullsized":"2024-09-05T02:16:31.834992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.834772+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:22.380162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":55829,"num_write":1110,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.629506+0000","last_change":"2024-09-05T02:16:52.629506+0000","last_active":"2024-09-05T02:16:52.629506+0000","last_peered":"2024-09-05T02:16:52.629506+0000","last_clean":"2024-09-05T02:16:52.629506+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:16:52.629506+0000","last_undegraded":"2024-09-05T02:16:52.629506+0000","last_fullsized":"2024-09-05T02:16:52.629506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.629320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:02:54.194725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'331","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.873220+0000","last_change":"2024-09-05T02:16:54.873220+0000","last_active":"2024-09-05T02:16:54.873220+0000","last_peered":"2024-09-05T02:16:54.873220+0000","last_clean":"2024-09-05T02:16:54.873220+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:54.873220+0000","last_undegraded":"2024-09-05T02:16:54.873220+0000","last_fullsized":"2024-09-05T02:16:54.873220+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'331","last_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_deep_scrub":"264'331","last_deep_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.873017+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:39:46.622589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":4548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.272266+0000","last_change":"2024-09-05T02:17:02.272266+0000","last_active":"2024-09-05T02:17:02.272266+0000","last_peered":"2024-09-05T02:17:02.272266+0000","last_clean":"2024-09-05T02:17:02.272266+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:17:02.272266+0000","last_undegraded":"2024-09-05T02:17:02.272266+0000","last_fullsized":"2024-09-05T02:17:02.272266+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.272095+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:47.154810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'747","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.480047+0000","last_change":"2024-09-05T02:16:42.480047+0000","last_active":"2024-09-05T02:16:42.480047+0000","last_peered":"2024-09-05T02:16:42.480047+0000","last_clean":"2024-09-05T02:16:42.480047+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:16:42.480047+0000","last_undegraded":"2024-09-05T02:16:42.480047+0000","last_fullsized":"2024-09-05T02:16:42.480047+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.479861+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:12.117260+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5103,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'440","reported_seq":1158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.122895+0000","last_change":"2024-09-05T02:16:36.122895+0000","last_active":"2024-09-05T02:16:36.122895+0000","last_peered":"2024-09-05T02:16:36.122895+0000","last_clean":"2024-09-05T02:16:36.122895+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:36.122895+0000","last_undegraded":"2024-09-05T02:16:36.122895+0000","last_fullsized":"2024-09-05T02:16:36.122895+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.122675+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:51.397953+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":823,"num_read_kb":4743,"num_write":1412,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.929007+0000","last_change":"2024-09-05T02:16:46.929007+0000","last_active":"2024-09-05T02:16:46.929007+0000","last_peered":"2024-09-05T02:16:46.929007+0000","last_clean":"2024-09-05T02:16:46.929007+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:16:46.929007+0000","last_undegraded":"2024-09-05T02:16:46.929007+0000","last_fullsized":"2024-09-05T02:16:46.929007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.928820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:33.551292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'430","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.607595+0000","last_change":"2024-09-05T02:16:54.607595+0000","last_active":"2024-09-05T02:16:54.607595+0000","last_peered":"2024-09-05T02:16:54.607595+0000","last_clean":"2024-09-05T02:16:54.607595+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:16:54.607595+0000","last_undegraded":"2024-09-05T02:16:54.607595+0000","last_fullsized":"2024-09-05T02:16:54.607595+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.607309+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:02:15.232596+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":700,"num_read_kb":1390,"num_write":540,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.186796+0000","last_change":"2024-09-05T02:16:50.186545+0000","last_active":"2024-09-05T02:16:50.186796+0000","last_peered":"2024-09-05T02:16:50.186796+0000","last_clean":"2024-09-05T02:16:50.186796+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:16:50.186796+0000","last_undegraded":"2024-09-05T02:16:50.186796+0000","last_fullsized":"2024-09-05T02:16:50.186796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.186319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:46:00.104169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'587","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.544434+0000","last_change":"2024-09-05T02:17:00.544151+0000","last_active":"2024-09-05T02:17:00.544434+0000","last_peered":"2024-09-05T02:17:00.544434+0000","last_clean":"2024-09-05T02:17:00.544434+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:17:00.544434+0000","last_undegraded":"2024-09-05T02:17:00.544434+0000","last_fullsized":"2024-09-05T02:17:00.544434+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'587","last_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_deep_scrub":"264'587","last_deep_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.543906+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:10:51.028073+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'439","reported_seq":1983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.464369+0000","last_change":"2024-09-05T02:16:35.464369+0000","last_active":"2024-09-05T02:16:35.464369+0000","last_peered":"2024-09-05T02:16:35.464369+0000","last_clean":"2024-09-05T02:16:35.464369+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:16:35.464369+0000","last_undegraded":"2024-09-05T02:16:35.464369+0000","last_fullsized":"2024-09-05T02:16:35.464369+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.464163+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:34.736676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'305","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.125447+0000","last_change":"2024-09-05T02:16:33.125280+0000","last_active":"2024-09-05T02:16:33.125447+0000","last_peered":"2024-09-05T02:16:33.125447+0000","last_clean":"2024-09-05T02:16:33.125447+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:33.125447+0000","last_undegraded":"2024-09-05T02:16:33.125447+0000","last_fullsized":"2024-09-05T02:16:33.125447+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.125091+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:46.538429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":6807,"num_write":872,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.791859+0000","last_change":"2024-09-05T02:16:40.791859+0000","last_active":"2024-09-05T02:16:40.791859+0000","last_peered":"2024-09-05T02:16:40.791859+0000","last_clean":"2024-09-05T02:16:40.791859+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:16:40.791859+0000","last_undegraded":"2024-09-05T02:16:40.791859+0000","last_fullsized":"2024-09-05T02:16:40.791859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.791659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:00:07.109747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'302","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.114210+0000","last_change":"2024-09-05T02:16:52.114066+0000","last_active":"2024-09-05T02:16:52.114210+0000","last_peered":"2024-09-05T02:16:52.114210+0000","last_clean":"2024-09-05T02:16:52.114210+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:16:52.114210+0000","last_undegraded":"2024-09-05T02:16:52.114210+0000","last_fullsized":"2024-09-05T02:16:52.114210+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.113869+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:18:23.318378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45431,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1122,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.195296+0000","last_change":"2024-09-05T02:17:00.195296+0000","last_active":"2024-09-05T02:17:00.195296+0000","last_peered":"2024-09-05T02:17:00.195296+0000","last_clean":"2024-09-05T02:17:00.195296+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:17:00.195296+0000","last_undegraded":"2024-09-05T02:17:00.195296+0000","last_fullsized":"2024-09-05T02:17:00.195296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.195111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:11:19.830376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.912916+0000","last_change":"2024-09-05T02:16:51.912916+0000","last_active":"2024-09-05T02:16:51.912916+0000","last_peered":"2024-09-05T02:16:51.912916+0000","last_clean":"2024-09-05T02:16:51.912916+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:16:51.912916+0000","last_undegraded":"2024-09-05T02:16:51.912916+0000","last_fullsized":"2024-09-05T02:16:51.912916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.912736+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:24.736846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'480","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.873624+0000","last_change":"2024-09-05T02:16:39.873624+0000","last_active":"2024-09-05T02:16:39.873624+0000","last_peered":"2024-09-05T02:16:39.873624+0000","last_clean":"2024-09-05T02:16:39.873624+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:16:39.873624+0000","last_undegraded":"2024-09-05T02:16:39.873624+0000","last_fullsized":"2024-09-05T02:16:39.873624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'480","last_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_deep_scrub":"264'480","last_deep_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.873409+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:34.456533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.108991+0000","last_change":"2024-09-05T02:16:34.108848+0000","last_active":"2024-09-05T02:16:34.108991+0000","last_peered":"2024-09-05T02:16:34.108991+0000","last_clean":"2024-09-05T02:16:34.108991+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:34.108991+0000","last_undegraded":"2024-09-05T02:16:34.108991+0000","last_fullsized":"2024-09-05T02:16:34.108991+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.108657+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:36:55.603566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":11870,"num_write":1072,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.768020+0000","last_change":"2024-09-05T02:16:42.767880+0000","last_active":"2024-09-05T02:16:42.768020+0000","last_peered":"2024-09-05T02:16:42.768020+0000","last_clean":"2024-09-05T02:16:42.768020+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:16:42.768020+0000","last_undegraded":"2024-09-05T02:16:42.768020+0000","last_fullsized":"2024-09-05T02:16:42.768020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.767694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:58:50.029710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'373","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.963277+0000","last_change":"2024-09-05T02:16:51.963277+0000","last_active":"2024-09-05T02:16:51.963277+0000","last_peered":"2024-09-05T02:16:51.963277+0000","last_clean":"2024-09-05T02:16:51.963277+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:51.963277+0000","last_undegraded":"2024-09-05T02:16:51.963277+0000","last_fullsized":"2024-09-05T02:16:51.963277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.963126+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:39:27.577793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1153,"num_write":442,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.239500+0000","last_change":"2024-09-05T02:16:44.239500+0000","last_active":"2024-09-05T02:16:44.239500+0000","last_peered":"2024-09-05T02:16:44.239500+0000","last_clean":"2024-09-05T02:16:44.239500+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:16:44.239500+0000","last_undegraded":"2024-09-05T02:16:44.239500+0000","last_fullsized":"2024-09-05T02:16:44.239500+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.239280+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:22:58.554723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'99","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.241222+0000","last_change":"2024-09-05T02:17:02.241222+0000","last_active":"2024-09-05T02:17:02.241222+0000","last_peered":"2024-09-05T02:17:02.241222+0000","last_clean":"2024-09-05T02:17:02.241222+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:17:02.241222+0000","last_undegraded":"2024-09-05T02:17:02.241222+0000","last_fullsized":"2024-09-05T02:17:02.241222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.241039+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:28.434401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'807","reported_seq":2411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.277564+0000","last_change":"2024-09-05T02:16:45.277310+0000","last_active":"2024-09-05T02:16:45.277564+0000","last_peered":"2024-09-05T02:16:45.277564+0000","last_clean":"2024-09-05T02:16:45.277564+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:16:45.277564+0000","last_undegraded":"2024-09-05T02:16:45.277564+0000","last_fullsized":"2024-09-05T02:16:45.277564+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'807","last_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_deep_scrub":"264'807","last_deep_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.277038+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:50.324780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3282,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'325","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.512913+0000","last_change":"2024-09-05T02:16:32.512680+0000","last_active":"2024-09-05T02:16:32.512913+0000","last_peered":"2024-09-05T02:16:32.512913+0000","last_clean":"2024-09-05T02:16:32.512913+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:16:32.512913+0000","last_undegraded":"2024-09-05T02:16:32.512913+0000","last_fullsized":"2024-09-05T02:16:32.512913+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.512392+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:51.415971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":126733,"num_write":975,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.758161+0000","last_change":"2024-09-05T02:16:41.758161+0000","last_active":"2024-09-05T02:16:41.758161+0000","last_peered":"2024-09-05T02:16:41.758161+0000","last_clean":"2024-09-05T02:16:41.758161+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:16:41.758161+0000","last_undegraded":"2024-09-05T02:16:41.758161+0000","last_fullsized":"2024-09-05T02:16:41.758161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.757955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:26.539921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'553","reported_seq":1233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.317795+0000","last_change":"2024-09-05T02:16:40.317795+0000","last_active":"2024-09-05T02:16:40.317795+0000","last_peered":"2024-09-05T02:16:40.317795+0000","last_clean":"2024-09-05T02:16:40.317795+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:16:40.317795+0000","last_undegraded":"2024-09-05T02:16:40.317795+0000","last_fullsized":"2024-09-05T02:16:40.317795+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.317611+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:00:06.774339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101782,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":984,"num_read_kb":2420,"num_write":814,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.774119+0000","last_change":"2024-09-05T02:16:46.774119+0000","last_active":"2024-09-05T02:16:46.774119+0000","last_peered":"2024-09-05T02:16:46.774119+0000","last_clean":"2024-09-05T02:16:46.774119+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:16:46.774119+0000","last_undegraded":"2024-09-05T02:16:46.774119+0000","last_fullsized":"2024-09-05T02:16:46.774119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.773927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:33.369118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'124","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.193863+0000","last_change":"2024-09-05T02:16:51.193863+0000","last_active":"2024-09-05T02:16:51.193863+0000","last_peered":"2024-09-05T02:16:51.193863+0000","last_clean":"2024-09-05T02:16:51.193863+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:16:51.193863+0000","last_undegraded":"2024-09-05T02:16:51.193863+0000","last_fullsized":"2024-09-05T02:16:51.193863+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.193637+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:46.253889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'959","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.496298+0000","last_change":"2024-09-05T02:16:34.496164+0000","last_active":"2024-09-05T02:16:34.496298+0000","last_peered":"2024-09-05T02:16:34.496298+0000","last_clean":"2024-09-05T02:16:34.496298+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:16:34.496298+0000","last_undegraded":"2024-09-05T02:16:34.496298+0000","last_fullsized":"2024-09-05T02:16:34.496298+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'959","last_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_deep_scrub":"264'959","last_deep_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.495992+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:04.831466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'591","reported_seq":1422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.881896+0000","last_change":"2024-09-05T02:16:27.881841+0000","last_active":"2024-09-05T02:16:27.881896+0000","last_peered":"2024-09-05T02:16:27.881896+0000","last_clean":"2024-09-05T02:16:27.881896+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:27.881896+0000","last_undegraded":"2024-09-05T02:16:27.881896+0000","last_fullsized":"2024-09-05T02:16:27.881896+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'591","last_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_deep_scrub":"264'591","last_deep_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.881626+0000","objects_scrubbed":10,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:45.891183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1279,"num_read_kb":93816,"num_write":1779,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.755557+0000","last_change":"2024-09-05T02:16:43.755375+0000","last_active":"2024-09-05T02:16:43.755557+0000","last_peered":"2024-09-05T02:16:43.755557+0000","last_clean":"2024-09-05T02:16:43.755557+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:16:43.755557+0000","last_undegraded":"2024-09-05T02:16:43.755557+0000","last_fullsized":"2024-09-05T02:16:43.755557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.755186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:44.890636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'324","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.459587+0000","last_change":"2024-09-05T02:16:54.459431+0000","last_active":"2024-09-05T02:16:54.459587+0000","last_peered":"2024-09-05T02:16:54.459587+0000","last_clean":"2024-09-05T02:16:54.459587+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:16:54.459587+0000","last_undegraded":"2024-09-05T02:16:54.459587+0000","last_fullsized":"2024-09-05T02:16:54.459587+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.459229+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:23.961491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":1083,"num_write":458,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.250313+0000","last_change":"2024-09-05T02:16:48.250313+0000","last_active":"2024-09-05T02:16:48.250313+0000","last_peered":"2024-09-05T02:16:48.250313+0000","last_clean":"2024-09-05T02:16:48.250313+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:16:48.250313+0000","last_undegraded":"2024-09-05T02:16:48.250313+0000","last_fullsized":"2024-09-05T02:16:48.250313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.250133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:07.642699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'105","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.238867+0000","last_change":"2024-09-05T02:17:03.238867+0000","last_active":"2024-09-05T02:17:03.238867+0000","last_peered":"2024-09-05T02:17:03.238867+0000","last_clean":"2024-09-05T02:17:03.238867+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:17:03.238867+0000","last_undegraded":"2024-09-05T02:17:03.238867+0000","last_fullsized":"2024-09-05T02:17:03.238867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.238583+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:20:30.549216+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'497","reported_seq":2128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.495768+0000","last_change":"2024-09-05T02:16:36.495522+0000","last_active":"2024-09-05T02:16:36.495768+0000","last_peered":"2024-09-05T02:16:36.495768+0000","last_clean":"2024-09-05T02:16:36.495768+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:16:36.495768+0000","last_undegraded":"2024-09-05T02:16:36.495768+0000","last_fullsized":"2024-09-05T02:16:36.495768+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.495268+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:26.514116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'382","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.836546+0000","last_change":"2024-09-05T02:16:29.836399+0000","last_active":"2024-09-05T02:16:29.836546+0000","last_peered":"2024-09-05T02:16:29.836546+0000","last_clean":"2024-09-05T02:16:29.836546+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:29.836546+0000","last_undegraded":"2024-09-05T02:16:29.836546+0000","last_fullsized":"2024-09-05T02:16:29.836546+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.836204+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:59.305574+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250145,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":21240,"num_write":1224,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.186752+0000","last_change":"2024-09-05T02:16:42.186623+0000","last_active":"2024-09-05T02:16:42.186752+0000","last_peered":"2024-09-05T02:16:42.186752+0000","last_clean":"2024-09-05T02:16:42.186752+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:16:42.186752+0000","last_undegraded":"2024-09-05T02:16:42.186752+0000","last_fullsized":"2024-09-05T02:16:42.186752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.186438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:10.931784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'353","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.751783+0000","last_change":"2024-09-05T02:16:44.751783+0000","last_active":"2024-09-05T02:16:44.751783+0000","last_peered":"2024-09-05T02:16:44.751783+0000","last_clean":"2024-09-05T02:16:44.751783+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:16:44.751783+0000","last_undegraded":"2024-09-05T02:16:44.751783+0000","last_fullsized":"2024-09-05T02:16:44.751783+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.751562+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:24.105318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":1068,"num_write":416,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.743832+0000","last_change":"2024-09-05T02:16:47.743669+0000","last_active":"2024-09-05T02:16:47.743832+0000","last_peered":"2024-09-05T02:16:47.743832+0000","last_clean":"2024-09-05T02:16:47.743832+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:47.743832+0000","last_undegraded":"2024-09-05T02:16:47.743832+0000","last_fullsized":"2024-09-05T02:16:47.743832+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.743487+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:46.001538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'119","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.160355+0000","last_change":"2024-09-05T02:16:49.160196+0000","last_active":"2024-09-05T02:16:49.160355+0000","last_peered":"2024-09-05T02:16:49.160355+0000","last_clean":"2024-09-05T02:16:49.160355+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:16:49.160355+0000","last_undegraded":"2024-09-05T02:16:49.160355+0000","last_fullsized":"2024-09-05T02:16:49.160355+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.160002+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:41:09.578917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'394","reported_seq":1897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.447509+0000","last_change":"2024-09-05T02:16:37.447326+0000","last_active":"2024-09-05T02:16:37.447509+0000","last_peered":"2024-09-05T02:16:37.447509+0000","last_clean":"2024-09-05T02:16:37.447509+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:16:37.447509+0000","last_undegraded":"2024-09-05T02:16:37.447509+0000","last_fullsized":"2024-09-05T02:16:37.447509+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.447142+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:57.480162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.517777+0000","last_change":"2024-09-05T02:16:29.517777+0000","last_active":"2024-09-05T02:16:29.517777+0000","last_peered":"2024-09-05T02:16:29.517777+0000","last_clean":"2024-09-05T02:16:29.517777+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:29.517777+0000","last_undegraded":"2024-09-05T02:16:29.517777+0000","last_fullsized":"2024-09-05T02:16:29.517777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.517556+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:02:11.732840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":32430,"num_write":1082,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.602492+0000","last_change":"2024-09-05T02:16:50.602492+0000","last_active":"2024-09-05T02:16:50.602492+0000","last_peered":"2024-09-05T02:16:50.602492+0000","last_clean":"2024-09-05T02:16:50.602492+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:16:50.602492+0000","last_undegraded":"2024-09-05T02:16:50.602492+0000","last_fullsized":"2024-09-05T02:16:50.602492+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.602255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:23.593095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'120","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.113741+0000","last_change":"2024-09-05T02:16:53.113589+0000","last_active":"2024-09-05T02:16:53.113741+0000","last_peered":"2024-09-05T02:16:53.113741+0000","last_clean":"2024-09-05T02:16:53.113741+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:16:53.113741+0000","last_undegraded":"2024-09-05T02:16:53.113741+0000","last_fullsized":"2024-09-05T02:16:53.113741+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.113378+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:32.124763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'771","reported_seq":2817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.889501+0000","last_change":"2024-09-05T02:16:48.889325+0000","last_active":"2024-09-05T02:16:48.889501+0000","last_peered":"2024-09-05T02:16:48.889501+0000","last_clean":"2024-09-05T02:16:48.889501+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:48.889501+0000","last_undegraded":"2024-09-05T02:16:48.889501+0000","last_fullsized":"2024-09-05T02:16:48.889501+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.889140+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:40.831468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.527512+0000","last_change":"2024-09-05T02:17:00.527328+0000","last_active":"2024-09-05T02:17:00.527512+0000","last_peered":"2024-09-05T02:17:00.527512+0000","last_clean":"2024-09-05T02:17:00.527512+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:17:00.527512+0000","last_undegraded":"2024-09-05T02:17:00.527512+0000","last_fullsized":"2024-09-05T02:17:00.527512+0000","mapping_epoch":33,"log_start":"264'101","ondisk_log_start":"264'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.527142+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:06.769067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1291","reported_seq":3056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.245104+0000","last_change":"2024-09-05T02:16:39.244971+0000","last_active":"2024-09-05T02:16:39.245104+0000","last_peered":"2024-09-05T02:16:39.245104+0000","last_clean":"2024-09-05T02:16:39.245104+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:16:39.245104+0000","last_undegraded":"2024-09-05T02:16:39.245104+0000","last_fullsized":"2024-09-05T02:16:39.245104+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1291","last_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_deep_scrub":"264'1291","last_deep_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.244780+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:47.585141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'361","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.900274+0000","last_change":"2024-09-05T02:16:29.900274+0000","last_active":"2024-09-05T02:16:29.900274+0000","last_peered":"2024-09-05T02:16:29.900274+0000","last_clean":"2024-09-05T02:16:29.900274+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:29.900274+0000","last_undegraded":"2024-09-05T02:16:29.900274+0000","last_fullsized":"2024-09-05T02:16:29.900274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.900193+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:20.281068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":2332,"num_write":1185,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.482427+0000","last_change":"2024-09-05T02:16:50.482268+0000","last_active":"2024-09-05T02:16:50.482427+0000","last_peered":"2024-09-05T02:16:50.482427+0000","last_clean":"2024-09-05T02:16:50.482427+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:16:50.482427+0000","last_undegraded":"2024-09-05T02:16:50.482427+0000","last_fullsized":"2024-09-05T02:16:50.482427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.482092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:18.769975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'462","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.581196+0000","last_change":"2024-09-05T02:16:55.580931+0000","last_active":"2024-09-05T02:16:55.581196+0000","last_peered":"2024-09-05T02:16:55.581196+0000","last_clean":"2024-09-05T02:16:55.581196+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:16:55.581196+0000","last_undegraded":"2024-09-05T02:16:55.581196+0000","last_fullsized":"2024-09-05T02:16:55.581196+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.580686+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:43.482301+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49653,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1315,"num_read_kb":1876,"num_write":1876,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.932227+0000","last_change":"2024-09-05T02:16:45.932041+0000","last_active":"2024-09-05T02:16:45.932227+0000","last_peered":"2024-09-05T02:16:45.932227+0000","last_clean":"2024-09-05T02:16:45.932227+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:16:45.932227+0000","last_undegraded":"2024-09-05T02:16:45.932227+0000","last_fullsized":"2024-09-05T02:16:45.932227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.931862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:22.195208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'154","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.274802+0000","last_change":"2024-09-05T02:16:58.274647+0000","last_active":"2024-09-05T02:16:58.274802+0000","last_peered":"2024-09-05T02:16:58.274802+0000","last_clean":"2024-09-05T02:16:58.274802+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:16:58.274802+0000","last_undegraded":"2024-09-05T02:16:58.274802+0000","last_fullsized":"2024-09-05T02:16:58.274802+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.274456+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:59.540758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'895","reported_seq":2578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.837218+0000","last_change":"2024-09-05T02:16:37.837031+0000","last_active":"2024-09-05T02:16:37.837218+0000","last_peered":"2024-09-05T02:16:37.837218+0000","last_clean":"2024-09-05T02:16:37.837218+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:16:37.837218+0000","last_undegraded":"2024-09-05T02:16:37.837218+0000","last_fullsized":"2024-09-05T02:16:37.837218+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'895","last_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_deep_scrub":"264'895","last_deep_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.836840+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:26.109909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1433,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.175725+0000","last_change":"2024-09-05T02:16:30.175725+0000","last_active":"2024-09-05T02:16:30.175725+0000","last_peered":"2024-09-05T02:16:30.175725+0000","last_clean":"2024-09-05T02:16:30.175725+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:16:30.175725+0000","last_undegraded":"2024-09-05T02:16:30.175725+0000","last_fullsized":"2024-09-05T02:16:30.175725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.175528+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:42:10.298718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.463168+0000","last_change":"2024-09-05T02:16:30.462900+0000","last_active":"2024-09-05T02:16:30.463168+0000","last_peered":"2024-09-05T02:16:30.463168+0000","last_clean":"2024-09-05T02:16:30.463168+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:16:30.463168+0000","last_undegraded":"2024-09-05T02:16:30.463168+0000","last_fullsized":"2024-09-05T02:16:30.463168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.462683+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.227113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'307","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.764633+0000","last_change":"2024-09-05T02:16:27.764633+0000","last_active":"2024-09-05T02:16:27.764633+0000","last_peered":"2024-09-05T02:16:27.764633+0000","last_clean":"2024-09-05T02:16:27.764633+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:27.764633+0000","last_undegraded":"2024-09-05T02:16:27.764633+0000","last_fullsized":"2024-09-05T02:16:27.764633+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.764568+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.844822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306176,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":457,"num_read_kb":14472,"num_write":870,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.976545+0000","last_change":"2024-09-05T02:16:50.976318+0000","last_active":"2024-09-05T02:16:50.976545+0000","last_peered":"2024-09-05T02:16:50.976545+0000","last_clean":"2024-09-05T02:16:50.976545+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:16:50.976545+0000","last_undegraded":"2024-09-05T02:16:50.976545+0000","last_fullsized":"2024-09-05T02:16:50.976545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.976113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:48:12.941027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'794","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.533155+0000","last_change":"2024-09-05T02:16:56.533155+0000","last_active":"2024-09-05T02:16:56.533155+0000","last_peered":"2024-09-05T02:16:56.533155+0000","last_clean":"2024-09-05T02:16:56.533155+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:16:56.533155+0000","last_undegraded":"2024-09-05T02:16:56.533155+0000","last_fullsized":"2024-09-05T02:16:56.533155+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.532937+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:46.840785+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157356,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1541,"num_read_kb":3609,"num_write":1452,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89058,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.222761+0000","last_change":"2024-09-05T02:16:56.222761+0000","last_active":"2024-09-05T02:16:56.222761+0000","last_peered":"2024-09-05T02:16:56.222761+0000","last_clean":"2024-09-05T02:16:56.222761+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:16:56.222761+0000","last_undegraded":"2024-09-05T02:16:56.222761+0000","last_fullsized":"2024-09-05T02:16:56.222761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.222553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:59.389821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'203","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.947987+0000","last_change":"2024-09-05T02:16:52.947987+0000","last_active":"2024-09-05T02:16:52.947987+0000","last_peered":"2024-09-05T02:16:52.947987+0000","last_clean":"2024-09-05T02:16:52.947987+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:16:52.947987+0000","last_undegraded":"2024-09-05T02:16:52.947987+0000","last_fullsized":"2024-09-05T02:16:52.947987+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.947749+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:13.134156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'785","reported_seq":2290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.420146+0000","last_change":"2024-09-05T02:16:35.420146+0000","last_active":"2024-09-05T02:16:35.420146+0000","last_peered":"2024-09-05T02:16:35.420146+0000","last_clean":"2024-09-05T02:16:35.420146+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:16:35.420146+0000","last_undegraded":"2024-09-05T02:16:35.420146+0000","last_fullsized":"2024-09-05T02:16:35.420146+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.419887+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:06.326976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.122749+0000","last_change":"2024-09-05T02:16:32.122749+0000","last_active":"2024-09-05T02:16:32.122749+0000","last_peered":"2024-09-05T02:16:32.122749+0000","last_clean":"2024-09-05T02:16:32.122749+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:16:32.122749+0000","last_undegraded":"2024-09-05T02:16:32.122749+0000","last_fullsized":"2024-09-05T02:16:32.122749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.122554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:52.851366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'314","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:26.509714+0000","last_change":"2024-09-05T02:16:26.509558+0000","last_active":"2024-09-05T02:16:26.509714+0000","last_peered":"2024-09-05T02:16:26.509714+0000","last_clean":"2024-09-05T02:16:26.509714+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:16:26.509714+0000","last_undegraded":"2024-09-05T02:16:26.509714+0000","last_fullsized":"2024-09-05T02:16:26.509714+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_clean_scrub_stamp":"2024-09-05T02:16:26.509242+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:07.832980+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":5706,"num_write":1068,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.588668+0000","last_change":"2024-09-05T02:16:49.588668+0000","last_active":"2024-09-05T02:16:49.588668+0000","last_peered":"2024-09-05T02:16:49.588668+0000","last_clean":"2024-09-05T02:16:49.588668+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:16:49.588668+0000","last_undegraded":"2024-09-05T02:16:49.588668+0000","last_fullsized":"2024-09-05T02:16:49.588668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.588378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:16.006275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1382","reported_seq":3406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.209063+0000","last_change":"2024-09-05T02:16:46.208830+0000","last_active":"2024-09-05T02:16:46.209063+0000","last_peered":"2024-09-05T02:16:46.209063+0000","last_clean":"2024-09-05T02:16:46.209063+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:46.209063+0000","last_undegraded":"2024-09-05T02:16:46.209063+0000","last_fullsized":"2024-09-05T02:16:46.209063+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1382","last_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_deep_scrub":"264'1382","last_deep_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.208570+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":1300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:04.028834+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2121,"num_read_kb":3935,"num_write":1230,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.826223+0000","last_change":"2024-09-05T02:16:58.825989+0000","last_active":"2024-09-05T02:16:58.826223+0000","last_peered":"2024-09-05T02:16:58.826223+0000","last_clean":"2024-09-05T02:16:58.826223+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:16:58.826223+0000","last_undegraded":"2024-09-05T02:16:58.826223+0000","last_fullsized":"2024-09-05T02:16:58.826223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.825724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.747695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'252","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.159330+0000","last_change":"2024-09-05T02:16:52.159330+0000","last_active":"2024-09-05T02:16:52.159330+0000","last_peered":"2024-09-05T02:16:52.159330+0000","last_clean":"2024-09-05T02:16:52.159330+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:16:52.159330+0000","last_undegraded":"2024-09-05T02:16:52.159330+0000","last_fullsized":"2024-09-05T02:16:52.159330+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.159103+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:01:00.496206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'413","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.210253+0000","last_change":"2024-09-05T02:16:40.210253+0000","last_active":"2024-09-05T02:16:40.210253+0000","last_peered":"2024-09-05T02:16:40.210253+0000","last_clean":"2024-09-05T02:16:40.210253+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:16:40.210253+0000","last_undegraded":"2024-09-05T02:16:40.210253+0000","last_fullsized":"2024-09-05T02:16:40.210253+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.210048+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:40.273557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":912,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.788046+0000","last_change":"2024-09-05T02:16:28.787900+0000","last_active":"2024-09-05T02:16:28.788046+0000","last_peered":"2024-09-05T02:16:28.788046+0000","last_clean":"2024-09-05T02:16:28.788046+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:16:28.788046+0000","last_undegraded":"2024-09-05T02:16:28.788046+0000","last_fullsized":"2024-09-05T02:16:28.788046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.787731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:26:43.122051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'335","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.326044+0000","last_change":"2024-09-05T02:16:29.326044+0000","last_active":"2024-09-05T02:16:29.326044+0000","last_peered":"2024-09-05T02:16:29.326044+0000","last_clean":"2024-09-05T02:16:29.326044+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:29.326044+0000","last_undegraded":"2024-09-05T02:16:29.326044+0000","last_fullsized":"2024-09-05T02:16:29.326044+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.325952+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:55.516960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":23361,"num_write":910,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.842874+0000","last_change":"2024-09-05T02:16:39.842874+0000","last_active":"2024-09-05T02:16:39.842874+0000","last_peered":"2024-09-05T02:16:39.842874+0000","last_clean":"2024-09-05T02:16:39.842874+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:16:39.842874+0000","last_undegraded":"2024-09-05T02:16:39.842874+0000","last_fullsized":"2024-09-05T02:16:39.842874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.842690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:16:19.549189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'355","reported_seq":1964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.918359+0000","last_change":"2024-09-05T02:16:53.918210+0000","last_active":"2024-09-05T02:16:53.918359+0000","last_peered":"2024-09-05T02:16:53.918359+0000","last_clean":"2024-09-05T02:16:53.918359+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:16:53.918359+0000","last_undegraded":"2024-09-05T02:16:53.918359+0000","last_fullsized":"2024-09-05T02:16:53.918359+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.917978+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:01:50.088462+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.287896+0000","last_change":"2024-09-05T02:16:43.287761+0000","last_active":"2024-09-05T02:16:43.287896+0000","last_peered":"2024-09-05T02:16:43.287896+0000","last_clean":"2024-09-05T02:16:43.287896+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:16:43.287896+0000","last_undegraded":"2024-09-05T02:16:43.287896+0000","last_fullsized":"2024-09-05T02:16:43.287896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.287581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:02.058137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'245","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.257968+0000","last_change":"2024-09-05T02:17:04.257720+0000","last_active":"2024-09-05T02:17:04.257968+0000","last_peered":"2024-09-05T02:17:04.257968+0000","last_clean":"2024-09-05T02:17:04.257968+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:17:04.257968+0000","last_undegraded":"2024-09-05T02:17:04.257968+0000","last_fullsized":"2024-09-05T02:17:04.257968+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.257502+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:51:50.338750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1278","reported_seq":2936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.277311+0000","last_change":"2024-09-05T02:16:36.277149+0000","last_active":"2024-09-05T02:16:36.277311+0000","last_peered":"2024-09-05T02:16:36.277311+0000","last_clean":"2024-09-05T02:16:36.277311+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:16:36.277311+0000","last_undegraded":"2024-09-05T02:16:36.277311+0000","last_fullsized":"2024-09-05T02:16:36.277311+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1278","last_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_deep_scrub":"264'1278","last_deep_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.276963+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:10.284570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1616,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.467029+0000","last_change":"2024-09-05T02:16:29.466902+0000","last_active":"2024-09-05T02:16:29.467029+0000","last_peered":"2024-09-05T02:16:29.467029+0000","last_clean":"2024-09-05T02:16:29.467029+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:16:29.467029+0000","last_undegraded":"2024-09-05T02:16:29.467029+0000","last_fullsized":"2024-09-05T02:16:29.467029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.466718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:17.729741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'367","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.515860+0000","last_change":"2024-09-05T02:16:31.515719+0000","last_active":"2024-09-05T02:16:31.515860+0000","last_peered":"2024-09-05T02:16:31.515860+0000","last_clean":"2024-09-05T02:16:31.515860+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:31.515860+0000","last_undegraded":"2024-09-05T02:16:31.515860+0000","last_fullsized":"2024-09-05T02:16:31.515860+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.515456+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:25:12.133378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":46632,"num_write":1174,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.271988+0000","last_change":"2024-09-05T02:16:46.271828+0000","last_active":"2024-09-05T02:16:46.271988+0000","last_peered":"2024-09-05T02:16:46.271988+0000","last_clean":"2024-09-05T02:16:46.271988+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:16:46.271988+0000","last_undegraded":"2024-09-05T02:16:46.271988+0000","last_fullsized":"2024-09-05T02:16:46.271988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.271644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:40.777056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'171","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.128445+0000","last_change":"2024-09-05T02:16:51.128445+0000","last_active":"2024-09-05T02:16:51.128445+0000","last_peered":"2024-09-05T02:16:51.128445+0000","last_clean":"2024-09-05T02:16:51.128445+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:16:51.128445+0000","last_undegraded":"2024-09-05T02:16:51.128445+0000","last_fullsized":"2024-09-05T02:16:51.128445+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.128239+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:54.774325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.884813+0000","last_change":"2024-09-05T02:16:46.884813+0000","last_active":"2024-09-05T02:16:46.884813+0000","last_peered":"2024-09-05T02:16:46.884813+0000","last_clean":"2024-09-05T02:16:46.884813+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:16:46.884813+0000","last_undegraded":"2024-09-05T02:16:46.884813+0000","last_fullsized":"2024-09-05T02:16:46.884813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.884632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:28:31.243635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'118","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.562825+0000","last_change":"2024-09-05T02:17:06.562825+0000","last_active":"2024-09-05T02:17:06.562825+0000","last_peered":"2024-09-05T02:17:06.562825+0000","last_clean":"2024-09-05T02:17:06.562825+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:17:06.562825+0000","last_undegraded":"2024-09-05T02:17:06.562825+0000","last_fullsized":"2024-09-05T02:17:06.562825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.562629+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:51.442782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'542","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.258808+0000","last_change":"2024-09-05T02:16:35.258563+0000","last_active":"2024-09-05T02:16:35.258808+0000","last_peered":"2024-09-05T02:16:35.258808+0000","last_clean":"2024-09-05T02:16:35.258808+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:16:35.258808+0000","last_undegraded":"2024-09-05T02:16:35.258808+0000","last_fullsized":"2024-09-05T02:16:35.258808+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.258316+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:30.208156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'306","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.502568+0000","last_change":"2024-09-05T02:16:31.502349+0000","last_active":"2024-09-05T02:16:31.502568+0000","last_peered":"2024-09-05T02:16:31.502568+0000","last_clean":"2024-09-05T02:16:31.502568+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:16:31.502568+0000","last_undegraded":"2024-09-05T02:16:31.502568+0000","last_fullsized":"2024-09-05T02:16:31.502568+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.502116+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:28.057536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":39042,"num_write":920,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.404422+0000","last_change":"2024-09-05T02:16:27.404366+0000","last_active":"2024-09-05T02:16:27.404422+0000","last_peered":"2024-09-05T02:16:27.404422+0000","last_clean":"2024-09-05T02:16:27.404422+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:16:27.404422+0000","last_undegraded":"2024-09-05T02:16:27.404422+0000","last_fullsized":"2024-09-05T02:16:27.404422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.404292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:45:52.441484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.217437+0000","last_change":"2024-09-05T02:16:57.217285+0000","last_active":"2024-09-05T02:16:57.217437+0000","last_peered":"2024-09-05T02:16:57.217437+0000","last_clean":"2024-09-05T02:16:57.217437+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:16:57.217437+0000","last_undegraded":"2024-09-05T02:16:57.217437+0000","last_fullsized":"2024-09-05T02:16:57.217437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.217067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:42.886187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'687","reported_seq":1413,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.284135+0000","last_change":"2024-09-05T02:16:47.284135+0000","last_active":"2024-09-05T02:16:47.284135+0000","last_peered":"2024-09-05T02:16:47.284135+0000","last_clean":"2024-09-05T02:16:47.284135+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:16:47.284135+0000","last_undegraded":"2024-09-05T02:16:47.284135+0000","last_fullsized":"2024-09-05T02:16:47.284135+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'687","last_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_deep_scrub":"264'687","last_deep_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.283917+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:28.307016+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1139,"num_read_kb":2483,"num_write":1010,"num_write_kb":799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.532489+0000","last_change":"2024-09-05T02:16:57.532254+0000","last_active":"2024-09-05T02:16:57.532489+0000","last_peered":"2024-09-05T02:16:57.532489+0000","last_clean":"2024-09-05T02:16:57.532489+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:16:57.532489+0000","last_undegraded":"2024-09-05T02:16:57.532489+0000","last_fullsized":"2024-09-05T02:16:57.532489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.531985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:20.408235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'189","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.243460+0000","last_change":"2024-09-05T02:17:03.243320+0000","last_active":"2024-09-05T02:17:03.243460+0000","last_peered":"2024-09-05T02:17:03.243460+0000","last_clean":"2024-09-05T02:17:03.243460+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:17:03.243460+0000","last_undegraded":"2024-09-05T02:17:03.243460+0000","last_fullsized":"2024-09-05T02:17:03.243460+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.243122+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:29:13.048015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'886","reported_seq":2362,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.267735+0000","last_change":"2024-09-05T02:16:54.267603+0000","last_active":"2024-09-05T02:16:54.267735+0000","last_peered":"2024-09-05T02:16:54.267735+0000","last_clean":"2024-09-05T02:16:54.267735+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:16:54.267735+0000","last_undegraded":"2024-09-05T02:16:54.267735+0000","last_fullsized":"2024-09-05T02:16:54.267735+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'886","last_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_deep_scrub":"264'886","last_deep_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.267422+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:10:42.442657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'324","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.373091+0000","last_change":"2024-09-05T02:16:30.372916+0000","last_active":"2024-09-05T02:16:30.373091+0000","last_peered":"2024-09-05T02:16:30.373091+0000","last_clean":"2024-09-05T02:16:30.373091+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:30.373091+0000","last_undegraded":"2024-09-05T02:16:30.373091+0000","last_fullsized":"2024-09-05T02:16:30.373091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.372709+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:12:13.999885+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":37378,"num_write":1055,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.124745+0000","last_change":"2024-09-05T02:16:31.124622+0000","last_active":"2024-09-05T02:16:31.124745+0000","last_peered":"2024-09-05T02:16:31.124745+0000","last_clean":"2024-09-05T02:16:31.124745+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:16:31.124745+0000","last_undegraded":"2024-09-05T02:16:31.124745+0000","last_fullsized":"2024-09-05T02:16:31.124745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.124439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:31.003902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.885018+0000","last_change":"2024-09-05T02:16:43.884773+0000","last_active":"2024-09-05T02:16:43.885018+0000","last_peered":"2024-09-05T02:16:43.885018+0000","last_clean":"2024-09-05T02:16:43.885018+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:16:43.885018+0000","last_undegraded":"2024-09-05T02:16:43.885018+0000","last_fullsized":"2024-09-05T02:16:43.885018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.884568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:16:44.961807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'212","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.198882+0000","last_change":"2024-09-05T02:16:47.198716+0000","last_active":"2024-09-05T02:16:47.198882+0000","last_peered":"2024-09-05T02:16:47.198882+0000","last_clean":"2024-09-05T02:16:47.198882+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:16:47.198882+0000","last_undegraded":"2024-09-05T02:16:47.198882+0000","last_fullsized":"2024-09-05T02:16:47.198882+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.198502+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:34.874131+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'798","reported_seq":3287,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.552427+0000","last_change":"2024-09-05T02:16:57.552427+0000","last_active":"2024-09-05T02:16:57.552427+0000","last_peered":"2024-09-05T02:16:57.552427+0000","last_clean":"2024-09-05T02:16:57.552427+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:16:57.552427+0000","last_undegraded":"2024-09-05T02:16:57.552427+0000","last_fullsized":"2024-09-05T02:16:57.552427+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'798","last_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_deep_scrub":"264'798","last_deep_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.552252+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.995961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.239397+0000","last_change":"2024-09-05T02:17:06.239397+0000","last_active":"2024-09-05T02:17:06.239397+0000","last_peered":"2024-09-05T02:17:06.239397+0000","last_clean":"2024-09-05T02:17:06.239397+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:17:06.239397+0000","last_undegraded":"2024-09-05T02:17:06.239397+0000","last_fullsized":"2024-09-05T02:17:06.239397+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.239206+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:46.358129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'964","reported_seq":2560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.072318+0000","last_change":"2024-09-05T02:16:45.072318+0000","last_active":"2024-09-05T02:16:45.072318+0000","last_peered":"2024-09-05T02:16:45.072318+0000","last_clean":"2024-09-05T02:16:45.072318+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:16:45.072318+0000","last_undegraded":"2024-09-05T02:16:45.072318+0000","last_fullsized":"2024-09-05T02:16:45.072318+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'964","last_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_deep_scrub":"264'964","last_deep_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.072096+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:26:16.793459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'419","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.916620+0000","last_change":"2024-09-05T02:16:28.916620+0000","last_active":"2024-09-05T02:16:28.916620+0000","last_peered":"2024-09-05T02:16:28.916620+0000","last_clean":"2024-09-05T02:16:28.916620+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:28.916620+0000","last_undegraded":"2024-09-05T02:16:28.916620+0000","last_fullsized":"2024-09-05T02:16:28.916620+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'419","last_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_deep_scrub":"264'419","last_deep_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.916405+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:38.195772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":754,"num_read_kb":36692,"num_write":1433,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.366495+0000","last_change":"2024-09-05T02:16:28.366495+0000","last_active":"2024-09-05T02:16:28.366495+0000","last_peered":"2024-09-05T02:16:28.366495+0000","last_clean":"2024-09-05T02:16:28.366495+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:16:28.366495+0000","last_undegraded":"2024-09-05T02:16:28.366495+0000","last_fullsized":"2024-09-05T02:16:28.366495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.366407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:29:33.144478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.448189+0000","last_change":"2024-09-05T02:16:48.448071+0000","last_active":"2024-09-05T02:16:48.448189+0000","last_peered":"2024-09-05T02:16:48.448189+0000","last_clean":"2024-09-05T02:16:48.448189+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:16:48.448189+0000","last_undegraded":"2024-09-05T02:16:48.448189+0000","last_fullsized":"2024-09-05T02:16:48.448189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.447892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:42:23.569052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'162","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.478714+0000","last_change":"2024-09-05T02:16:53.478566+0000","last_active":"2024-09-05T02:16:53.478714+0000","last_peered":"2024-09-05T02:16:53.478714+0000","last_clean":"2024-09-05T02:16:53.478714+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:16:53.478714+0000","last_undegraded":"2024-09-05T02:16:53.478714+0000","last_fullsized":"2024-09-05T02:16:53.478714+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.478364+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:22.605913+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.133922+0000","last_change":"2024-09-05T02:16:58.133765+0000","last_active":"2024-09-05T02:16:58.133922+0000","last_peered":"2024-09-05T02:16:58.133922+0000","last_clean":"2024-09-05T02:16:58.133922+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:58.133922+0000","last_undegraded":"2024-09-05T02:16:58.133922+0000","last_fullsized":"2024-09-05T02:16:58.133922+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.133593+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:25.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'177","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.235324+0000","last_change":"2024-09-05T02:16:53.235179+0000","last_active":"2024-09-05T02:16:53.235324+0000","last_peered":"2024-09-05T02:16:53.235324+0000","last_clean":"2024-09-05T02:16:53.235324+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:16:53.235324+0000","last_undegraded":"2024-09-05T02:16:53.235324+0000","last_fullsized":"2024-09-05T02:16:53.235324+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.234979+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:35.819811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'567","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.473632+0000","last_change":"2024-09-05T02:16:33.473476+0000","last_active":"2024-09-05T02:16:33.473632+0000","last_peered":"2024-09-05T02:16:33.473632+0000","last_clean":"2024-09-05T02:16:33.473632+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:16:33.473632+0000","last_undegraded":"2024-09-05T02:16:33.473632+0000","last_fullsized":"2024-09-05T02:16:33.473632+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'567","last_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_deep_scrub":"264'567","last_deep_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.473297+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:11.125295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":876,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'379","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.461633+0000","last_change":"2024-09-05T02:16:27.461633+0000","last_active":"2024-09-05T02:16:27.461633+0000","last_peered":"2024-09-05T02:16:27.461633+0000","last_clean":"2024-09-05T02:16:27.461633+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:16:27.461633+0000","last_undegraded":"2024-09-05T02:16:27.461633+0000","last_fullsized":"2024-09-05T02:16:27.461633+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'379","last_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_deep_scrub":"264'379","last_deep_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.461448+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:09.203614+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306547,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":1286,"num_write":1063,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.797643+0000","last_change":"2024-09-05T02:16:30.797643+0000","last_active":"2024-09-05T02:16:30.797643+0000","last_peered":"2024-09-05T02:16:30.797643+0000","last_clean":"2024-09-05T02:16:30.797643+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:16:30.797643+0000","last_undegraded":"2024-09-05T02:16:30.797643+0000","last_fullsized":"2024-09-05T02:16:30.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.797468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:12.858645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.140192+0000","last_change":"2024-09-05T02:16:49.140192+0000","last_active":"2024-09-05T02:16:49.140192+0000","last_peered":"2024-09-05T02:16:49.140192+0000","last_clean":"2024-09-05T02:16:49.140192+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:16:49.140192+0000","last_undegraded":"2024-09-05T02:16:49.140192+0000","last_fullsized":"2024-09-05T02:16:49.140192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.140009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:59:04.745264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'765","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.015988+0000","last_change":"2024-09-05T02:16:50.015732+0000","last_active":"2024-09-05T02:16:50.015988+0000","last_peered":"2024-09-05T02:16:50.015988+0000","last_clean":"2024-09-05T02:16:50.015988+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:50.015988+0000","last_undegraded":"2024-09-05T02:16:50.015988+0000","last_fullsized":"2024-09-05T02:16:50.015988+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.015404+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:41:52.046842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142523,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1322,"num_read_kb":3088,"num_write":1054,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.146385+0000","last_change":"2024-09-05T02:16:57.146257+0000","last_active":"2024-09-05T02:16:57.146385+0000","last_peered":"2024-09-05T02:16:57.146385+0000","last_clean":"2024-09-05T02:16:57.146385+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:16:57.146385+0000","last_undegraded":"2024-09-05T02:16:57.146385+0000","last_fullsized":"2024-09-05T02:16:57.146385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.146070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:02.238780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'121","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.577050+0000","last_change":"2024-09-05T02:17:01.576899+0000","last_active":"2024-09-05T02:17:01.577050+0000","last_peered":"2024-09-05T02:17:01.577050+0000","last_clean":"2024-09-05T02:17:01.577050+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:17:01.577050+0000","last_undegraded":"2024-09-05T02:17:01.577050+0000","last_fullsized":"2024-09-05T02:17:01.577050+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.576713+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:14.801974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.249645+0000","last_change":"2024-09-05T02:17:04.249509+0000","last_active":"2024-09-05T02:17:04.249645+0000","last_peered":"2024-09-05T02:17:04.249645+0000","last_clean":"2024-09-05T02:17:04.249645+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:17:04.249645+0000","last_undegraded":"2024-09-05T02:17:04.249645+0000","last_fullsized":"2024-09-05T02:17:04.249645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.249322+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:38.397612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'584","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.467016+0000","last_change":"2024-09-05T02:16:38.467016+0000","last_active":"2024-09-05T02:16:38.467016+0000","last_peered":"2024-09-05T02:16:38.467016+0000","last_clean":"2024-09-05T02:16:38.467016+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:16:38.467016+0000","last_undegraded":"2024-09-05T02:16:38.467016+0000","last_fullsized":"2024-09-05T02:16:38.467016+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.466831+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:09.713439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'310","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.564836+0000","last_change":"2024-09-05T02:16:28.564836+0000","last_active":"2024-09-05T02:16:28.564836+0000","last_peered":"2024-09-05T02:16:28.564836+0000","last_clean":"2024-09-05T02:16:28.564836+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:28.564836+0000","last_undegraded":"2024-09-05T02:16:28.564836+0000","last_fullsized":"2024-09-05T02:16:28.564836+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.564631+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:46:10.085984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524318,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":27235,"num_write":955,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.151032+0000","last_change":"2024-09-05T02:16:45.151032+0000","last_active":"2024-09-05T02:16:45.151032+0000","last_peered":"2024-09-05T02:16:45.151032+0000","last_clean":"2024-09-05T02:16:45.151032+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:16:45.151032+0000","last_undegraded":"2024-09-05T02:16:45.151032+0000","last_fullsized":"2024-09-05T02:16:45.151032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.150846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:14.522761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'321","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.164900+0000","last_change":"2024-09-05T02:16:54.164900+0000","last_active":"2024-09-05T02:16:54.164900+0000","last_peered":"2024-09-05T02:16:54.164900+0000","last_clean":"2024-09-05T02:16:54.164900+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:16:54.164900+0000","last_undegraded":"2024-09-05T02:16:54.164900+0000","last_fullsized":"2024-09-05T02:16:54.164900+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.164706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:59.874764+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43168,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1204,"num_write":426,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.235619+0000","last_change":"2024-09-05T02:17:01.235619+0000","last_active":"2024-09-05T02:17:01.235619+0000","last_peered":"2024-09-05T02:17:01.235619+0000","last_clean":"2024-09-05T02:17:01.235619+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:17:01.235619+0000","last_undegraded":"2024-09-05T02:17:01.235619+0000","last_fullsized":"2024-09-05T02:17:01.235619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.235436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:04.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'134","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.244926+0000","last_change":"2024-09-05T02:17:08.244926+0000","last_active":"2024-09-05T02:17:08.244926+0000","last_peered":"2024-09-05T02:17:08.244926+0000","last_clean":"2024-09-05T02:17:08.244926+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:17:08.244926+0000","last_undegraded":"2024-09-05T02:17:08.244926+0000","last_fullsized":"2024-09-05T02:17:08.244926+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-05T02:17:08.244748+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-05T02:17:08.244748+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.244748+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:59.092306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'373","reported_seq":1845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.199178+0000","last_change":"2024-09-05T02:16:41.199178+0000","last_active":"2024-09-05T02:16:41.199178+0000","last_peered":"2024-09-05T02:16:41.199178+0000","last_clean":"2024-09-05T02:16:41.199178+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:16:41.199178+0000","last_undegraded":"2024-09-05T02:16:41.199178+0000","last_fullsized":"2024-09-05T02:16:41.199178+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.198938+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:49.138470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'308","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.040013+0000","last_change":"2024-09-05T02:16:38.040013+0000","last_active":"2024-09-05T02:16:38.040013+0000","last_peered":"2024-09-05T02:16:38.040013+0000","last_clean":"2024-09-05T02:16:38.040013+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:38.040013+0000","last_undegraded":"2024-09-05T02:16:38.040013+0000","last_fullsized":"2024-09-05T02:16:38.040013+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.039781+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:04:40.447440+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":54962,"num_write":1038,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.110479+0000","last_change":"2024-09-05T02:16:47.110479+0000","last_active":"2024-09-05T02:16:47.110479+0000","last_peered":"2024-09-05T02:16:47.110479+0000","last_clean":"2024-09-05T02:16:47.110479+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:16:47.110479+0000","last_undegraded":"2024-09-05T02:16:47.110479+0000","last_fullsized":"2024-09-05T02:16:47.110479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.110272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:03:15.952888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'72","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.241593+0000","last_change":"2024-09-05T02:16:49.241593+0000","last_active":"2024-09-05T02:16:49.241593+0000","last_peered":"2024-09-05T02:16:49.241593+0000","last_clean":"2024-09-05T02:16:49.241593+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:16:49.241593+0000","last_undegraded":"2024-09-05T02:16:49.241593+0000","last_fullsized":"2024-09-05T02:16:49.241593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'72","last_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_deep_scrub":"264'72","last_deep_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.241369+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:27.076422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.848918+0000","last_change":"2024-09-05T02:16:56.848918+0000","last_active":"2024-09-05T02:16:56.848918+0000","last_peered":"2024-09-05T02:16:56.848918+0000","last_clean":"2024-09-05T02:16:56.848918+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:16:56.848918+0000","last_undegraded":"2024-09-05T02:16:56.848918+0000","last_fullsized":"2024-09-05T02:16:56.848918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.848710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:51.306857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'232","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.345550+0000","last_change":"2024-09-05T02:17:07.345360+0000","last_active":"2024-09-05T02:17:07.345550+0000","last_peered":"2024-09-05T02:17:07.345550+0000","last_clean":"2024-09-05T02:17:07.345550+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:17:07.345550+0000","last_undegraded":"2024-09-05T02:17:07.345550+0000","last_fullsized":"2024-09-05T02:17:07.345550+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.345041+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:31:05.231444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'413","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.001539+0000","last_change":"2024-09-05T02:16:37.001539+0000","last_active":"2024-09-05T02:16:37.001539+0000","last_peered":"2024-09-05T02:16:37.001539+0000","last_clean":"2024-09-05T02:16:37.001539+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:16:37.001539+0000","last_undegraded":"2024-09-05T02:16:37.001539+0000","last_fullsized":"2024-09-05T02:16:37.001539+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.001348+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:37:09.716022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'312","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.491656+0000","last_change":"2024-09-05T02:16:33.491656+0000","last_active":"2024-09-05T02:16:33.491656+0000","last_peered":"2024-09-05T02:16:33.491656+0000","last_clean":"2024-09-05T02:16:33.491656+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:16:33.491656+0000","last_undegraded":"2024-09-05T02:16:33.491656+0000","last_fullsized":"2024-09-05T02:16:33.491656+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.491428+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:05.829040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":91576,"num_write":1030,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.005253+0000","last_change":"2024-09-05T02:16:49.005253+0000","last_active":"2024-09-05T02:16:49.005253+0000","last_peered":"2024-09-05T02:16:49.005253+0000","last_clean":"2024-09-05T02:16:49.005253+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:16:49.005253+0000","last_undegraded":"2024-09-05T02:16:49.005253+0000","last_fullsized":"2024-09-05T02:16:49.005253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.005040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:33.592652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'339","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.135170+0000","last_change":"2024-09-05T02:16:55.135170+0000","last_active":"2024-09-05T02:16:55.135170+0000","last_peered":"2024-09-05T02:16:55.135170+0000","last_clean":"2024-09-05T02:16:55.135170+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:55.135170+0000","last_undegraded":"2024-09-05T02:16:55.135170+0000","last_fullsized":"2024-09-05T02:16:55.135170+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.134979+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:11:41.547516+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.885736+0000","last_change":"2024-09-05T02:16:47.885736+0000","last_active":"2024-09-05T02:16:47.885736+0000","last_peered":"2024-09-05T02:16:47.885736+0000","last_clean":"2024-09-05T02:16:47.885736+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:16:47.885736+0000","last_undegraded":"2024-09-05T02:16:47.885736+0000","last_fullsized":"2024-09-05T02:16:47.885736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.885547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:38:52.795987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'122","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.556768+0000","last_change":"2024-09-05T02:17:05.556619+0000","last_active":"2024-09-05T02:17:05.556768+0000","last_peered":"2024-09-05T02:17:05.556768+0000","last_clean":"2024-09-05T02:17:05.556768+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:17:05.556768+0000","last_undegraded":"2024-09-05T02:17:05.556768+0000","last_fullsized":"2024-09-05T02:17:05.556768+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.556414+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:18.944327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.065795+0000","last_change":"2024-09-05T02:16:46.065795+0000","last_active":"2024-09-05T02:16:46.065795+0000","last_peered":"2024-09-05T02:16:46.065795+0000","last_clean":"2024-09-05T02:16:46.065795+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:16:46.065795+0000","last_undegraded":"2024-09-05T02:16:46.065795+0000","last_fullsized":"2024-09-05T02:16:46.065795+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1176","last_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_deep_scrub":"264'1176","last_deep_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.065600+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:12.655472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'343","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.487651+0000","last_change":"2024-09-05T02:16:28.487518+0000","last_active":"2024-09-05T02:16:28.487651+0000","last_peered":"2024-09-05T02:16:28.487651+0000","last_clean":"2024-09-05T02:16:28.487651+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:16:28.487651+0000","last_undegraded":"2024-09-05T02:16:28.487651+0000","last_fullsized":"2024-09-05T02:16:28.487651+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.487300+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:13:55.683962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342090,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":6648,"num_write":1112,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.908314+0000","last_change":"2024-09-05T02:16:41.908314+0000","last_active":"2024-09-05T02:16:41.908314+0000","last_peered":"2024-09-05T02:16:41.908314+0000","last_clean":"2024-09-05T02:16:41.908314+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:16:41.908314+0000","last_undegraded":"2024-09-05T02:16:41.908314+0000","last_fullsized":"2024-09-05T02:16:41.908314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.908112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:02.070944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'302","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.957155+0000","last_change":"2024-09-05T02:16:52.957155+0000","last_active":"2024-09-05T02:16:52.957155+0000","last_peered":"2024-09-05T02:16:52.957155+0000","last_clean":"2024-09-05T02:16:52.957155+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:16:52.957155+0000","last_undegraded":"2024-09-05T02:16:52.957155+0000","last_fullsized":"2024-09-05T02:16:52.957155+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.956962+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:52.321946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1205,"num_write":416,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.218254+0000","last_change":"2024-09-05T02:16:58.218254+0000","last_active":"2024-09-05T02:16:58.218254+0000","last_peered":"2024-09-05T02:16:58.218254+0000","last_clean":"2024-09-05T02:16:58.218254+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:16:58.218254+0000","last_undegraded":"2024-09-05T02:16:58.218254+0000","last_fullsized":"2024-09-05T02:16:58.218254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.218069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:28.921690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'401","reported_seq":1943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.833763+0000","last_change":"2024-09-05T02:16:38.833608+0000","last_active":"2024-09-05T02:16:38.833763+0000","last_peered":"2024-09-05T02:16:38.833763+0000","last_clean":"2024-09-05T02:16:38.833763+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:16:38.833763+0000","last_undegraded":"2024-09-05T02:16:38.833763+0000","last_fullsized":"2024-09-05T02:16:38.833763+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.833404+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:32:18.954201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'332","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.909052+0000","last_change":"2024-09-05T02:16:30.908902+0000","last_active":"2024-09-05T02:16:30.909052+0000","last_peered":"2024-09-05T02:16:30.909052+0000","last_clean":"2024-09-05T02:16:30.909052+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:30.909052+0000","last_undegraded":"2024-09-05T02:16:30.909052+0000","last_fullsized":"2024-09-05T02:16:30.909052+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.908658+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:38.710026+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":908,"num_read_kb":44981,"num_write":1071,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.283913+0000","last_change":"2024-09-05T02:16:50.283913+0000","last_active":"2024-09-05T02:16:50.283913+0000","last_peered":"2024-09-05T02:16:50.283913+0000","last_clean":"2024-09-05T02:16:50.283913+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:16:50.283913+0000","last_undegraded":"2024-09-05T02:16:50.283913+0000","last_fullsized":"2024-09-05T02:16:50.283913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.283841+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:07.764546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'541","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.119138+0000","last_change":"2024-09-05T02:16:53.118919+0000","last_active":"2024-09-05T02:16:53.119138+0000","last_peered":"2024-09-05T02:16:53.119138+0000","last_clean":"2024-09-05T02:16:53.119138+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:53.119138+0000","last_undegraded":"2024-09-05T02:16:53.119138+0000","last_fullsized":"2024-09-05T02:16:53.119138+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'541","last_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_deep_scrub":"264'541","last_deep_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.118675+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:17.667696+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90605,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":950,"num_read_kb":2270,"num_write":820,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.525571+0000","last_change":"2024-09-05T02:16:59.525336+0000","last_active":"2024-09-05T02:16:59.525571+0000","last_peered":"2024-09-05T02:16:59.525571+0000","last_clean":"2024-09-05T02:16:59.525571+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:16:59.525571+0000","last_undegraded":"2024-09-05T02:16:59.525571+0000","last_fullsized":"2024-09-05T02:16:59.525571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.525078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:01.095440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'184","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.223600+0000","last_change":"2024-09-05T02:17:05.223600+0000","last_active":"2024-09-05T02:17:05.223600+0000","last_peered":"2024-09-05T02:17:05.223600+0000","last_clean":"2024-09-05T02:17:05.223600+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:17:05.223600+0000","last_undegraded":"2024-09-05T02:17:05.223600+0000","last_fullsized":"2024-09-05T02:17:05.223600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.223412+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:39.805729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'421","reported_seq":1999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.325824+0000","last_change":"2024-09-05T02:16:41.325824+0000","last_active":"2024-09-05T02:16:41.325824+0000","last_peered":"2024-09-05T02:16:41.325824+0000","last_clean":"2024-09-05T02:16:41.325824+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:16:41.325824+0000","last_undegraded":"2024-09-05T02:16:41.325824+0000","last_fullsized":"2024-09-05T02:16:41.325824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.325623+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:24.604460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'348","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.380399+0000","last_change":"2024-09-05T02:16:31.380143+0000","last_active":"2024-09-05T02:16:31.380399+0000","last_peered":"2024-09-05T02:16:31.380399+0000","last_clean":"2024-09-05T02:16:31.380399+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:31.380399+0000","last_undegraded":"2024-09-05T02:16:31.380399+0000","last_fullsized":"2024-09-05T02:16:31.380399+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.379870+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.538823+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":27594,"num_write":1025,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.916164+0000","last_change":"2024-09-05T02:16:44.915915+0000","last_active":"2024-09-05T02:16:44.916164+0000","last_peered":"2024-09-05T02:16:44.916164+0000","last_clean":"2024-09-05T02:16:44.916164+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:16:44.916164+0000","last_undegraded":"2024-09-05T02:16:44.916164+0000","last_fullsized":"2024-09-05T02:16:44.916164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.915627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:46:19.249723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'342","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.876390+0000","last_change":"2024-09-05T02:16:55.876250+0000","last_active":"2024-09-05T02:16:55.876390+0000","last_peered":"2024-09-05T02:16:55.876390+0000","last_clean":"2024-09-05T02:16:55.876390+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:55.876390+0000","last_undegraded":"2024-09-05T02:16:55.876390+0000","last_fullsized":"2024-09-05T02:16:55.876390+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.876025+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:35.582439+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.303250+0000","last_change":"2024-09-05T02:16:59.302978+0000","last_active":"2024-09-05T02:16:59.303250+0000","last_peered":"2024-09-05T02:16:59.303250+0000","last_clean":"2024-09-05T02:16:59.303250+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:16:59.303250+0000","last_undegraded":"2024-09-05T02:16:59.303250+0000","last_fullsized":"2024-09-05T02:16:59.303250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.302762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:13.771230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'165","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.968209+0000","last_change":"2024-09-05T02:16:53.968209+0000","last_active":"2024-09-05T02:16:53.968209+0000","last_peered":"2024-09-05T02:16:53.968209+0000","last_clean":"2024-09-05T02:16:53.968209+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:16:53.968209+0000","last_undegraded":"2024-09-05T02:16:53.968209+0000","last_fullsized":"2024-09-05T02:16:53.968209+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.967993+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:11.198975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'494","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.038028+0000","last_change":"2024-09-05T02:16:41.037772+0000","last_active":"2024-09-05T02:16:41.038028+0000","last_peered":"2024-09-05T02:16:41.038028+0000","last_clean":"2024-09-05T02:16:41.038028+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:16:41.038028+0000","last_undegraded":"2024-09-05T02:16:41.038028+0000","last_fullsized":"2024-09-05T02:16:41.038028+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'494","last_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_deep_scrub":"264'494","last_deep_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.037536+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:37:11.731456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'324","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.561005+0000","last_change":"2024-09-05T02:16:30.560869+0000","last_active":"2024-09-05T02:16:30.561005+0000","last_peered":"2024-09-05T02:16:30.561005+0000","last_clean":"2024-09-05T02:16:30.561005+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:30.561005+0000","last_undegraded":"2024-09-05T02:16:30.561005+0000","last_fullsized":"2024-09-05T02:16:30.561005+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.560663+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:40.454373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":39348,"num_write":968,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.505123+0000","last_change":"2024-09-05T02:16:52.504988+0000","last_active":"2024-09-05T02:16:52.505123+0000","last_peered":"2024-09-05T02:16:52.505123+0000","last_clean":"2024-09-05T02:16:52.505123+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:16:52.505123+0000","last_undegraded":"2024-09-05T02:16:52.505123+0000","last_fullsized":"2024-09-05T02:16:52.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.504809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:12.255051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'326","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.114823+0000","last_change":"2024-09-05T02:16:56.114678+0000","last_active":"2024-09-05T02:16:56.114823+0000","last_peered":"2024-09-05T02:16:56.114823+0000","last_clean":"2024-09-05T02:16:56.114823+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:16:56.114823+0000","last_undegraded":"2024-09-05T02:16:56.114823+0000","last_fullsized":"2024-09-05T02:16:56.114823+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.114479+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:21.147000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":1207,"num_write":432,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.192453+0000","last_change":"2024-09-05T02:16:56.192453+0000","last_active":"2024-09-05T02:16:56.192453+0000","last_peered":"2024-09-05T02:16:56.192453+0000","last_clean":"2024-09-05T02:16:56.192453+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:16:56.192453+0000","last_undegraded":"2024-09-05T02:16:56.192453+0000","last_fullsized":"2024-09-05T02:16:56.192453+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.192269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:47:46.160471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'110","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.537213+0000","last_change":"2024-09-05T02:17:02.537213+0000","last_active":"2024-09-05T02:17:02.537213+0000","last_peered":"2024-09-05T02:17:02.537213+0000","last_clean":"2024-09-05T02:17:02.537213+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:17:02.537213+0000","last_undegraded":"2024-09-05T02:17:02.537213+0000","last_fullsized":"2024-09-05T02:17:02.537213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.537031+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:09:20.213705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'326","reported_seq":1650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.800451+0000","last_change":"2024-09-05T02:16:34.800307+0000","last_active":"2024-09-05T02:16:34.800451+0000","last_peered":"2024-09-05T02:16:34.800451+0000","last_clean":"2024-09-05T02:16:34.800451+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:16:34.800451+0000","last_undegraded":"2024-09-05T02:16:34.800451+0000","last_fullsized":"2024-09-05T02:16:34.800451+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.800111+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:39.707710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'405","reported_seq":1114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.365306+0000","last_change":"2024-09-05T02:16:38.365125+0000","last_active":"2024-09-05T02:16:38.365306+0000","last_peered":"2024-09-05T02:16:38.365306+0000","last_clean":"2024-09-05T02:16:38.365306+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:16:38.365306+0000","last_undegraded":"2024-09-05T02:16:38.365306+0000","last_fullsized":"2024-09-05T02:16:38.365306+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.364894+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:52.067211+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642858,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":739,"num_read_kb":25030,"num_write":1256,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.191125+0000","last_change":"2024-09-05T02:16:48.190992+0000","last_active":"2024-09-05T02:16:48.191125+0000","last_peered":"2024-09-05T02:16:48.191125+0000","last_clean":"2024-09-05T02:16:48.191125+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:16:48.191125+0000","last_undegraded":"2024-09-05T02:16:48.191125+0000","last_fullsized":"2024-09-05T02:16:48.191125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.190800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:24:46.556049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'153","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.525793+0000","last_change":"2024-09-05T02:16:58.525793+0000","last_active":"2024-09-05T02:16:58.525793+0000","last_peered":"2024-09-05T02:16:58.525793+0000","last_clean":"2024-09-05T02:16:58.525793+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:16:58.525793+0000","last_undegraded":"2024-09-05T02:16:58.525793+0000","last_fullsized":"2024-09-05T02:16:58.525793+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.525607+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:32:05.887270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'771","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.883984+0000","last_change":"2024-09-05T02:16:50.883737+0000","last_active":"2024-09-05T02:16:50.883984+0000","last_peered":"2024-09-05T02:16:50.883984+0000","last_clean":"2024-09-05T02:16:50.883984+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:50.883984+0000","last_undegraded":"2024-09-05T02:16:50.883984+0000","last_fullsized":"2024-09-05T02:16:50.883984+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.883511+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:56.045690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.820599+0000","last_change":"2024-09-05T02:17:00.820599+0000","last_active":"2024-09-05T02:17:00.820599+0000","last_peered":"2024-09-05T02:17:00.820599+0000","last_clean":"2024-09-05T02:17:00.820599+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:17:00.820599+0000","last_undegraded":"2024-09-05T02:17:00.820599+0000","last_fullsized":"2024-09-05T02:17:00.820599+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.820416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:24.728201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'870","reported_seq":2421,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.444135+0000","last_change":"2024-09-05T02:16:40.444001+0000","last_active":"2024-09-05T02:16:40.444135+0000","last_peered":"2024-09-05T02:16:40.444135+0000","last_clean":"2024-09-05T02:16:40.444135+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:16:40.444135+0000","last_undegraded":"2024-09-05T02:16:40.444135+0000","last_fullsized":"2024-09-05T02:16:40.444135+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.443792+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:41:30.425677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'289","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.482772+0000","last_change":"2024-09-05T02:16:34.482628+0000","last_active":"2024-09-05T02:16:34.482772+0000","last_peered":"2024-09-05T02:16:34.482772+0000","last_clean":"2024-09-05T02:16:34.482772+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:16:34.482772+0000","last_undegraded":"2024-09-05T02:16:34.482772+0000","last_fullsized":"2024-09-05T02:16:34.482772+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.482431+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:08:51.964548+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":6339,"num_write":869,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.956925+0000","last_change":"2024-09-05T02:16:47.956779+0000","last_active":"2024-09-05T02:16:47.956925+0000","last_peered":"2024-09-05T02:16:47.956925+0000","last_clean":"2024-09-05T02:16:47.956925+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:16:47.956925+0000","last_undegraded":"2024-09-05T02:16:47.956925+0000","last_fullsized":"2024-09-05T02:16:47.956925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.956598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:02:38.985311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'393","reported_seq":1044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.534799+0000","last_change":"2024-09-05T02:16:58.534659+0000","last_active":"2024-09-05T02:16:58.534799+0000","last_peered":"2024-09-05T02:16:58.534799+0000","last_clean":"2024-09-05T02:16:58.534799+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:16:58.534799+0000","last_undegraded":"2024-09-05T02:16:58.534799+0000","last_fullsized":"2024-09-05T02:16:58.534799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.534448+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.086187+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47763,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":623,"num_read_kb":1294,"num_write":490,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.199718+0000","last_change":"2024-09-05T02:17:01.199718+0000","last_active":"2024-09-05T02:17:01.199718+0000","last_peered":"2024-09-05T02:17:01.199718+0000","last_clean":"2024-09-05T02:17:01.199718+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:17:01.199718+0000","last_undegraded":"2024-09-05T02:17:01.199718+0000","last_fullsized":"2024-09-05T02:17:01.199718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.199508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:39.811372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'201","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.829744+0000","last_change":"2024-09-05T02:17:02.829744+0000","last_active":"2024-09-05T02:17:02.829744+0000","last_peered":"2024-09-05T02:17:02.829744+0000","last_clean":"2024-09-05T02:17:02.829744+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:17:02.829744+0000","last_undegraded":"2024-09-05T02:17:02.829744+0000","last_fullsized":"2024-09-05T02:17:02.829744+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.829553+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:12.703178+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'736","reported_seq":2533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.487574+0000","last_change":"2024-09-05T02:16:41.487412+0000","last_active":"2024-09-05T02:16:41.487574+0000","last_peered":"2024-09-05T02:16:41.487574+0000","last_clean":"2024-09-05T02:16:41.487574+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:16:41.487574+0000","last_undegraded":"2024-09-05T02:16:41.487574+0000","last_fullsized":"2024-09-05T02:16:41.487574+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'736","last_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_deep_scrub":"264'736","last_deep_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.487221+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:01.507115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1182,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'414","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.532824+0000","last_change":"2024-09-05T02:16:35.532666+0000","last_active":"2024-09-05T02:16:35.532824+0000","last_peered":"2024-09-05T02:16:35.532824+0000","last_clean":"2024-09-05T02:16:35.532824+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:16:35.532824+0000","last_undegraded":"2024-09-05T02:16:35.532824+0000","last_fullsized":"2024-09-05T02:16:35.532824+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.532436+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:12:38.507010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080041,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":137827,"num_write":1317,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"264'4","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.624622+0000","last_change":"2024-09-05T02:16:53.624429+0000","last_active":"2024-09-05T02:16:53.624622+0000","last_peered":"2024-09-05T02:16:53.624622+0000","last_clean":"2024-09-05T02:16:53.624622+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:16:53.624622+0000","last_undegraded":"2024-09-05T02:16:53.624622+0000","last_fullsized":"2024-09-05T02:16:53.624622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.624247+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:06:48.307668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'304","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.262641+0000","last_change":"2024-09-05T02:16:52.262641+0000","last_active":"2024-09-05T02:16:52.262641+0000","last_peered":"2024-09-05T02:16:52.262641+0000","last_clean":"2024-09-05T02:16:52.262641+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:16:52.262641+0000","last_undegraded":"2024-09-05T02:16:52.262641+0000","last_fullsized":"2024-09-05T02:16:52.262641+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.262443+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:39:11.098650+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47523,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":500,"num_read_kb":1144,"num_write":402,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.860529+0000","last_change":"2024-09-05T02:16:49.860353+0000","last_active":"2024-09-05T02:16:49.860529+0000","last_peered":"2024-09-05T02:16:49.860529+0000","last_clean":"2024-09-05T02:16:49.860529+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:16:49.860529+0000","last_undegraded":"2024-09-05T02:16:49.860529+0000","last_fullsized":"2024-09-05T02:16:49.860529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.860160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:40.431987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'113","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.232271+0000","last_change":"2024-09-05T02:17:07.232271+0000","last_active":"2024-09-05T02:17:07.232271+0000","last_peered":"2024-09-05T02:17:07.232271+0000","last_clean":"2024-09-05T02:17:07.232271+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:17:07.232271+0000","last_undegraded":"2024-09-05T02:17:07.232271+0000","last_fullsized":"2024-09-05T02:17:07.232271+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-05T02:17:07.232045+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-05T02:17:07.232045+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.232045+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:18.319223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'476","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.011288+0000","last_change":"2024-09-05T02:16:40.011129+0000","last_active":"2024-09-05T02:16:40.011288+0000","last_peered":"2024-09-05T02:16:40.011288+0000","last_clean":"2024-09-05T02:16:40.011288+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:16:40.011288+0000","last_undegraded":"2024-09-05T02:16:40.011288+0000","last_fullsized":"2024-09-05T02:16:40.011288+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.010943+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:14:00.723241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'319","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.936309+0000","last_change":"2024-09-05T02:16:33.936309+0000","last_active":"2024-09-05T02:16:33.936309+0000","last_peered":"2024-09-05T02:16:33.936309+0000","last_clean":"2024-09-05T02:16:33.936309+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:33.936309+0000","last_undegraded":"2024-09-05T02:16:33.936309+0000","last_fullsized":"2024-09-05T02:16:33.936309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.936126+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:20:49.975373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":12836,"num_write":1013,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.503184+0000","last_change":"2024-09-05T02:16:51.503184+0000","last_active":"2024-09-05T02:16:51.503184+0000","last_peered":"2024-09-05T02:16:51.503184+0000","last_clean":"2024-09-05T02:16:51.503184+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:16:51.503184+0000","last_undegraded":"2024-09-05T02:16:51.503184+0000","last_fullsized":"2024-09-05T02:16:51.503184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.503000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:52.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'268","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.169369+0000","last_change":"2024-09-05T02:16:59.169192+0000","last_active":"2024-09-05T02:16:59.169369+0000","last_peered":"2024-09-05T02:16:59.169369+0000","last_clean":"2024-09-05T02:16:59.169369+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:16:59.169369+0000","last_undegraded":"2024-09-05T02:16:59.169369+0000","last_fullsized":"2024-09-05T02:16:59.169369+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.168997+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:49.788871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47269,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1091,"num_write":358,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.522236+0000","last_change":"2024-09-05T02:17:01.522113+0000","last_active":"2024-09-05T02:17:01.522236+0000","last_peered":"2024-09-05T02:17:01.522236+0000","last_clean":"2024-09-05T02:17:01.522236+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:17:01.522236+0000","last_undegraded":"2024-09-05T02:17:01.522236+0000","last_fullsized":"2024-09-05T02:17:01.522236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.521917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:55.686761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.873479+0000","last_change":"2024-09-05T02:17:01.873479+0000","last_active":"2024-09-05T02:17:01.873479+0000","last_peered":"2024-09-05T02:17:01.873479+0000","last_clean":"2024-09-05T02:17:01.873479+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:17:01.873479+0000","last_undegraded":"2024-09-05T02:17:01.873479+0000","last_fullsized":"2024-09-05T02:17:01.873479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.873172+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:47.785372+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'346","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.488577+0000","last_change":"2024-09-05T02:16:39.488577+0000","last_active":"2024-09-05T02:16:39.488577+0000","last_peered":"2024-09-05T02:16:39.488577+0000","last_clean":"2024-09-05T02:16:39.488577+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:16:39.488577+0000","last_undegraded":"2024-09-05T02:16:39.488577+0000","last_fullsized":"2024-09-05T02:16:39.488577+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.488358+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:26.414847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'356","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.518422+0000","last_change":"2024-09-05T02:16:30.518195+0000","last_active":"2024-09-05T02:16:30.518422+0000","last_peered":"2024-09-05T02:16:30.518422+0000","last_clean":"2024-09-05T02:16:30.518422+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:16:30.518422+0000","last_undegraded":"2024-09-05T02:16:30.518422+0000","last_fullsized":"2024-09-05T02:16:30.518422+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.517946+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:33:37.139871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8860,"num_write":1095,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.170684+0000","last_change":"2024-09-05T02:16:44.170684+0000","last_active":"2024-09-05T02:16:44.170684+0000","last_peered":"2024-09-05T02:16:44.170684+0000","last_clean":"2024-09-05T02:16:44.170684+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:16:44.170684+0000","last_undegraded":"2024-09-05T02:16:44.170684+0000","last_fullsized":"2024-09-05T02:16:44.170684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.170506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:33.236636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'343","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.485820+0000","last_change":"2024-09-05T02:16:55.485686+0000","last_active":"2024-09-05T02:16:55.485820+0000","last_peered":"2024-09-05T02:16:55.485820+0000","last_clean":"2024-09-05T02:16:55.485820+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:16:55.485820+0000","last_undegraded":"2024-09-05T02:16:55.485820+0000","last_fullsized":"2024-09-05T02:16:55.485820+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.485485+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:32.153291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":1162,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.170798+0000","last_change":"2024-09-05T02:17:00.170568+0000","last_active":"2024-09-05T02:17:00.170798+0000","last_peered":"2024-09-05T02:17:00.170798+0000","last_clean":"2024-09-05T02:17:00.170798+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:17:00.170798+0000","last_undegraded":"2024-09-05T02:17:00.170798+0000","last_fullsized":"2024-09-05T02:17:00.170798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.170359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:22:09.289364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'133","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.526116+0000","last_change":"2024-09-05T02:17:02.526116+0000","last_active":"2024-09-05T02:17:02.526116+0000","last_peered":"2024-09-05T02:17:02.526116+0000","last_clean":"2024-09-05T02:17:02.526116+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:17:02.526116+0000","last_undegraded":"2024-09-05T02:17:02.526116+0000","last_fullsized":"2024-09-05T02:17:02.526116+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.525900+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:34.211908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'435","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.163976+0000","last_change":"2024-09-05T02:16:43.163976+0000","last_active":"2024-09-05T02:16:43.163976+0000","last_peered":"2024-09-05T02:16:43.163976+0000","last_clean":"2024-09-05T02:16:43.163976+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:16:43.163976+0000","last_undegraded":"2024-09-05T02:16:43.163976+0000","last_fullsized":"2024-09-05T02:16:43.163976+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.163765+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:41.045947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4549,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'378","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.805267+0000","last_change":"2024-09-05T02:16:32.805135+0000","last_active":"2024-09-05T02:16:32.805267+0000","last_peered":"2024-09-05T02:16:32.805267+0000","last_clean":"2024-09-05T02:16:32.805267+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:32.805267+0000","last_undegraded":"2024-09-05T02:16:32.805267+0000","last_fullsized":"2024-09-05T02:16:32.805267+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.804912+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:04.484010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":487,"num_read_kb":8853,"num_write":1134,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1144","reported_seq":2643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.267542+0000","last_change":"2024-09-05T02:16:37.267542+0000","last_active":"2024-09-05T02:16:37.267542+0000","last_peered":"2024-09-05T02:16:37.267542+0000","last_clean":"2024-09-05T02:16:37.267542+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:16:37.267542+0000","last_undegraded":"2024-09-05T02:16:37.267542+0000","last_fullsized":"2024-09-05T02:16:37.267542+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1144","last_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_deep_scrub":"264'1144","last_deep_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.267346+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:22:33.530651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'332","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.795376+0000","last_change":"2024-09-05T02:16:30.795215+0000","last_active":"2024-09-05T02:16:30.795376+0000","last_peered":"2024-09-05T02:16:30.795376+0000","last_clean":"2024-09-05T02:16:30.795376+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:30.795376+0000","last_undegraded":"2024-09-05T02:16:30.795376+0000","last_fullsized":"2024-09-05T02:16:30.795376+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.794997+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:04:12.891688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":102142,"num_write":1127,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.550350+0000","last_change":"2024-09-05T02:16:47.550350+0000","last_active":"2024-09-05T02:16:47.550350+0000","last_peered":"2024-09-05T02:16:47.550350+0000","last_clean":"2024-09-05T02:16:47.550350+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:16:47.550350+0000","last_undegraded":"2024-09-05T02:16:47.550350+0000","last_fullsized":"2024-09-05T02:16:47.550350+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'694","last_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_deep_scrub":"264'694","last_deep_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.550157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:09.741807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'312","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.519094+0000","last_change":"2024-09-05T02:16:36.518851+0000","last_active":"2024-09-05T02:16:36.519094+0000","last_peered":"2024-09-05T02:16:36.519094+0000","last_clean":"2024-09-05T02:16:36.519094+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:16:36.519094+0000","last_undegraded":"2024-09-05T02:16:36.519094+0000","last_fullsized":"2024-09-05T02:16:36.519094+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.518501+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:55.497838+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":411,"num_write":976,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'418","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.226428+0000","last_change":"2024-09-05T02:16:38.226428+0000","last_active":"2024-09-05T02:16:38.226428+0000","last_peered":"2024-09-05T02:16:38.226428+0000","last_clean":"2024-09-05T02:16:38.226428+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:16:38.226428+0000","last_undegraded":"2024-09-05T02:16:38.226428+0000","last_fullsized":"2024-09-05T02:16:38.226428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.226250+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:52.035389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'318","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.490829+0000","last_change":"2024-09-05T02:16:33.490696+0000","last_active":"2024-09-05T02:16:33.490829+0000","last_peered":"2024-09-05T02:16:33.490829+0000","last_clean":"2024-09-05T02:16:33.490829+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:16:33.490829+0000","last_undegraded":"2024-09-05T02:16:33.490829+0000","last_fullsized":"2024-09-05T02:16:33.490829+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.490479+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:04.157446+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":737,"num_read_kb":8229,"num_write":1002,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1684","reported_seq":3540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.037874+0000","last_change":"2024-09-05T02:16:42.037729+0000","last_active":"2024-09-05T02:16:42.037874+0000","last_peered":"2024-09-05T02:16:42.037874+0000","last_clean":"2024-09-05T02:16:42.037874+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:16:42.037874+0000","last_undegraded":"2024-09-05T02:16:42.037874+0000","last_fullsized":"2024-09-05T02:16:42.037874+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1684","last_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_deep_scrub":"264'1684","last_deep_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.037537+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":1600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:08.464426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'362","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.923360+0000","last_change":"2024-09-05T02:16:31.923360+0000","last_active":"2024-09-05T02:16:31.923360+0000","last_peered":"2024-09-05T02:16:31.923360+0000","last_clean":"2024-09-05T02:16:31.923360+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:31.923360+0000","last_undegraded":"2024-09-05T02:16:31.923360+0000","last_fullsized":"2024-09-05T02:16:31.923360+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.923168+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:09.796286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":75263,"num_write":1071,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'626","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.513628+0000","last_change":"2024-09-05T02:16:42.513367+0000","last_active":"2024-09-05T02:16:42.513628+0000","last_peered":"2024-09-05T02:16:42.513628+0000","last_clean":"2024-09-05T02:16:42.513628+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:16:42.513628+0000","last_undegraded":"2024-09-05T02:16:42.513628+0000","last_fullsized":"2024-09-05T02:16:42.513628+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.513129+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:25.607651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'360","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.345367+0000","last_change":"2024-09-05T02:16:32.345367+0000","last_active":"2024-09-05T02:16:32.345367+0000","last_peered":"2024-09-05T02:16:32.345367+0000","last_clean":"2024-09-05T02:16:32.345367+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:32.345367+0000","last_undegraded":"2024-09-05T02:16:32.345367+0000","last_fullsized":"2024-09-05T02:16:32.345367+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.345077+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:46.067374+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453457,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":27144,"num_write":1118,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'685","reported_seq":2370,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.065195+0000","last_change":"2024-09-05T02:16:44.065049+0000","last_active":"2024-09-05T02:16:44.065195+0000","last_peered":"2024-09-05T02:16:44.065195+0000","last_clean":"2024-09-05T02:16:44.065195+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:16:44.065195+0000","last_undegraded":"2024-09-05T02:16:44.065195+0000","last_fullsized":"2024-09-05T02:16:44.065195+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.064848+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:18.934798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'376","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.778588+0000","last_change":"2024-09-05T02:16:33.778588+0000","last_active":"2024-09-05T02:16:33.778588+0000","last_peered":"2024-09-05T02:16:33.778588+0000","last_clean":"2024-09-05T02:16:33.778588+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:33.778588+0000","last_undegraded":"2024-09-05T02:16:33.778588+0000","last_fullsized":"2024-09-05T02:16:33.778588+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.778363+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:27.507514+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":588,"num_read_kb":10940,"num_write":1274,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'477","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.912137+0000","last_change":"2024-09-05T02:16:40.911914+0000","last_active":"2024-09-05T02:16:40.912137+0000","last_peered":"2024-09-05T02:16:40.912137+0000","last_clean":"2024-09-05T02:16:40.912137+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:16:40.912137+0000","last_undegraded":"2024-09-05T02:16:40.912137+0000","last_fullsized":"2024-09-05T02:16:40.912137+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.911681+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:52.589997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.936616+0000","last_change":"2024-09-05T02:16:32.936616+0000","last_active":"2024-09-05T02:16:32.936616+0000","last_peered":"2024-09-05T02:16:32.936616+0000","last_clean":"2024-09-05T02:16:32.936616+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:32.936616+0000","last_undegraded":"2024-09-05T02:16:32.936616+0000","last_fullsized":"2024-09-05T02:16:32.936616+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.936402+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:04.969865+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461798,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":29011,"num_write":1195,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1110","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.389653+0000","last_change":"2024-09-05T02:16:37.389653+0000","last_active":"2024-09-05T02:16:37.389653+0000","last_peered":"2024-09-05T02:16:37.389653+0000","last_clean":"2024-09-05T02:16:37.389653+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:16:37.389653+0000","last_undegraded":"2024-09-05T02:16:37.389653+0000","last_fullsized":"2024-09-05T02:16:37.389653+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1110","last_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_deep_scrub":"264'1110","last_deep_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.389478+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:32.651447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'366","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.545413+0000","last_change":"2024-09-05T02:16:37.545413+0000","last_active":"2024-09-05T02:16:37.545413+0000","last_peered":"2024-09-05T02:16:37.545413+0000","last_clean":"2024-09-05T02:16:37.545413+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:16:37.545413+0000","last_undegraded":"2024-09-05T02:16:37.545413+0000","last_fullsized":"2024-09-05T02:16:37.545413+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.545206+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.687864+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":61900,"num_write":1145,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'622","reported_seq":2305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.495551+0000","last_change":"2024-09-05T02:16:44.495551+0000","last_active":"2024-09-05T02:16:44.495551+0000","last_peered":"2024-09-05T02:16:44.495551+0000","last_clean":"2024-09-05T02:16:44.495551+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:16:44.495551+0000","last_undegraded":"2024-09-05T02:16:44.495551+0000","last_fullsized":"2024-09-05T02:16:44.495551+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'622","last_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_deep_scrub":"264'622","last_deep_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.495326+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:02.043865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.044750+0000","last_change":"2024-09-05T02:16:36.044641+0000","last_active":"2024-09-05T02:16:36.044750+0000","last_peered":"2024-09-05T02:16:36.044750+0000","last_clean":"2024-09-05T02:16:36.044750+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:36.044750+0000","last_undegraded":"2024-09-05T02:16:36.044750+0000","last_fullsized":"2024-09-05T02:16:36.044750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.044432+0000","objects_scrubbed":13,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:25.636296+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953006,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":484,"num_read_kb":25097,"num_write":1158,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'543","reported_seq":2197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.753037+0000","last_change":"2024-09-05T02:16:35.752884+0000","last_active":"2024-09-05T02:16:35.753037+0000","last_peered":"2024-09-05T02:16:35.753037+0000","last_clean":"2024-09-05T02:16:35.753037+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:16:35.753037+0000","last_undegraded":"2024-09-05T02:16:35.753037+0000","last_fullsized":"2024-09-05T02:16:35.753037+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.752698+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:45.155213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'410","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.779143+0000","last_change":"2024-09-05T02:16:29.779143+0000","last_active":"2024-09-05T02:16:29.779143+0000","last_peered":"2024-09-05T02:16:29.779143+0000","last_clean":"2024-09-05T02:16:29.779143+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:29.779143+0000","last_undegraded":"2024-09-05T02:16:29.779143+0000","last_fullsized":"2024-09-05T02:16:29.779143+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'410","last_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_deep_scrub":"264'410","last_deep_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.778934+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:09.661610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262234,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":5699,"num_write":1247,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1185","reported_seq":2845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.510478+0000","last_change":"2024-09-05T02:16:43.510341+0000","last_active":"2024-09-05T02:16:43.510478+0000","last_peered":"2024-09-05T02:16:43.510478+0000","last_clean":"2024-09-05T02:16:43.510478+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:16:43.510478+0000","last_undegraded":"2024-09-05T02:16:43.510478+0000","last_fullsized":"2024-09-05T02:16:43.510478+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1185","last_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_deep_scrub":"264'1185","last_deep_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.510160+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":1100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:51.275393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'336","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.452460+0000","last_change":"2024-09-05T02:16:36.452295+0000","last_active":"2024-09-05T02:16:36.452460+0000","last_peered":"2024-09-05T02:16:36.452460+0000","last_clean":"2024-09-05T02:16:36.452460+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:16:36.452460+0000","last_undegraded":"2024-09-05T02:16:36.452460+0000","last_fullsized":"2024-09-05T02:16:36.452460+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.451991+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:44.484998+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":5076,"num_write":1193,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'491","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.060981+0000","last_change":"2024-09-05T02:16:43.060842+0000","last_active":"2024-09-05T02:16:43.060981+0000","last_peered":"2024-09-05T02:16:43.060981+0000","last_clean":"2024-09-05T02:16:43.060981+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:16:43.060981+0000","last_undegraded":"2024-09-05T02:16:43.060981+0000","last_fullsized":"2024-09-05T02:16:43.060981+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'491","last_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_deep_scrub":"264'491","last_deep_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.060647+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.428329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'374","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.790434+0000","last_change":"2024-09-05T02:16:34.790296+0000","last_active":"2024-09-05T02:16:34.790434+0000","last_peered":"2024-09-05T02:16:34.790434+0000","last_clean":"2024-09-05T02:16:34.790434+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:34.790434+0000","last_undegraded":"2024-09-05T02:16:34.790434+0000","last_fullsized":"2024-09-05T02:16:34.790434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'374","last_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_deep_scrub":"264'374","last_deep_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.790058+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:13.589152+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":31375,"num_write":1285,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'688","reported_seq":2242,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.444897+0000","last_change":"2024-09-05T02:16:34.444760+0000","last_active":"2024-09-05T02:16:34.444897+0000","last_peered":"2024-09-05T02:16:34.444897+0000","last_clean":"2024-09-05T02:16:34.444897+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:16:34.444897+0000","last_undegraded":"2024-09-05T02:16:34.444897+0000","last_fullsized":"2024-09-05T02:16:34.444897+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'688","last_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_deep_scrub":"264'688","last_deep_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.444577+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:27.270344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'349","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.051570+0000","last_change":"2024-09-05T02:16:39.051570+0000","last_active":"2024-09-05T02:16:39.051570+0000","last_peered":"2024-09-05T02:16:39.051570+0000","last_clean":"2024-09-05T02:16:39.051570+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:39.051570+0000","last_undegraded":"2024-09-05T02:16:39.051570+0000","last_fullsized":"2024-09-05T02:16:39.051570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.051218+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:07.873190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":11105,"num_write":1131,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'524","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.037778+0000","last_change":"2024-09-05T02:16:43.037635+0000","last_active":"2024-09-05T02:16:43.037778+0000","last_peered":"2024-09-05T02:16:43.037778+0000","last_clean":"2024-09-05T02:16:43.037778+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:16:43.037778+0000","last_undegraded":"2024-09-05T02:16:43.037778+0000","last_fullsized":"2024-09-05T02:16:43.037778+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'524","last_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_deep_scrub":"264'524","last_deep_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.037438+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:01.180965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'332","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.770992+0000","last_change":"2024-09-05T02:16:31.770992+0000","last_active":"2024-09-05T02:16:31.770992+0000","last_peered":"2024-09-05T02:16:31.770992+0000","last_clean":"2024-09-05T02:16:31.770992+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:31.770992+0000","last_undegraded":"2024-09-05T02:16:31.770992+0000","last_fullsized":"2024-09-05T02:16:31.770992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.770780+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:08.517290+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":115088,"num_write":1048,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.964444+0000","last_change":"2024-09-05T02:16:44.964444+0000","last_active":"2024-09-05T02:16:44.964444+0000","last_peered":"2024-09-05T02:16:44.964444+0000","last_clean":"2024-09-05T02:16:44.964444+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:16:44.964444+0000","last_undegraded":"2024-09-05T02:16:44.964444+0000","last_fullsized":"2024-09-05T02:16:44.964444+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.964260+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:25.779977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'313","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.588790+0000","last_change":"2024-09-05T02:16:38.588790+0000","last_active":"2024-09-05T02:16:38.588790+0000","last_peered":"2024-09-05T02:16:38.588790+0000","last_clean":"2024-09-05T02:16:38.588790+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:16:38.588790+0000","last_undegraded":"2024-09-05T02:16:38.588790+0000","last_fullsized":"2024-09-05T02:16:38.588790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.588599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:12.567380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":641,"num_write":1040,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'421","reported_seq":1128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.547611+0000","last_change":"2024-09-05T02:16:40.547611+0000","last_active":"2024-09-05T02:16:40.547611+0000","last_peered":"2024-09-05T02:16:40.547611+0000","last_clean":"2024-09-05T02:16:40.547611+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:16:40.547611+0000","last_undegraded":"2024-09-05T02:16:40.547611+0000","last_fullsized":"2024-09-05T02:16:40.547611+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.547395+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:27.409142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":738,"num_read_kb":35471,"num_write":1283,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'408","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.357291+0000","last_change":"2024-09-05T02:16:39.357127+0000","last_active":"2024-09-05T02:16:39.357291+0000","last_peered":"2024-09-05T02:16:39.357291+0000","last_clean":"2024-09-05T02:16:39.357291+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:16:39.357291+0000","last_undegraded":"2024-09-05T02:16:39.357291+0000","last_fullsized":"2024-09-05T02:16:39.357291+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.356925+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:00.382840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2486,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'378","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.318136+0000","last_change":"2024-09-05T02:16:33.318136+0000","last_active":"2024-09-05T02:16:33.318136+0000","last_peered":"2024-09-05T02:16:33.318136+0000","last_clean":"2024-09-05T02:16:33.318136+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:33.318136+0000","last_undegraded":"2024-09-05T02:16:33.318136+0000","last_fullsized":"2024-09-05T02:16:33.318136+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.317918+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:08.472687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":26073,"num_write":1194,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'875","reported_seq":2446,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.477942+0000","last_change":"2024-09-05T02:16:45.477942+0000","last_active":"2024-09-05T02:16:45.477942+0000","last_peered":"2024-09-05T02:16:45.477942+0000","last_clean":"2024-09-05T02:16:45.477942+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:16:45.477942+0000","last_undegraded":"2024-09-05T02:16:45.477942+0000","last_fullsized":"2024-09-05T02:16:45.477942+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.477756+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:50:07.361494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6000,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1022,"ondisk_log_size":1022,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1846,"ondisk_log_size":1846,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1550994,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19804,"num_read_kb":40130,"num_write":16519,"num_write_kb":12075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675288,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1951,"ondisk_log_size":1951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43016,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66708448,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36139,"num_read_kb":2043809,"num_write":71843,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134676480,"data_stored":133416896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3567,"ondisk_log_size":3567,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174352,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174298,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510506,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285436,"kb_used_data":23788,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94086404,"statfs":{"total":96636764160,"available":96344477696,"internally_reserved":0,"allocated":24358912,"data_stored":22640434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510505,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221484,"kb_used_data":13980,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94150356,"statfs":{"total":96636764160,"available":96409964544,"internally_reserved":0,"allocated":14315520,"data_stored":12734941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510502,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120456,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94251384,"statfs":{"total":96636764160,"available":96513417216,"internally_reserved":0,"allocated":31711232,"data_stored":30061356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510506,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":35928,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":36790272,"data_stored":35092545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510504,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103096,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94268744,"statfs":{"total":96636764160,"available":96531193856,"internally_reserved":0,"allocated":9740288,"data_stored":8176150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510505,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149928,"kb_used_data":10520,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94221912,"statfs":{"total":96636764160,"available":96483237888,"internally_reserved":0,"allocated":10772480,"data_stored":9180748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543209,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150792,"kb_used_data":16952,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94221048,"statfs":{"total":96636764160,"available":96482353152,"internally_reserved":0,"allocated":17358848,"data_stored":15590745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543210,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271424,"kb_used_data":19568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100416,"statfs":{"total":96636764160,"available":96358825984,"internally_reserved":0,"allocated":20037632,"data_stored":18279783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15736832,"data_stored":15540753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":7036545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6131712,"data_stored":6032468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33136640,"data_stored":32946939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28102656,"data_stored":27918588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":13446327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":10591792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20078592,"data_stored":19903484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:17:31.285 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:31.285 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:31.286 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:31.286 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-05T01:30:14.615410+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=1, tm_min=30, tm_sec=14, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=2, tm_min=16, tm_sec=24, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T02:17:31.290 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T02:17:51.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T02:17:51.656 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-05T02:17:51.669 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-05T02:17:51.672 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":2916,"stamp":"2024-09-05T02:17:50.567967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":68867067,"num_objects":856,"num_object_clones":0,"num_object_copies":1712,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":856,"num_whiteouts":0,"num_read":292554,"num_read_kb":2648548,"num_write":162836,"num_write_kb":2503589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728124,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13542,"ondisk_log_size":13542,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1600128,"kb_used_data":161216,"kb_used_omap":12,"kb_used_meta":1438771,"kb_avail":753374592,"statfs":{"total":773094113280,"available":771455582208,"internally_reserved":0,"allocated":165085184,"data_stored":151756702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1473302064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008530"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.586372+0000","last_change":"2024-09-05T02:17:15.586222+0000","last_active":"2024-09-05T02:17:15.586372+0000","last_peered":"2024-09-05T02:17:15.586372+0000","last_clean":"2024-09-05T02:17:15.586372+0000","last_became_active":"2024-09-05T01:30:15.665796+0000","last_became_peered":"2024-09-05T01:30:15.665796+0000","last_unstale":"2024-09-05T02:17:15.586372+0000","last_undegraded":"2024-09-05T02:17:15.586372+0000","last_fullsized":"2024-09-05T02:17:15.586372+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:15.586006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:15.586006+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.586006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:36.857545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.642450+0000","last_change":"2024-09-05T02:17:13.642450+0000","last_active":"2024-09-05T02:17:13.642450+0000","last_peered":"2024-09-05T02:17:13.642450+0000","last_clean":"2024-09-05T02:17:13.642450+0000","last_became_active":"2024-09-05T01:09:26.333256+0000","last_became_peered":"2024-09-05T01:09:26.333256+0000","last_unstale":"2024-09-05T02:17:13.642450+0000","last_undegraded":"2024-09-05T02:17:13.642450+0000","last_fullsized":"2024-09-05T02:17:13.642450+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.642267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.642267+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.642267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:42:58.045503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'8","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.167962+0000","last_change":"2024-09-05T02:17:17.167962+0000","last_active":"2024-09-05T02:17:17.167962+0000","last_peered":"2024-09-05T02:17:17.167962+0000","last_clean":"2024-09-05T02:17:17.167962+0000","last_became_active":"2024-09-05T01:09:22.196611+0000","last_became_peered":"2024-09-05T01:09:22.196611+0000","last_unstale":"2024-09-05T02:17:17.167962+0000","last_undegraded":"2024-09-05T02:17:17.167962+0000","last_fullsized":"2024-09-05T02:17:17.167962+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:17.167782+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:17.167782+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.167782+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:05:11.423168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10242,"num_write":13,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'22","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.346952+0000","last_change":"2024-09-05T02:17:13.346952+0000","last_active":"2024-09-05T02:17:13.346952+0000","last_peered":"2024-09-05T02:17:13.346952+0000","last_clean":"2024-09-05T02:17:13.346952+0000","last_became_active":"2024-09-05T01:05:07.108955+0000","last_became_peered":"2024-09-05T01:05:07.108955+0000","last_unstale":"2024-09-05T02:17:13.346952+0000","last_undegraded":"2024-09-05T02:17:13.346952+0000","last_fullsized":"2024-09-05T02:17:13.346952+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-05T02:17:13.346771+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-05T02:17:13.346771+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.346771+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:33:43.772880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":81,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.728317+0000","last_change":"2024-09-05T02:16:57.728112+0000","last_active":"2024-09-05T02:16:57.728317+0000","last_peered":"2024-09-05T02:16:57.728317+0000","last_clean":"2024-09-05T02:16:57.728317+0000","last_became_active":"2024-09-05T01:30:15.666820+0000","last_became_peered":"2024-09-05T01:30:15.666820+0000","last_unstale":"2024-09-05T02:16:57.728317+0000","last_undegraded":"2024-09-05T02:16:57.728317+0000","last_fullsized":"2024-09-05T02:16:57.728317+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.727939+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.727939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:39:18.941355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.409189+0000","last_change":"2024-09-05T02:17:16.409189+0000","last_active":"2024-09-05T02:17:16.409189+0000","last_peered":"2024-09-05T02:17:16.409189+0000","last_clean":"2024-09-05T02:17:16.409189+0000","last_became_active":"2024-09-05T01:09:26.326177+0000","last_became_peered":"2024-09-05T01:09:26.326177+0000","last_unstale":"2024-09-05T02:17:16.409189+0000","last_undegraded":"2024-09-05T02:17:16.409189+0000","last_fullsized":"2024-09-05T02:17:16.409189+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:16.409003+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:16.409003+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.409003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:10:12.597151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.338018+0000","last_change":"2024-09-05T02:17:03.338018+0000","last_active":"2024-09-05T02:17:03.338018+0000","last_peered":"2024-09-05T02:17:03.338018+0000","last_clean":"2024-09-05T02:17:03.338018+0000","last_became_active":"2024-09-05T01:09:22.193616+0000","last_became_peered":"2024-09-05T01:09:22.193616+0000","last_unstale":"2024-09-05T02:17:03.338018+0000","last_undegraded":"2024-09-05T02:17:03.338018+0000","last_fullsized":"2024-09-05T02:17:03.338018+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.337834+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.337834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:07.730190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'35","reported_seq":169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.717095+0000","last_change":"2024-09-05T02:16:49.716953+0000","last_active":"2024-09-05T02:16:49.717095+0000","last_peered":"2024-09-05T02:16:49.717095+0000","last_clean":"2024-09-05T02:16:49.717095+0000","last_became_active":"2024-09-05T01:05:07.119357+0000","last_became_peered":"2024-09-05T01:05:07.119357+0000","last_unstale":"2024-09-05T02:16:49.717095+0000","last_undegraded":"2024-09-05T02:16:49.717095+0000","last_fullsized":"2024-09-05T02:16:49.717095+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-05T02:16:49.716771+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.716771+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:00.343321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":112,"num_write":70,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.194130+0000","last_change":"2024-09-05T02:17:07.194130+0000","last_active":"2024-09-05T02:17:07.194130+0000","last_peered":"2024-09-05T02:17:07.194130+0000","last_clean":"2024-09-05T02:17:07.194130+0000","last_became_active":"2024-09-05T01:30:15.671418+0000","last_became_peered":"2024-09-05T01:30:15.671418+0000","last_unstale":"2024-09-05T02:17:07.194130+0000","last_undegraded":"2024-09-05T02:17:07.194130+0000","last_fullsized":"2024-09-05T02:17:07.194130+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:07.193950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:07.193950+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.193950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:06.859491+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.414593+0000","last_change":"2024-09-05T02:17:20.414593+0000","last_active":"2024-09-05T02:17:20.414593+0000","last_peered":"2024-09-05T02:17:20.414593+0000","last_clean":"2024-09-05T02:17:20.414593+0000","last_became_active":"2024-09-05T01:09:26.328529+0000","last_became_peered":"2024-09-05T01:09:26.328529+0000","last_unstale":"2024-09-05T02:17:20.414593+0000","last_undegraded":"2024-09-05T02:17:20.414593+0000","last_fullsized":"2024-09-05T02:17:20.414593+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:17:20.414408+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:17:20.414408+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.414408+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:13.162364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":53,"num_write":4,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.795364+0000","last_change":"2024-09-05T02:16:55.795230+0000","last_active":"2024-09-05T02:16:55.795364+0000","last_peered":"2024-09-05T02:16:55.795364+0000","last_clean":"2024-09-05T02:16:55.795364+0000","last_became_active":"2024-09-05T01:09:22.186437+0000","last_became_peered":"2024-09-05T01:09:22.186437+0000","last_unstale":"2024-09-05T02:16:55.795364+0000","last_undegraded":"2024-09-05T02:16:55.795364+0000","last_fullsized":"2024-09-05T02:16:55.795364+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:55.795045+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.795045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:42:15.586272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'21","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.419588+0000","last_change":"2024-09-05T02:17:10.419370+0000","last_active":"2024-09-05T02:17:10.419588+0000","last_peered":"2024-09-05T02:17:10.419588+0000","last_clean":"2024-09-05T02:17:10.419588+0000","last_became_active":"2024-09-05T01:05:07.098887+0000","last_became_peered":"2024-09-05T01:05:07.098887+0000","last_unstale":"2024-09-05T02:17:10.419588+0000","last_undegraded":"2024-09-05T02:17:10.419588+0000","last_fullsized":"2024-09-05T02:17:10.419588+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'21","last_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_deep_scrub":"264'21","last_deep_scrub_stamp":"2024-09-05T02:17:10.419204+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.419204+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:14:09.371937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":38,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:30.199005+0000","last_change":"2024-09-05T02:17:30.199005+0000","last_active":"2024-09-05T02:17:30.199005+0000","last_peered":"2024-09-05T02:17:30.199005+0000","last_clean":"2024-09-05T02:17:30.199005+0000","last_became_active":"2024-09-05T01:30:15.657638+0000","last_became_peered":"2024-09-05T01:30:15.657638+0000","last_unstale":"2024-09-05T02:17:30.199005+0000","last_undegraded":"2024-09-05T02:17:30.199005+0000","last_fullsized":"2024-09-05T02:17:30.199005+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:30.198803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:30.198803+0000","last_clean_scrub_stamp":"2024-09-05T02:17:30.198803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:26.477655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.224792+0000","last_change":"2024-09-05T02:17:24.224589+0000","last_active":"2024-09-05T02:17:24.224792+0000","last_peered":"2024-09-05T02:17:24.224792+0000","last_clean":"2024-09-05T02:17:24.224792+0000","last_became_active":"2024-09-05T01:09:26.338531+0000","last_became_peered":"2024-09-05T01:09:26.338531+0000","last_unstale":"2024-09-05T02:17:24.224792+0000","last_undegraded":"2024-09-05T02:17:24.224792+0000","last_fullsized":"2024-09-05T02:17:24.224792+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-05T02:17:24.224397+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-05T02:17:24.224397+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.224397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:01.179980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.408483+0000","last_change":"2024-09-05T02:17:11.408483+0000","last_active":"2024-09-05T02:17:11.408483+0000","last_peered":"2024-09-05T02:17:11.408483+0000","last_clean":"2024-09-05T02:17:11.408483+0000","last_became_active":"2024-09-05T01:09:22.178842+0000","last_became_peered":"2024-09-05T01:09:22.178842+0000","last_unstale":"2024-09-05T02:17:11.408483+0000","last_undegraded":"2024-09-05T02:17:11.408483+0000","last_fullsized":"2024-09-05T02:17:11.408483+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:11.408291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:11.408291+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.408291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:39.451154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.175614+0000","last_change":"2024-09-05T02:17:14.175425+0000","last_active":"2024-09-05T02:17:14.175614+0000","last_peered":"2024-09-05T02:17:14.175614+0000","last_clean":"2024-09-05T02:17:14.175614+0000","last_became_active":"2024-09-05T01:05:07.102000+0000","last_became_peered":"2024-09-05T01:05:07.102000+0000","last_unstale":"2024-09-05T02:17:14.175614+0000","last_undegraded":"2024-09-05T02:17:14.175614+0000","last_fullsized":"2024-09-05T02:17:14.175614+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-09-05T02:17:14.175238+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-09-05T02:17:14.175238+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.175238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:49:10.537670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":119,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:29.228866+0000","last_change":"2024-09-05T02:17:29.228866+0000","last_active":"2024-09-05T02:17:29.228866+0000","last_peered":"2024-09-05T02:17:29.228866+0000","last_clean":"2024-09-05T02:17:29.228866+0000","last_became_active":"2024-09-05T01:30:15.665074+0000","last_became_peered":"2024-09-05T01:30:15.665074+0000","last_unstale":"2024-09-05T02:17:29.228866+0000","last_undegraded":"2024-09-05T02:17:29.228866+0000","last_fullsized":"2024-09-05T02:17:29.228866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:29.228655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:29.228655+0000","last_clean_scrub_stamp":"2024-09-05T02:17:29.228655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:32:39.743886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"264'9","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.629392+0000","last_change":"2024-09-05T02:17:11.629251+0000","last_active":"2024-09-05T02:17:11.629392+0000","last_peered":"2024-09-05T02:17:11.629392+0000","last_clean":"2024-09-05T02:17:11.629392+0000","last_became_active":"2024-09-05T01:09:26.329101+0000","last_became_peered":"2024-09-05T01:09:26.329101+0000","last_unstale":"2024-09-05T02:17:11.629392+0000","last_undegraded":"2024-09-05T02:17:11.629392+0000","last_fullsized":"2024-09-05T02:17:11.629392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:11.629055+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:11.629055+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.629055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:35:47.522659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":22528,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"0'0","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.438067+0000","last_change":"2024-09-05T02:17:16.438067+0000","last_active":"2024-09-05T02:17:16.438067+0000","last_peered":"2024-09-05T02:17:16.438067+0000","last_clean":"2024-09-05T02:17:16.438067+0000","last_became_active":"2024-09-05T01:09:22.174720+0000","last_became_peered":"2024-09-05T01:09:22.174720+0000","last_unstale":"2024-09-05T02:17:16.438067+0000","last_undegraded":"2024-09-05T02:17:16.438067+0000","last_fullsized":"2024-09-05T02:17:16.438067+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.437893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.437893+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.437893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.038786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'83","reported_seq":364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.188152+0000","last_change":"2024-09-05T02:17:13.187986+0000","last_active":"2024-09-05T02:17:13.188152+0000","last_peered":"2024-09-05T02:17:13.188152+0000","last_clean":"2024-09-05T02:17:13.188152+0000","last_became_active":"2024-09-05T01:05:07.112064+0000","last_became_peered":"2024-09-05T01:05:07.112064+0000","last_unstale":"2024-09-05T02:17:13.188152+0000","last_undegraded":"2024-09-05T02:17:13.188152+0000","last_fullsized":"2024-09-05T02:17:13.188152+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-05T02:17:13.187794+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-05T02:17:13.187794+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.187794+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:03:10.510308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":575,"num_read_kb":390,"num_write":99,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.414606+0000","last_change":"2024-09-05T02:17:10.414606+0000","last_active":"2024-09-05T02:17:10.414606+0000","last_peered":"2024-09-05T02:17:10.414606+0000","last_clean":"2024-09-05T02:17:10.414606+0000","last_became_active":"2024-09-05T01:30:15.648279+0000","last_became_peered":"2024-09-05T01:30:15.648279+0000","last_unstale":"2024-09-05T02:17:10.414606+0000","last_undegraded":"2024-09-05T02:17:10.414606+0000","last_fullsized":"2024-09-05T02:17:10.414606+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.414408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.414408+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.414408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:20:47.837044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.172642+0000","last_change":"2024-09-05T02:17:04.172386+0000","last_active":"2024-09-05T02:17:04.172642+0000","last_peered":"2024-09-05T02:17:04.172642+0000","last_clean":"2024-09-05T02:17:04.172642+0000","last_became_active":"2024-09-05T01:09:26.323385+0000","last_became_peered":"2024-09-05T01:09:26.323385+0000","last_unstale":"2024-09-05T02:17:04.172642+0000","last_undegraded":"2024-09-05T02:17:04.172642+0000","last_fullsized":"2024-09-05T02:17:04.172642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:04.172168+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.172168+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:25.385664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'3","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.436721+0000","last_change":"2024-09-05T02:17:09.436523+0000","last_active":"2024-09-05T02:17:09.436721+0000","last_peered":"2024-09-05T02:17:09.436721+0000","last_clean":"2024-09-05T02:17:09.436721+0000","last_became_active":"2024-09-05T01:09:22.174094+0000","last_became_peered":"2024-09-05T01:09:22.174094+0000","last_unstale":"2024-09-05T02:17:09.436721+0000","last_undegraded":"2024-09-05T02:17:09.436721+0000","last_fullsized":"2024-09-05T02:17:09.436721+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:09.436341+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:09.436341+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.436341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:32.438055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"261'33","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.054604+0000","last_change":"2024-09-05T02:16:59.054295+0000","last_active":"2024-09-05T02:16:59.054604+0000","last_peered":"2024-09-05T02:16:59.054604+0000","last_clean":"2024-09-05T02:16:59.054604+0000","last_became_active":"2024-09-05T01:05:07.099291+0000","last_became_peered":"2024-09-05T01:05:07.099291+0000","last_unstale":"2024-09-05T02:16:59.054604+0000","last_undegraded":"2024-09-05T02:16:59.054604+0000","last_fullsized":"2024-09-05T02:16:59.054604+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-05T02:16:59.053968+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.053968+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:36.825922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":134,"num_write":50,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.918713+0000","last_change":"2024-09-05T02:17:24.918565+0000","last_active":"2024-09-05T02:17:24.918713+0000","last_peered":"2024-09-05T02:17:24.918713+0000","last_clean":"2024-09-05T02:17:24.918713+0000","last_became_active":"2024-09-05T01:30:15.663870+0000","last_became_peered":"2024-09-05T01:30:15.663870+0000","last_unstale":"2024-09-05T02:17:24.918713+0000","last_undegraded":"2024-09-05T02:17:24.918713+0000","last_fullsized":"2024-09-05T02:17:24.918713+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:24.918352+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:24.918352+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.918352+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:43:39.242996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.215417+0000","last_change":"2024-09-05T02:17:05.215417+0000","last_active":"2024-09-05T02:17:05.215417+0000","last_peered":"2024-09-05T02:17:05.215417+0000","last_clean":"2024-09-05T02:17:05.215417+0000","last_became_active":"2024-09-05T01:09:26.322283+0000","last_became_peered":"2024-09-05T01:09:26.322283+0000","last_unstale":"2024-09-05T02:17:05.215417+0000","last_undegraded":"2024-09-05T02:17:05.215417+0000","last_fullsized":"2024-09-05T02:17:05.215417+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:05.215205+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.215205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:58:38.050614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":10,"num_write_kb":1047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.441926+0000","last_change":"2024-09-05T02:17:10.441926+0000","last_active":"2024-09-05T02:17:10.441926+0000","last_peered":"2024-09-05T02:17:10.441926+0000","last_clean":"2024-09-05T02:17:10.441926+0000","last_became_active":"2024-09-05T01:09:22.185758+0000","last_became_peered":"2024-09-05T01:09:22.185758+0000","last_unstale":"2024-09-05T02:17:10.441926+0000","last_undegraded":"2024-09-05T02:17:10.441926+0000","last_fullsized":"2024-09-05T02:17:10.441926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.441721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.441721+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.441721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:46:54.348907+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'29","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.376977+0000","last_change":"2024-09-05T02:17:09.376977+0000","last_active":"2024-09-05T02:17:09.376977+0000","last_peered":"2024-09-05T02:17:09.376977+0000","last_clean":"2024-09-05T02:17:09.376977+0000","last_became_active":"2024-09-05T01:05:07.113445+0000","last_became_peered":"2024-09-05T01:05:07.113445+0000","last_unstale":"2024-09-05T02:17:09.376977+0000","last_undegraded":"2024-09-05T02:17:09.376977+0000","last_fullsized":"2024-09-05T02:17:09.376977+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:09.376801+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.376801+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:37.688382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":52,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.867411+0000","last_change":"2024-09-05T02:17:25.867144+0000","last_active":"2024-09-05T02:17:25.867411+0000","last_peered":"2024-09-05T02:17:25.867411+0000","last_clean":"2024-09-05T02:17:25.867411+0000","last_became_active":"2024-09-05T01:30:15.671179+0000","last_became_peered":"2024-09-05T01:30:15.671179+0000","last_unstale":"2024-09-05T02:17:25.867411+0000","last_undegraded":"2024-09-05T02:17:25.867411+0000","last_fullsized":"2024-09-05T02:17:25.867411+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.866861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.866861+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.866861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:13.452320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"264'8","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:26.249942+0000","last_change":"2024-09-05T02:17:26.249942+0000","last_active":"2024-09-05T02:17:26.249942+0000","last_peered":"2024-09-05T02:17:26.249942+0000","last_clean":"2024-09-05T02:17:26.249942+0000","last_became_active":"2024-09-05T01:09:26.323951+0000","last_became_peered":"2024-09-05T01:09:26.323951+0000","last_unstale":"2024-09-05T02:17:26.249942+0000","last_undegraded":"2024-09-05T02:17:26.249942+0000","last_fullsized":"2024-09-05T02:17:26.249942+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:26.249748+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:26.249748+0000","last_clean_scrub_stamp":"2024-09-05T02:17:26.249748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:31:45.121481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.428645+0000","last_change":"2024-09-05T02:17:18.428645+0000","last_active":"2024-09-05T02:17:18.428645+0000","last_peered":"2024-09-05T02:17:18.428645+0000","last_clean":"2024-09-05T02:17:18.428645+0000","last_became_active":"2024-09-05T01:09:22.204239+0000","last_became_peered":"2024-09-05T01:09:22.204239+0000","last_unstale":"2024-09-05T02:17:18.428645+0000","last_undegraded":"2024-09-05T02:17:18.428645+0000","last_fullsized":"2024-09-05T02:17:18.428645+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:18.428458+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:18.428458+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.428458+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:34:42.895859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":23604,"num_write":14,"num_write_kb":8242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'32","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.239865+0000","last_change":"2024-09-05T02:16:57.239705+0000","last_active":"2024-09-05T02:16:57.239865+0000","last_peered":"2024-09-05T02:16:57.239865+0000","last_clean":"2024-09-05T02:16:57.239865+0000","last_became_active":"2024-09-05T01:05:07.106585+0000","last_became_peered":"2024-09-05T01:05:07.106585+0000","last_unstale":"2024-09-05T02:16:57.239865+0000","last_undegraded":"2024-09-05T02:16:57.239865+0000","last_fullsized":"2024-09-05T02:16:57.239865+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-05T02:16:57.239525+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.239525+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:43:44.031261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":64,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.380425+0000","last_change":"2024-09-05T02:17:08.380425+0000","last_active":"2024-09-05T02:17:08.380425+0000","last_peered":"2024-09-05T02:17:08.380425+0000","last_clean":"2024-09-05T02:17:08.380425+0000","last_became_active":"2024-09-05T01:30:15.663440+0000","last_became_peered":"2024-09-05T01:30:15.663440+0000","last_unstale":"2024-09-05T02:17:08.380425+0000","last_undegraded":"2024-09-05T02:17:08.380425+0000","last_fullsized":"2024-09-05T02:17:08.380425+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:08.380201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:08.380201+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.380201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:46:10.596628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'5","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.236687+0000","last_change":"2024-09-05T02:17:22.236687+0000","last_active":"2024-09-05T02:17:22.236687+0000","last_peered":"2024-09-05T02:17:22.236687+0000","last_clean":"2024-09-05T02:17:22.236687+0000","last_became_active":"2024-09-05T01:09:26.347855+0000","last_became_peered":"2024-09-05T01:09:26.347855+0000","last_unstale":"2024-09-05T02:17:22.236687+0000","last_undegraded":"2024-09-05T02:17:22.236687+0000","last_fullsized":"2024-09-05T02:17:22.236687+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-05T02:17:22.236456+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-05T02:17:22.236456+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.236456+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:30:05.713293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.669166+0000","last_change":"2024-09-05T02:17:12.669027+0000","last_active":"2024-09-05T02:17:12.669166+0000","last_peered":"2024-09-05T02:17:12.669166+0000","last_clean":"2024-09-05T02:17:12.669166+0000","last_became_active":"2024-09-05T01:09:22.177404+0000","last_became_peered":"2024-09-05T01:09:22.177404+0000","last_unstale":"2024-09-05T02:17:12.669166+0000","last_undegraded":"2024-09-05T02:17:12.669166+0000","last_fullsized":"2024-09-05T02:17:12.669166+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:12.668836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:12.668836+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.668836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:47:12.036044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'18","reported_seq":119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.382345+0000","last_change":"2024-09-05T02:17:11.382188+0000","last_active":"2024-09-05T02:17:11.382345+0000","last_peered":"2024-09-05T02:17:11.382345+0000","last_clean":"2024-09-05T02:17:11.382345+0000","last_became_active":"2024-09-05T01:05:07.107654+0000","last_became_peered":"2024-09-05T01:05:07.107654+0000","last_unstale":"2024-09-05T02:17:11.382345+0000","last_undegraded":"2024-09-05T02:17:11.382345+0000","last_fullsized":"2024-09-05T02:17:11.382345+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-05T02:17:11.382012+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-05T02:17:11.382012+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.382012+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:52:00.703296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":60,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.759428+0000","last_change":"2024-09-05T02:16:58.759428+0000","last_active":"2024-09-05T02:16:58.759428+0000","last_peered":"2024-09-05T02:16:58.759428+0000","last_clean":"2024-09-05T02:16:58.759428+0000","last_became_active":"2024-09-05T01:30:15.668005+0000","last_became_peered":"2024-09-05T01:30:15.668005+0000","last_unstale":"2024-09-05T02:16:58.759428+0000","last_undegraded":"2024-09-05T02:16:58.759428+0000","last_fullsized":"2024-09-05T02:16:58.759428+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:58.759204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.759204+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:12.620338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'10","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.223140+0000","last_change":"2024-09-05T02:17:21.222865+0000","last_active":"2024-09-05T02:17:21.223140+0000","last_peered":"2024-09-05T02:17:21.223140+0000","last_clean":"2024-09-05T02:17:21.223140+0000","last_became_active":"2024-09-05T01:09:26.339476+0000","last_became_peered":"2024-09-05T01:09:26.339476+0000","last_unstale":"2024-09-05T02:17:21.223140+0000","last_undegraded":"2024-09-05T02:17:21.223140+0000","last_fullsized":"2024-09-05T02:17:21.223140+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-05T02:17:21.222647+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-05T02:17:21.222647+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.222647+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:29.043695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28674,"num_write":15,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.835841+0000","last_change":"2024-09-05T02:17:13.835841+0000","last_active":"2024-09-05T02:17:13.835841+0000","last_peered":"2024-09-05T02:17:13.835841+0000","last_clean":"2024-09-05T02:17:13.835841+0000","last_became_active":"2024-09-05T01:09:22.171573+0000","last_became_peered":"2024-09-05T01:09:22.171573+0000","last_unstale":"2024-09-05T02:17:13.835841+0000","last_undegraded":"2024-09-05T02:17:13.835841+0000","last_fullsized":"2024-09-05T02:17:13.835841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.835635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.835635+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.835635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:02.090975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'28","reported_seq":149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.233431+0000","last_change":"2024-09-05T02:17:12.233245+0000","last_active":"2024-09-05T02:17:12.233431+0000","last_peered":"2024-09-05T02:17:12.233431+0000","last_clean":"2024-09-05T02:17:12.233431+0000","last_became_active":"2024-09-05T01:05:07.094413+0000","last_became_peered":"2024-09-05T01:05:07.094413+0000","last_unstale":"2024-09-05T02:17:12.233431+0000","last_undegraded":"2024-09-05T02:17:12.233431+0000","last_fullsized":"2024-09-05T02:17:12.233431+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-05T02:17:12.233061+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-05T02:17:12.233061+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.233061+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:54.922850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":101,"num_write":62,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.921614+0000","last_change":"2024-09-05T02:17:23.921614+0000","last_active":"2024-09-05T02:17:23.921614+0000","last_peered":"2024-09-05T02:17:23.921614+0000","last_clean":"2024-09-05T02:17:23.921614+0000","last_became_active":"2024-09-05T01:30:15.663567+0000","last_became_peered":"2024-09-05T01:30:15.663567+0000","last_unstale":"2024-09-05T02:17:23.921614+0000","last_undegraded":"2024-09-05T02:17:23.921614+0000","last_fullsized":"2024-09-05T02:17:23.921614+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.921423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.921423+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.921423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:03.013268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.198430+0000","last_change":"2024-09-05T02:17:23.198430+0000","last_active":"2024-09-05T02:17:23.198430+0000","last_peered":"2024-09-05T02:17:23.198430+0000","last_clean":"2024-09-05T02:17:23.198430+0000","last_became_active":"2024-09-05T01:09:26.331895+0000","last_became_peered":"2024-09-05T01:09:26.331895+0000","last_unstale":"2024-09-05T02:17:23.198430+0000","last_undegraded":"2024-09-05T02:17:23.198430+0000","last_fullsized":"2024-09-05T02:17:23.198430+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.198245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.198245+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.198245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:19:01.252673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.759403+0000","last_change":"2024-09-05T02:16:51.759263+0000","last_active":"2024-09-05T02:16:51.759403+0000","last_peered":"2024-09-05T02:16:51.759403+0000","last_clean":"2024-09-05T02:16:51.759403+0000","last_became_active":"2024-09-05T01:09:22.194743+0000","last_became_peered":"2024-09-05T01:09:22.194743+0000","last_unstale":"2024-09-05T02:16:51.759403+0000","last_undegraded":"2024-09-05T02:16:51.759403+0000","last_fullsized":"2024-09-05T02:16:51.759403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-05T02:16:51.759077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.759077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:34.310502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'49","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.731907+0000","last_change":"2024-09-05T02:16:50.731755+0000","last_active":"2024-09-05T02:16:50.731907+0000","last_peered":"2024-09-05T02:16:50.731907+0000","last_clean":"2024-09-05T02:16:50.731907+0000","last_became_active":"2024-09-05T01:05:07.109373+0000","last_became_peered":"2024-09-05T01:05:07.109373+0000","last_unstale":"2024-09-05T02:16:50.731907+0000","last_undegraded":"2024-09-05T02:16:50.731907+0000","last_fullsized":"2024-09-05T02:16:50.731907+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:16:50.731551+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.731551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:35:18.587423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":171,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.591984+0000","last_change":"2024-09-05T02:17:16.591984+0000","last_active":"2024-09-05T02:17:16.591984+0000","last_peered":"2024-09-05T02:17:16.591984+0000","last_clean":"2024-09-05T02:17:16.591984+0000","last_became_active":"2024-09-05T01:30:15.666398+0000","last_became_peered":"2024-09-05T01:30:15.666398+0000","last_unstale":"2024-09-05T02:17:16.591984+0000","last_undegraded":"2024-09-05T02:17:16.591984+0000","last_fullsized":"2024-09-05T02:17:16.591984+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.591806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.591806+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.591806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:31:59.637744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.411861+0000","last_change":"2024-09-05T02:17:15.411861+0000","last_active":"2024-09-05T02:17:15.411861+0000","last_peered":"2024-09-05T02:17:15.411861+0000","last_clean":"2024-09-05T02:17:15.411861+0000","last_became_active":"2024-09-05T01:09:26.314286+0000","last_became_peered":"2024-09-05T01:09:26.314286+0000","last_unstale":"2024-09-05T02:17:15.411861+0000","last_undegraded":"2024-09-05T02:17:15.411861+0000","last_fullsized":"2024-09-05T02:17:15.411861+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:15.411653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:15.411653+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.411653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:21:44.133238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'6","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.410669+0000","last_change":"2024-09-05T02:17:17.410669+0000","last_active":"2024-09-05T02:17:17.410669+0000","last_peered":"2024-09-05T02:17:17.410669+0000","last_clean":"2024-09-05T02:17:17.410669+0000","last_became_active":"2024-09-05T01:09:22.176362+0000","last_became_peered":"2024-09-05T01:09:22.176362+0000","last_unstale":"2024-09-05T02:17:17.410669+0000","last_undegraded":"2024-09-05T02:17:17.410669+0000","last_fullsized":"2024-09-05T02:17:17.410669+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:17.410475+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:17.410475+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.410475+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:06:28.023340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'30","reported_seq":161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.839887+0000","last_change":"2024-09-05T02:17:07.839721+0000","last_active":"2024-09-05T02:17:07.839887+0000","last_peered":"2024-09-05T02:17:07.839887+0000","last_clean":"2024-09-05T02:17:07.839887+0000","last_became_active":"2024-09-05T01:05:07.087409+0000","last_became_peered":"2024-09-05T01:05:07.087409+0000","last_unstale":"2024-09-05T02:17:07.839887+0000","last_undegraded":"2024-09-05T02:17:07.839887+0000","last_fullsized":"2024-09-05T02:17:07.839887+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-05T02:17:07.839528+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-05T02:17:07.839528+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.839528+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:29:24.409530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":52,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:28.263281+0000","last_change":"2024-09-05T02:17:28.263281+0000","last_active":"2024-09-05T02:17:28.263281+0000","last_peered":"2024-09-05T02:17:28.263281+0000","last_clean":"2024-09-05T02:17:28.263281+0000","last_became_active":"2024-09-05T01:30:15.664697+0000","last_became_peered":"2024-09-05T01:30:15.664697+0000","last_unstale":"2024-09-05T02:17:28.263281+0000","last_undegraded":"2024-09-05T02:17:28.263281+0000","last_fullsized":"2024-09-05T02:17:28.263281+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:28.263088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:28.263088+0000","last_clean_scrub_stamp":"2024-09-05T02:17:28.263088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:45:05.914806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.430192+0000","last_change":"2024-09-05T02:17:09.430192+0000","last_active":"2024-09-05T02:17:09.430192+0000","last_peered":"2024-09-05T02:17:09.430192+0000","last_clean":"2024-09-05T02:17:09.430192+0000","last_became_active":"2024-09-05T01:09:26.325220+0000","last_became_peered":"2024-09-05T01:09:26.325220+0000","last_unstale":"2024-09-05T02:17:09.430192+0000","last_undegraded":"2024-09-05T02:17:09.430192+0000","last_fullsized":"2024-09-05T02:17:09.430192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:09.430004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:09.430004+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.430004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:08:18.621474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.573211+0000","last_change":"2024-09-05T02:17:06.573211+0000","last_active":"2024-09-05T02:17:06.573211+0000","last_peered":"2024-09-05T02:17:06.573211+0000","last_clean":"2024-09-05T02:17:06.573211+0000","last_became_active":"2024-09-05T01:09:22.190475+0000","last_became_peered":"2024-09-05T01:09:22.190475+0000","last_unstale":"2024-09-05T02:17:06.573211+0000","last_undegraded":"2024-09-05T02:17:06.573211+0000","last_fullsized":"2024-09-05T02:17:06.573211+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:06.573024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:06.573024+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.573024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:41.082783+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'25","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.877547+0000","last_change":"2024-09-05T02:17:06.877374+0000","last_active":"2024-09-05T02:17:06.877547+0000","last_peered":"2024-09-05T02:17:06.877547+0000","last_clean":"2024-09-05T02:17:06.877547+0000","last_became_active":"2024-09-05T01:05:07.098584+0000","last_became_peered":"2024-09-05T01:05:07.098584+0000","last_unstale":"2024-09-05T02:17:06.877547+0000","last_undegraded":"2024-09-05T02:17:06.877547+0000","last_fullsized":"2024-09-05T02:17:06.877547+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-05T02:17:06.877190+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-05T02:17:06.877190+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.877190+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:01.895449+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":87,"num_write":50,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.403067+0000","last_change":"2024-09-05T02:17:25.403067+0000","last_active":"2024-09-05T02:17:25.403067+0000","last_peered":"2024-09-05T02:17:25.403067+0000","last_clean":"2024-09-05T02:17:25.403067+0000","last_became_active":"2024-09-05T01:30:15.653066+0000","last_became_peered":"2024-09-05T01:30:15.653066+0000","last_unstale":"2024-09-05T02:17:25.403067+0000","last_undegraded":"2024-09-05T02:17:25.403067+0000","last_fullsized":"2024-09-05T02:17:25.403067+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.402888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.402888+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.402888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:16:46.216426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'8","reported_seq":81,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.316513+0000","last_change":"2024-09-05T02:17:06.316376+0000","last_active":"2024-09-05T02:17:06.316513+0000","last_peered":"2024-09-05T02:17:06.316513+0000","last_clean":"2024-09-05T02:17:06.316513+0000","last_became_active":"2024-09-05T01:09:26.319499+0000","last_became_peered":"2024-09-05T01:09:26.319499+0000","last_unstale":"2024-09-05T02:17:06.316513+0000","last_undegraded":"2024-09-05T02:17:06.316513+0000","last_fullsized":"2024-09-05T02:17:06.316513+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-05T02:17:06.316187+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.316187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:57:15.545632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":26626,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'5","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.184092+0000","last_change":"2024-09-05T02:17:15.184092+0000","last_active":"2024-09-05T02:17:15.184092+0000","last_peered":"2024-09-05T02:17:15.184092+0000","last_clean":"2024-09-05T02:17:15.184092+0000","last_became_active":"2024-09-05T01:09:22.194750+0000","last_became_peered":"2024-09-05T01:09:22.194750+0000","last_unstale":"2024-09-05T02:17:15.184092+0000","last_undegraded":"2024-09-05T02:17:15.184092+0000","last_fullsized":"2024-09-05T02:17:15.184092+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-05T02:17:15.183920+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-05T02:17:15.183920+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.183920+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:56:51.742695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'117","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.337782+0000","last_change":"2024-09-05T02:17:08.337648+0000","last_active":"2024-09-05T02:17:08.337782+0000","last_peered":"2024-09-05T02:17:08.337782+0000","last_clean":"2024-09-05T02:17:08.337782+0000","last_became_active":"2024-09-05T01:05:07.105401+0000","last_became_peered":"2024-09-05T01:05:07.105401+0000","last_unstale":"2024-09-05T02:17:08.337782+0000","last_undegraded":"2024-09-05T02:17:08.337782+0000","last_fullsized":"2024-09-05T02:17:08.337782+0000","mapping_epoch":251,"log_start":"264'100","ondisk_log_start":"264'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-05T02:17:08.337473+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.337473+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:56.312725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":792,"num_read_kb":544,"num_write":155,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:26.449188+0000","last_change":"2024-09-05T02:17:26.449188+0000","last_active":"2024-09-05T02:17:26.449188+0000","last_peered":"2024-09-05T02:17:26.449188+0000","last_clean":"2024-09-05T02:17:26.449188+0000","last_became_active":"2024-09-05T01:30:15.652647+0000","last_became_peered":"2024-09-05T01:30:15.652647+0000","last_unstale":"2024-09-05T02:17:26.449188+0000","last_undegraded":"2024-09-05T02:17:26.449188+0000","last_fullsized":"2024-09-05T02:17:26.449188+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:26.448986+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:26.448986+0000","last_clean_scrub_stamp":"2024-09-05T02:17:26.448986+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:13:12.020262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'6","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.173052+0000","last_change":"2024-09-05T02:17:20.173052+0000","last_active":"2024-09-05T02:17:20.173052+0000","last_peered":"2024-09-05T02:17:20.173052+0000","last_clean":"2024-09-05T02:17:20.173052+0000","last_became_active":"2024-09-05T01:09:26.340718+0000","last_became_peered":"2024-09-05T01:09:26.340718+0000","last_unstale":"2024-09-05T02:17:20.173052+0000","last_undegraded":"2024-09-05T02:17:20.173052+0000","last_fullsized":"2024-09-05T02:17:20.173052+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:20.172862+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:20.172862+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.172862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:44:26.246248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"264'3","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.128550+0000","last_change":"2024-09-05T02:17:02.128550+0000","last_active":"2024-09-05T02:17:02.128550+0000","last_peered":"2024-09-05T02:17:02.128550+0000","last_clean":"2024-09-05T02:17:02.128550+0000","last_became_active":"2024-09-05T01:09:22.204035+0000","last_became_peered":"2024-09-05T01:09:22.204035+0000","last_unstale":"2024-09-05T02:17:02.128550+0000","last_undegraded":"2024-09-05T02:17:02.128550+0000","last_fullsized":"2024-09-05T02:17:02.128550+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:02.128361+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.128361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:30.574482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'12","reported_seq":108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.480255+0000","last_change":"2024-09-05T02:17:08.479939+0000","last_active":"2024-09-05T02:17:08.480255+0000","last_peered":"2024-09-05T02:17:08.480255+0000","last_clean":"2024-09-05T02:17:08.480255+0000","last_became_active":"2024-09-05T01:05:07.104630+0000","last_became_peered":"2024-09-05T01:05:07.104630+0000","last_unstale":"2024-09-05T02:17:08.480255+0000","last_undegraded":"2024-09-05T02:17:08.480255+0000","last_fullsized":"2024-09-05T02:17:08.480255+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-05T02:17:08.479674+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-05T02:17:08.479674+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.479674+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:12:58.229303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:27.249371+0000","last_change":"2024-09-05T02:17:27.249371+0000","last_active":"2024-09-05T02:17:27.249371+0000","last_peered":"2024-09-05T02:17:27.249371+0000","last_clean":"2024-09-05T02:17:27.249371+0000","last_became_active":"2024-09-05T01:30:15.657663+0000","last_became_peered":"2024-09-05T01:30:15.657663+0000","last_unstale":"2024-09-05T02:17:27.249371+0000","last_undegraded":"2024-09-05T02:17:27.249371+0000","last_fullsized":"2024-09-05T02:17:27.249371+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:27.249162+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:27.249162+0000","last_clean_scrub_stamp":"2024-09-05T02:17:27.249162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:24:33.894714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.128289+0000","last_change":"2024-09-05T02:17:03.128122+0000","last_active":"2024-09-05T02:17:03.128289+0000","last_peered":"2024-09-05T02:17:03.128289+0000","last_clean":"2024-09-05T02:17:03.128289+0000","last_became_active":"2024-09-05T01:09:26.325934+0000","last_became_peered":"2024-09-05T01:09:26.325934+0000","last_unstale":"2024-09-05T02:17:03.128289+0000","last_undegraded":"2024-09-05T02:17:03.128289+0000","last_fullsized":"2024-09-05T02:17:03.128289+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:03.127940+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.127940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:28:30.698265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.628636+0000","last_change":"2024-09-05T02:17:09.628636+0000","last_active":"2024-09-05T02:17:09.628636+0000","last_peered":"2024-09-05T02:17:09.628636+0000","last_clean":"2024-09-05T02:17:09.628636+0000","last_became_active":"2024-09-05T01:09:22.186746+0000","last_became_peered":"2024-09-05T01:09:22.186746+0000","last_unstale":"2024-09-05T02:17:09.628636+0000","last_undegraded":"2024-09-05T02:17:09.628636+0000","last_fullsized":"2024-09-05T02:17:09.628636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:09.628448+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.628448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:06:13.486705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'10","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.227110+0000","last_change":"2024-09-05T02:17:11.226946+0000","last_active":"2024-09-05T02:17:11.227110+0000","last_peered":"2024-09-05T02:17:11.227110+0000","last_clean":"2024-09-05T02:17:11.227110+0000","last_became_active":"2024-09-05T01:05:07.111770+0000","last_became_peered":"2024-09-05T01:05:07.111770+0000","last_unstale":"2024-09-05T02:17:11.227110+0000","last_undegraded":"2024-09-05T02:17:11.227110+0000","last_fullsized":"2024-09-05T02:17:11.227110+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-09-05T02:17:11.226761+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-09-05T02:17:11.226761+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.226761+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:40:34.540750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":32,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.751960+0000","last_change":"2024-09-05T02:16:56.751960+0000","last_active":"2024-09-05T02:16:56.751960+0000","last_peered":"2024-09-05T02:16:56.751960+0000","last_clean":"2024-09-05T02:16:56.751960+0000","last_became_active":"2024-09-05T01:30:15.668844+0000","last_became_peered":"2024-09-05T01:30:15.668844+0000","last_unstale":"2024-09-05T02:16:56.751960+0000","last_undegraded":"2024-09-05T02:16:56.751960+0000","last_fullsized":"2024-09-05T02:16:56.751960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.751614+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.751614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:10.647303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.180469+0000","last_change":"2024-09-05T02:17:18.180469+0000","last_active":"2024-09-05T02:17:18.180469+0000","last_peered":"2024-09-05T02:17:18.180469+0000","last_clean":"2024-09-05T02:17:18.180469+0000","last_became_active":"2024-09-05T01:09:26.339219+0000","last_became_peered":"2024-09-05T01:09:26.339219+0000","last_unstale":"2024-09-05T02:17:18.180469+0000","last_undegraded":"2024-09-05T02:17:18.180469+0000","last_fullsized":"2024-09-05T02:17:18.180469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:18.180301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:18.180301+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.180301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:32.430802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'3","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.854537+0000","last_change":"2024-09-05T02:17:12.854537+0000","last_active":"2024-09-05T02:17:12.854537+0000","last_peered":"2024-09-05T02:17:12.854537+0000","last_clean":"2024-09-05T02:17:12.854537+0000","last_became_active":"2024-09-05T01:09:22.190818+0000","last_became_peered":"2024-09-05T01:09:22.190818+0000","last_unstale":"2024-09-05T02:17:12.854537+0000","last_undegraded":"2024-09-05T02:17:12.854537+0000","last_fullsized":"2024-09-05T02:17:12.854537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:12.854342+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:12.854342+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.854342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:54:51.250695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'26","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.238023+0000","last_change":"2024-09-05T02:17:10.237844+0000","last_active":"2024-09-05T02:17:10.238023+0000","last_peered":"2024-09-05T02:17:10.238023+0000","last_clean":"2024-09-05T02:17:10.238023+0000","last_became_active":"2024-09-05T01:05:07.109047+0000","last_became_peered":"2024-09-05T01:05:07.109047+0000","last_unstale":"2024-09-05T02:17:10.238023+0000","last_undegraded":"2024-09-05T02:17:10.238023+0000","last_fullsized":"2024-09-05T02:17:10.238023+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'26","last_scrub_stamp":"2024-09-05T02:17:10.237655+0000","last_deep_scrub":"264'26","last_deep_scrub_stamp":"2024-09-05T02:17:10.237655+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.237655+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:41.328707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":89,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:20.965217+0000","last_change":"2024-09-05T02:17:20.965052+0000","last_active":"2024-09-05T02:17:20.965217+0000","last_peered":"2024-09-05T02:17:20.965217+0000","last_clean":"2024-09-05T02:17:20.965217+0000","last_became_active":"2024-09-05T01:30:15.651100+0000","last_became_peered":"2024-09-05T01:30:15.651100+0000","last_unstale":"2024-09-05T02:17:20.965217+0000","last_undegraded":"2024-09-05T02:17:20.965217+0000","last_fullsized":"2024-09-05T02:17:20.965217+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:20.964858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:20.964858+0000","last_clean_scrub_stamp":"2024-09-05T02:17:20.964858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:11:14.189425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.204873+0000","last_change":"2024-09-05T02:17:16.204873+0000","last_active":"2024-09-05T02:17:16.204873+0000","last_peered":"2024-09-05T02:17:16.204873+0000","last_clean":"2024-09-05T02:17:16.204873+0000","last_became_active":"2024-09-05T01:09:26.324290+0000","last_became_peered":"2024-09-05T01:09:26.324290+0000","last_unstale":"2024-09-05T02:17:16.204873+0000","last_undegraded":"2024-09-05T02:17:16.204873+0000","last_fullsized":"2024-09-05T02:17:16.204873+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:16.204662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:16.204662+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.204662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:43:32.227468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.772516+0000","last_change":"2024-09-05T02:16:53.772516+0000","last_active":"2024-09-05T02:16:53.772516+0000","last_peered":"2024-09-05T02:16:53.772516+0000","last_clean":"2024-09-05T02:16:53.772516+0000","last_became_active":"2024-09-05T01:09:22.171448+0000","last_became_peered":"2024-09-05T01:09:22.171448+0000","last_unstale":"2024-09-05T02:16:53.772516+0000","last_undegraded":"2024-09-05T02:16:53.772516+0000","last_fullsized":"2024-09-05T02:16:53.772516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:53.772339+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.772339+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:26.528640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'18","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.555603+0000","last_change":"2024-09-05T02:17:07.555411+0000","last_active":"2024-09-05T02:17:07.555603+0000","last_peered":"2024-09-05T02:17:07.555603+0000","last_clean":"2024-09-05T02:17:07.555603+0000","last_became_active":"2024-09-05T01:05:07.096678+0000","last_became_peered":"2024-09-05T01:05:07.096678+0000","last_unstale":"2024-09-05T02:17:07.555603+0000","last_undegraded":"2024-09-05T02:17:07.555603+0000","last_fullsized":"2024-09-05T02:17:07.555603+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-09-05T02:17:07.555220+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.555220+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:28.608854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":68,"num_write":31,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.191473+0000","last_change":"2024-09-05T02:17:06.191473+0000","last_active":"2024-09-05T02:17:06.191473+0000","last_peered":"2024-09-05T02:17:06.191473+0000","last_clean":"2024-09-05T02:17:06.191473+0000","last_became_active":"2024-09-05T01:30:15.657895+0000","last_became_peered":"2024-09-05T01:30:15.657895+0000","last_unstale":"2024-09-05T02:17:06.191473+0000","last_undegraded":"2024-09-05T02:17:06.191473+0000","last_fullsized":"2024-09-05T02:17:06.191473+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:06.191257+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.191257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:33:00.620408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'8","reported_seq":79,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.291061+0000","last_change":"2024-09-05T02:17:02.290922+0000","last_active":"2024-09-05T02:17:02.291061+0000","last_peered":"2024-09-05T02:17:02.291061+0000","last_clean":"2024-09-05T02:17:02.291061+0000","last_became_active":"2024-09-05T01:09:26.327853+0000","last_became_peered":"2024-09-05T01:09:26.327853+0000","last_unstale":"2024-09-05T02:17:02.291061+0000","last_undegraded":"2024-09-05T02:17:02.291061+0000","last_fullsized":"2024-09-05T02:17:02.291061+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-05T02:17:02.290717+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.290717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:53:26.594431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14338,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"264'4","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.417543+0000","last_change":"2024-09-05T02:17:15.417543+0000","last_active":"2024-09-05T02:17:15.417543+0000","last_peered":"2024-09-05T02:17:15.417543+0000","last_clean":"2024-09-05T02:17:15.417543+0000","last_became_active":"2024-09-05T01:09:22.189622+0000","last_became_peered":"2024-09-05T01:09:22.189622+0000","last_unstale":"2024-09-05T02:17:15.417543+0000","last_undegraded":"2024-09-05T02:17:15.417543+0000","last_fullsized":"2024-09-05T02:17:15.417543+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:17:15.417237+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:17:15.417237+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.417237+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:16.539323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":88,"num_write":4,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'24","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.006759+0000","last_change":"2024-09-05T02:16:58.006578+0000","last_active":"2024-09-05T02:16:58.006759+0000","last_peered":"2024-09-05T02:16:58.006759+0000","last_clean":"2024-09-05T02:16:58.006759+0000","last_became_active":"2024-09-05T01:05:07.107935+0000","last_became_peered":"2024-09-05T01:05:07.107935+0000","last_unstale":"2024-09-05T02:16:58.006759+0000","last_undegraded":"2024-09-05T02:16:58.006759+0000","last_fullsized":"2024-09-05T02:16:58.006759+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-05T02:16:58.006393+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.006393+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:22.081174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":45,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.957136+0000","last_change":"2024-09-05T02:17:19.957136+0000","last_active":"2024-09-05T02:17:19.957136+0000","last_peered":"2024-09-05T02:17:19.957136+0000","last_clean":"2024-09-05T02:17:19.957136+0000","last_became_active":"2024-09-05T01:30:15.671177+0000","last_became_peered":"2024-09-05T01:30:15.671177+0000","last_unstale":"2024-09-05T02:17:19.957136+0000","last_undegraded":"2024-09-05T02:17:19.957136+0000","last_fullsized":"2024-09-05T02:17:19.957136+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:19.956943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:19.956943+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.956943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:34.998852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.156383+0000","last_change":"2024-09-05T02:17:19.156383+0000","last_active":"2024-09-05T02:17:19.156383+0000","last_peered":"2024-09-05T02:17:19.156383+0000","last_clean":"2024-09-05T02:17:19.156383+0000","last_became_active":"2024-09-05T01:09:26.345611+0000","last_became_peered":"2024-09-05T01:09:26.345611+0000","last_unstale":"2024-09-05T02:17:19.156383+0000","last_undegraded":"2024-09-05T02:17:19.156383+0000","last_fullsized":"2024-09-05T02:17:19.156383+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:19.156193+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:19.156193+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.156193+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:25:55.657348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.295444+0000","last_change":"2024-09-05T02:17:01.295286+0000","last_active":"2024-09-05T02:17:01.295444+0000","last_peered":"2024-09-05T02:17:01.295444+0000","last_clean":"2024-09-05T02:17:01.295444+0000","last_became_active":"2024-09-05T01:09:22.198727+0000","last_became_peered":"2024-09-05T01:09:22.198727+0000","last_unstale":"2024-09-05T02:17:01.295444+0000","last_undegraded":"2024-09-05T02:17:01.295444+0000","last_fullsized":"2024-09-05T02:17:01.295444+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:01.295090+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.295090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.543229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"261'31","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.760320+0000","last_change":"2024-09-05T02:16:48.760175+0000","last_active":"2024-09-05T02:16:48.760320+0000","last_peered":"2024-09-05T02:16:48.760320+0000","last_clean":"2024-09-05T02:16:48.760320+0000","last_became_active":"2024-09-05T01:05:07.106757+0000","last_became_peered":"2024-09-05T01:05:07.106757+0000","last_unstale":"2024-09-05T02:16:48.760320+0000","last_undegraded":"2024-09-05T02:16:48.760320+0000","last_fullsized":"2024-09-05T02:16:48.760320+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'31","last_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_deep_scrub":"261'31","last_deep_scrub_stamp":"2024-09-05T02:16:48.759982+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.759982+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:14.996988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":141,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:25.273110+0000","last_change":"2024-09-05T02:17:25.272974+0000","last_active":"2024-09-05T02:17:25.273110+0000","last_peered":"2024-09-05T02:17:25.273110+0000","last_clean":"2024-09-05T02:17:25.273110+0000","last_became_active":"2024-09-05T01:30:15.664371+0000","last_became_peered":"2024-09-05T01:30:15.664371+0000","last_unstale":"2024-09-05T02:17:25.273110+0000","last_undegraded":"2024-09-05T02:17:25.273110+0000","last_fullsized":"2024-09-05T02:17:25.273110+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:25.272786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:25.272786+0000","last_clean_scrub_stamp":"2024-09-05T02:17:25.272786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:09:33.593269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.399639+0000","last_change":"2024-09-05T02:17:14.399639+0000","last_active":"2024-09-05T02:17:14.399639+0000","last_peered":"2024-09-05T02:17:14.399639+0000","last_clean":"2024-09-05T02:17:14.399639+0000","last_became_active":"2024-09-05T01:10:05.430469+0000","last_became_peered":"2024-09-05T01:10:05.430469+0000","last_unstale":"2024-09-05T02:17:14.399639+0000","last_undegraded":"2024-09-05T02:17:14.399639+0000","last_fullsized":"2024-09-05T02:17:14.399639+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:14.399438+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:14.399438+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.399438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:39:53.494303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"261'5","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.373823+0000","last_change":"2024-09-05T02:17:12.373823+0000","last_active":"2024-09-05T02:17:12.373823+0000","last_peered":"2024-09-05T02:17:12.373823+0000","last_clean":"2024-09-05T02:17:12.373823+0000","last_became_active":"2024-09-05T01:09:22.189768+0000","last_became_peered":"2024-09-05T01:09:22.189768+0000","last_unstale":"2024-09-05T02:17:12.373823+0000","last_undegraded":"2024-09-05T02:17:12.373823+0000","last_fullsized":"2024-09-05T02:17:12.373823+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:12.373641+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:12.373641+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.373641+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:57:38.374692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'25","reported_seq":142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.294839+0000","last_change":"2024-09-05T02:17:06.294692+0000","last_active":"2024-09-05T02:17:06.294839+0000","last_peered":"2024-09-05T02:17:06.294839+0000","last_clean":"2024-09-05T02:17:06.294839+0000","last_became_active":"2024-09-05T01:05:07.108931+0000","last_became_peered":"2024-09-05T01:05:07.108931+0000","last_unstale":"2024-09-05T02:17:06.294839+0000","last_undegraded":"2024-09-05T02:17:06.294839+0000","last_fullsized":"2024-09-05T02:17:06.294839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-05T02:17:06.294519+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.294519+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:32:04.814706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":87,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.902955+0000","last_change":"2024-09-05T02:17:22.902785+0000","last_active":"2024-09-05T02:17:22.902955+0000","last_peered":"2024-09-05T02:17:22.902955+0000","last_clean":"2024-09-05T02:17:22.902955+0000","last_became_active":"2024-09-05T01:30:15.672793+0000","last_became_peered":"2024-09-05T01:30:15.672793+0000","last_unstale":"2024-09-05T02:17:22.902955+0000","last_undegraded":"2024-09-05T02:17:22.902955+0000","last_fullsized":"2024-09-05T02:17:22.902955+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:22.902590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:22.902590+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.902590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:34:45.823413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:15.914827+0000","last_change":"2024-09-05T02:17:15.914827+0000","last_active":"2024-09-05T02:17:15.914827+0000","last_peered":"2024-09-05T02:17:15.914827+0000","last_clean":"2024-09-05T02:17:15.914827+0000","last_became_active":"2024-09-05T01:09:26.296293+0000","last_became_peered":"2024-09-05T01:09:26.296293+0000","last_unstale":"2024-09-05T02:17:15.914827+0000","last_undegraded":"2024-09-05T02:17:15.914827+0000","last_fullsized":"2024-09-05T02:17:15.914827+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:15.914652+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:15.914652+0000","last_clean_scrub_stamp":"2024-09-05T02:17:15.914652+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:08.427922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.272686+0000","last_change":"2024-09-05T02:17:00.272686+0000","last_active":"2024-09-05T02:17:00.272686+0000","last_peered":"2024-09-05T02:17:00.272686+0000","last_clean":"2024-09-05T02:17:00.272686+0000","last_became_active":"2024-09-05T01:09:22.198572+0000","last_became_peered":"2024-09-05T01:09:22.198572+0000","last_unstale":"2024-09-05T02:17:00.272686+0000","last_undegraded":"2024-09-05T02:17:00.272686+0000","last_fullsized":"2024-09-05T02:17:00.272686+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.272504+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.272504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:00:35.928753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'27","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.862626+0000","last_change":"2024-09-05T02:17:05.862626+0000","last_active":"2024-09-05T02:17:05.862626+0000","last_peered":"2024-09-05T02:17:05.862626+0000","last_clean":"2024-09-05T02:17:05.862626+0000","last_became_active":"2024-09-05T01:05:07.107449+0000","last_became_peered":"2024-09-05T01:05:07.107449+0000","last_unstale":"2024-09-05T02:17:05.862626+0000","last_undegraded":"2024-09-05T02:17:05.862626+0000","last_fullsized":"2024-09-05T02:17:05.862626+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-05T02:17:05.862443+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.862443+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:45:23.459892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":121,"num_read_kb":88,"num_write":55,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.924843+0000","last_change":"2024-09-05T02:17:21.924704+0000","last_active":"2024-09-05T02:17:21.924843+0000","last_peered":"2024-09-05T02:17:21.924843+0000","last_clean":"2024-09-05T02:17:21.924843+0000","last_became_active":"2024-09-05T01:30:15.670969+0000","last_became_peered":"2024-09-05T01:30:15.670969+0000","last_unstale":"2024-09-05T02:17:21.924843+0000","last_undegraded":"2024-09-05T02:17:21.924843+0000","last_fullsized":"2024-09-05T02:17:21.924843+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:21.924475+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:21.924475+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.924475+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:43:57.527333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"261'3","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.300389+0000","last_change":"2024-09-05T02:17:05.300389+0000","last_active":"2024-09-05T02:17:05.300389+0000","last_peered":"2024-09-05T02:17:05.300389+0000","last_clean":"2024-09-05T02:17:05.300389+0000","last_became_active":"2024-09-05T01:09:26.335001+0000","last_became_peered":"2024-09-05T01:09:26.335001+0000","last_unstale":"2024-09-05T02:17:05.300389+0000","last_undegraded":"2024-09-05T02:17:05.300389+0000","last_fullsized":"2024-09-05T02:17:05.300389+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:05.300194+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.300194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:03.393835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'9","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.393834+0000","last_change":"2024-09-05T02:17:14.393834+0000","last_active":"2024-09-05T02:17:14.393834+0000","last_peered":"2024-09-05T02:17:14.393834+0000","last_clean":"2024-09-05T02:17:14.393834+0000","last_became_active":"2024-09-05T01:09:22.180238+0000","last_became_peered":"2024-09-05T01:09:22.180238+0000","last_unstale":"2024-09-05T02:17:14.393834+0000","last_undegraded":"2024-09-05T02:17:14.393834+0000","last_fullsized":"2024-09-05T02:17:14.393834+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-05T02:17:14.393659+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-05T02:17:14.393659+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.393659+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:25.557357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'37","reported_seq":179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.255214+0000","last_change":"2024-09-05T02:17:09.255214+0000","last_active":"2024-09-05T02:17:09.255214+0000","last_peered":"2024-09-05T02:17:09.255214+0000","last_clean":"2024-09-05T02:17:09.255214+0000","last_became_active":"2024-09-05T01:05:07.107124+0000","last_became_peered":"2024-09-05T01:05:07.107124+0000","last_unstale":"2024-09-05T02:17:09.255214+0000","last_undegraded":"2024-09-05T02:17:09.255214+0000","last_fullsized":"2024-09-05T02:17:09.255214+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-09-05T02:17:09.254979+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-09-05T02:17:09.254979+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.254979+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:09.520326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":193,"num_read_kb":135,"num_write":77,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:24.391882+0000","last_change":"2024-09-05T02:17:24.391748+0000","last_active":"2024-09-05T02:17:24.391882+0000","last_peered":"2024-09-05T02:17:24.391882+0000","last_clean":"2024-09-05T02:17:24.391882+0000","last_became_active":"2024-09-05T01:30:15.646108+0000","last_became_peered":"2024-09-05T01:30:15.646108+0000","last_unstale":"2024-09-05T02:17:24.391882+0000","last_undegraded":"2024-09-05T02:17:24.391882+0000","last_fullsized":"2024-09-05T02:17:24.391882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:24.391574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:24.391574+0000","last_clean_scrub_stamp":"2024-09-05T02:17:24.391574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:56:20.884046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'3","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:16.927579+0000","last_change":"2024-09-05T02:17:16.927579+0000","last_active":"2024-09-05T02:17:16.927579+0000","last_peered":"2024-09-05T02:17:16.927579+0000","last_clean":"2024-09-05T02:17:16.927579+0000","last_became_active":"2024-09-05T01:09:26.322732+0000","last_became_peered":"2024-09-05T01:09:26.322732+0000","last_unstale":"2024-09-05T02:17:16.927579+0000","last_undegraded":"2024-09-05T02:17:16.927579+0000","last_fullsized":"2024-09-05T02:17:16.927579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:16.927345+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:16.927345+0000","last_clean_scrub_stamp":"2024-09-05T02:17:16.927345+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:09:23.649427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.527210+0000","last_change":"2024-09-05T02:17:07.527210+0000","last_active":"2024-09-05T02:17:07.527210+0000","last_peered":"2024-09-05T02:17:07.527210+0000","last_clean":"2024-09-05T02:17:07.527210+0000","last_became_active":"2024-09-05T01:09:22.179512+0000","last_became_peered":"2024-09-05T01:09:22.179512+0000","last_unstale":"2024-09-05T02:17:07.527210+0000","last_undegraded":"2024-09-05T02:17:07.527210+0000","last_fullsized":"2024-09-05T02:17:07.527210+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:07.527014+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:07.527014+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.527014+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:33:56.247730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'57","reported_seq":229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.974334+0000","last_change":"2024-09-05T02:16:56.974334+0000","last_active":"2024-09-05T02:16:56.974334+0000","last_peered":"2024-09-05T02:16:56.974334+0000","last_clean":"2024-09-05T02:16:56.974334+0000","last_became_active":"2024-09-05T01:05:07.107605+0000","last_became_peered":"2024-09-05T01:05:07.107605+0000","last_unstale":"2024-09-05T02:16:56.974334+0000","last_undegraded":"2024-09-05T02:16:56.974334+0000","last_fullsized":"2024-09-05T02:16:56.974334+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'57","last_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_deep_scrub":"264'57","last_deep_scrub_stamp":"2024-09-05T02:16:56.974112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.974112+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:45:03.463271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":201,"num_write":96,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.967623+0000","last_change":"2024-09-05T02:17:17.967623+0000","last_active":"2024-09-05T02:17:17.967623+0000","last_peered":"2024-09-05T02:17:17.967623+0000","last_clean":"2024-09-05T02:17:17.967623+0000","last_became_active":"2024-09-05T01:30:15.671430+0000","last_became_peered":"2024-09-05T01:30:15.671430+0000","last_unstale":"2024-09-05T02:17:17.967623+0000","last_undegraded":"2024-09-05T02:17:17.967623+0000","last_fullsized":"2024-09-05T02:17:17.967623+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:17.967348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:17.967348+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.967348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:48:36.603744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:19.415865+0000","last_change":"2024-09-05T02:17:19.415865+0000","last_active":"2024-09-05T02:17:19.415865+0000","last_peered":"2024-09-05T02:17:19.415865+0000","last_clean":"2024-09-05T02:17:19.415865+0000","last_became_active":"2024-09-05T01:09:26.336513+0000","last_became_peered":"2024-09-05T01:09:26.336513+0000","last_unstale":"2024-09-05T02:17:19.415865+0000","last_undegraded":"2024-09-05T02:17:19.415865+0000","last_fullsized":"2024-09-05T02:17:19.415865+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:19.415679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:19.415679+0000","last_clean_scrub_stamp":"2024-09-05T02:17:19.415679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:48.869642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'5","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.815629+0000","last_change":"2024-09-05T02:17:10.815629+0000","last_active":"2024-09-05T02:17:10.815629+0000","last_peered":"2024-09-05T02:17:10.815629+0000","last_clean":"2024-09-05T02:17:10.815629+0000","last_became_active":"2024-09-05T01:09:22.166163+0000","last_became_peered":"2024-09-05T01:09:22.166163+0000","last_unstale":"2024-09-05T02:17:10.815629+0000","last_undegraded":"2024-09-05T02:17:10.815629+0000","last_fullsized":"2024-09-05T02:17:10.815629+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:10.815414+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:10.815414+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.815414+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:32:24.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1069,"num_write":10,"num_write_kb":1069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'49","reported_seq":203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.244575+0000","last_change":"2024-09-05T02:17:05.244575+0000","last_active":"2024-09-05T02:17:05.244575+0000","last_peered":"2024-09-05T02:17:05.244575+0000","last_clean":"2024-09-05T02:17:05.244575+0000","last_became_active":"2024-09-05T01:05:07.114940+0000","last_became_peered":"2024-09-05T01:05:07.114940+0000","last_unstale":"2024-09-05T02:17:05.244575+0000","last_undegraded":"2024-09-05T02:17:05.244575+0000","last_fullsized":"2024-09-05T02:17:05.244575+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-09-05T02:17:05.244395+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.244395+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:52:14.456469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":165,"num_write":93,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.630218+0000","last_change":"2024-09-05T02:17:14.630218+0000","last_active":"2024-09-05T02:17:14.630218+0000","last_peered":"2024-09-05T02:17:14.630218+0000","last_clean":"2024-09-05T02:17:14.630218+0000","last_became_active":"2024-09-05T01:30:15.666033+0000","last_became_peered":"2024-09-05T01:30:15.666033+0000","last_unstale":"2024-09-05T02:17:14.630218+0000","last_undegraded":"2024-09-05T02:17:14.630218+0000","last_fullsized":"2024-09-05T02:17:14.630218+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:14.630016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:14.630016+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.630016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:33:22.419131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:21.426146+0000","last_change":"2024-09-05T02:17:21.426146+0000","last_active":"2024-09-05T02:17:21.426146+0000","last_peered":"2024-09-05T02:17:21.426146+0000","last_clean":"2024-09-05T02:17:21.426146+0000","last_became_active":"2024-09-05T01:09:26.315899+0000","last_became_peered":"2024-09-05T01:09:26.315899+0000","last_unstale":"2024-09-05T02:17:21.426146+0000","last_undegraded":"2024-09-05T02:17:21.426146+0000","last_fullsized":"2024-09-05T02:17:21.426146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:21.425960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:21.425960+0000","last_clean_scrub_stamp":"2024-09-05T02:17:21.425960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:14:00.799924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.776089+0000","last_change":"2024-09-05T02:16:52.776089+0000","last_active":"2024-09-05T02:16:52.776089+0000","last_peered":"2024-09-05T02:16:52.776089+0000","last_clean":"2024-09-05T02:16:52.776089+0000","last_became_active":"2024-09-05T01:09:22.172158+0000","last_became_peered":"2024-09-05T01:09:22.172158+0000","last_unstale":"2024-09-05T02:16:52.776089+0000","last_undegraded":"2024-09-05T02:16:52.776089+0000","last_fullsized":"2024-09-05T02:16:52.776089+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.775909+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.775909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:34:19.795384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'41","reported_seq":188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.976839+0000","last_change":"2024-09-05T02:16:55.976839+0000","last_active":"2024-09-05T02:16:55.976839+0000","last_peered":"2024-09-05T02:16:55.976839+0000","last_clean":"2024-09-05T02:16:55.976839+0000","last_became_active":"2024-09-05T01:05:07.102224+0000","last_became_peered":"2024-09-05T01:05:07.102224+0000","last_unstale":"2024-09-05T02:16:55.976839+0000","last_undegraded":"2024-09-05T02:16:55.976839+0000","last_fullsized":"2024-09-05T02:16:55.976839+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-09-05T02:16:55.976604+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.976604+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:49.837443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":155,"num_write":64,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.344726+0000","last_change":"2024-09-05T02:17:07.344726+0000","last_active":"2024-09-05T02:17:07.344726+0000","last_peered":"2024-09-05T02:17:07.344726+0000","last_clean":"2024-09-05T02:17:07.344726+0000","last_became_active":"2024-09-05T01:30:15.659958+0000","last_became_peered":"2024-09-05T01:30:15.659958+0000","last_unstale":"2024-09-05T02:17:07.344726+0000","last_undegraded":"2024-09-05T02:17:07.344726+0000","last_fullsized":"2024-09-05T02:17:07.344726+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:07.344455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:07.344455+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.344455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.769861+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:14.870555+0000","last_change":"2024-09-05T02:17:14.870555+0000","last_active":"2024-09-05T02:17:14.870555+0000","last_peered":"2024-09-05T02:17:14.870555+0000","last_clean":"2024-09-05T02:17:14.870555+0000","last_became_active":"2024-09-05T01:09:26.302207+0000","last_became_peered":"2024-09-05T01:09:26.302207+0000","last_unstale":"2024-09-05T02:17:14.870555+0000","last_undegraded":"2024-09-05T02:17:14.870555+0000","last_fullsized":"2024-09-05T02:17:14.870555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-05T02:17:14.870271+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-05T02:17:14.870271+0000","last_clean_scrub_stamp":"2024-09-05T02:17:14.870271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:20.820103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.580373+0000","last_change":"2024-09-05T02:17:08.580373+0000","last_active":"2024-09-05T02:17:08.580373+0000","last_peered":"2024-09-05T02:17:08.580373+0000","last_clean":"2024-09-05T02:17:08.580373+0000","last_became_active":"2024-09-05T01:09:22.189056+0000","last_became_peered":"2024-09-05T01:09:22.189056+0000","last_unstale":"2024-09-05T02:17:08.580373+0000","last_undegraded":"2024-09-05T02:17:08.580373+0000","last_fullsized":"2024-09-05T02:17:08.580373+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:08.580196+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.580196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:15:28.347538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"261'24","reported_seq":140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.830880+0000","last_change":"2024-09-05T02:17:04.830880+0000","last_active":"2024-09-05T02:17:04.830880+0000","last_peered":"2024-09-05T02:17:04.830880+0000","last_clean":"2024-09-05T02:17:04.830880+0000","last_became_active":"2024-09-05T01:05:07.104278+0000","last_became_peered":"2024-09-05T01:05:07.104278+0000","last_unstale":"2024-09-05T02:17:04.830880+0000","last_undegraded":"2024-09-05T02:17:04.830880+0000","last_fullsized":"2024-09-05T02:17:04.830880+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-05T02:17:04.830648+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.830648+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:29.585319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":84,"num_write":42,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:17.428971+0000","last_change":"2024-09-05T02:17:17.428971+0000","last_active":"2024-09-05T02:17:17.428971+0000","last_peered":"2024-09-05T02:17:17.428971+0000","last_clean":"2024-09-05T02:17:17.428971+0000","last_became_active":"2024-09-05T01:30:15.661178+0000","last_became_peered":"2024-09-05T01:30:15.661178+0000","last_unstale":"2024-09-05T02:17:17.428971+0000","last_undegraded":"2024-09-05T02:17:17.428971+0000","last_fullsized":"2024-09-05T02:17:17.428971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:17.428792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:17.428792+0000","last_clean_scrub_stamp":"2024-09-05T02:17:17.428792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:32:54.516889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:13.393906+0000","last_change":"2024-09-05T02:17:13.393906+0000","last_active":"2024-09-05T02:17:13.393906+0000","last_peered":"2024-09-05T02:17:13.393906+0000","last_clean":"2024-09-05T02:17:13.393906+0000","last_became_active":"2024-09-05T01:09:26.312427+0000","last_became_peered":"2024-09-05T01:09:26.312427+0000","last_unstale":"2024-09-05T02:17:13.393906+0000","last_undegraded":"2024-09-05T02:17:13.393906+0000","last_fullsized":"2024-09-05T02:17:13.393906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:13.393731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:13.393731+0000","last_clean_scrub_stamp":"2024-09-05T02:17:13.393731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:28.956286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'6","reported_seq":78,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:11.833096+0000","last_change":"2024-09-05T02:17:11.833096+0000","last_active":"2024-09-05T02:17:11.833096+0000","last_peered":"2024-09-05T02:17:11.833096+0000","last_clean":"2024-09-05T02:17:11.833096+0000","last_became_active":"2024-09-05T01:09:22.198441+0000","last_became_peered":"2024-09-05T01:09:22.198441+0000","last_unstale":"2024-09-05T02:17:11.833096+0000","last_undegraded":"2024-09-05T02:17:11.833096+0000","last_fullsized":"2024-09-05T02:17:11.833096+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:17:11.832881+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:17:11.832881+0000","last_clean_scrub_stamp":"2024-09-05T02:17:11.832881+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:13:08.376387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'30","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.146987+0000","last_change":"2024-09-05T02:16:55.146987+0000","last_active":"2024-09-05T02:16:55.146987+0000","last_peered":"2024-09-05T02:16:55.146987+0000","last_clean":"2024-09-05T02:16:55.146987+0000","last_became_active":"2024-09-05T01:05:07.109051+0000","last_became_peered":"2024-09-05T01:05:07.109051+0000","last_unstale":"2024-09-05T02:16:55.146987+0000","last_undegraded":"2024-09-05T02:16:55.146987+0000","last_fullsized":"2024-09-05T02:16:55.146987+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'30","last_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_deep_scrub":"264'30","last_deep_scrub_stamp":"2024-09-05T02:16:55.146799+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.146799+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:52:09.173061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":99,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.765175+0000","last_change":"2024-09-05T02:16:54.765175+0000","last_active":"2024-09-05T02:16:54.765175+0000","last_peered":"2024-09-05T02:16:54.765175+0000","last_clean":"2024-09-05T02:16:54.765175+0000","last_became_active":"2024-09-05T01:30:15.670288+0000","last_became_peered":"2024-09-05T01:30:15.670288+0000","last_unstale":"2024-09-05T02:16:54.765175+0000","last_undegraded":"2024-09-05T02:16:54.765175+0000","last_fullsized":"2024-09-05T02:16:54.765175+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:54.764967+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.764967+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:41:33.575826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'2","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.341502+0000","last_change":"2024-09-05T02:17:04.341502+0000","last_active":"2024-09-05T02:17:04.341502+0000","last_peered":"2024-09-05T02:17:04.341502+0000","last_clean":"2024-09-05T02:17:04.341502+0000","last_became_active":"2024-09-05T01:09:26.335431+0000","last_became_peered":"2024-09-05T01:09:26.335431+0000","last_unstale":"2024-09-05T02:17:04.341502+0000","last_undegraded":"2024-09-05T02:17:04.341502+0000","last_fullsized":"2024-09-05T02:17:04.341502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:04.341302+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.341302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:07.810567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":100,"num_write":2,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'2","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.871708+0000","last_change":"2024-09-05T02:17:08.871572+0000","last_active":"2024-09-05T02:17:08.871708+0000","last_peered":"2024-09-05T02:17:08.871708+0000","last_clean":"2024-09-05T02:17:08.871708+0000","last_became_active":"2024-09-05T01:09:22.168769+0000","last_became_peered":"2024-09-05T01:09:22.168769+0000","last_unstale":"2024-09-05T02:17:08.871708+0000","last_undegraded":"2024-09-05T02:17:08.871708+0000","last_fullsized":"2024-09-05T02:17:08.871708+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:08.871354+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:08.871354+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.871354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:38:22.298118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'29","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.505895+0000","last_change":"2024-09-05T02:17:03.505895+0000","last_active":"2024-09-05T02:17:03.505895+0000","last_peered":"2024-09-05T02:17:03.505895+0000","last_clean":"2024-09-05T02:17:03.505895+0000","last_became_active":"2024-09-05T01:05:07.103125+0000","last_became_peered":"2024-09-05T01:05:07.103125+0000","last_unstale":"2024-09-05T02:17:03.505895+0000","last_undegraded":"2024-09-05T02:17:03.505895+0000","last_fullsized":"2024-09-05T02:17:03.505895+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-05T02:17:03.505610+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.505610+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:26:48.894550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:23.360695+0000","last_change":"2024-09-05T02:17:23.360695+0000","last_active":"2024-09-05T02:17:23.360695+0000","last_peered":"2024-09-05T02:17:23.360695+0000","last_clean":"2024-09-05T02:17:23.360695+0000","last_became_active":"2024-09-05T01:30:15.662909+0000","last_became_peered":"2024-09-05T01:30:15.662909+0000","last_unstale":"2024-09-05T02:17:23.360695+0000","last_undegraded":"2024-09-05T02:17:23.360695+0000","last_fullsized":"2024-09-05T02:17:23.360695+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:23.360519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:23.360519+0000","last_clean_scrub_stamp":"2024-09-05T02:17:23.360519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.834939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:10.664225+0000","last_change":"2024-09-05T02:17:10.664086+0000","last_active":"2024-09-05T02:17:10.664225+0000","last_peered":"2024-09-05T02:17:10.664225+0000","last_clean":"2024-09-05T02:17:10.664225+0000","last_became_active":"2024-09-05T01:09:26.316280+0000","last_became_peered":"2024-09-05T01:09:26.316280+0000","last_unstale":"2024-09-05T02:17:10.664225+0000","last_undegraded":"2024-09-05T02:17:10.664225+0000","last_fullsized":"2024-09-05T02:17:10.664225+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:10.663894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:10.663894+0000","last_clean_scrub_stamp":"2024-09-05T02:17:10.663894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:39.440002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:09.830224+0000","last_change":"2024-09-05T02:17:09.830224+0000","last_active":"2024-09-05T02:17:09.830224+0000","last_peered":"2024-09-05T02:17:09.830224+0000","last_clean":"2024-09-05T02:17:09.830224+0000","last_became_active":"2024-09-05T01:09:22.198524+0000","last_became_peered":"2024-09-05T01:09:22.198524+0000","last_unstale":"2024-09-05T02:17:09.830224+0000","last_undegraded":"2024-09-05T02:17:09.830224+0000","last_fullsized":"2024-09-05T02:17:09.830224+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-05T02:17:09.830010+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-05T02:17:09.830010+0000","last_clean_scrub_stamp":"2024-09-05T02:17:09.830010+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:47:40.926655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'38","reported_seq":180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.515155+0000","last_change":"2024-09-05T02:17:04.515155+0000","last_active":"2024-09-05T02:17:04.515155+0000","last_peered":"2024-09-05T02:17:04.515155+0000","last_clean":"2024-09-05T02:17:04.515155+0000","last_became_active":"2024-09-05T01:05:07.100286+0000","last_became_peered":"2024-09-05T01:05:07.100286+0000","last_unstale":"2024-09-05T02:17:04.515155+0000","last_undegraded":"2024-09-05T02:17:04.515155+0000","last_fullsized":"2024-09-05T02:17:04.515155+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-05T02:17:04.514980+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.514980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:13:20.300283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":130,"num_write":74,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:22.403228+0000","last_change":"2024-09-05T02:17:22.403228+0000","last_active":"2024-09-05T02:17:22.403228+0000","last_peered":"2024-09-05T02:17:22.403228+0000","last_clean":"2024-09-05T02:17:22.403228+0000","last_became_active":"2024-09-05T01:30:15.652437+0000","last_became_peered":"2024-09-05T01:30:15.652437+0000","last_unstale":"2024-09-05T02:17:22.403228+0000","last_undegraded":"2024-09-05T02:17:22.403228+0000","last_fullsized":"2024-09-05T02:17:22.403228+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:22.403052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:22.403052+0000","last_clean_scrub_stamp":"2024-09-05T02:17:22.403052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:20.733360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'2","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.090864+0000","last_change":"2024-09-05T02:17:01.090864+0000","last_active":"2024-09-05T02:17:01.090864+0000","last_peered":"2024-09-05T02:17:01.090864+0000","last_clean":"2024-09-05T02:17:01.090864+0000","last_became_active":"2024-09-05T01:09:26.348128+0000","last_became_peered":"2024-09-05T01:09:26.348128+0000","last_unstale":"2024-09-05T02:17:01.090864+0000","last_undegraded":"2024-09-05T02:17:01.090864+0000","last_fullsized":"2024-09-05T02:17:01.090864+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:17:01.090683+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.090683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:16.047191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.155440+0000","last_change":"2024-09-05T02:16:54.155440+0000","last_active":"2024-09-05T02:16:54.155440+0000","last_peered":"2024-09-05T02:16:54.155440+0000","last_clean":"2024-09-05T02:16:54.155440+0000","last_became_active":"2024-09-05T01:09:22.181414+0000","last_became_peered":"2024-09-05T01:09:22.181414+0000","last_unstale":"2024-09-05T02:16:54.155440+0000","last_undegraded":"2024-09-05T02:16:54.155440+0000","last_fullsized":"2024-09-05T02:16:54.155440+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:54.155147+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.155147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:02.845734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'56","reported_seq":224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.980140+0000","last_change":"2024-09-05T02:16:54.980140+0000","last_active":"2024-09-05T02:16:54.980140+0000","last_peered":"2024-09-05T02:16:54.980140+0000","last_clean":"2024-09-05T02:16:54.980140+0000","last_became_active":"2024-09-05T01:05:07.093414+0000","last_became_peered":"2024-09-05T01:05:07.093414+0000","last_unstale":"2024-09-05T02:16:54.980140+0000","last_undegraded":"2024-09-05T02:16:54.980140+0000","last_fullsized":"2024-09-05T02:16:54.980140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-09-05T02:16:54.979911+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.979911+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:13.094203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":195,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:18.936122+0000","last_change":"2024-09-05T02:17:18.936122+0000","last_active":"2024-09-05T02:17:18.936122+0000","last_peered":"2024-09-05T02:17:18.936122+0000","last_clean":"2024-09-05T02:17:18.936122+0000","last_became_active":"2024-09-05T01:30:15.671745+0000","last_became_peered":"2024-09-05T01:30:15.671745+0000","last_unstale":"2024-09-05T02:17:18.936122+0000","last_undegraded":"2024-09-05T02:17:18.936122+0000","last_fullsized":"2024-09-05T02:17:18.936122+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:18.935934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:18.935934+0000","last_clean_scrub_stamp":"2024-09-05T02:17:18.935934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:38:07.815726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:12.374915+0000","last_change":"2024-09-05T02:17:12.374915+0000","last_active":"2024-09-05T02:17:12.374915+0000","last_peered":"2024-09-05T02:17:12.374915+0000","last_clean":"2024-09-05T02:17:12.374915+0000","last_became_active":"2024-09-05T01:09:26.313707+0000","last_became_peered":"2024-09-05T01:09:26.313707+0000","last_unstale":"2024-09-05T02:17:12.374915+0000","last_undegraded":"2024-09-05T02:17:12.374915+0000","last_fullsized":"2024-09-05T02:17:12.374915+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:12.374736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:12.374736+0000","last_clean_scrub_stamp":"2024-09-05T02:17:12.374736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:26:23.935553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.088692+0000","last_change":"2024-09-05T02:17:00.088692+0000","last_active":"2024-09-05T02:17:00.088692+0000","last_peered":"2024-09-05T02:17:00.088692+0000","last_clean":"2024-09-05T02:17:00.088692+0000","last_became_active":"2024-09-05T01:09:22.172467+0000","last_became_peered":"2024-09-05T01:09:22.172467+0000","last_unstale":"2024-09-05T02:17:00.088692+0000","last_undegraded":"2024-09-05T02:17:00.088692+0000","last_fullsized":"2024-09-05T02:17:00.088692+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:17:00.088515+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.088515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:35:15.940853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'31","reported_seq":166,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.811174+0000","last_change":"2024-09-05T02:17:03.811009+0000","last_active":"2024-09-05T02:17:03.811174+0000","last_peered":"2024-09-05T02:17:03.811174+0000","last_clean":"2024-09-05T02:17:03.811174+0000","last_became_active":"2024-09-05T01:05:07.102432+0000","last_became_peered":"2024-09-05T01:05:07.102432+0000","last_unstale":"2024-09-05T02:17:03.811174+0000","last_undegraded":"2024-09-05T02:17:03.811174+0000","last_fullsized":"2024-09-05T02:17:03.811174+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-05T02:17:03.810788+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.810788+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:32:45.300011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":117,"num_write":50,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'377","reported_seq":1077,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.819729+0000","last_change":"2024-09-05T02:16:32.819483+0000","last_active":"2024-09-05T02:16:32.819729+0000","last_peered":"2024-09-05T02:16:32.819729+0000","last_clean":"2024-09-05T02:16:32.819729+0000","last_became_active":"2024-09-05T00:50:04.197020+0000","last_became_peered":"2024-09-05T00:50:04.197020+0000","last_unstale":"2024-09-05T02:16:32.819729+0000","last_undegraded":"2024-09-05T02:16:32.819729+0000","last_fullsized":"2024-09-05T02:16:32.819729+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-05T02:16:32.819228+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.819228+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:06.348956+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":705716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":47646,"num_write":1216,"num_write_kb":58962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"264'507","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.516932+0000","last_change":"2024-09-05T02:16:46.516781+0000","last_active":"2024-09-05T02:16:46.516932+0000","last_peered":"2024-09-05T02:16:46.516932+0000","last_clean":"2024-09-05T02:16:46.516932+0000","last_became_active":"2024-09-05T00:49:29.901557+0000","last_became_peered":"2024-09-05T00:49:29.901557+0000","last_unstale":"2024-09-05T02:16:46.516932+0000","last_undegraded":"2024-09-05T02:16:46.516932+0000","last_fullsized":"2024-09-05T02:16:46.516932+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-09-05T02:16:46.516577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.516577+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:11.618374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2661,"num_read_kb":2472,"num_write":619,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'384","reported_seq":1075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.308155+0000","last_change":"2024-09-05T02:16:34.307989+0000","last_active":"2024-09-05T02:16:34.308155+0000","last_peered":"2024-09-05T02:16:34.308155+0000","last_clean":"2024-09-05T02:16:34.308155+0000","last_became_active":"2024-09-05T00:49:27.898308+0000","last_became_peered":"2024-09-05T00:49:27.898308+0000","last_unstale":"2024-09-05T02:16:34.308155+0000","last_undegraded":"2024-09-05T02:16:34.308155+0000","last_fullsized":"2024-09-05T02:16:34.308155+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-05T02:16:34.307761+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.307761+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:52:07.165023+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":565,"num_read_kb":74894,"num_write":1179,"num_write_kb":22501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'450","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.926481+0000","last_change":"2024-09-05T02:16:45.926317+0000","last_active":"2024-09-05T02:16:45.926481+0000","last_peered":"2024-09-05T02:16:45.926481+0000","last_clean":"2024-09-05T02:16:45.926481+0000","last_became_active":"2024-09-05T00:50:04.183229+0000","last_became_peered":"2024-09-05T00:50:04.183229+0000","last_unstale":"2024-09-05T02:16:45.926481+0000","last_undegraded":"2024-09-05T02:16:45.926481+0000","last_fullsized":"2024-09-05T02:16:45.926481+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'450","last_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_deep_scrub":"264'450","last_deep_scrub_stamp":"2024-09-05T02:16:45.926073+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.926073+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:10:34.170133+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2522,"num_read_kb":2389,"num_write":527,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'393","reported_seq":1060,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.517995+0000","last_change":"2024-09-05T02:16:32.517827+0000","last_active":"2024-09-05T02:16:32.517995+0000","last_peered":"2024-09-05T02:16:32.517995+0000","last_clean":"2024-09-05T02:16:32.517995+0000","last_became_active":"2024-09-05T00:49:27.876331+0000","last_became_peered":"2024-09-05T00:49:27.876331+0000","last_unstale":"2024-09-05T02:16:32.517995+0000","last_undegraded":"2024-09-05T02:16:32.517995+0000","last_fullsized":"2024-09-05T02:16:32.517995+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:32.517629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.517629+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:14.484505+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":589,"num_read_kb":743,"num_write":1140,"num_write_kb":40089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'857","reported_seq":2433,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.487707+0000","last_change":"2024-09-05T02:16:46.487548+0000","last_active":"2024-09-05T02:16:46.487707+0000","last_peered":"2024-09-05T02:16:46.487707+0000","last_clean":"2024-09-05T02:16:46.487707+0000","last_became_active":"2024-09-05T00:49:29.900229+0000","last_became_peered":"2024-09-05T00:49:29.900229+0000","last_unstale":"2024-09-05T02:16:46.487707+0000","last_undegraded":"2024-09-05T02:16:46.487707+0000","last_fullsized":"2024-09-05T02:16:46.487707+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'857","last_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_deep_scrub":"264'857","last_deep_scrub_stamp":"2024-09-05T02:16:46.487350+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.487350+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:48:26.885564+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3988,"num_read_kb":3574,"num_write":1133,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":457,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'380","reported_seq":1185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.511848+0000","last_change":"2024-09-05T02:16:41.511848+0000","last_active":"2024-09-05T02:16:41.511848+0000","last_peered":"2024-09-05T02:16:41.511848+0000","last_clean":"2024-09-05T02:16:41.511848+0000","last_became_active":"2024-09-05T00:49:27.890882+0000","last_became_peered":"2024-09-05T00:49:27.890882+0000","last_unstale":"2024-09-05T02:16:41.511848+0000","last_undegraded":"2024-09-05T02:16:41.511848+0000","last_fullsized":"2024-09-05T02:16:41.511848+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'380","last_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_deep_scrub":"264'380","last_deep_scrub_stamp":"2024-09-05T02:16:41.511651+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.511651+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:25.215125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":68502,"num_write":1310,"num_write_kb":29093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'1273","reported_seq":3103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.257591+0000","last_change":"2024-09-05T02:16:51.257332+0000","last_active":"2024-09-05T02:16:51.257591+0000","last_peered":"2024-09-05T02:16:51.257591+0000","last_clean":"2024-09-05T02:16:51.257591+0000","last_became_active":"2024-09-05T00:49:29.919143+0000","last_became_peered":"2024-09-05T00:49:29.919143+0000","last_unstale":"2024-09-05T02:16:51.257591+0000","last_undegraded":"2024-09-05T02:16:51.257591+0000","last_fullsized":"2024-09-05T02:16:51.257591+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1273","last_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_deep_scrub":"264'1273","last_deep_scrub_stamp":"2024-09-05T02:16:51.257106+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.257106+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:44:16.442936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5845,"num_read_kb":5188,"num_write":1722,"num_write_kb":676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'363","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.081565+0000","last_change":"2024-09-05T02:16:42.081318+0000","last_active":"2024-09-05T02:16:42.081565+0000","last_peered":"2024-09-05T02:16:42.081565+0000","last_clean":"2024-09-05T02:16:42.081565+0000","last_became_active":"2024-09-05T00:49:27.903741+0000","last_became_peered":"2024-09-05T00:49:27.903741+0000","last_unstale":"2024-09-05T02:16:42.081565+0000","last_undegraded":"2024-09-05T02:16:42.081565+0000","last_fullsized":"2024-09-05T02:16:42.081565+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-09-05T02:16:42.081062+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.081062+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:53:18.173817+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":460,"num_read_kb":9059,"num_write":1154,"num_write_kb":65910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'447","reported_seq":1931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.875774+0000","last_change":"2024-09-05T02:16:42.875774+0000","last_active":"2024-09-05T02:16:42.875774+0000","last_peered":"2024-09-05T02:16:42.875774+0000","last_clean":"2024-09-05T02:16:42.875774+0000","last_became_active":"2024-09-05T00:49:29.902646+0000","last_became_peered":"2024-09-05T00:49:29.902646+0000","last_unstale":"2024-09-05T02:16:42.875774+0000","last_undegraded":"2024-09-05T02:16:42.875774+0000","last_fullsized":"2024-09-05T02:16:42.875774+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'447","last_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_deep_scrub":"264'447","last_deep_scrub_stamp":"2024-09-05T02:16:42.875583+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.875583+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:30.938475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2316,"num_read_kb":2152,"num_write":526,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'324","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.541002+0000","last_change":"2024-09-05T02:16:39.540870+0000","last_active":"2024-09-05T02:16:39.541002+0000","last_peered":"2024-09-05T02:16:39.541002+0000","last_clean":"2024-09-05T02:16:39.541002+0000","last_became_active":"2024-09-05T00:49:27.898908+0000","last_became_peered":"2024-09-05T00:49:27.898908+0000","last_unstale":"2024-09-05T02:16:39.541002+0000","last_undegraded":"2024-09-05T02:16:39.541002+0000","last_fullsized":"2024-09-05T02:16:39.541002+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:39.540684+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.540684+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:35:25.366090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":498,"num_read_kb":472,"num_write":1089,"num_write_kb":20945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'505","reported_seq":2152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.476440+0000","last_change":"2024-09-05T02:16:49.476308+0000","last_active":"2024-09-05T02:16:49.476440+0000","last_peered":"2024-09-05T02:16:49.476440+0000","last_clean":"2024-09-05T02:16:49.476440+0000","last_became_active":"2024-09-05T00:49:29.900095+0000","last_became_peered":"2024-09-05T00:49:29.900095+0000","last_unstale":"2024-09-05T02:16:49.476440+0000","last_undegraded":"2024-09-05T02:16:49.476440+0000","last_fullsized":"2024-09-05T02:16:49.476440+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-09-05T02:16:49.476121+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.476121+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:30:55.880313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2776,"num_read_kb":2603,"num_write":588,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'353","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.087473+0000","last_change":"2024-09-05T02:16:41.087320+0000","last_active":"2024-09-05T02:16:41.087473+0000","last_peered":"2024-09-05T02:16:41.087473+0000","last_clean":"2024-09-05T02:16:41.087473+0000","last_became_active":"2024-09-05T00:49:27.904809+0000","last_became_peered":"2024-09-05T00:49:27.904809+0000","last_unstale":"2024-09-05T02:16:41.087473+0000","last_undegraded":"2024-09-05T02:16:41.087473+0000","last_fullsized":"2024-09-05T02:16:41.087473+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:41.087096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.087096+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:59:56.430971+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495269,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":507,"num_read_kb":57163,"num_write":1112,"num_write_kb":53361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'474","reported_seq":2175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.586174+0000","last_change":"2024-09-05T02:16:48.586021+0000","last_active":"2024-09-05T02:16:48.586174+0000","last_peered":"2024-09-05T02:16:48.586174+0000","last_clean":"2024-09-05T02:16:48.586174+0000","last_became_active":"2024-09-05T00:49:29.918271+0000","last_became_peered":"2024-09-05T00:49:29.918271+0000","last_unstale":"2024-09-05T02:16:48.586174+0000","last_undegraded":"2024-09-05T02:16:48.586174+0000","last_fullsized":"2024-09-05T02:16:48.586174+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:48.585842+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.585842+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:05:53.161158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2697,"num_read_kb":2544,"num_write":570,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'355","reported_seq":1193,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.003064+0000","last_change":"2024-09-05T02:16:39.002926+0000","last_active":"2024-09-05T02:16:39.003064+0000","last_peered":"2024-09-05T02:16:39.003064+0000","last_clean":"2024-09-05T02:16:39.003064+0000","last_became_active":"2024-09-05T00:49:27.893583+0000","last_became_peered":"2024-09-05T00:49:27.893583+0000","last_unstale":"2024-09-05T02:16:39.003064+0000","last_undegraded":"2024-09-05T02:16:39.003064+0000","last_fullsized":"2024-09-05T02:16:39.003064+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:39.002732+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.002732+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:22:17.177395+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":814,"num_read_kb":7164,"num_write":1128,"num_write_kb":17805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'453","reported_seq":2037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.824734+0000","last_change":"2024-09-05T02:16:38.824593+0000","last_active":"2024-09-05T02:16:38.824734+0000","last_peered":"2024-09-05T02:16:38.824734+0000","last_clean":"2024-09-05T02:16:38.824734+0000","last_became_active":"2024-09-05T00:49:29.916851+0000","last_became_peered":"2024-09-05T00:49:29.916851+0000","last_unstale":"2024-09-05T02:16:38.824734+0000","last_undegraded":"2024-09-05T02:16:38.824734+0000","last_fullsized":"2024-09-05T02:16:38.824734+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'453","last_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_deep_scrub":"264'453","last_deep_scrub_stamp":"2024-09-05T02:16:38.824400+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.824400+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:12:46.210785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2463,"num_read_kb":2313,"num_write":533,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'747","reported_seq":2219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.472094+0000","last_change":"2024-09-05T02:16:45.472094+0000","last_active":"2024-09-05T02:16:45.472094+0000","last_peered":"2024-09-05T02:16:45.472094+0000","last_clean":"2024-09-05T02:16:45.472094+0000","last_became_active":"2024-09-05T00:49:29.904200+0000","last_became_peered":"2024-09-05T00:49:29.904200+0000","last_unstale":"2024-09-05T02:16:45.472094+0000","last_undegraded":"2024-09-05T02:16:45.472094+0000","last_fullsized":"2024-09-05T02:16:45.472094+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:45.471918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.471918+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:16.977832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3494,"num_read_kb":3154,"num_write":987,"num_write_kb":357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'356","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.061665+0000","last_change":"2024-09-05T02:16:40.061510+0000","last_active":"2024-09-05T02:16:40.061665+0000","last_peered":"2024-09-05T02:16:40.061665+0000","last_clean":"2024-09-05T02:16:40.061665+0000","last_became_active":"2024-09-05T00:49:27.908936+0000","last_became_peered":"2024-09-05T00:49:27.908936+0000","last_unstale":"2024-09-05T02:16:40.061665+0000","last_undegraded":"2024-09-05T02:16:40.061665+0000","last_fullsized":"2024-09-05T02:16:40.061665+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:40.061289+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.061289+0000","objects_scrubbed":9,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:56:17.879080+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1733359,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":485,"num_read_kb":16771,"num_write":1085,"num_write_kb":29734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'435","reported_seq":1966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.012421+0000","last_change":"2024-09-05T02:16:44.012421+0000","last_active":"2024-09-05T02:16:44.012421+0000","last_peered":"2024-09-05T02:16:44.012421+0000","last_clean":"2024-09-05T02:16:44.012421+0000","last_became_active":"2024-09-05T00:49:29.923423+0000","last_became_peered":"2024-09-05T00:49:29.923423+0000","last_unstale":"2024-09-05T02:16:44.012421+0000","last_undegraded":"2024-09-05T02:16:44.012421+0000","last_fullsized":"2024-09-05T02:16:44.012421+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:44.012213+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.012213+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:58:25.759917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2268,"num_read_kb":2144,"num_write":512,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'350","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.815192+0000","last_change":"2024-09-05T02:16:36.815192+0000","last_active":"2024-09-05T02:16:36.815192+0000","last_peered":"2024-09-05T02:16:36.815192+0000","last_clean":"2024-09-05T02:16:36.815192+0000","last_became_active":"2024-09-05T00:49:27.895658+0000","last_became_peered":"2024-09-05T00:49:27.895658+0000","last_unstale":"2024-09-05T02:16:36.815192+0000","last_undegraded":"2024-09-05T02:16:36.815192+0000","last_fullsized":"2024-09-05T02:16:36.815192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.814965+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.814965+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:09:24.655143+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524506,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":461,"num_read_kb":5849,"num_write":1054,"num_write_kb":44491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'463","reported_seq":2003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.501298+0000","last_change":"2024-09-05T02:16:44.501298+0000","last_active":"2024-09-05T02:16:44.501298+0000","last_peered":"2024-09-05T02:16:44.501298+0000","last_clean":"2024-09-05T02:16:44.501298+0000","last_became_active":"2024-09-05T00:49:29.909833+0000","last_became_peered":"2024-09-05T00:49:29.909833+0000","last_unstale":"2024-09-05T02:16:44.501298+0000","last_undegraded":"2024-09-05T02:16:44.501298+0000","last_fullsized":"2024-09-05T02:16:44.501298+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'463","last_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_deep_scrub":"264'463","last_deep_scrub_stamp":"2024-09-05T02:16:44.501076+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.501076+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:32:51.917233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2356,"num_read_kb":2204,"num_write":531,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'361","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.812670+0000","last_change":"2024-09-05T02:16:35.812670+0000","last_active":"2024-09-05T02:16:35.812670+0000","last_peered":"2024-09-05T02:16:35.812670+0000","last_clean":"2024-09-05T02:16:35.812670+0000","last_became_active":"2024-09-05T00:49:27.894291+0000","last_became_peered":"2024-09-05T00:49:27.894291+0000","last_unstale":"2024-09-05T02:16:35.812670+0000","last_undegraded":"2024-09-05T02:16:35.812670+0000","last_fullsized":"2024-09-05T02:16:35.812670+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:35.812463+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.812463+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:33:35.464351+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127471,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":7060,"num_write":1221,"num_write_kb":22249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'493","reported_seq":2161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.766824+0000","last_change":"2024-09-05T02:16:36.766824+0000","last_active":"2024-09-05T02:16:36.766824+0000","last_peered":"2024-09-05T02:16:36.766824+0000","last_clean":"2024-09-05T02:16:36.766824+0000","last_became_active":"2024-09-05T00:49:29.911759+0000","last_became_peered":"2024-09-05T00:49:29.911759+0000","last_unstale":"2024-09-05T02:16:36.766824+0000","last_undegraded":"2024-09-05T02:16:36.766824+0000","last_fullsized":"2024-09-05T02:16:36.766824+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'493","last_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_deep_scrub":"264'493","last_deep_scrub_stamp":"2024-09-05T02:16:36.766629+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.766629+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:02:04.726199+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2652,"num_read_kb":2509,"num_write":557,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'358","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.529586+0000","last_change":"2024-09-05T02:16:32.529586+0000","last_active":"2024-09-05T02:16:32.529586+0000","last_peered":"2024-09-05T02:16:32.529586+0000","last_clean":"2024-09-05T02:16:32.529586+0000","last_became_active":"2024-09-05T00:49:27.882259+0000","last_became_peered":"2024-09-05T00:49:27.882259+0000","last_unstale":"2024-09-05T02:16:32.529586+0000","last_undegraded":"2024-09-05T02:16:32.529586+0000","last_fullsized":"2024-09-05T02:16:32.529586+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-05T02:16:32.529382+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.529382+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:35:38.596982+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5422953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":550,"num_read_kb":17342,"num_write":1226,"num_write_kb":42776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'408","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.779690+0000","last_change":"2024-09-05T02:16:37.779690+0000","last_active":"2024-09-05T02:16:37.779690+0000","last_peered":"2024-09-05T02:16:37.779690+0000","last_clean":"2024-09-05T02:16:37.779690+0000","last_became_active":"2024-09-05T00:49:29.917460+0000","last_became_peered":"2024-09-05T00:49:29.917460+0000","last_unstale":"2024-09-05T02:16:37.779690+0000","last_undegraded":"2024-09-05T02:16:37.779690+0000","last_fullsized":"2024-09-05T02:16:37.779690+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:37.779509+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.779509+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:32:37.394227+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2178,"num_read_kb":2047,"num_write":464,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'353","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.985816+0000","last_change":"2024-09-05T02:16:34.985816+0000","last_active":"2024-09-05T02:16:34.985816+0000","last_peered":"2024-09-05T02:16:34.985816+0000","last_clean":"2024-09-05T02:16:34.985816+0000","last_became_active":"2024-09-05T00:49:27.878683+0000","last_became_peered":"2024-09-05T00:49:27.878683+0000","last_unstale":"2024-09-05T02:16:34.985816+0000","last_undegraded":"2024-09-05T02:16:34.985816+0000","last_fullsized":"2024-09-05T02:16:34.985816+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:34.985621+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.985621+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:30:35.048288+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079903,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":1528,"num_write":1229,"num_write_kb":38127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'751","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.482525+0000","last_change":"2024-09-05T02:16:47.482525+0000","last_active":"2024-09-05T02:16:47.482525+0000","last_peered":"2024-09-05T02:16:47.482525+0000","last_clean":"2024-09-05T02:16:47.482525+0000","last_became_active":"2024-09-05T00:49:29.920362+0000","last_became_peered":"2024-09-05T00:49:29.920362+0000","last_unstale":"2024-09-05T02:16:47.482525+0000","last_undegraded":"2024-09-05T02:16:47.482525+0000","last_fullsized":"2024-09-05T02:16:47.482525+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'751","last_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_deep_scrub":"264'751","last_deep_scrub_stamp":"2024-09-05T02:16:47.482313+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.482313+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:15.492660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3599,"num_read_kb":3239,"num_write":997,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'340","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.555210+0000","last_change":"2024-09-05T02:16:31.555210+0000","last_active":"2024-09-05T02:16:31.555210+0000","last_peered":"2024-09-05T02:16:31.555210+0000","last_clean":"2024-09-05T02:16:31.555210+0000","last_became_active":"2024-09-05T00:49:27.882635+0000","last_became_peered":"2024-09-05T00:49:27.882635+0000","last_unstale":"2024-09-05T02:16:31.555210+0000","last_undegraded":"2024-09-05T02:16:31.555210+0000","last_fullsized":"2024-09-05T02:16:31.555210+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-09-05T02:16:31.555009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.555009+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:56:13.682055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170236,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":501,"num_read_kb":32081,"num_write":1077,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'129","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.545088+0000","last_change":"2024-09-05T02:17:03.545088+0000","last_active":"2024-09-05T02:17:03.545088+0000","last_peered":"2024-09-05T02:17:03.545088+0000","last_clean":"2024-09-05T02:17:03.545088+0000","last_became_active":"2024-09-05T00:49:37.949079+0000","last_became_peered":"2024-09-05T00:49:37.949079+0000","last_unstale":"2024-09-05T02:17:03.545088+0000","last_undegraded":"2024-09-05T02:17:03.545088+0000","last_fullsized":"2024-09-05T02:17:03.545088+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'129","last_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_deep_scrub":"264'129","last_deep_scrub_stamp":"2024-09-05T02:17:03.544858+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.544858+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:33.897822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":135,"num_read_kb":132,"num_write":298,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'323","reported_seq":1638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.810201+0000","last_change":"2024-09-05T02:16:33.810064+0000","last_active":"2024-09-05T02:16:33.810201+0000","last_peered":"2024-09-05T02:16:33.810201+0000","last_clean":"2024-09-05T02:16:33.810201+0000","last_became_active":"2024-09-05T00:50:04.179140+0000","last_became_peered":"2024-09-05T00:50:04.179140+0000","last_unstale":"2024-09-05T02:16:33.810201+0000","last_undegraded":"2024-09-05T02:16:33.810201+0000","last_fullsized":"2024-09-05T02:16:33.810201+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:33.809886+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.809886+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:45:56.483637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1694,"num_read_kb":1623,"num_write":351,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"264'351","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.079623+0000","last_change":"2024-09-05T02:16:37.079623+0000","last_active":"2024-09-05T02:16:37.079623+0000","last_peered":"2024-09-05T02:16:37.079623+0000","last_clean":"2024-09-05T02:16:37.079623+0000","last_became_active":"2024-09-05T00:49:27.907441+0000","last_became_peered":"2024-09-05T00:49:27.907441+0000","last_unstale":"2024-09-05T02:16:37.079623+0000","last_undegraded":"2024-09-05T02:16:37.079623+0000","last_fullsized":"2024-09-05T02:16:37.079623+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-09-05T02:16:37.079302+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.079302+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:25:10.945666+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":5561,"num_write":1118,"num_write_kb":26018,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.589865+0000","last_change":"2024-09-05T02:16:51.589865+0000","last_active":"2024-09-05T02:16:51.589865+0000","last_peered":"2024-09-05T02:16:51.589865+0000","last_clean":"2024-09-05T02:16:51.589865+0000","last_became_active":"2024-09-05T00:49:31.910731+0000","last_became_peered":"2024-09-05T00:49:31.910731+0000","last_unstale":"2024-09-05T02:16:51.589865+0000","last_undegraded":"2024-09-05T02:16:51.589865+0000","last_fullsized":"2024-09-05T02:16:51.589865+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.589683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.589683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:45:12.569819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'373","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.248678+0000","last_change":"2024-09-05T02:16:55.248678+0000","last_active":"2024-09-05T02:16:55.248678+0000","last_peered":"2024-09-05T02:16:55.248678+0000","last_clean":"2024-09-05T02:16:55.248678+0000","last_became_active":"2024-09-05T00:49:33.907573+0000","last_became_peered":"2024-09-05T00:49:33.907573+0000","last_unstale":"2024-09-05T02:16:55.248678+0000","last_undegraded":"2024-09-05T02:16:55.248678+0000","last_fullsized":"2024-09-05T02:16:55.248678+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:55.248481+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.248481+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:24:12.292604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":585,"num_read_kb":1187,"num_write":454,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.803463+0000","last_change":"2024-09-05T02:16:57.803463+0000","last_active":"2024-09-05T02:16:57.803463+0000","last_peered":"2024-09-05T02:16:57.803463+0000","last_clean":"2024-09-05T02:16:57.803463+0000","last_became_active":"2024-09-05T00:49:35.934435+0000","last_became_peered":"2024-09-05T00:49:35.934435+0000","last_unstale":"2024-09-05T02:16:57.803463+0000","last_undegraded":"2024-09-05T02:16:57.803463+0000","last_fullsized":"2024-09-05T02:16:57.803463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.803282+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.803282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:14:25.367667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2472","reported_seq":4389,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.524861+0000","last_change":"2024-09-05T02:17:04.524711+0000","last_active":"2024-09-05T02:17:04.524861+0000","last_peered":"2024-09-05T02:17:04.524861+0000","last_clean":"2024-09-05T02:17:04.524861+0000","last_became_active":"2024-09-05T00:49:37.938331+0000","last_became_peered":"2024-09-05T00:49:37.938331+0000","last_unstale":"2024-09-05T02:17:04.524861+0000","last_undegraded":"2024-09-05T02:17:04.524861+0000","last_fullsized":"2024-09-05T02:17:04.524861+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2472","last_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_deep_scrub":"264'2472","last_deep_scrub_stamp":"2024-09-05T02:17:04.524509+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.524509+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:23:48.550803+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6159,"num_read_kb":6152,"num_write":4955,"num_write_kb":1814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'752","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.488036+0000","last_change":"2024-09-05T02:16:43.488036+0000","last_active":"2024-09-05T02:16:43.488036+0000","last_peered":"2024-09-05T02:16:43.488036+0000","last_clean":"2024-09-05T02:16:43.488036+0000","last_became_active":"2024-09-05T00:49:29.903396+0000","last_became_peered":"2024-09-05T00:49:29.903396+0000","last_unstale":"2024-09-05T02:16:43.488036+0000","last_undegraded":"2024-09-05T02:16:43.488036+0000","last_fullsized":"2024-09-05T02:16:43.488036+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'752","last_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_deep_scrub":"264'752","last_deep_scrub_stamp":"2024-09-05T02:16:43.487849+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.487849+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:53:28.339919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3502,"num_read_kb":3135,"num_write":1000,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'326","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.495350+0000","last_change":"2024-09-05T02:16:29.495350+0000","last_active":"2024-09-05T02:16:29.495350+0000","last_peered":"2024-09-05T02:16:29.495350+0000","last_clean":"2024-09-05T02:16:29.495350+0000","last_became_active":"2024-09-05T00:49:27.905388+0000","last_became_peered":"2024-09-05T00:49:27.905388+0000","last_unstale":"2024-09-05T02:16:29.495350+0000","last_undegraded":"2024-09-05T02:16:29.495350+0000","last_fullsized":"2024-09-05T02:16:29.495350+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:29.495167+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.495167+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:19:45.662775+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":61922,"num_write":915,"num_write_kb":55304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.147689+0000","last_change":"2024-09-05T02:16:48.147689+0000","last_active":"2024-09-05T02:16:48.147689+0000","last_peered":"2024-09-05T02:16:48.147689+0000","last_clean":"2024-09-05T02:16:48.147689+0000","last_became_active":"2024-09-05T00:49:31.916342+0000","last_became_peered":"2024-09-05T00:49:31.916342+0000","last_unstale":"2024-09-05T02:16:48.147689+0000","last_undegraded":"2024-09-05T02:16:48.147689+0000","last_fullsized":"2024-09-05T02:16:48.147689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.147489+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.147489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:34.064672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'110","reported_seq":671,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.527062+0000","last_change":"2024-09-05T02:16:56.527062+0000","last_active":"2024-09-05T02:16:56.527062+0000","last_peered":"2024-09-05T02:16:56.527062+0000","last_clean":"2024-09-05T02:16:56.527062+0000","last_became_active":"2024-09-05T00:49:33.908028+0000","last_became_peered":"2024-09-05T00:49:33.908028+0000","last_unstale":"2024-09-05T02:16:56.527062+0000","last_undegraded":"2024-09-05T02:16:56.527062+0000","last_fullsized":"2024-09-05T02:16:56.527062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:56.526730+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.526730+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:26:52.832215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":130,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.481410+0000","last_change":"2024-09-05T02:16:59.481410+0000","last_active":"2024-09-05T02:16:59.481410+0000","last_peered":"2024-09-05T02:16:59.481410+0000","last_clean":"2024-09-05T02:16:59.481410+0000","last_became_active":"2024-09-05T00:49:35.929275+0000","last_became_peered":"2024-09-05T00:49:35.929275+0000","last_unstale":"2024-09-05T02:16:59.481410+0000","last_undegraded":"2024-09-05T02:16:59.481410+0000","last_fullsized":"2024-09-05T02:16:59.481410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.481224+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.481224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:23.052575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'110","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.211744+0000","last_change":"2024-09-05T02:16:59.211606+0000","last_active":"2024-09-05T02:16:59.211744+0000","last_peered":"2024-09-05T02:16:59.211744+0000","last_clean":"2024-09-05T02:16:59.211744+0000","last_became_active":"2024-09-05T00:49:37.931941+0000","last_became_peered":"2024-09-05T00:49:37.931941+0000","last_unstale":"2024-09-05T02:16:59.211744+0000","last_undegraded":"2024-09-05T02:16:59.211744+0000","last_fullsized":"2024-09-05T02:16:59.211744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:16:59.211408+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.211408+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:46.901389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":240,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'1224","reported_seq":2918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.299022+0000","last_change":"2024-09-05T02:16:42.299022+0000","last_active":"2024-09-05T02:16:42.299022+0000","last_peered":"2024-09-05T02:16:42.299022+0000","last_clean":"2024-09-05T02:16:42.299022+0000","last_became_active":"2024-09-05T00:49:29.910763+0000","last_became_peered":"2024-09-05T00:49:29.910763+0000","last_unstale":"2024-09-05T02:16:42.299022+0000","last_undegraded":"2024-09-05T02:16:42.299022+0000","last_fullsized":"2024-09-05T02:16:42.299022+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1224","last_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_deep_scrub":"264'1224","last_deep_scrub_stamp":"2024-09-05T02:16:42.298827+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.298827+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:49.318161+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5434,"num_read_kb":4819,"num_write":1661,"num_write_kb":650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.081594+0000","last_change":"2024-09-05T02:16:35.081594+0000","last_active":"2024-09-05T02:16:35.081594+0000","last_peered":"2024-09-05T02:16:35.081594+0000","last_clean":"2024-09-05T02:16:35.081594+0000","last_became_active":"2024-09-05T00:49:27.904004+0000","last_became_peered":"2024-09-05T00:49:27.904004+0000","last_unstale":"2024-09-05T02:16:35.081594+0000","last_undegraded":"2024-09-05T02:16:35.081594+0000","last_fullsized":"2024-09-05T02:16:35.081594+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:35.081383+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.081383+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:56:51.256314+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":516,"num_read_kb":6929,"num_write":1016,"num_write_kb":17291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.111742+0000","last_change":"2024-09-05T02:16:50.111742+0000","last_active":"2024-09-05T02:16:50.111742+0000","last_peered":"2024-09-05T02:16:50.111742+0000","last_clean":"2024-09-05T02:16:50.111742+0000","last_became_active":"2024-09-05T00:49:31.912536+0000","last_became_peered":"2024-09-05T00:49:31.912536+0000","last_unstale":"2024-09-05T02:16:50.111742+0000","last_undegraded":"2024-09-05T02:16:50.111742+0000","last_fullsized":"2024-09-05T02:16:50.111742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.111667+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.111667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:07:39.242968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'188","reported_seq":777,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.799623+0000","last_change":"2024-09-05T02:16:45.799623+0000","last_active":"2024-09-05T02:16:45.799623+0000","last_peered":"2024-09-05T02:16:45.799623+0000","last_clean":"2024-09-05T02:16:45.799623+0000","last_became_active":"2024-09-05T00:49:33.901776+0000","last_became_peered":"2024-09-05T00:49:33.901776+0000","last_unstale":"2024-09-05T02:16:45.799623+0000","last_undegraded":"2024-09-05T02:16:45.799623+0000","last_fullsized":"2024-09-05T02:16:45.799623+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'188","last_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_deep_scrub":"264'188","last_deep_scrub_stamp":"2024-09-05T02:16:45.799431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.799431+0000","objects_scrubbed":7,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:12:29.922191+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":214,"num_read_kb":201,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'788","reported_seq":4961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.789188+0000","last_change":"2024-09-05T02:16:59.789188+0000","last_active":"2024-09-05T02:16:59.789188+0000","last_peered":"2024-09-05T02:16:59.789188+0000","last_clean":"2024-09-05T02:16:59.789188+0000","last_became_active":"2024-09-05T00:49:35.924827+0000","last_became_peered":"2024-09-05T00:49:35.924827+0000","last_unstale":"2024-09-05T02:16:59.789188+0000","last_undegraded":"2024-09-05T02:16:59.789188+0000","last_fullsized":"2024-09-05T02:16:59.789188+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'788","last_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_deep_scrub":"264'788","last_deep_scrub_stamp":"2024-09-05T02:16:59.789001+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.789001+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:42.866750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'236","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.568466+0000","last_change":"2024-09-05T02:17:05.568317+0000","last_active":"2024-09-05T02:17:05.568466+0000","last_peered":"2024-09-05T02:17:05.568466+0000","last_clean":"2024-09-05T02:17:05.568466+0000","last_became_active":"2024-09-05T00:49:37.921457+0000","last_became_peered":"2024-09-05T00:49:37.921457+0000","last_unstale":"2024-09-05T02:17:05.568466+0000","last_undegraded":"2024-09-05T02:17:05.568466+0000","last_fullsized":"2024-09-05T02:17:05.568466+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'236","last_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_deep_scrub":"264'236","last_deep_scrub_stamp":"2024-09-05T02:17:05.568123+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.568123+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:46:23.769683+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":651,"num_write":528,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'685","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.979024+0000","last_change":"2024-09-05T02:16:37.979024+0000","last_active":"2024-09-05T02:16:37.979024+0000","last_peered":"2024-09-05T02:16:37.979024+0000","last_clean":"2024-09-05T02:16:37.979024+0000","last_became_active":"2024-09-05T00:49:29.927410+0000","last_became_peered":"2024-09-05T00:49:29.927410+0000","last_unstale":"2024-09-05T02:16:37.979024+0000","last_undegraded":"2024-09-05T02:16:37.979024+0000","last_fullsized":"2024-09-05T02:16:37.979024+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:37.978839+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.978839+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:29:33.371371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3280,"num_read_kb":2976,"num_write":879,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'362","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.834992+0000","last_change":"2024-09-05T02:16:31.834992+0000","last_active":"2024-09-05T02:16:31.834992+0000","last_peered":"2024-09-05T02:16:31.834992+0000","last_clean":"2024-09-05T02:16:31.834992+0000","last_became_active":"2024-09-05T00:49:27.880038+0000","last_became_peered":"2024-09-05T00:49:27.880038+0000","last_unstale":"2024-09-05T02:16:31.834992+0000","last_undegraded":"2024-09-05T02:16:31.834992+0000","last_fullsized":"2024-09-05T02:16:31.834992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.834772+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.834772+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:12:22.380162+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":55829,"num_write":1110,"num_write_kb":30059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.629506+0000","last_change":"2024-09-05T02:16:52.629506+0000","last_active":"2024-09-05T02:16:52.629506+0000","last_peered":"2024-09-05T02:16:52.629506+0000","last_clean":"2024-09-05T02:16:52.629506+0000","last_became_active":"2024-09-05T00:49:31.909487+0000","last_became_peered":"2024-09-05T00:49:31.909487+0000","last_unstale":"2024-09-05T02:16:52.629506+0000","last_undegraded":"2024-09-05T02:16:52.629506+0000","last_fullsized":"2024-09-05T02:16:52.629506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.629320+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.629320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:02:54.194725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'331","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.873220+0000","last_change":"2024-09-05T02:16:54.873220+0000","last_active":"2024-09-05T02:16:54.873220+0000","last_peered":"2024-09-05T02:16:54.873220+0000","last_clean":"2024-09-05T02:16:54.873220+0000","last_became_active":"2024-09-05T00:49:34.054477+0000","last_became_peered":"2024-09-05T00:49:34.054477+0000","last_unstale":"2024-09-05T02:16:54.873220+0000","last_undegraded":"2024-09-05T02:16:54.873220+0000","last_fullsized":"2024-09-05T02:16:54.873220+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'331","last_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_deep_scrub":"264'331","last_deep_scrub_stamp":"2024-09-05T02:16:54.873017+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.873017+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:39:46.622589+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1195,"num_write":422,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'802","reported_seq":4548,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.272266+0000","last_change":"2024-09-05T02:17:02.272266+0000","last_active":"2024-09-05T02:17:02.272266+0000","last_peered":"2024-09-05T02:17:02.272266+0000","last_clean":"2024-09-05T02:17:02.272266+0000","last_became_active":"2024-09-05T00:49:35.937473+0000","last_became_peered":"2024-09-05T00:49:35.937473+0000","last_unstale":"2024-09-05T02:17:02.272266+0000","last_undegraded":"2024-09-05T02:17:02.272266+0000","last_fullsized":"2024-09-05T02:17:02.272266+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'802","last_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_deep_scrub":"264'802","last_deep_scrub_stamp":"2024-09-05T02:17:02.272095+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.272095+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:47.154810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'747","reported_seq":2279,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.480047+0000","last_change":"2024-09-05T02:16:42.480047+0000","last_active":"2024-09-05T02:16:42.480047+0000","last_peered":"2024-09-05T02:16:42.480047+0000","last_clean":"2024-09-05T02:16:42.480047+0000","last_became_active":"2024-09-05T00:49:29.903274+0000","last_became_peered":"2024-09-05T00:49:29.903274+0000","last_unstale":"2024-09-05T02:16:42.480047+0000","last_undegraded":"2024-09-05T02:16:42.480047+0000","last_fullsized":"2024-09-05T02:16:42.480047+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'747","last_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_deep_scrub":"264'747","last_deep_scrub_stamp":"2024-09-05T02:16:42.479861+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.479861+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:17:12.117260+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3776,"num_read_kb":3422,"num_write":1002,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5103,"num_omap_keys":20,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'440","reported_seq":1159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.123038+0000","last_change":"2024-09-05T02:16:36.122895+0000","last_active":"2024-09-05T02:16:36.123038+0000","last_peered":"2024-09-05T02:16:36.123038+0000","last_clean":"2024-09-05T02:16:36.123038+0000","last_became_active":"2024-09-05T00:49:27.913419+0000","last_became_peered":"2024-09-05T00:49:27.913419+0000","last_unstale":"2024-09-05T02:16:36.123038+0000","last_undegraded":"2024-09-05T02:16:36.123038+0000","last_fullsized":"2024-09-05T02:16:36.123038+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'440","last_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_deep_scrub":"264'440","last_deep_scrub_stamp":"2024-09-05T02:16:36.122675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.122675+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:51.397953+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":823,"num_read_kb":4743,"num_write":1412,"num_write_kb":14859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.929007+0000","last_change":"2024-09-05T02:16:46.929007+0000","last_active":"2024-09-05T02:16:46.929007+0000","last_peered":"2024-09-05T02:16:46.929007+0000","last_clean":"2024-09-05T02:16:46.929007+0000","last_became_active":"2024-09-05T00:49:31.917861+0000","last_became_peered":"2024-09-05T00:49:31.917861+0000","last_unstale":"2024-09-05T02:16:46.929007+0000","last_undegraded":"2024-09-05T02:16:46.929007+0000","last_fullsized":"2024-09-05T02:16:46.929007+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.928820+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.928820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:33.551292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'430","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.607595+0000","last_change":"2024-09-05T02:16:54.607595+0000","last_active":"2024-09-05T02:16:54.607595+0000","last_peered":"2024-09-05T02:16:54.607595+0000","last_clean":"2024-09-05T02:16:54.607595+0000","last_became_active":"2024-09-05T00:49:34.051695+0000","last_became_peered":"2024-09-05T00:49:34.051695+0000","last_unstale":"2024-09-05T02:16:54.607595+0000","last_undegraded":"2024-09-05T02:16:54.607595+0000","last_fullsized":"2024-09-05T02:16:54.607595+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-09-05T02:16:54.607309+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.607309+0000","objects_scrubbed":10,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:02:15.232596+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50654,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":700,"num_read_kb":1390,"num_write":540,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.186796+0000","last_change":"2024-09-05T02:16:50.186545+0000","last_active":"2024-09-05T02:16:50.186796+0000","last_peered":"2024-09-05T02:16:50.186796+0000","last_clean":"2024-09-05T02:16:50.186796+0000","last_became_active":"2024-09-05T00:49:35.936497+0000","last_became_peered":"2024-09-05T00:49:35.936497+0000","last_unstale":"2024-09-05T02:16:50.186796+0000","last_undegraded":"2024-09-05T02:16:50.186796+0000","last_fullsized":"2024-09-05T02:16:50.186796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.186319+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.186319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:46:00.104169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'587","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.544434+0000","last_change":"2024-09-05T02:17:00.544151+0000","last_active":"2024-09-05T02:17:00.544434+0000","last_peered":"2024-09-05T02:17:00.544434+0000","last_clean":"2024-09-05T02:17:00.544434+0000","last_became_active":"2024-09-05T00:49:37.944557+0000","last_became_peered":"2024-09-05T00:49:37.944557+0000","last_unstale":"2024-09-05T02:17:00.544434+0000","last_undegraded":"2024-09-05T02:17:00.544434+0000","last_fullsized":"2024-09-05T02:17:00.544434+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'587","last_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_deep_scrub":"264'587","last_deep_scrub_stamp":"2024-09-05T02:17:00.543906+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.543906+0000","objects_scrubbed":3,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:10:51.028073+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1327,"num_read_kb":1319,"num_write":1245,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'439","reported_seq":1983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.464369+0000","last_change":"2024-09-05T02:16:35.464369+0000","last_active":"2024-09-05T02:16:35.464369+0000","last_peered":"2024-09-05T02:16:35.464369+0000","last_clean":"2024-09-05T02:16:35.464369+0000","last_became_active":"2024-09-05T00:49:29.921467+0000","last_became_peered":"2024-09-05T00:49:29.921467+0000","last_unstale":"2024-09-05T02:16:35.464369+0000","last_undegraded":"2024-09-05T02:16:35.464369+0000","last_fullsized":"2024-09-05T02:16:35.464369+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-09-05T02:16:35.464163+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.464163+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:05:34.736676+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2306,"num_read_kb":2182,"num_write":511,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'305","reported_seq":936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.125447+0000","last_change":"2024-09-05T02:16:33.125280+0000","last_active":"2024-09-05T02:16:33.125447+0000","last_peered":"2024-09-05T02:16:33.125447+0000","last_clean":"2024-09-05T02:16:33.125447+0000","last_became_active":"2024-09-05T00:49:27.904223+0000","last_became_peered":"2024-09-05T00:49:27.904223+0000","last_unstale":"2024-09-05T02:16:33.125447+0000","last_undegraded":"2024-09-05T02:16:33.125447+0000","last_fullsized":"2024-09-05T02:16:33.125447+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'305","last_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_deep_scrub":"264'305","last_deep_scrub_stamp":"2024-09-05T02:16:33.125091+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.125091+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:46:46.538429+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262277,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":401,"num_read_kb":6807,"num_write":872,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.791859+0000","last_change":"2024-09-05T02:16:40.791859+0000","last_active":"2024-09-05T02:16:40.791859+0000","last_peered":"2024-09-05T02:16:40.791859+0000","last_clean":"2024-09-05T02:16:40.791859+0000","last_became_active":"2024-09-05T00:49:31.900228+0000","last_became_peered":"2024-09-05T00:49:31.900228+0000","last_unstale":"2024-09-05T02:16:40.791859+0000","last_undegraded":"2024-09-05T02:16:40.791859+0000","last_fullsized":"2024-09-05T02:16:40.791859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:40.791659+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.791659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:00:07.109747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'302","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.114210+0000","last_change":"2024-09-05T02:16:52.114066+0000","last_active":"2024-09-05T02:16:52.114210+0000","last_peered":"2024-09-05T02:16:52.114210+0000","last_clean":"2024-09-05T02:16:52.114210+0000","last_became_active":"2024-09-05T00:49:33.925173+0000","last_became_peered":"2024-09-05T00:49:33.925173+0000","last_unstale":"2024-09-05T02:16:52.114210+0000","last_undegraded":"2024-09-05T02:16:52.114210+0000","last_fullsized":"2024-09-05T02:16:52.114210+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.113869+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.113869+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:18:23.318378+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45431,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":1122,"num_write":388,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.195296+0000","last_change":"2024-09-05T02:17:00.195296+0000","last_active":"2024-09-05T02:17:00.195296+0000","last_peered":"2024-09-05T02:17:00.195296+0000","last_clean":"2024-09-05T02:17:00.195296+0000","last_became_active":"2024-09-05T00:49:35.933640+0000","last_became_peered":"2024-09-05T00:49:35.933640+0000","last_unstale":"2024-09-05T02:17:00.195296+0000","last_undegraded":"2024-09-05T02:17:00.195296+0000","last_fullsized":"2024-09-05T02:17:00.195296+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.195111+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.195111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:11:19.830376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.913106+0000","last_change":"2024-09-05T02:16:51.912916+0000","last_active":"2024-09-05T02:16:51.913106+0000","last_peered":"2024-09-05T02:16:51.913106+0000","last_clean":"2024-09-05T02:16:51.913106+0000","last_became_active":"2024-09-05T00:49:37.938625+0000","last_became_peered":"2024-09-05T00:49:37.938625+0000","last_unstale":"2024-09-05T02:16:51.913106+0000","last_undegraded":"2024-09-05T02:16:51.913106+0000","last_fullsized":"2024-09-05T02:16:51.913106+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-05T02:16:51.912736+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.912736+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:24.736846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":98,"num_write":271,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'480","reported_seq":2255,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.873624+0000","last_change":"2024-09-05T02:16:39.873624+0000","last_active":"2024-09-05T02:16:39.873624+0000","last_peered":"2024-09-05T02:16:39.873624+0000","last_clean":"2024-09-05T02:16:39.873624+0000","last_became_active":"2024-09-05T00:49:29.895224+0000","last_became_peered":"2024-09-05T00:49:29.895224+0000","last_unstale":"2024-09-05T02:16:39.873624+0000","last_undegraded":"2024-09-05T02:16:39.873624+0000","last_fullsized":"2024-09-05T02:16:39.873624+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'480","last_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_deep_scrub":"264'480","last_deep_scrub_stamp":"2024-09-05T02:16:39.873409+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.873409+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:36:34.456533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2727,"num_read_kb":2602,"num_write":551,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.108991+0000","last_change":"2024-09-05T02:16:34.108848+0000","last_active":"2024-09-05T02:16:34.108991+0000","last_peered":"2024-09-05T02:16:34.108991+0000","last_clean":"2024-09-05T02:16:34.108991+0000","last_became_active":"2024-09-05T00:49:27.906971+0000","last_became_peered":"2024-09-05T00:49:27.906971+0000","last_unstale":"2024-09-05T02:16:34.108991+0000","last_undegraded":"2024-09-05T02:16:34.108991+0000","last_fullsized":"2024-09-05T02:16:34.108991+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-09-05T02:16:34.108657+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.108657+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:36:55.603566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568320,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":440,"num_read_kb":11870,"num_write":1072,"num_write_kb":40356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.768020+0000","last_change":"2024-09-05T02:16:42.767880+0000","last_active":"2024-09-05T02:16:42.768020+0000","last_peered":"2024-09-05T02:16:42.768020+0000","last_clean":"2024-09-05T02:16:42.768020+0000","last_became_active":"2024-09-05T00:49:31.901921+0000","last_became_peered":"2024-09-05T00:49:31.901921+0000","last_unstale":"2024-09-05T02:16:42.768020+0000","last_undegraded":"2024-09-05T02:16:42.768020+0000","last_fullsized":"2024-09-05T02:16:42.768020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.767694+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.767694+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:58:50.029710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'373","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.963277+0000","last_change":"2024-09-05T02:16:51.963277+0000","last_active":"2024-09-05T02:16:51.963277+0000","last_peered":"2024-09-05T02:16:51.963277+0000","last_clean":"2024-09-05T02:16:51.963277+0000","last_became_active":"2024-09-05T00:49:33.913496+0000","last_became_peered":"2024-09-05T00:49:33.913496+0000","last_unstale":"2024-09-05T02:16:51.963277+0000","last_undegraded":"2024-09-05T02:16:51.963277+0000","last_fullsized":"2024-09-05T02:16:51.963277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:51.963126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.963126+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:39:27.577793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1153,"num_write":442,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'803","reported_seq":2979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.239500+0000","last_change":"2024-09-05T02:16:44.239500+0000","last_active":"2024-09-05T02:16:44.239500+0000","last_peered":"2024-09-05T02:16:44.239500+0000","last_clean":"2024-09-05T02:16:44.239500+0000","last_became_active":"2024-09-05T00:49:35.941929+0000","last_became_peered":"2024-09-05T00:49:35.941929+0000","last_unstale":"2024-09-05T02:16:44.239500+0000","last_undegraded":"2024-09-05T02:16:44.239500+0000","last_fullsized":"2024-09-05T02:16:44.239500+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:44.239280+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.239280+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:22:58.554723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'99","reported_seq":613,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.241222+0000","last_change":"2024-09-05T02:17:02.241222+0000","last_active":"2024-09-05T02:17:02.241222+0000","last_peered":"2024-09-05T02:17:02.241222+0000","last_clean":"2024-09-05T02:17:02.241222+0000","last_became_active":"2024-09-05T00:49:37.929883+0000","last_became_peered":"2024-09-05T00:49:37.929883+0000","last_unstale":"2024-09-05T02:17:02.241222+0000","last_undegraded":"2024-09-05T02:17:02.241222+0000","last_fullsized":"2024-09-05T02:17:02.241222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'99","last_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_deep_scrub":"264'99","last_deep_scrub_stamp":"2024-09-05T02:17:02.241039+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.241039+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:16:28.434401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":90,"num_write":246,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'807","reported_seq":2411,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.277564+0000","last_change":"2024-09-05T02:16:45.277310+0000","last_active":"2024-09-05T02:16:45.277564+0000","last_peered":"2024-09-05T02:16:45.277564+0000","last_clean":"2024-09-05T02:16:45.277564+0000","last_became_active":"2024-09-05T00:49:29.920654+0000","last_became_peered":"2024-09-05T00:49:29.920654+0000","last_unstale":"2024-09-05T02:16:45.277564+0000","last_undegraded":"2024-09-05T02:16:45.277564+0000","last_fullsized":"2024-09-05T02:16:45.277564+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'807","last_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_deep_scrub":"264'807","last_deep_scrub_stamp":"2024-09-05T02:16:45.277038+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.277038+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:50.324780+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3980,"num_read_kb":3586,"num_write":1067,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3282,"num_omap_keys":13,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'325","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.512913+0000","last_change":"2024-09-05T02:16:32.512680+0000","last_active":"2024-09-05T02:16:32.512913+0000","last_peered":"2024-09-05T02:16:32.512913+0000","last_clean":"2024-09-05T02:16:32.512913+0000","last_became_active":"2024-09-05T00:49:27.888002+0000","last_became_peered":"2024-09-05T00:49:27.888002+0000","last_unstale":"2024-09-05T02:16:32.512913+0000","last_undegraded":"2024-09-05T02:16:32.512913+0000","last_fullsized":"2024-09-05T02:16:32.512913+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-05T02:16:32.512392+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.512392+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:51.415971+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":553,"num_read_kb":126733,"num_write":975,"num_write_kb":55809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.758161+0000","last_change":"2024-09-05T02:16:41.758161+0000","last_active":"2024-09-05T02:16:41.758161+0000","last_peered":"2024-09-05T02:16:41.758161+0000","last_clean":"2024-09-05T02:16:41.758161+0000","last_became_active":"2024-09-05T00:49:31.917670+0000","last_became_peered":"2024-09-05T00:49:31.917670+0000","last_unstale":"2024-09-05T02:16:41.758161+0000","last_undegraded":"2024-09-05T02:16:41.758161+0000","last_fullsized":"2024-09-05T02:16:41.758161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.757955+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.757955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:25:26.539921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'553","reported_seq":1233,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.317795+0000","last_change":"2024-09-05T02:16:40.317795+0000","last_active":"2024-09-05T02:16:40.317795+0000","last_peered":"2024-09-05T02:16:40.317795+0000","last_clean":"2024-09-05T02:16:40.317795+0000","last_became_active":"2024-09-05T00:49:33.912229+0000","last_became_peered":"2024-09-05T00:49:33.912229+0000","last_unstale":"2024-09-05T02:16:40.317795+0000","last_undegraded":"2024-09-05T02:16:40.317795+0000","last_fullsized":"2024-09-05T02:16:40.317795+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'553","last_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_deep_scrub":"264'553","last_deep_scrub_stamp":"2024-09-05T02:16:40.317611+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.317611+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:00:06.774339+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101782,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":984,"num_read_kb":2420,"num_write":814,"num_write_kb":674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.774119+0000","last_change":"2024-09-05T02:16:46.774119+0000","last_active":"2024-09-05T02:16:46.774119+0000","last_peered":"2024-09-05T02:16:46.774119+0000","last_clean":"2024-09-05T02:16:46.774119+0000","last_became_active":"2024-09-05T00:49:35.923271+0000","last_became_peered":"2024-09-05T00:49:35.923271+0000","last_unstale":"2024-09-05T02:16:46.774119+0000","last_undegraded":"2024-09-05T02:16:46.774119+0000","last_fullsized":"2024-09-05T02:16:46.774119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.773927+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.773927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:33.369118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'124","reported_seq":676,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.193863+0000","last_change":"2024-09-05T02:16:51.193863+0000","last_active":"2024-09-05T02:16:51.193863+0000","last_peered":"2024-09-05T02:16:51.193863+0000","last_clean":"2024-09-05T02:16:51.193863+0000","last_became_active":"2024-09-05T00:49:37.951164+0000","last_became_peered":"2024-09-05T00:49:37.951164+0000","last_unstale":"2024-09-05T02:16:51.193863+0000","last_undegraded":"2024-09-05T02:16:51.193863+0000","last_fullsized":"2024-09-05T02:16:51.193863+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-05T02:16:51.193637+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.193637+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:27:46.253889+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":189,"num_read_kb":171,"num_write":279,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'959","reported_seq":2796,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.496298+0000","last_change":"2024-09-05T02:16:34.496164+0000","last_active":"2024-09-05T02:16:34.496298+0000","last_peered":"2024-09-05T02:16:34.496298+0000","last_clean":"2024-09-05T02:16:34.496298+0000","last_became_active":"2024-09-05T00:49:29.915751+0000","last_became_peered":"2024-09-05T00:49:29.915751+0000","last_unstale":"2024-09-05T02:16:34.496298+0000","last_undegraded":"2024-09-05T02:16:34.496298+0000","last_fullsized":"2024-09-05T02:16:34.496298+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'959","last_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_deep_scrub":"264'959","last_deep_scrub_stamp":"2024-09-05T02:16:34.495992+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.495992+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":900,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:40:04.831466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4689,"num_read_kb":4231,"num_write":1251,"num_write_kb":439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'591","reported_seq":1422,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.881896+0000","last_change":"2024-09-05T02:16:27.881841+0000","last_active":"2024-09-05T02:16:27.881896+0000","last_peered":"2024-09-05T02:16:27.881896+0000","last_clean":"2024-09-05T02:16:27.881896+0000","last_became_active":"2024-09-05T00:49:27.881318+0000","last_became_peered":"2024-09-05T00:49:27.881318+0000","last_unstale":"2024-09-05T02:16:27.881896+0000","last_undegraded":"2024-09-05T02:16:27.881896+0000","last_fullsized":"2024-09-05T02:16:27.881896+0000","mapping_epoch":23,"log_start":"264'500","ondisk_log_start":"264'500","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'591","last_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_deep_scrub":"264'591","last_deep_scrub_stamp":"2024-09-05T02:16:27.881626+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.881626+0000","objects_scrubbed":10,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:45.891183+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1648694,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1279,"num_read_kb":93816,"num_write":1779,"num_write_kb":50479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.755557+0000","last_change":"2024-09-05T02:16:43.755375+0000","last_active":"2024-09-05T02:16:43.755557+0000","last_peered":"2024-09-05T02:16:43.755557+0000","last_clean":"2024-09-05T02:16:43.755557+0000","last_became_active":"2024-09-05T00:49:31.913524+0000","last_became_peered":"2024-09-05T00:49:31.913524+0000","last_unstale":"2024-09-05T02:16:43.755557+0000","last_undegraded":"2024-09-05T02:16:43.755557+0000","last_fullsized":"2024-09-05T02:16:43.755557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.755186+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.755186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:33:44.890636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'324","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.459587+0000","last_change":"2024-09-05T02:16:54.459431+0000","last_active":"2024-09-05T02:16:54.459587+0000","last_peered":"2024-09-05T02:16:54.459587+0000","last_clean":"2024-09-05T02:16:54.459587+0000","last_became_active":"2024-09-05T00:49:33.911348+0000","last_became_peered":"2024-09-05T00:49:33.911348+0000","last_unstale":"2024-09-05T02:16:54.459587+0000","last_undegraded":"2024-09-05T02:16:54.459587+0000","last_fullsized":"2024-09-05T02:16:54.459587+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:54.459229+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.459229+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:23.961491+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45586,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":525,"num_read_kb":1083,"num_write":458,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.250447+0000","last_change":"2024-09-05T02:16:48.250313+0000","last_active":"2024-09-05T02:16:48.250447+0000","last_peered":"2024-09-05T02:16:48.250447+0000","last_clean":"2024-09-05T02:16:48.250447+0000","last_became_active":"2024-09-05T00:49:35.942306+0000","last_became_peered":"2024-09-05T00:49:35.942306+0000","last_unstale":"2024-09-05T02:16:48.250447+0000","last_undegraded":"2024-09-05T02:16:48.250447+0000","last_fullsized":"2024-09-05T02:16:48.250447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.250133+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.250133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:25:07.642699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'105","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.238867+0000","last_change":"2024-09-05T02:17:03.238867+0000","last_active":"2024-09-05T02:17:03.238867+0000","last_peered":"2024-09-05T02:17:03.238867+0000","last_clean":"2024-09-05T02:17:03.238867+0000","last_became_active":"2024-09-05T00:49:37.950412+0000","last_became_peered":"2024-09-05T00:49:37.950412+0000","last_unstale":"2024-09-05T02:17:03.238867+0000","last_undegraded":"2024-09-05T02:17:03.238867+0000","last_fullsized":"2024-09-05T02:17:03.238867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-05T02:17:03.238583+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.238583+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:20:30.549216+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":71,"num_read_kb":71,"num_write":223,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'497","reported_seq":2128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.495768+0000","last_change":"2024-09-05T02:16:36.495522+0000","last_active":"2024-09-05T02:16:36.495768+0000","last_peered":"2024-09-05T02:16:36.495768+0000","last_clean":"2024-09-05T02:16:36.495768+0000","last_became_active":"2024-09-05T00:49:29.912825+0000","last_became_peered":"2024-09-05T00:49:29.912825+0000","last_unstale":"2024-09-05T02:16:36.495768+0000","last_undegraded":"2024-09-05T02:16:36.495768+0000","last_fullsized":"2024-09-05T02:16:36.495768+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'497","last_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_deep_scrub":"264'497","last_deep_scrub_stamp":"2024-09-05T02:16:36.495268+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.495268+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:26.514116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2679,"num_read_kb":2499,"num_write":617,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'382","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.836546+0000","last_change":"2024-09-05T02:16:29.836399+0000","last_active":"2024-09-05T02:16:29.836546+0000","last_peered":"2024-09-05T02:16:29.836546+0000","last_clean":"2024-09-05T02:16:29.836546+0000","last_became_active":"2024-09-05T00:49:27.887780+0000","last_became_peered":"2024-09-05T00:49:27.887780+0000","last_unstale":"2024-09-05T02:16:29.836546+0000","last_undegraded":"2024-09-05T02:16:29.836546+0000","last_fullsized":"2024-09-05T02:16:29.836546+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'382","last_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_deep_scrub":"264'382","last_deep_scrub_stamp":"2024-09-05T02:16:29.836204+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.836204+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:59.305574+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250145,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":642,"num_read_kb":21240,"num_write":1224,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.186752+0000","last_change":"2024-09-05T02:16:42.186623+0000","last_active":"2024-09-05T02:16:42.186752+0000","last_peered":"2024-09-05T02:16:42.186752+0000","last_clean":"2024-09-05T02:16:42.186752+0000","last_became_active":"2024-09-05T00:49:31.925590+0000","last_became_peered":"2024-09-05T00:49:31.925590+0000","last_unstale":"2024-09-05T02:16:42.186752+0000","last_undegraded":"2024-09-05T02:16:42.186752+0000","last_fullsized":"2024-09-05T02:16:42.186752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:42.186438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.186438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:19:10.931784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'353","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.751944+0000","last_change":"2024-09-05T02:16:44.751783+0000","last_active":"2024-09-05T02:16:44.751944+0000","last_peered":"2024-09-05T02:16:44.751944+0000","last_clean":"2024-09-05T02:16:44.751944+0000","last_became_active":"2024-09-05T00:49:33.922751+0000","last_became_peered":"2024-09-05T00:49:33.922751+0000","last_unstale":"2024-09-05T02:16:44.751944+0000","last_undegraded":"2024-09-05T02:16:44.751944+0000","last_fullsized":"2024-09-05T02:16:44.751944+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-09-05T02:16:44.751562+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.751562+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:02:24.105318+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":533,"num_read_kb":1068,"num_write":416,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'733","reported_seq":2792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.743832+0000","last_change":"2024-09-05T02:16:47.743669+0000","last_active":"2024-09-05T02:16:47.743832+0000","last_peered":"2024-09-05T02:16:47.743832+0000","last_clean":"2024-09-05T02:16:47.743832+0000","last_became_active":"2024-09-05T00:49:35.936913+0000","last_became_peered":"2024-09-05T00:49:35.936913+0000","last_unstale":"2024-09-05T02:16:47.743832+0000","last_undegraded":"2024-09-05T02:16:47.743832+0000","last_fullsized":"2024-09-05T02:16:47.743832+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'733","last_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_deep_scrub":"264'733","last_deep_scrub_stamp":"2024-09-05T02:16:47.743487+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.743487+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":700,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:40:46.001538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'119","reported_seq":672,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.160355+0000","last_change":"2024-09-05T02:16:49.160196+0000","last_active":"2024-09-05T02:16:49.160355+0000","last_peered":"2024-09-05T02:16:49.160355+0000","last_clean":"2024-09-05T02:16:49.160355+0000","last_became_active":"2024-09-05T00:49:37.932791+0000","last_became_peered":"2024-09-05T00:49:37.932791+0000","last_unstale":"2024-09-05T02:16:49.160355+0000","last_undegraded":"2024-09-05T02:16:49.160355+0000","last_fullsized":"2024-09-05T02:16:49.160355+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-05T02:16:49.160002+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.160002+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:41:09.578917+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":217,"num_read_kb":187,"num_write":280,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'394","reported_seq":1897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.447509+0000","last_change":"2024-09-05T02:16:37.447326+0000","last_active":"2024-09-05T02:16:37.447509+0000","last_peered":"2024-09-05T02:16:37.447509+0000","last_clean":"2024-09-05T02:16:37.447509+0000","last_became_active":"2024-09-05T00:49:29.913305+0000","last_became_peered":"2024-09-05T00:49:29.913305+0000","last_unstale":"2024-09-05T02:16:37.447509+0000","last_undegraded":"2024-09-05T02:16:37.447509+0000","last_fullsized":"2024-09-05T02:16:37.447509+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'394","last_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_deep_scrub":"264'394","last_deep_scrub_stamp":"2024-09-05T02:16:37.447142+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.447142+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:57.480162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2077,"num_read_kb":1978,"num_write":431,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'323","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.517777+0000","last_change":"2024-09-05T02:16:29.517777+0000","last_active":"2024-09-05T02:16:29.517777+0000","last_peered":"2024-09-05T02:16:29.517777+0000","last_clean":"2024-09-05T02:16:29.517777+0000","last_became_active":"2024-09-05T00:49:27.874372+0000","last_became_peered":"2024-09-05T00:49:27.874372+0000","last_unstale":"2024-09-05T02:16:29.517777+0000","last_undegraded":"2024-09-05T02:16:29.517777+0000","last_fullsized":"2024-09-05T02:16:29.517777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-05T02:16:29.517556+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.517556+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:02:11.732840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":32430,"num_write":1082,"num_write_kb":19783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.602738+0000","last_change":"2024-09-05T02:16:50.602492+0000","last_active":"2024-09-05T02:16:50.602738+0000","last_peered":"2024-09-05T02:16:50.602738+0000","last_clean":"2024-09-05T02:16:50.602738+0000","last_became_active":"2024-09-05T00:49:31.920776+0000","last_became_peered":"2024-09-05T00:49:31.920776+0000","last_unstale":"2024-09-05T02:16:50.602738+0000","last_undegraded":"2024-09-05T02:16:50.602738+0000","last_fullsized":"2024-09-05T02:16:50.602738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:50.602255+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.602255+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:23.593095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'120","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.113741+0000","last_change":"2024-09-05T02:16:53.113589+0000","last_active":"2024-09-05T02:16:53.113741+0000","last_peered":"2024-09-05T02:16:53.113741+0000","last_clean":"2024-09-05T02:16:53.113741+0000","last_became_active":"2024-09-05T00:49:34.053501+0000","last_became_peered":"2024-09-05T00:49:34.053501+0000","last_unstale":"2024-09-05T02:16:53.113741+0000","last_undegraded":"2024-09-05T02:16:53.113741+0000","last_fullsized":"2024-09-05T02:16:53.113741+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-09-05T02:16:53.113378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.113378+0000","objects_scrubbed":5,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:32.124763+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":132,"num_write":94,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'771","reported_seq":2817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.889501+0000","last_change":"2024-09-05T02:16:48.889325+0000","last_active":"2024-09-05T02:16:48.889501+0000","last_peered":"2024-09-05T02:16:48.889501+0000","last_clean":"2024-09-05T02:16:48.889501+0000","last_became_active":"2024-09-05T00:49:35.926356+0000","last_became_peered":"2024-09-05T00:49:35.926356+0000","last_unstale":"2024-09-05T02:16:48.889501+0000","last_undegraded":"2024-09-05T02:16:48.889501+0000","last_fullsized":"2024-09-05T02:16:48.889501+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:48.889140+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.889140+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:21:40.831468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'112","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.527512+0000","last_change":"2024-09-05T02:17:00.527328+0000","last_active":"2024-09-05T02:17:00.527512+0000","last_peered":"2024-09-05T02:17:00.527512+0000","last_clean":"2024-09-05T02:17:00.527512+0000","last_became_active":"2024-09-05T00:49:37.927124+0000","last_became_peered":"2024-09-05T00:49:37.927124+0000","last_unstale":"2024-09-05T02:17:00.527512+0000","last_undegraded":"2024-09-05T02:17:00.527512+0000","last_fullsized":"2024-09-05T02:17:00.527512+0000","mapping_epoch":33,"log_start":"264'101","ondisk_log_start":"264'101","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-05T02:17:00.527142+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.527142+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:06.769067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":122,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'1291","reported_seq":3056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.245104+0000","last_change":"2024-09-05T02:16:39.244971+0000","last_active":"2024-09-05T02:16:39.245104+0000","last_peered":"2024-09-05T02:16:39.245104+0000","last_clean":"2024-09-05T02:16:39.245104+0000","last_became_active":"2024-09-05T00:49:29.919555+0000","last_became_peered":"2024-09-05T00:49:29.919555+0000","last_unstale":"2024-09-05T02:16:39.245104+0000","last_undegraded":"2024-09-05T02:16:39.245104+0000","last_fullsized":"2024-09-05T02:16:39.245104+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1291","last_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_deep_scrub":"264'1291","last_deep_scrub_stamp":"2024-09-05T02:16:39.244780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.244780+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":1200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:31:47.585141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5952,"num_read_kb":5260,"num_write":1791,"num_write_kb":763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'361","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.900274+0000","last_change":"2024-09-05T02:16:29.900274+0000","last_active":"2024-09-05T02:16:29.900274+0000","last_peered":"2024-09-05T02:16:29.900274+0000","last_clean":"2024-09-05T02:16:29.900274+0000","last_became_active":"2024-09-05T00:49:27.884157+0000","last_became_peered":"2024-09-05T00:49:27.884157+0000","last_unstale":"2024-09-05T02:16:29.900274+0000","last_undegraded":"2024-09-05T02:16:29.900274+0000","last_fullsized":"2024-09-05T02:16:29.900274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'361","last_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_deep_scrub":"264'361","last_deep_scrub_stamp":"2024-09-05T02:16:29.900193+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.900193+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:55:20.281068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262231,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":2332,"num_write":1185,"num_write_kb":17887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.482427+0000","last_change":"2024-09-05T02:16:50.482268+0000","last_active":"2024-09-05T02:16:50.482427+0000","last_peered":"2024-09-05T02:16:50.482427+0000","last_clean":"2024-09-05T02:16:50.482427+0000","last_became_active":"2024-09-05T00:49:31.916084+0000","last_became_peered":"2024-09-05T00:49:31.916084+0000","last_unstale":"2024-09-05T02:16:50.482427+0000","last_undegraded":"2024-09-05T02:16:50.482427+0000","last_fullsized":"2024-09-05T02:16:50.482427+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.482092+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.482092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:18.769975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'462","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.581196+0000","last_change":"2024-09-05T02:16:55.580931+0000","last_active":"2024-09-05T02:16:55.581196+0000","last_peered":"2024-09-05T02:16:55.581196+0000","last_clean":"2024-09-05T02:16:55.581196+0000","last_became_active":"2024-09-05T00:49:33.910101+0000","last_became_peered":"2024-09-05T00:49:33.910101+0000","last_unstale":"2024-09-05T02:16:55.581196+0000","last_undegraded":"2024-09-05T02:16:55.581196+0000","last_fullsized":"2024-09-05T02:16:55.581196+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'462","last_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_deep_scrub":"264'462","last_deep_scrub_stamp":"2024-09-05T02:16:55.580686+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.580686+0000","objects_scrubbed":9,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:56:43.482301+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49653,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1315,"num_read_kb":1876,"num_write":1876,"num_write_kb":1687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.932227+0000","last_change":"2024-09-05T02:16:45.932041+0000","last_active":"2024-09-05T02:16:45.932227+0000","last_peered":"2024-09-05T02:16:45.932227+0000","last_clean":"2024-09-05T02:16:45.932227+0000","last_became_active":"2024-09-05T00:49:35.932539+0000","last_became_peered":"2024-09-05T00:49:35.932539+0000","last_unstale":"2024-09-05T02:16:45.932227+0000","last_undegraded":"2024-09-05T02:16:45.932227+0000","last_fullsized":"2024-09-05T02:16:45.932227+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.931862+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.931862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:22.195208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'154","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.274802+0000","last_change":"2024-09-05T02:16:58.274647+0000","last_active":"2024-09-05T02:16:58.274802+0000","last_peered":"2024-09-05T02:16:58.274802+0000","last_clean":"2024-09-05T02:16:58.274802+0000","last_became_active":"2024-09-05T00:49:37.944489+0000","last_became_peered":"2024-09-05T00:49:37.944489+0000","last_unstale":"2024-09-05T02:16:58.274802+0000","last_undegraded":"2024-09-05T02:16:58.274802+0000","last_fullsized":"2024-09-05T02:16:58.274802+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-05T02:16:58.274456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.274456+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:38:59.540758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":148,"num_write":375,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'895","reported_seq":2578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.837218+0000","last_change":"2024-09-05T02:16:37.837031+0000","last_active":"2024-09-05T02:16:37.837218+0000","last_peered":"2024-09-05T02:16:37.837218+0000","last_clean":"2024-09-05T02:16:37.837218+0000","last_became_active":"2024-09-05T00:49:29.899320+0000","last_became_peered":"2024-09-05T00:49:29.899320+0000","last_unstale":"2024-09-05T02:16:37.837218+0000","last_undegraded":"2024-09-05T02:16:37.837218+0000","last_fullsized":"2024-09-05T02:16:37.837218+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'895","last_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_deep_scrub":"264'895","last_deep_scrub_stamp":"2024-09-05T02:16:37.836840+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.836840+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":800,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:40:26.109909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4232,"num_read_kb":3808,"num_write":1202,"num_write_kb":445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1433,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.175866+0000","last_change":"2024-09-05T02:16:30.175725+0000","last_active":"2024-09-05T02:16:30.175866+0000","last_peered":"2024-09-05T02:16:30.175866+0000","last_clean":"2024-09-05T02:16:30.175866+0000","last_became_active":"2024-09-05T00:49:12.753112+0000","last_became_peered":"2024-09-05T00:49:12.753112+0000","last_unstale":"2024-09-05T02:16:30.175866+0000","last_undegraded":"2024-09-05T02:16:30.175866+0000","last_fullsized":"2024-09-05T02:16:30.175866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-05T02:16:30.175528+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.175528+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:42:10.298718+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.463168+0000","last_change":"2024-09-05T02:16:30.462900+0000","last_active":"2024-09-05T02:16:30.463168+0000","last_peered":"2024-09-05T02:16:30.463168+0000","last_clean":"2024-09-05T02:16:30.463168+0000","last_became_active":"2024-09-05T00:49:17.798855+0000","last_became_peered":"2024-09-05T00:49:17.798855+0000","last_unstale":"2024-09-05T02:16:30.463168+0000","last_undegraded":"2024-09-05T02:16:30.463168+0000","last_fullsized":"2024-09-05T02:16:30.463168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:30.462683+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.462683+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:37:50.227113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012273309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'307","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.764681+0000","last_change":"2024-09-05T02:16:27.764633+0000","last_active":"2024-09-05T02:16:27.764681+0000","last_peered":"2024-09-05T02:16:27.764681+0000","last_clean":"2024-09-05T02:16:27.764681+0000","last_became_active":"2024-09-05T00:50:04.178456+0000","last_became_peered":"2024-09-05T00:50:04.178456+0000","last_unstale":"2024-09-05T02:16:27.764681+0000","last_undegraded":"2024-09-05T02:16:27.764681+0000","last_fullsized":"2024-09-05T02:16:27.764681+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'307","last_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_deep_scrub":"264'307","last_deep_scrub_stamp":"2024-09-05T02:16:27.764568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.764568+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:23:59.844822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306176,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":457,"num_read_kb":14472,"num_write":870,"num_write_kb":15529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.976545+0000","last_change":"2024-09-05T02:16:50.976318+0000","last_active":"2024-09-05T02:16:50.976545+0000","last_peered":"2024-09-05T02:16:50.976545+0000","last_clean":"2024-09-05T02:16:50.976545+0000","last_became_active":"2024-09-05T00:49:31.912435+0000","last_became_peered":"2024-09-05T00:49:31.912435+0000","last_unstale":"2024-09-05T02:16:50.976545+0000","last_undegraded":"2024-09-05T02:16:50.976545+0000","last_fullsized":"2024-09-05T02:16:50.976545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:50.976113+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.976113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:48:12.941027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'794","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.533155+0000","last_change":"2024-09-05T02:16:56.533155+0000","last_active":"2024-09-05T02:16:56.533155+0000","last_peered":"2024-09-05T02:16:56.533155+0000","last_clean":"2024-09-05T02:16:56.533155+0000","last_became_active":"2024-09-05T00:49:33.921086+0000","last_became_peered":"2024-09-05T00:49:33.921086+0000","last_unstale":"2024-09-05T02:16:56.533155+0000","last_undegraded":"2024-09-05T02:16:56.533155+0000","last_fullsized":"2024-09-05T02:16:56.533155+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'794","last_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_deep_scrub":"264'794","last_deep_scrub_stamp":"2024-09-05T02:16:56.532937+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.532937+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:57:46.840785+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157356,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1541,"num_read_kb":3609,"num_write":1452,"num_write_kb":1277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89058,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.222761+0000","last_change":"2024-09-05T02:16:56.222761+0000","last_active":"2024-09-05T02:16:56.222761+0000","last_peered":"2024-09-05T02:16:56.222761+0000","last_clean":"2024-09-05T02:16:56.222761+0000","last_became_active":"2024-09-05T00:49:35.942440+0000","last_became_peered":"2024-09-05T00:49:35.942440+0000","last_unstale":"2024-09-05T02:16:56.222761+0000","last_undegraded":"2024-09-05T02:16:56.222761+0000","last_fullsized":"2024-09-05T02:16:56.222761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.222553+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.222553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:59.389821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'203","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.947987+0000","last_change":"2024-09-05T02:16:52.947987+0000","last_active":"2024-09-05T02:16:52.947987+0000","last_peered":"2024-09-05T02:16:52.947987+0000","last_clean":"2024-09-05T02:16:52.947987+0000","last_became_active":"2024-09-05T00:49:37.941712+0000","last_became_peered":"2024-09-05T00:49:37.941712+0000","last_unstale":"2024-09-05T02:16:52.947987+0000","last_undegraded":"2024-09-05T02:16:52.947987+0000","last_fullsized":"2024-09-05T02:16:52.947987+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-05T02:16:52.947749+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.947749+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:26:13.134156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":429,"num_read_kb":427,"num_write":439,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'785","reported_seq":2290,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.420146+0000","last_change":"2024-09-05T02:16:35.420146+0000","last_active":"2024-09-05T02:16:35.420146+0000","last_peered":"2024-09-05T02:16:35.420146+0000","last_clean":"2024-09-05T02:16:35.420146+0000","last_became_active":"2024-09-05T00:49:29.920876+0000","last_became_peered":"2024-09-05T00:49:29.920876+0000","last_unstale":"2024-09-05T02:16:35.420146+0000","last_undegraded":"2024-09-05T02:16:35.420146+0000","last_fullsized":"2024-09-05T02:16:35.420146+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'785","last_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_deep_scrub":"264'785","last_deep_scrub_stamp":"2024-09-05T02:16:35.419887+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.419887+0000","objects_scrubbed":3,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:06.326976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3751,"num_read_kb":3387,"num_write":1020,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":544,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.122938+0000","last_change":"2024-09-05T02:16:32.122749+0000","last_active":"2024-09-05T02:16:32.122938+0000","last_peered":"2024-09-05T02:16:32.122938+0000","last_clean":"2024-09-05T02:16:32.122938+0000","last_became_active":"2024-09-05T00:49:17.800112+0000","last_became_peered":"2024-09-05T00:49:17.800112+0000","last_unstale":"2024-09-05T02:16:32.122938+0000","last_undegraded":"2024-09-05T02:16:32.122938+0000","last_fullsized":"2024-09-05T02:16:32.122938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:32.122554+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.122554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:57:52.851366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012489179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'314","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:26.509714+0000","last_change":"2024-09-05T02:16:26.509558+0000","last_active":"2024-09-05T02:16:26.509714+0000","last_peered":"2024-09-05T02:16:26.509714+0000","last_clean":"2024-09-05T02:16:26.509714+0000","last_became_active":"2024-09-05T00:49:27.871404+0000","last_became_peered":"2024-09-05T00:49:27.871404+0000","last_unstale":"2024-09-05T02:16:26.509714+0000","last_undegraded":"2024-09-05T02:16:26.509714+0000","last_fullsized":"2024-09-05T02:16:26.509714+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-09-05T02:16:26.509242+0000","last_clean_scrub_stamp":"2024-09-05T02:16:26.509242+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:54:07.832980+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079945,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":417,"num_read_kb":5706,"num_write":1068,"num_write_kb":42738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.588668+0000","last_change":"2024-09-05T02:16:49.588668+0000","last_active":"2024-09-05T02:16:49.588668+0000","last_peered":"2024-09-05T02:16:49.588668+0000","last_clean":"2024-09-05T02:16:49.588668+0000","last_became_active":"2024-09-05T00:49:31.907658+0000","last_became_peered":"2024-09-05T00:49:31.907658+0000","last_unstale":"2024-09-05T02:16:49.588668+0000","last_undegraded":"2024-09-05T02:16:49.588668+0000","last_fullsized":"2024-09-05T02:16:49.588668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.588378+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.588378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:21:16.006275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1382","reported_seq":3406,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.209063+0000","last_change":"2024-09-05T02:16:46.208830+0000","last_active":"2024-09-05T02:16:46.209063+0000","last_peered":"2024-09-05T02:16:46.209063+0000","last_clean":"2024-09-05T02:16:46.209063+0000","last_became_active":"2024-09-05T00:49:33.924613+0000","last_became_peered":"2024-09-05T00:49:33.924613+0000","last_unstale":"2024-09-05T02:16:46.209063+0000","last_undegraded":"2024-09-05T02:16:46.209063+0000","last_fullsized":"2024-09-05T02:16:46.209063+0000","mapping_epoch":29,"log_start":"264'1300","ondisk_log_start":"264'1300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1382","last_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_deep_scrub":"264'1382","last_deep_scrub_stamp":"2024-09-05T02:16:46.208570+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.208570+0000","objects_scrubbed":12,"log_size":82,"log_dups_size":1300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:27:04.028834+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141816,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2121,"num_read_kb":3935,"num_write":1230,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.826223+0000","last_change":"2024-09-05T02:16:58.825989+0000","last_active":"2024-09-05T02:16:58.826223+0000","last_peered":"2024-09-05T02:16:58.826223+0000","last_clean":"2024-09-05T02:16:58.826223+0000","last_became_active":"2024-09-05T00:49:35.937597+0000","last_became_peered":"2024-09-05T00:49:35.937597+0000","last_unstale":"2024-09-05T02:16:58.826223+0000","last_undegraded":"2024-09-05T02:16:58.826223+0000","last_fullsized":"2024-09-05T02:16:58.826223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.825724+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.825724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.747695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'252","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.159330+0000","last_change":"2024-09-05T02:16:52.159330+0000","last_active":"2024-09-05T02:16:52.159330+0000","last_peered":"2024-09-05T02:16:52.159330+0000","last_clean":"2024-09-05T02:16:52.159330+0000","last_became_active":"2024-09-05T00:49:37.938304+0000","last_became_peered":"2024-09-05T00:49:37.938304+0000","last_unstale":"2024-09-05T02:16:52.159330+0000","last_undegraded":"2024-09-05T02:16:52.159330+0000","last_fullsized":"2024-09-05T02:16:52.159330+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-09-05T02:16:52.159103+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.159103+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:01:00.496206+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":399,"num_write":461,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'413","reported_seq":1919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.210253+0000","last_change":"2024-09-05T02:16:40.210253+0000","last_active":"2024-09-05T02:16:40.210253+0000","last_peered":"2024-09-05T02:16:40.210253+0000","last_clean":"2024-09-05T02:16:40.210253+0000","last_became_active":"2024-09-05T00:49:29.899919+0000","last_became_peered":"2024-09-05T00:49:29.899919+0000","last_unstale":"2024-09-05T02:16:40.210253+0000","last_undegraded":"2024-09-05T02:16:40.210253+0000","last_fullsized":"2024-09-05T02:16:40.210253+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:40.210048+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.210048+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:47:40.273557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2172,"num_read_kb":2051,"num_write":467,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":912,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":546,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.788046+0000","last_change":"2024-09-05T02:16:28.787900+0000","last_active":"2024-09-05T02:16:28.788046+0000","last_peered":"2024-09-05T02:16:28.788046+0000","last_clean":"2024-09-05T02:16:28.788046+0000","last_became_active":"2024-09-05T00:49:17.986685+0000","last_became_peered":"2024-09-05T00:49:17.986685+0000","last_unstale":"2024-09-05T02:16:28.788046+0000","last_undegraded":"2024-09-05T02:16:28.788046+0000","last_fullsized":"2024-09-05T02:16:28.788046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.787731+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.787731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:26:43.122051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00129003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'335","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.326103+0000","last_change":"2024-09-05T02:16:29.326044+0000","last_active":"2024-09-05T02:16:29.326103+0000","last_peered":"2024-09-05T02:16:29.326103+0000","last_clean":"2024-09-05T02:16:29.326103+0000","last_became_active":"2024-09-05T00:49:27.882777+0000","last_became_peered":"2024-09-05T00:49:27.882777+0000","last_unstale":"2024-09-05T02:16:29.326103+0000","last_undegraded":"2024-09-05T02:16:29.326103+0000","last_fullsized":"2024-09-05T02:16:29.326103+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-05T02:16:29.325952+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.325952+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:55.516960+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":23361,"num_write":910,"num_write_kb":28883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.842874+0000","last_change":"2024-09-05T02:16:39.842874+0000","last_active":"2024-09-05T02:16:39.842874+0000","last_peered":"2024-09-05T02:16:39.842874+0000","last_clean":"2024-09-05T02:16:39.842874+0000","last_became_active":"2024-09-05T00:49:31.894542+0000","last_became_peered":"2024-09-05T00:49:31.894542+0000","last_unstale":"2024-09-05T02:16:39.842874+0000","last_undegraded":"2024-09-05T02:16:39.842874+0000","last_fullsized":"2024-09-05T02:16:39.842874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:39.842690+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.842690+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:16:19.549189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'355","reported_seq":1964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.918359+0000","last_change":"2024-09-05T02:16:53.918210+0000","last_active":"2024-09-05T02:16:53.918359+0000","last_peered":"2024-09-05T02:16:53.918359+0000","last_clean":"2024-09-05T02:16:53.918359+0000","last_became_active":"2024-09-05T00:49:34.053475+0000","last_became_peered":"2024-09-05T00:49:34.053475+0000","last_unstale":"2024-09-05T02:16:53.918359+0000","last_undegraded":"2024-09-05T02:16:53.918359+0000","last_fullsized":"2024-09-05T02:16:53.918359+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-05T02:16:53.917978+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.917978+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:01:50.088462+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":299,"num_read_kb":288,"num_write":287,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.287896+0000","last_change":"2024-09-05T02:16:43.287761+0000","last_active":"2024-09-05T02:16:43.287896+0000","last_peered":"2024-09-05T02:16:43.287896+0000","last_clean":"2024-09-05T02:16:43.287896+0000","last_became_active":"2024-09-05T00:49:35.925599+0000","last_became_peered":"2024-09-05T00:49:35.925599+0000","last_unstale":"2024-09-05T02:16:43.287896+0000","last_undegraded":"2024-09-05T02:16:43.287896+0000","last_fullsized":"2024-09-05T02:16:43.287896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.287581+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.287581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:54:02.058137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'245","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.257968+0000","last_change":"2024-09-05T02:17:04.257720+0000","last_active":"2024-09-05T02:17:04.257968+0000","last_peered":"2024-09-05T02:17:04.257968+0000","last_clean":"2024-09-05T02:17:04.257968+0000","last_became_active":"2024-09-05T00:49:37.950200+0000","last_became_peered":"2024-09-05T00:49:37.950200+0000","last_unstale":"2024-09-05T02:17:04.257968+0000","last_undegraded":"2024-09-05T02:17:04.257968+0000","last_fullsized":"2024-09-05T02:17:04.257968+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'245","last_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_deep_scrub":"264'245","last_deep_scrub_stamp":"2024-09-05T02:17:04.257502+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.257502+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:51:50.338750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":549,"num_write":543,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'1278","reported_seq":2936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.277311+0000","last_change":"2024-09-05T02:16:36.277149+0000","last_active":"2024-09-05T02:16:36.277311+0000","last_peered":"2024-09-05T02:16:36.277311+0000","last_clean":"2024-09-05T02:16:36.277311+0000","last_became_active":"2024-09-05T00:49:29.901776+0000","last_became_peered":"2024-09-05T00:49:29.901776+0000","last_unstale":"2024-09-05T02:16:36.277311+0000","last_undegraded":"2024-09-05T02:16:36.277311+0000","last_fullsized":"2024-09-05T02:16:36.277311+0000","mapping_epoch":25,"log_start":"264'1200","ondisk_log_start":"264'1200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1278","last_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_deep_scrub":"264'1278","last_deep_scrub_stamp":"2024-09-05T02:16:36.276963+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.276963+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":1200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:21:10.284570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5760,"num_read_kb":5039,"num_write":1749,"num_write_kb":744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1616,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":545,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.467029+0000","last_change":"2024-09-05T02:16:29.466902+0000","last_active":"2024-09-05T02:16:29.467029+0000","last_peered":"2024-09-05T02:16:29.467029+0000","last_clean":"2024-09-05T02:16:29.467029+0000","last_became_active":"2024-09-05T00:49:17.798783+0000","last_became_peered":"2024-09-05T00:49:17.798783+0000","last_unstale":"2024-09-05T02:16:29.467029+0000","last_undegraded":"2024-09-05T02:16:29.467029+0000","last_fullsized":"2024-09-05T02:16:29.467029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-05T02:16:29.466718+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.466718+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:17.729741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020560209999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'367","reported_seq":1053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.515860+0000","last_change":"2024-09-05T02:16:31.515719+0000","last_active":"2024-09-05T02:16:31.515860+0000","last_peered":"2024-09-05T02:16:31.515860+0000","last_clean":"2024-09-05T02:16:31.515860+0000","last_became_active":"2024-09-05T00:49:27.897706+0000","last_became_peered":"2024-09-05T00:49:27.897706+0000","last_unstale":"2024-09-05T02:16:31.515860+0000","last_undegraded":"2024-09-05T02:16:31.515860+0000","last_fullsized":"2024-09-05T02:16:31.515860+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-09-05T02:16:31.515456+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.515456+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:25:12.133378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":553,"num_read_kb":46632,"num_write":1174,"num_write_kb":38586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.271988+0000","last_change":"2024-09-05T02:16:46.271828+0000","last_active":"2024-09-05T02:16:46.271988+0000","last_peered":"2024-09-05T02:16:46.271988+0000","last_clean":"2024-09-05T02:16:46.271988+0000","last_became_active":"2024-09-05T00:49:31.910033+0000","last_became_peered":"2024-09-05T00:49:31.910033+0000","last_unstale":"2024-09-05T02:16:46.271988+0000","last_undegraded":"2024-09-05T02:16:46.271988+0000","last_fullsized":"2024-09-05T02:16:46.271988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.271644+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.271644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:10:40.777056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'171","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.128445+0000","last_change":"2024-09-05T02:16:51.128445+0000","last_active":"2024-09-05T02:16:51.128445+0000","last_peered":"2024-09-05T02:16:51.128445+0000","last_clean":"2024-09-05T02:16:51.128445+0000","last_became_active":"2024-09-05T00:49:33.928709+0000","last_became_peered":"2024-09-05T00:49:33.928709+0000","last_unstale":"2024-09-05T02:16:51.128445+0000","last_undegraded":"2024-09-05T02:16:51.128445+0000","last_fullsized":"2024-09-05T02:16:51.128445+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:16:51.128239+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.128239+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:41:54.774325+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":156,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.884813+0000","last_change":"2024-09-05T02:16:46.884813+0000","last_active":"2024-09-05T02:16:46.884813+0000","last_peered":"2024-09-05T02:16:46.884813+0000","last_clean":"2024-09-05T02:16:46.884813+0000","last_became_active":"2024-09-05T00:49:35.947203+0000","last_became_peered":"2024-09-05T00:49:35.947203+0000","last_unstale":"2024-09-05T02:16:46.884813+0000","last_undegraded":"2024-09-05T02:16:46.884813+0000","last_fullsized":"2024-09-05T02:16:46.884813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:46.884632+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.884632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:28:31.243635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'118","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.562825+0000","last_change":"2024-09-05T02:17:06.562825+0000","last_active":"2024-09-05T02:17:06.562825+0000","last_peered":"2024-09-05T02:17:06.562825+0000","last_clean":"2024-09-05T02:17:06.562825+0000","last_became_active":"2024-09-05T00:49:37.953547+0000","last_became_peered":"2024-09-05T00:49:37.953547+0000","last_unstale":"2024-09-05T02:17:06.562825+0000","last_undegraded":"2024-09-05T02:17:06.562825+0000","last_fullsized":"2024-09-05T02:17:06.562825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'118","last_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_deep_scrub":"264'118","last_deep_scrub_stamp":"2024-09-05T02:17:06.562629+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.562629+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:51.442782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":276,"num_read_kb":254,"num_write":281,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'542","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.258808+0000","last_change":"2024-09-05T02:16:35.258563+0000","last_active":"2024-09-05T02:16:35.258808+0000","last_peered":"2024-09-05T02:16:35.258808+0000","last_clean":"2024-09-05T02:16:35.258808+0000","last_became_active":"2024-09-05T00:49:29.907028+0000","last_became_peered":"2024-09-05T00:49:29.907028+0000","last_unstale":"2024-09-05T02:16:35.258808+0000","last_undegraded":"2024-09-05T02:16:35.258808+0000","last_fullsized":"2024-09-05T02:16:35.258808+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'542","last_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_deep_scrub":"264'542","last_deep_scrub_stamp":"2024-09-05T02:16:35.258316+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.258316+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:30.208156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2800,"num_read_kb":2585,"num_write":684,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'306","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.502568+0000","last_change":"2024-09-05T02:16:31.502349+0000","last_active":"2024-09-05T02:16:31.502568+0000","last_peered":"2024-09-05T02:16:31.502568+0000","last_clean":"2024-09-05T02:16:31.502568+0000","last_became_active":"2024-09-05T00:49:27.887968+0000","last_became_peered":"2024-09-05T00:49:27.887968+0000","last_unstale":"2024-09-05T02:16:31.502568+0000","last_undegraded":"2024-09-05T02:16:31.502568+0000","last_fullsized":"2024-09-05T02:16:31.502568+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-05T02:16:31.502116+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.502116+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:28.057536+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2908084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":564,"num_read_kb":39042,"num_write":920,"num_write_kb":15460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":552,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.404422+0000","last_change":"2024-09-05T02:16:27.404366+0000","last_active":"2024-09-05T02:16:27.404422+0000","last_peered":"2024-09-05T02:16:27.404422+0000","last_clean":"2024-09-05T02:16:27.404422+0000","last_became_active":"2024-09-05T00:49:17.981569+0000","last_became_peered":"2024-09-05T00:49:17.981569+0000","last_unstale":"2024-09-05T02:16:27.404422+0000","last_undegraded":"2024-09-05T02:16:27.404422+0000","last_fullsized":"2024-09-05T02:16:27.404422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:27.404292+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.404292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:45:52.441484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00117015,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.217437+0000","last_change":"2024-09-05T02:16:57.217285+0000","last_active":"2024-09-05T02:16:57.217437+0000","last_peered":"2024-09-05T02:16:57.217437+0000","last_clean":"2024-09-05T02:16:57.217437+0000","last_became_active":"2024-09-05T00:49:31.915367+0000","last_became_peered":"2024-09-05T00:49:31.915367+0000","last_unstale":"2024-09-05T02:16:57.217437+0000","last_undegraded":"2024-09-05T02:16:57.217437+0000","last_fullsized":"2024-09-05T02:16:57.217437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.217067+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.217067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:43:42.886187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'687","reported_seq":1413,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.284135+0000","last_change":"2024-09-05T02:16:47.284135+0000","last_active":"2024-09-05T02:16:47.284135+0000","last_peered":"2024-09-05T02:16:47.284135+0000","last_clean":"2024-09-05T02:16:47.284135+0000","last_became_active":"2024-09-05T00:49:33.927916+0000","last_became_peered":"2024-09-05T00:49:33.927916+0000","last_unstale":"2024-09-05T02:16:47.284135+0000","last_undegraded":"2024-09-05T02:16:47.284135+0000","last_fullsized":"2024-09-05T02:16:47.284135+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'687","last_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_deep_scrub":"264'687","last_deep_scrub_stamp":"2024-09-05T02:16:47.283917+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.283917+0000","objects_scrubbed":11,"log_size":87,"log_dups_size":600,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:34:28.307016+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113279,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1139,"num_read_kb":2483,"num_write":1010,"num_write_kb":799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.532489+0000","last_change":"2024-09-05T02:16:57.532254+0000","last_active":"2024-09-05T02:16:57.532489+0000","last_peered":"2024-09-05T02:16:57.532489+0000","last_clean":"2024-09-05T02:16:57.532489+0000","last_became_active":"2024-09-05T00:49:35.937441+0000","last_became_peered":"2024-09-05T00:49:35.937441+0000","last_unstale":"2024-09-05T02:16:57.532489+0000","last_undegraded":"2024-09-05T02:16:57.532489+0000","last_fullsized":"2024-09-05T02:16:57.532489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.531985+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.531985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:46:20.408235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'189","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:03.243460+0000","last_change":"2024-09-05T02:17:03.243320+0000","last_active":"2024-09-05T02:17:03.243460+0000","last_peered":"2024-09-05T02:17:03.243460+0000","last_clean":"2024-09-05T02:17:03.243460+0000","last_became_active":"2024-09-05T00:49:37.933020+0000","last_became_peered":"2024-09-05T00:49:37.933020+0000","last_unstale":"2024-09-05T02:17:03.243460+0000","last_undegraded":"2024-09-05T02:17:03.243460+0000","last_fullsized":"2024-09-05T02:17:03.243460+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-05T02:17:03.243122+0000","last_clean_scrub_stamp":"2024-09-05T02:17:03.243122+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:29:13.048015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":190,"num_write":474,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'886","reported_seq":2362,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.267735+0000","last_change":"2024-09-05T02:16:54.267603+0000","last_active":"2024-09-05T02:16:54.267735+0000","last_peered":"2024-09-05T02:16:54.267735+0000","last_clean":"2024-09-05T02:16:54.267735+0000","last_became_active":"2024-09-05T00:49:29.912466+0000","last_became_peered":"2024-09-05T00:49:29.912466+0000","last_unstale":"2024-09-05T02:16:54.267735+0000","last_undegraded":"2024-09-05T02:16:54.267735+0000","last_fullsized":"2024-09-05T02:16:54.267735+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'886","last_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_deep_scrub":"264'886","last_deep_scrub_stamp":"2024-09-05T02:16:54.267422+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.267422+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":800,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:10:42.442657+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4149,"num_read_kb":3652,"num_write":1245,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'324","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.373091+0000","last_change":"2024-09-05T02:16:30.372916+0000","last_active":"2024-09-05T02:16:30.373091+0000","last_peered":"2024-09-05T02:16:30.373091+0000","last_clean":"2024-09-05T02:16:30.373091+0000","last_became_active":"2024-09-05T00:49:27.879197+0000","last_became_peered":"2024-09-05T00:49:27.879197+0000","last_unstale":"2024-09-05T02:16:30.373091+0000","last_undegraded":"2024-09-05T02:16:30.373091+0000","last_fullsized":"2024-09-05T02:16:30.373091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.372709+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.372709+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:12:13.999885+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079890,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":526,"num_read_kb":37378,"num_write":1055,"num_write_kb":25212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.124745+0000","last_change":"2024-09-05T02:16:31.124622+0000","last_active":"2024-09-05T02:16:31.124745+0000","last_peered":"2024-09-05T02:16:31.124745+0000","last_clean":"2024-09-05T02:16:31.124745+0000","last_became_active":"2024-09-05T00:49:17.978900+0000","last_became_peered":"2024-09-05T00:49:17.978900+0000","last_unstale":"2024-09-05T02:16:31.124745+0000","last_undegraded":"2024-09-05T02:16:31.124745+0000","last_fullsized":"2024-09-05T02:16:31.124745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:31.124439+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.124439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:31.003902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001374583,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.885018+0000","last_change":"2024-09-05T02:16:43.884773+0000","last_active":"2024-09-05T02:16:43.885018+0000","last_peered":"2024-09-05T02:16:43.885018+0000","last_clean":"2024-09-05T02:16:43.885018+0000","last_became_active":"2024-09-05T00:49:31.912286+0000","last_became_peered":"2024-09-05T00:49:31.912286+0000","last_unstale":"2024-09-05T02:16:43.885018+0000","last_undegraded":"2024-09-05T02:16:43.885018+0000","last_fullsized":"2024-09-05T02:16:43.885018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:43.884568+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.884568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:16:44.961807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'212","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.198882+0000","last_change":"2024-09-05T02:16:47.198716+0000","last_active":"2024-09-05T02:16:47.198882+0000","last_peered":"2024-09-05T02:16:47.198882+0000","last_clean":"2024-09-05T02:16:47.198882+0000","last_became_active":"2024-09-05T00:49:34.053466+0000","last_became_peered":"2024-09-05T00:49:34.053466+0000","last_unstale":"2024-09-05T02:16:47.198882+0000","last_undegraded":"2024-09-05T02:16:47.198882+0000","last_fullsized":"2024-09-05T02:16:47.198882+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'212","last_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_deep_scrub":"264'212","last_deep_scrub_stamp":"2024-09-05T02:16:47.198502+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.198502+0000","objects_scrubbed":8,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:34.874131+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":286,"num_read_kb":278,"num_write":188,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'798","reported_seq":3287,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.552427+0000","last_change":"2024-09-05T02:16:57.552427+0000","last_active":"2024-09-05T02:16:57.552427+0000","last_peered":"2024-09-05T02:16:57.552427+0000","last_clean":"2024-09-05T02:16:57.552427+0000","last_became_active":"2024-09-05T00:49:35.932929+0000","last_became_peered":"2024-09-05T00:49:35.932929+0000","last_unstale":"2024-09-05T02:16:57.552427+0000","last_undegraded":"2024-09-05T02:16:57.552427+0000","last_fullsized":"2024-09-05T02:16:57.552427+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'798","last_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_deep_scrub":"264'798","last_deep_scrub_stamp":"2024-09-05T02:16:57.552252+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.552252+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:00.995961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'149","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:06.239554+0000","last_change":"2024-09-05T02:17:06.239397+0000","last_active":"2024-09-05T02:17:06.239554+0000","last_peered":"2024-09-05T02:17:06.239554+0000","last_clean":"2024-09-05T02:17:06.239554+0000","last_became_active":"2024-09-05T00:49:37.948024+0000","last_became_peered":"2024-09-05T00:49:37.948024+0000","last_unstale":"2024-09-05T02:17:06.239554+0000","last_undegraded":"2024-09-05T02:17:06.239554+0000","last_fullsized":"2024-09-05T02:17:06.239554+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'149","last_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_deep_scrub":"264'149","last_deep_scrub_stamp":"2024-09-05T02:17:06.239206+0000","last_clean_scrub_stamp":"2024-09-05T02:17:06.239206+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:58:46.358129+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":193,"num_write":380,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'964","reported_seq":2560,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.072318+0000","last_change":"2024-09-05T02:16:45.072318+0000","last_active":"2024-09-05T02:16:45.072318+0000","last_peered":"2024-09-05T02:16:45.072318+0000","last_clean":"2024-09-05T02:16:45.072318+0000","last_became_active":"2024-09-05T00:49:29.927347+0000","last_became_peered":"2024-09-05T00:49:29.927347+0000","last_unstale":"2024-09-05T02:16:45.072318+0000","last_undegraded":"2024-09-05T02:16:45.072318+0000","last_fullsized":"2024-09-05T02:16:45.072318+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'964","last_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_deep_scrub":"264'964","last_deep_scrub_stamp":"2024-09-05T02:16:45.072096+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.072096+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":900,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:26:16.793459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4687,"num_read_kb":4171,"num_write":1325,"num_write_kb":528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'419","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.916620+0000","last_change":"2024-09-05T02:16:28.916620+0000","last_active":"2024-09-05T02:16:28.916620+0000","last_peered":"2024-09-05T02:16:28.916620+0000","last_clean":"2024-09-05T02:16:28.916620+0000","last_became_active":"2024-09-05T00:49:27.909634+0000","last_became_peered":"2024-09-05T00:49:27.909634+0000","last_unstale":"2024-09-05T02:16:28.916620+0000","last_undegraded":"2024-09-05T02:16:28.916620+0000","last_fullsized":"2024-09-05T02:16:28.916620+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'419","last_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_deep_scrub":"264'419","last_deep_scrub_stamp":"2024-09-05T02:16:28.916405+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.916405+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:38.195772+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":754,"num_read_kb":36692,"num_write":1433,"num_write_kb":20390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.366495+0000","last_change":"2024-09-05T02:16:28.366495+0000","last_active":"2024-09-05T02:16:28.366495+0000","last_peered":"2024-09-05T02:16:28.366495+0000","last_clean":"2024-09-05T02:16:28.366495+0000","last_became_active":"2024-09-05T00:49:17.801330+0000","last_became_peered":"2024-09-05T00:49:17.801330+0000","last_unstale":"2024-09-05T02:16:28.366495+0000","last_undegraded":"2024-09-05T02:16:28.366495+0000","last_fullsized":"2024-09-05T02:16:28.366495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:28.366407+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.366407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:29:33.144478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001286693,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.448189+0000","last_change":"2024-09-05T02:16:48.448071+0000","last_active":"2024-09-05T02:16:48.448189+0000","last_peered":"2024-09-05T02:16:48.448189+0000","last_clean":"2024-09-05T02:16:48.448189+0000","last_became_active":"2024-09-05T00:49:31.915225+0000","last_became_peered":"2024-09-05T00:49:31.915225+0000","last_unstale":"2024-09-05T02:16:48.448189+0000","last_undegraded":"2024-09-05T02:16:48.448189+0000","last_fullsized":"2024-09-05T02:16:48.448189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.447892+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.447892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:42:23.569052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'162","reported_seq":747,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.478714+0000","last_change":"2024-09-05T02:16:53.478566+0000","last_active":"2024-09-05T02:16:53.478714+0000","last_peered":"2024-09-05T02:16:53.478714+0000","last_clean":"2024-09-05T02:16:53.478714+0000","last_became_active":"2024-09-05T00:49:33.918761+0000","last_became_peered":"2024-09-05T00:49:33.918761+0000","last_unstale":"2024-09-05T02:16:53.478714+0000","last_undegraded":"2024-09-05T02:16:53.478714+0000","last_fullsized":"2024-09-05T02:16:53.478714+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-05T02:16:53.478364+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.478364+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:22.605913+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'803","reported_seq":2798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.133922+0000","last_change":"2024-09-05T02:16:58.133765+0000","last_active":"2024-09-05T02:16:58.133922+0000","last_peered":"2024-09-05T02:16:58.133922+0000","last_clean":"2024-09-05T02:16:58.133922+0000","last_became_active":"2024-09-05T00:49:35.937283+0000","last_became_peered":"2024-09-05T00:49:35.937283+0000","last_unstale":"2024-09-05T02:16:58.133922+0000","last_undegraded":"2024-09-05T02:16:58.133922+0000","last_fullsized":"2024-09-05T02:16:58.133922+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'803","last_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_deep_scrub":"264'803","last_deep_scrub_stamp":"2024-09-05T02:16:58.133593+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.133593+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:25.865655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'177","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.235324+0000","last_change":"2024-09-05T02:16:53.235179+0000","last_active":"2024-09-05T02:16:53.235324+0000","last_peered":"2024-09-05T02:16:53.235324+0000","last_clean":"2024-09-05T02:16:53.235324+0000","last_became_active":"2024-09-05T00:49:37.953698+0000","last_became_peered":"2024-09-05T00:49:37.953698+0000","last_unstale":"2024-09-05T02:16:53.235324+0000","last_undegraded":"2024-09-05T02:16:53.235324+0000","last_fullsized":"2024-09-05T02:16:53.235324+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'177","last_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_deep_scrub":"264'177","last_deep_scrub_stamp":"2024-09-05T02:16:53.234979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.234979+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:59:35.819811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":131,"num_write":414,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'567","reported_seq":2088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.473632+0000","last_change":"2024-09-05T02:16:33.473476+0000","last_active":"2024-09-05T02:16:33.473632+0000","last_peered":"2024-09-05T02:16:33.473632+0000","last_clean":"2024-09-05T02:16:33.473632+0000","last_became_active":"2024-09-05T00:49:29.905412+0000","last_became_peered":"2024-09-05T00:49:29.905412+0000","last_unstale":"2024-09-05T02:16:33.473632+0000","last_undegraded":"2024-09-05T02:16:33.473632+0000","last_fullsized":"2024-09-05T02:16:33.473632+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'567","last_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_deep_scrub":"264'567","last_deep_scrub_stamp":"2024-09-05T02:16:33.473297+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.473297+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:21:11.125295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2811,"num_read_kb":2554,"num_write":725,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":876,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'379","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:27.461633+0000","last_change":"2024-09-05T02:16:27.461633+0000","last_active":"2024-09-05T02:16:27.461633+0000","last_peered":"2024-09-05T02:16:27.461633+0000","last_clean":"2024-09-05T02:16:27.461633+0000","last_became_active":"2024-09-05T00:49:27.892676+0000","last_became_peered":"2024-09-05T00:49:27.892676+0000","last_unstale":"2024-09-05T02:16:27.461633+0000","last_undegraded":"2024-09-05T02:16:27.461633+0000","last_fullsized":"2024-09-05T02:16:27.461633+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'379","last_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_deep_scrub":"264'379","last_deep_scrub_stamp":"2024-09-05T02:16:27.461448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:27.461448+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:09.203614+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306547,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":505,"num_read_kb":1286,"num_write":1063,"num_write_kb":17055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.797643+0000","last_change":"2024-09-05T02:16:30.797643+0000","last_active":"2024-09-05T02:16:30.797643+0000","last_peered":"2024-09-05T02:16:30.797643+0000","last_clean":"2024-09-05T02:16:30.797643+0000","last_became_active":"2024-09-05T00:49:17.802671+0000","last_became_peered":"2024-09-05T00:49:17.802671+0000","last_unstale":"2024-09-05T02:16:30.797643+0000","last_undegraded":"2024-09-05T02:16:30.797643+0000","last_fullsized":"2024-09-05T02:16:30.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:30.797468+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.797468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:56:12.858645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011252619999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.140192+0000","last_change":"2024-09-05T02:16:49.140192+0000","last_active":"2024-09-05T02:16:49.140192+0000","last_peered":"2024-09-05T02:16:49.140192+0000","last_clean":"2024-09-05T02:16:49.140192+0000","last_became_active":"2024-09-05T00:49:31.912481+0000","last_became_peered":"2024-09-05T00:49:31.912481+0000","last_unstale":"2024-09-05T02:16:49.140192+0000","last_undegraded":"2024-09-05T02:16:49.140192+0000","last_fullsized":"2024-09-05T02:16:49.140192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.140009+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.140009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:59:04.745264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'765","reported_seq":1535,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.015988+0000","last_change":"2024-09-05T02:16:50.015732+0000","last_active":"2024-09-05T02:16:50.015988+0000","last_peered":"2024-09-05T02:16:50.015988+0000","last_clean":"2024-09-05T02:16:50.015988+0000","last_became_active":"2024-09-05T00:49:34.053462+0000","last_became_peered":"2024-09-05T00:49:34.053462+0000","last_unstale":"2024-09-05T02:16:50.015988+0000","last_undegraded":"2024-09-05T02:16:50.015988+0000","last_fullsized":"2024-09-05T02:16:50.015988+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'765","last_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_deep_scrub":"264'765","last_deep_scrub_stamp":"2024-09-05T02:16:50.015404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.015404+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:41:52.046842+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142523,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1322,"num_read_kb":3088,"num_write":1054,"num_write_kb":823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:57.146385+0000","last_change":"2024-09-05T02:16:57.146257+0000","last_active":"2024-09-05T02:16:57.146385+0000","last_peered":"2024-09-05T02:16:57.146385+0000","last_clean":"2024-09-05T02:16:57.146385+0000","last_became_active":"2024-09-05T00:49:35.933590+0000","last_became_peered":"2024-09-05T00:49:35.933590+0000","last_unstale":"2024-09-05T02:16:57.146385+0000","last_undegraded":"2024-09-05T02:16:57.146385+0000","last_fullsized":"2024-09-05T02:16:57.146385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:57.146070+0000","last_clean_scrub_stamp":"2024-09-05T02:16:57.146070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:02:02.238780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'121","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.577050+0000","last_change":"2024-09-05T02:17:01.576899+0000","last_active":"2024-09-05T02:17:01.577050+0000","last_peered":"2024-09-05T02:17:01.577050+0000","last_clean":"2024-09-05T02:17:01.577050+0000","last_became_active":"2024-09-05T00:49:37.941528+0000","last_became_peered":"2024-09-05T00:49:37.941528+0000","last_unstale":"2024-09-05T02:17:01.577050+0000","last_undegraded":"2024-09-05T02:17:01.577050+0000","last_fullsized":"2024-09-05T02:17:01.577050+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-09-05T02:17:01.576713+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.576713+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:02:14.801974+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:04.249645+0000","last_change":"2024-09-05T02:17:04.249509+0000","last_active":"2024-09-05T02:17:04.249645+0000","last_peered":"2024-09-05T02:17:04.249645+0000","last_clean":"2024-09-05T02:17:04.249645+0000","last_became_active":"2024-09-05T00:49:37.942854+0000","last_became_peered":"2024-09-05T00:49:37.942854+0000","last_unstale":"2024-09-05T02:17:04.249645+0000","last_undegraded":"2024-09-05T02:17:04.249645+0000","last_fullsized":"2024-09-05T02:17:04.249645+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-05T02:17:04.249322+0000","last_clean_scrub_stamp":"2024-09-05T02:17:04.249322+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:41:38.397612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":270,"num_read_kb":250,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'584","reported_seq":2224,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.467016+0000","last_change":"2024-09-05T02:16:38.467016+0000","last_active":"2024-09-05T02:16:38.467016+0000","last_peered":"2024-09-05T02:16:38.467016+0000","last_clean":"2024-09-05T02:16:38.467016+0000","last_became_active":"2024-09-05T00:49:29.912068+0000","last_became_peered":"2024-09-05T00:49:29.912068+0000","last_unstale":"2024-09-05T02:16:38.467016+0000","last_undegraded":"2024-09-05T02:16:38.467016+0000","last_fullsized":"2024-09-05T02:16:38.467016+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-09-05T02:16:38.466831+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.466831+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:09.713439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2974,"num_read_kb":2725,"num_write":733,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'310","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.564836+0000","last_change":"2024-09-05T02:16:28.564836+0000","last_active":"2024-09-05T02:16:28.564836+0000","last_peered":"2024-09-05T02:16:28.564836+0000","last_clean":"2024-09-05T02:16:28.564836+0000","last_became_active":"2024-09-05T00:49:27.906956+0000","last_became_peered":"2024-09-05T00:49:27.906956+0000","last_unstale":"2024-09-05T02:16:28.564836+0000","last_undegraded":"2024-09-05T02:16:28.564836+0000","last_fullsized":"2024-09-05T02:16:28.564836+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'310","last_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_deep_scrub":"264'310","last_deep_scrub_stamp":"2024-09-05T02:16:28.564631+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.564631+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:46:10.085984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524318,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":508,"num_read_kb":27235,"num_write":955,"num_write_kb":46865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.151032+0000","last_change":"2024-09-05T02:16:45.151032+0000","last_active":"2024-09-05T02:16:45.151032+0000","last_peered":"2024-09-05T02:16:45.151032+0000","last_clean":"2024-09-05T02:16:45.151032+0000","last_became_active":"2024-09-05T00:49:31.905124+0000","last_became_peered":"2024-09-05T00:49:31.905124+0000","last_unstale":"2024-09-05T02:16:45.151032+0000","last_undegraded":"2024-09-05T02:16:45.151032+0000","last_fullsized":"2024-09-05T02:16:45.151032+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:45.150846+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.150846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:14.522761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'321","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:54.164900+0000","last_change":"2024-09-05T02:16:54.164900+0000","last_active":"2024-09-05T02:16:54.164900+0000","last_peered":"2024-09-05T02:16:54.164900+0000","last_clean":"2024-09-05T02:16:54.164900+0000","last_became_active":"2024-09-05T00:49:33.929634+0000","last_became_peered":"2024-09-05T00:49:33.929634+0000","last_unstale":"2024-09-05T02:16:54.164900+0000","last_undegraded":"2024-09-05T02:16:54.164900+0000","last_fullsized":"2024-09-05T02:16:54.164900+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'321","last_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_deep_scrub":"264'321","last_deep_scrub_stamp":"2024-09-05T02:16:54.164706+0000","last_clean_scrub_stamp":"2024-09-05T02:16:54.164706+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:06:59.874764+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43168,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":534,"num_read_kb":1204,"num_write":426,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.235619+0000","last_change":"2024-09-05T02:17:01.235619+0000","last_active":"2024-09-05T02:17:01.235619+0000","last_peered":"2024-09-05T02:17:01.235619+0000","last_clean":"2024-09-05T02:17:01.235619+0000","last_became_active":"2024-09-05T00:49:35.938696+0000","last_became_peered":"2024-09-05T00:49:35.938696+0000","last_unstale":"2024-09-05T02:17:01.235619+0000","last_undegraded":"2024-09-05T02:17:01.235619+0000","last_fullsized":"2024-09-05T02:17:01.235619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.235436+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.235436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:07:04.074346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'134","reported_seq":654,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:08.244926+0000","last_change":"2024-09-05T02:17:08.244926+0000","last_active":"2024-09-05T02:17:08.244926+0000","last_peered":"2024-09-05T02:17:08.244926+0000","last_clean":"2024-09-05T02:17:08.244926+0000","last_became_active":"2024-09-05T00:49:37.949778+0000","last_became_peered":"2024-09-05T00:49:37.949778+0000","last_unstale":"2024-09-05T02:17:08.244926+0000","last_undegraded":"2024-09-05T02:17:08.244926+0000","last_fullsized":"2024-09-05T02:17:08.244926+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-09-05T02:17:08.244748+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-09-05T02:17:08.244748+0000","last_clean_scrub_stamp":"2024-09-05T02:17:08.244748+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:29:59.092306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":110,"num_write":312,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'373","reported_seq":1845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.199178+0000","last_change":"2024-09-05T02:16:41.199178+0000","last_active":"2024-09-05T02:16:41.199178+0000","last_peered":"2024-09-05T02:16:41.199178+0000","last_clean":"2024-09-05T02:16:41.199178+0000","last_became_active":"2024-09-05T00:49:29.889023+0000","last_became_peered":"2024-09-05T00:49:29.889023+0000","last_unstale":"2024-09-05T02:16:41.199178+0000","last_undegraded":"2024-09-05T02:16:41.199178+0000","last_fullsized":"2024-09-05T02:16:41.199178+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-09-05T02:16:41.198938+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.198938+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:49.138470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1999,"num_read_kb":1908,"num_write":436,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'308","reported_seq":1063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.040013+0000","last_change":"2024-09-05T02:16:38.040013+0000","last_active":"2024-09-05T02:16:38.040013+0000","last_peered":"2024-09-05T02:16:38.040013+0000","last_clean":"2024-09-05T02:16:38.040013+0000","last_became_active":"2024-09-05T00:49:27.904502+0000","last_became_peered":"2024-09-05T00:49:27.904502+0000","last_unstale":"2024-09-05T02:16:38.040013+0000","last_undegraded":"2024-09-05T02:16:38.040013+0000","last_fullsized":"2024-09-05T02:16:38.040013+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-09-05T02:16:38.039781+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.039781+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:04:40.447440+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":745,"num_read_kb":54962,"num_write":1038,"num_write_kb":27935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.110479+0000","last_change":"2024-09-05T02:16:47.110479+0000","last_active":"2024-09-05T02:16:47.110479+0000","last_peered":"2024-09-05T02:16:47.110479+0000","last_clean":"2024-09-05T02:16:47.110479+0000","last_became_active":"2024-09-05T00:49:31.909758+0000","last_became_peered":"2024-09-05T00:49:31.909758+0000","last_unstale":"2024-09-05T02:16:47.110479+0000","last_undegraded":"2024-09-05T02:16:47.110479+0000","last_fullsized":"2024-09-05T02:16:47.110479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.110272+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.110272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:03:15.952888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'72","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.241593+0000","last_change":"2024-09-05T02:16:49.241593+0000","last_active":"2024-09-05T02:16:49.241593+0000","last_peered":"2024-09-05T02:16:49.241593+0000","last_clean":"2024-09-05T02:16:49.241593+0000","last_became_active":"2024-09-05T00:49:33.913184+0000","last_became_peered":"2024-09-05T00:49:33.913184+0000","last_unstale":"2024-09-05T02:16:49.241593+0000","last_undegraded":"2024-09-05T02:16:49.241593+0000","last_fullsized":"2024-09-05T02:16:49.241593+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'72","last_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_deep_scrub":"264'72","last_deep_scrub_stamp":"2024-09-05T02:16:49.241369+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.241369+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:23:27.076422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":48,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.848918+0000","last_change":"2024-09-05T02:16:56.848918+0000","last_active":"2024-09-05T02:16:56.848918+0000","last_peered":"2024-09-05T02:16:56.848918+0000","last_clean":"2024-09-05T02:16:56.848918+0000","last_became_active":"2024-09-05T00:49:35.934770+0000","last_became_peered":"2024-09-05T00:49:35.934770+0000","last_unstale":"2024-09-05T02:16:56.848918+0000","last_undegraded":"2024-09-05T02:16:56.848918+0000","last_fullsized":"2024-09-05T02:16:56.848918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.848710+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.848710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:20:51.306857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'232","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.345550+0000","last_change":"2024-09-05T02:17:07.345360+0000","last_active":"2024-09-05T02:17:07.345550+0000","last_peered":"2024-09-05T02:17:07.345550+0000","last_clean":"2024-09-05T02:17:07.345550+0000","last_became_active":"2024-09-05T00:49:37.925539+0000","last_became_peered":"2024-09-05T00:49:37.925539+0000","last_unstale":"2024-09-05T02:17:07.345550+0000","last_undegraded":"2024-09-05T02:17:07.345550+0000","last_fullsized":"2024-09-05T02:17:07.345550+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-09-05T02:17:07.345041+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.345041+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:31:05.231444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":330,"num_read_kb":317,"num_write":518,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'413","reported_seq":2007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.001539+0000","last_change":"2024-09-05T02:16:37.001539+0000","last_active":"2024-09-05T02:16:37.001539+0000","last_peered":"2024-09-05T02:16:37.001539+0000","last_clean":"2024-09-05T02:16:37.001539+0000","last_became_active":"2024-09-05T00:49:29.927379+0000","last_became_peered":"2024-09-05T00:49:29.927379+0000","last_unstale":"2024-09-05T02:16:37.001539+0000","last_undegraded":"2024-09-05T02:16:37.001539+0000","last_fullsized":"2024-09-05T02:16:37.001539+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-09-05T02:16:37.001348+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.001348+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:37:09.716022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2285,"num_read_kb":2182,"num_write":456,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'312","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.491656+0000","last_change":"2024-09-05T02:16:33.491656+0000","last_active":"2024-09-05T02:16:33.491656+0000","last_peered":"2024-09-05T02:16:33.491656+0000","last_clean":"2024-09-05T02:16:33.491656+0000","last_became_active":"2024-09-05T00:49:27.911177+0000","last_became_peered":"2024-09-05T00:49:27.911177+0000","last_unstale":"2024-09-05T02:16:33.491656+0000","last_undegraded":"2024-09-05T02:16:33.491656+0000","last_fullsized":"2024-09-05T02:16:33.491656+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:33.491428+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.491428+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:01:05.829040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":91576,"num_write":1030,"num_write_kb":54906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.005253+0000","last_change":"2024-09-05T02:16:49.005253+0000","last_active":"2024-09-05T02:16:49.005253+0000","last_peered":"2024-09-05T02:16:49.005253+0000","last_clean":"2024-09-05T02:16:49.005253+0000","last_became_active":"2024-09-05T00:49:31.925908+0000","last_became_peered":"2024-09-05T00:49:31.925908+0000","last_unstale":"2024-09-05T02:16:49.005253+0000","last_undegraded":"2024-09-05T02:16:49.005253+0000","last_fullsized":"2024-09-05T02:16:49.005253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.005040+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.005040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:32:33.592652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'339","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.135170+0000","last_change":"2024-09-05T02:16:55.135170+0000","last_active":"2024-09-05T02:16:55.135170+0000","last_peered":"2024-09-05T02:16:55.135170+0000","last_clean":"2024-09-05T02:16:55.135170+0000","last_became_active":"2024-09-05T00:49:33.929958+0000","last_became_peered":"2024-09-05T00:49:33.929958+0000","last_unstale":"2024-09-05T02:16:55.135170+0000","last_undegraded":"2024-09-05T02:16:55.135170+0000","last_fullsized":"2024-09-05T02:16:55.135170+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-05T02:16:55.134979+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.134979+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:11:41.547516+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49685,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":561,"num_read_kb":1221,"num_write":440,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.885736+0000","last_change":"2024-09-05T02:16:47.885736+0000","last_active":"2024-09-05T02:16:47.885736+0000","last_peered":"2024-09-05T02:16:47.885736+0000","last_clean":"2024-09-05T02:16:47.885736+0000","last_became_active":"2024-09-05T00:49:35.947198+0000","last_became_peered":"2024-09-05T00:49:35.947198+0000","last_unstale":"2024-09-05T02:16:47.885736+0000","last_undegraded":"2024-09-05T02:16:47.885736+0000","last_fullsized":"2024-09-05T02:16:47.885736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.885547+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.885547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:38:52.795987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'122","reported_seq":647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.556768+0000","last_change":"2024-09-05T02:17:05.556619+0000","last_active":"2024-09-05T02:17:05.556768+0000","last_peered":"2024-09-05T02:17:05.556768+0000","last_clean":"2024-09-05T02:17:05.556768+0000","last_became_active":"2024-09-05T00:49:37.945338+0000","last_became_peered":"2024-09-05T00:49:37.945338+0000","last_unstale":"2024-09-05T02:17:05.556768+0000","last_undegraded":"2024-09-05T02:17:05.556768+0000","last_fullsized":"2024-09-05T02:17:05.556768+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'122","last_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_deep_scrub":"264'122","last_deep_scrub_stamp":"2024-09-05T02:17:05.556414+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.556414+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:20:18.944327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":276,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1176","reported_seq":2735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:46.065795+0000","last_change":"2024-09-05T02:16:46.065795+0000","last_active":"2024-09-05T02:16:46.065795+0000","last_peered":"2024-09-05T02:16:46.065795+0000","last_clean":"2024-09-05T02:16:46.065795+0000","last_became_active":"2024-09-05T00:49:29.924367+0000","last_became_peered":"2024-09-05T00:49:29.924367+0000","last_unstale":"2024-09-05T02:16:46.065795+0000","last_undegraded":"2024-09-05T02:16:46.065795+0000","last_fullsized":"2024-09-05T02:16:46.065795+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1176","last_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_deep_scrub":"264'1176","last_deep_scrub_stamp":"2024-09-05T02:16:46.065600+0000","last_clean_scrub_stamp":"2024-09-05T02:16:46.065600+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:12.655472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5259,"num_read_kb":4633,"num_write":1610,"num_write_kb":651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'343","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:28.487651+0000","last_change":"2024-09-05T02:16:28.487518+0000","last_active":"2024-09-05T02:16:28.487651+0000","last_peered":"2024-09-05T02:16:28.487651+0000","last_clean":"2024-09-05T02:16:28.487651+0000","last_became_active":"2024-09-05T00:49:27.893339+0000","last_became_peered":"2024-09-05T00:49:27.893339+0000","last_unstale":"2024-09-05T02:16:28.487651+0000","last_undegraded":"2024-09-05T02:16:28.487651+0000","last_fullsized":"2024-09-05T02:16:28.487651+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:28.487300+0000","last_clean_scrub_stamp":"2024-09-05T02:16:28.487300+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:13:55.683962+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342090,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":6648,"num_write":1112,"num_write_kb":11892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.908314+0000","last_change":"2024-09-05T02:16:41.908314+0000","last_active":"2024-09-05T02:16:41.908314+0000","last_peered":"2024-09-05T02:16:41.908314+0000","last_clean":"2024-09-05T02:16:41.908314+0000","last_became_active":"2024-09-05T00:49:31.922724+0000","last_became_peered":"2024-09-05T00:49:31.922724+0000","last_unstale":"2024-09-05T02:16:41.908314+0000","last_undegraded":"2024-09-05T02:16:41.908314+0000","last_fullsized":"2024-09-05T02:16:41.908314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:41.908112+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.908112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:02.070944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'302","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.957155+0000","last_change":"2024-09-05T02:16:52.957155+0000","last_active":"2024-09-05T02:16:52.957155+0000","last_peered":"2024-09-05T02:16:52.957155+0000","last_clean":"2024-09-05T02:16:52.957155+0000","last_became_active":"2024-09-05T00:49:33.907859+0000","last_became_peered":"2024-09-05T00:49:33.907859+0000","last_unstale":"2024-09-05T02:16:52.957155+0000","last_undegraded":"2024-09-05T02:16:52.957155+0000","last_fullsized":"2024-09-05T02:16:52.957155+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-05T02:16:52.956962+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.956962+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:08:52.321946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47373,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":510,"num_read_kb":1205,"num_write":416,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.218254+0000","last_change":"2024-09-05T02:16:58.218254+0000","last_active":"2024-09-05T02:16:58.218254+0000","last_peered":"2024-09-05T02:16:58.218254+0000","last_clean":"2024-09-05T02:16:58.218254+0000","last_became_active":"2024-09-05T00:49:35.942487+0000","last_became_peered":"2024-09-05T00:49:35.942487+0000","last_unstale":"2024-09-05T02:16:58.218254+0000","last_undegraded":"2024-09-05T02:16:58.218254+0000","last_fullsized":"2024-09-05T02:16:58.218254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:58.218069+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.218069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:28.921690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'401","reported_seq":1943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.833763+0000","last_change":"2024-09-05T02:16:38.833608+0000","last_active":"2024-09-05T02:16:38.833763+0000","last_peered":"2024-09-05T02:16:38.833763+0000","last_clean":"2024-09-05T02:16:38.833763+0000","last_became_active":"2024-09-05T00:49:29.902497+0000","last_became_peered":"2024-09-05T00:49:29.902497+0000","last_unstale":"2024-09-05T02:16:38.833763+0000","last_undegraded":"2024-09-05T02:16:38.833763+0000","last_fullsized":"2024-09-05T02:16:38.833763+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-09-05T02:16:38.833404+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.833404+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:32:18.954201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2234,"num_read_kb":2138,"num_write":442,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'332","reported_seq":1202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.909052+0000","last_change":"2024-09-05T02:16:30.908902+0000","last_active":"2024-09-05T02:16:30.909052+0000","last_peered":"2024-09-05T02:16:30.909052+0000","last_clean":"2024-09-05T02:16:30.909052+0000","last_became_active":"2024-09-05T00:49:27.883417+0000","last_became_peered":"2024-09-05T00:49:27.883417+0000","last_unstale":"2024-09-05T02:16:30.909052+0000","last_undegraded":"2024-09-05T02:16:30.909052+0000","last_fullsized":"2024-09-05T02:16:30.909052+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.908658+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.908658+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:38.710026+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":908,"num_read_kb":44981,"num_write":1071,"num_write_kb":45916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"264'6","reported_seq":1005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.283913+0000","last_change":"2024-09-05T02:16:50.283913+0000","last_active":"2024-09-05T02:16:50.283913+0000","last_peered":"2024-09-05T02:16:50.283913+0000","last_clean":"2024-09-05T02:16:50.283913+0000","last_became_active":"2024-09-05T00:49:31.914446+0000","last_became_peered":"2024-09-05T00:49:31.914446+0000","last_unstale":"2024-09-05T02:16:50.283913+0000","last_undegraded":"2024-09-05T02:16:50.283913+0000","last_fullsized":"2024-09-05T02:16:50.283913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-05T02:16:50.283841+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.283841+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:07.764546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'541","reported_seq":1218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.119138+0000","last_change":"2024-09-05T02:16:53.118919+0000","last_active":"2024-09-05T02:16:53.119138+0000","last_peered":"2024-09-05T02:16:53.119138+0000","last_clean":"2024-09-05T02:16:53.119138+0000","last_became_active":"2024-09-05T00:49:33.911593+0000","last_became_peered":"2024-09-05T00:49:33.911593+0000","last_unstale":"2024-09-05T02:16:53.119138+0000","last_undegraded":"2024-09-05T02:16:53.119138+0000","last_fullsized":"2024-09-05T02:16:53.119138+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'541","last_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_deep_scrub":"264'541","last_deep_scrub_stamp":"2024-09-05T02:16:53.118675+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.118675+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:17.667696+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90605,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":950,"num_read_kb":2270,"num_write":820,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.525571+0000","last_change":"2024-09-05T02:16:59.525336+0000","last_active":"2024-09-05T02:16:59.525571+0000","last_peered":"2024-09-05T02:16:59.525571+0000","last_clean":"2024-09-05T02:16:59.525571+0000","last_became_active":"2024-09-05T00:49:35.937552+0000","last_became_peered":"2024-09-05T00:49:35.937552+0000","last_unstale":"2024-09-05T02:16:59.525571+0000","last_undegraded":"2024-09-05T02:16:59.525571+0000","last_fullsized":"2024-09-05T02:16:59.525571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.525078+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.525078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:23:01.095440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'184","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:05.223600+0000","last_change":"2024-09-05T02:17:05.223600+0000","last_active":"2024-09-05T02:17:05.223600+0000","last_peered":"2024-09-05T02:17:05.223600+0000","last_clean":"2024-09-05T02:17:05.223600+0000","last_became_active":"2024-09-05T00:49:37.950671+0000","last_became_peered":"2024-09-05T00:49:37.950671+0000","last_unstale":"2024-09-05T02:17:05.223600+0000","last_undegraded":"2024-09-05T02:17:05.223600+0000","last_fullsized":"2024-09-05T02:17:05.223600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-05T02:17:05.223412+0000","last_clean_scrub_stamp":"2024-09-05T02:17:05.223412+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:50:39.805729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":421,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'421","reported_seq":2000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.325953+0000","last_change":"2024-09-05T02:16:41.325824+0000","last_active":"2024-09-05T02:16:41.325953+0000","last_peered":"2024-09-05T02:16:41.325953+0000","last_clean":"2024-09-05T02:16:41.325953+0000","last_became_active":"2024-09-05T00:49:29.904089+0000","last_became_peered":"2024-09-05T00:49:29.904089+0000","last_unstale":"2024-09-05T02:16:41.325953+0000","last_undegraded":"2024-09-05T02:16:41.325953+0000","last_fullsized":"2024-09-05T02:16:41.325953+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:41.325623+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.325623+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:08:24.604460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2399,"num_read_kb":2279,"num_write":491,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'348","reported_seq":1059,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.380399+0000","last_change":"2024-09-05T02:16:31.380143+0000","last_active":"2024-09-05T02:16:31.380399+0000","last_peered":"2024-09-05T02:16:31.380399+0000","last_clean":"2024-09-05T02:16:31.380399+0000","last_became_active":"2024-09-05T00:49:27.881120+0000","last_became_peered":"2024-09-05T00:49:27.881120+0000","last_unstale":"2024-09-05T02:16:31.380399+0000","last_undegraded":"2024-09-05T02:16:31.380399+0000","last_fullsized":"2024-09-05T02:16:31.380399+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-09-05T02:16:31.379870+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.379870+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.538823+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2159835,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":561,"num_read_kb":27594,"num_write":1025,"num_write_kb":24363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.916164+0000","last_change":"2024-09-05T02:16:44.915915+0000","last_active":"2024-09-05T02:16:44.916164+0000","last_peered":"2024-09-05T02:16:44.916164+0000","last_clean":"2024-09-05T02:16:44.916164+0000","last_became_active":"2024-09-05T00:49:31.922209+0000","last_became_peered":"2024-09-05T00:49:31.922209+0000","last_unstale":"2024-09-05T02:16:44.916164+0000","last_undegraded":"2024-09-05T02:16:44.916164+0000","last_fullsized":"2024-09-05T02:16:44.916164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:44.915627+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.915627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:46:19.249723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'342","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.876390+0000","last_change":"2024-09-05T02:16:55.876250+0000","last_active":"2024-09-05T02:16:55.876390+0000","last_peered":"2024-09-05T02:16:55.876390+0000","last_clean":"2024-09-05T02:16:55.876390+0000","last_became_active":"2024-09-05T00:49:33.916644+0000","last_became_peered":"2024-09-05T00:49:33.916644+0000","last_unstale":"2024-09-05T02:16:55.876390+0000","last_undegraded":"2024-09-05T02:16:55.876390+0000","last_fullsized":"2024-09-05T02:16:55.876390+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-05T02:16:55.876025+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.876025+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:17:35.582439+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44494,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":534,"num_read_kb":1059,"num_write":428,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.303250+0000","last_change":"2024-09-05T02:16:59.302978+0000","last_active":"2024-09-05T02:16:59.303250+0000","last_peered":"2024-09-05T02:16:59.303250+0000","last_clean":"2024-09-05T02:16:59.303250+0000","last_became_active":"2024-09-05T00:49:35.923969+0000","last_became_peered":"2024-09-05T00:49:35.923969+0000","last_unstale":"2024-09-05T02:16:59.303250+0000","last_undegraded":"2024-09-05T02:16:59.303250+0000","last_fullsized":"2024-09-05T02:16:59.303250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:59.302762+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.302762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:13.771230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'165","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.968209+0000","last_change":"2024-09-05T02:16:53.968209+0000","last_active":"2024-09-05T02:16:53.968209+0000","last_peered":"2024-09-05T02:16:53.968209+0000","last_clean":"2024-09-05T02:16:53.968209+0000","last_became_active":"2024-09-05T00:49:37.930550+0000","last_became_peered":"2024-09-05T00:49:37.930550+0000","last_unstale":"2024-09-05T02:16:53.968209+0000","last_undegraded":"2024-09-05T02:16:53.968209+0000","last_fullsized":"2024-09-05T02:16:53.968209+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-05T02:16:53.967993+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.967993+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:06:11.198975+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":175,"num_read_kb":173,"num_write":447,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'494","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.038028+0000","last_change":"2024-09-05T02:16:41.037772+0000","last_active":"2024-09-05T02:16:41.038028+0000","last_peered":"2024-09-05T02:16:41.038028+0000","last_clean":"2024-09-05T02:16:41.038028+0000","last_became_active":"2024-09-05T00:49:29.925121+0000","last_became_peered":"2024-09-05T00:49:29.925121+0000","last_unstale":"2024-09-05T02:16:41.038028+0000","last_undegraded":"2024-09-05T02:16:41.038028+0000","last_fullsized":"2024-09-05T02:16:41.038028+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'494","last_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_deep_scrub":"264'494","last_deep_scrub_stamp":"2024-09-05T02:16:41.037536+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.037536+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:37:11.731456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2903,"num_read_kb":2733,"num_write":621,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'324","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.561005+0000","last_change":"2024-09-05T02:16:30.560869+0000","last_active":"2024-09-05T02:16:30.561005+0000","last_peered":"2024-09-05T02:16:30.561005+0000","last_clean":"2024-09-05T02:16:30.561005+0000","last_became_active":"2024-09-05T00:49:27.882502+0000","last_became_peered":"2024-09-05T00:49:27.882502+0000","last_unstale":"2024-09-05T02:16:30.561005+0000","last_undegraded":"2024-09-05T02:16:30.561005+0000","last_fullsized":"2024-09-05T02:16:30.561005+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-05T02:16:30.560663+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.560663+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:41:40.454373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":39348,"num_write":968,"num_write_kb":33796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.505123+0000","last_change":"2024-09-05T02:16:52.504988+0000","last_active":"2024-09-05T02:16:52.505123+0000","last_peered":"2024-09-05T02:16:52.505123+0000","last_clean":"2024-09-05T02:16:52.505123+0000","last_became_active":"2024-09-05T00:49:31.923265+0000","last_became_peered":"2024-09-05T00:49:31.923265+0000","last_unstale":"2024-09-05T02:16:52.505123+0000","last_undegraded":"2024-09-05T02:16:52.505123+0000","last_fullsized":"2024-09-05T02:16:52.505123+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:52.504809+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.504809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:58:12.255051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'326","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.114823+0000","last_change":"2024-09-05T02:16:56.114678+0000","last_active":"2024-09-05T02:16:56.114823+0000","last_peered":"2024-09-05T02:16:56.114823+0000","last_clean":"2024-09-05T02:16:56.114823+0000","last_became_active":"2024-09-05T00:49:34.055122+0000","last_became_peered":"2024-09-05T00:49:34.055122+0000","last_unstale":"2024-09-05T02:16:56.114823+0000","last_undegraded":"2024-09-05T02:16:56.114823+0000","last_fullsized":"2024-09-05T02:16:56.114823+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:56.114479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.114479+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:02:21.147000+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":539,"num_read_kb":1207,"num_write":432,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:56.192582+0000","last_change":"2024-09-05T02:16:56.192453+0000","last_active":"2024-09-05T02:16:56.192582+0000","last_peered":"2024-09-05T02:16:56.192582+0000","last_clean":"2024-09-05T02:16:56.192582+0000","last_became_active":"2024-09-05T00:49:35.934394+0000","last_became_peered":"2024-09-05T00:49:35.934394+0000","last_unstale":"2024-09-05T02:16:56.192582+0000","last_undegraded":"2024-09-05T02:16:56.192582+0000","last_fullsized":"2024-09-05T02:16:56.192582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:56.192269+0000","last_clean_scrub_stamp":"2024-09-05T02:16:56.192269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:47:46.160471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'110","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.537213+0000","last_change":"2024-09-05T02:17:02.537213+0000","last_active":"2024-09-05T02:17:02.537213+0000","last_peered":"2024-09-05T02:17:02.537213+0000","last_clean":"2024-09-05T02:17:02.537213+0000","last_became_active":"2024-09-05T00:49:37.938128+0000","last_became_peered":"2024-09-05T00:49:37.938128+0000","last_unstale":"2024-09-05T02:17:02.537213+0000","last_undegraded":"2024-09-05T02:17:02.537213+0000","last_fullsized":"2024-09-05T02:17:02.537213+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-05T02:17:02.537031+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.537031+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:09:20.213705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":134,"num_read_kb":120,"num_write":261,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'326","reported_seq":1650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.800451+0000","last_change":"2024-09-05T02:16:34.800307+0000","last_active":"2024-09-05T02:16:34.800451+0000","last_peered":"2024-09-05T02:16:34.800451+0000","last_clean":"2024-09-05T02:16:34.800451+0000","last_became_active":"2024-09-05T00:49:29.900210+0000","last_became_peered":"2024-09-05T00:49:29.900210+0000","last_unstale":"2024-09-05T02:16:34.800451+0000","last_undegraded":"2024-09-05T02:16:34.800451+0000","last_fullsized":"2024-09-05T02:16:34.800451+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-05T02:16:34.800111+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.800111+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:39.707710+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1697,"num_read_kb":1623,"num_write":370,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'405","reported_seq":1114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.365306+0000","last_change":"2024-09-05T02:16:38.365125+0000","last_active":"2024-09-05T02:16:38.365306+0000","last_peered":"2024-09-05T02:16:38.365306+0000","last_clean":"2024-09-05T02:16:38.365306+0000","last_became_active":"2024-09-05T00:49:27.875869+0000","last_became_peered":"2024-09-05T00:49:27.875869+0000","last_unstale":"2024-09-05T02:16:38.365306+0000","last_undegraded":"2024-09-05T02:16:38.365306+0000","last_fullsized":"2024-09-05T02:16:38.365306+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-05T02:16:38.364894+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.364894+0000","objects_scrubbed":9,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:32:52.067211+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642858,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":739,"num_read_kb":25030,"num_write":1256,"num_write_kb":38954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:48.191125+0000","last_change":"2024-09-05T02:16:48.190992+0000","last_active":"2024-09-05T02:16:48.191125+0000","last_peered":"2024-09-05T02:16:48.191125+0000","last_clean":"2024-09-05T02:16:48.191125+0000","last_became_active":"2024-09-05T00:49:31.925543+0000","last_became_peered":"2024-09-05T00:49:31.925543+0000","last_unstale":"2024-09-05T02:16:48.191125+0000","last_undegraded":"2024-09-05T02:16:48.191125+0000","last_fullsized":"2024-09-05T02:16:48.191125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:48.190800+0000","last_clean_scrub_stamp":"2024-09-05T02:16:48.190800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:24:46.556049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'153","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.525793+0000","last_change":"2024-09-05T02:16:58.525793+0000","last_active":"2024-09-05T02:16:58.525793+0000","last_peered":"2024-09-05T02:16:58.525793+0000","last_clean":"2024-09-05T02:16:58.525793+0000","last_became_active":"2024-09-05T00:49:34.052111+0000","last_became_peered":"2024-09-05T00:49:34.052111+0000","last_unstale":"2024-09-05T02:16:58.525793+0000","last_undegraded":"2024-09-05T02:16:58.525793+0000","last_fullsized":"2024-09-05T02:16:58.525793+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'153","last_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_deep_scrub":"264'153","last_deep_scrub_stamp":"2024-09-05T02:16:58.525607+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.525607+0000","objects_scrubbed":8,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:32:05.887270+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":190,"num_read_kb":184,"num_write":186,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'771","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:50.883984+0000","last_change":"2024-09-05T02:16:50.883737+0000","last_active":"2024-09-05T02:16:50.883984+0000","last_peered":"2024-09-05T02:16:50.883984+0000","last_clean":"2024-09-05T02:16:50.883984+0000","last_became_active":"2024-09-05T00:49:35.931906+0000","last_became_peered":"2024-09-05T00:49:35.931906+0000","last_unstale":"2024-09-05T02:16:50.883984+0000","last_undegraded":"2024-09-05T02:16:50.883984+0000","last_fullsized":"2024-09-05T02:16:50.883984+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'771","last_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_deep_scrub":"264'771","last_deep_scrub_stamp":"2024-09-05T02:16:50.883511+0000","last_clean_scrub_stamp":"2024-09-05T02:16:50.883511+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:56.045690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'136","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.820599+0000","last_change":"2024-09-05T02:17:00.820599+0000","last_active":"2024-09-05T02:17:00.820599+0000","last_peered":"2024-09-05T02:17:00.820599+0000","last_clean":"2024-09-05T02:17:00.820599+0000","last_became_active":"2024-09-05T00:49:37.941651+0000","last_became_peered":"2024-09-05T00:49:37.941651+0000","last_unstale":"2024-09-05T02:17:00.820599+0000","last_undegraded":"2024-09-05T02:17:00.820599+0000","last_fullsized":"2024-09-05T02:17:00.820599+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'136","last_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_deep_scrub":"264'136","last_deep_scrub_stamp":"2024-09-05T02:17:00.820416+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.820416+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:48:24.728201+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":151,"num_write":348,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'870","reported_seq":2421,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.444135+0000","last_change":"2024-09-05T02:16:40.444001+0000","last_active":"2024-09-05T02:16:40.444135+0000","last_peered":"2024-09-05T02:16:40.444135+0000","last_clean":"2024-09-05T02:16:40.444135+0000","last_became_active":"2024-09-05T00:49:29.917646+0000","last_became_peered":"2024-09-05T00:49:29.917646+0000","last_unstale":"2024-09-05T02:16:40.444135+0000","last_undegraded":"2024-09-05T02:16:40.444135+0000","last_fullsized":"2024-09-05T02:16:40.444135+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'870","last_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_deep_scrub":"264'870","last_deep_scrub_stamp":"2024-09-05T02:16:40.443792+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.443792+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":800,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:41:30.425677+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4024,"num_read_kb":3586,"num_write":1135,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'289","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.482772+0000","last_change":"2024-09-05T02:16:34.482628+0000","last_active":"2024-09-05T02:16:34.482772+0000","last_peered":"2024-09-05T02:16:34.482772+0000","last_clean":"2024-09-05T02:16:34.482772+0000","last_became_active":"2024-09-05T00:49:27.897752+0000","last_became_peered":"2024-09-05T00:49:27.897752+0000","last_unstale":"2024-09-05T02:16:34.482772+0000","last_undegraded":"2024-09-05T02:16:34.482772+0000","last_fullsized":"2024-09-05T02:16:34.482772+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-09-05T02:16:34.482431+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.482431+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:08:51.964548+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1250696,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":366,"num_read_kb":6339,"num_write":869,"num_write_kb":26991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.956925+0000","last_change":"2024-09-05T02:16:47.956779+0000","last_active":"2024-09-05T02:16:47.956925+0000","last_peered":"2024-09-05T02:16:47.956925+0000","last_clean":"2024-09-05T02:16:47.956925+0000","last_became_active":"2024-09-05T00:49:31.924027+0000","last_became_peered":"2024-09-05T00:49:31.924027+0000","last_unstale":"2024-09-05T02:16:47.956925+0000","last_undegraded":"2024-09-05T02:16:47.956925+0000","last_fullsized":"2024-09-05T02:16:47.956925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:47.956598+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.956598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:02:38.985311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'393","reported_seq":1044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:58.534799+0000","last_change":"2024-09-05T02:16:58.534659+0000","last_active":"2024-09-05T02:16:58.534799+0000","last_peered":"2024-09-05T02:16:58.534799+0000","last_clean":"2024-09-05T02:16:58.534799+0000","last_became_active":"2024-09-05T00:49:33.909639+0000","last_became_peered":"2024-09-05T00:49:33.909639+0000","last_unstale":"2024-09-05T02:16:58.534799+0000","last_undegraded":"2024-09-05T02:16:58.534799+0000","last_fullsized":"2024-09-05T02:16:58.534799+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-09-05T02:16:58.534448+0000","last_clean_scrub_stamp":"2024-09-05T02:16:58.534448+0000","objects_scrubbed":11,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:53:21.086187+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47763,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":623,"num_read_kb":1294,"num_write":490,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.199718+0000","last_change":"2024-09-05T02:17:01.199718+0000","last_active":"2024-09-05T02:17:01.199718+0000","last_peered":"2024-09-05T02:17:01.199718+0000","last_clean":"2024-09-05T02:17:01.199718+0000","last_became_active":"2024-09-05T00:49:35.926502+0000","last_became_peered":"2024-09-05T00:49:35.926502+0000","last_unstale":"2024-09-05T02:17:01.199718+0000","last_undegraded":"2024-09-05T02:17:01.199718+0000","last_fullsized":"2024-09-05T02:17:01.199718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.199508+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.199508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:35:39.811372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'201","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.829744+0000","last_change":"2024-09-05T02:17:02.829744+0000","last_active":"2024-09-05T02:17:02.829744+0000","last_peered":"2024-09-05T02:17:02.829744+0000","last_clean":"2024-09-05T02:17:02.829744+0000","last_became_active":"2024-09-05T00:49:37.945552+0000","last_became_peered":"2024-09-05T00:49:37.945552+0000","last_unstale":"2024-09-05T02:17:02.829744+0000","last_undegraded":"2024-09-05T02:17:02.829744+0000","last_fullsized":"2024-09-05T02:17:02.829744+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'201","last_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_deep_scrub":"264'201","last_deep_scrub_stamp":"2024-09-05T02:17:02.829553+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.829553+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:03:12.703178+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1259,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":334,"num_read_kb":274,"num_write":431,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'736","reported_seq":2533,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:41.487574+0000","last_change":"2024-09-05T02:16:41.487412+0000","last_active":"2024-09-05T02:16:41.487574+0000","last_peered":"2024-09-05T02:16:41.487574+0000","last_clean":"2024-09-05T02:16:41.487574+0000","last_became_active":"2024-09-05T00:49:29.915408+0000","last_became_peered":"2024-09-05T00:49:29.915408+0000","last_unstale":"2024-09-05T02:16:41.487574+0000","last_undegraded":"2024-09-05T02:16:41.487574+0000","last_fullsized":"2024-09-05T02:16:41.487574+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'736","last_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_deep_scrub":"264'736","last_deep_scrub_stamp":"2024-09-05T02:16:41.487221+0000","last_clean_scrub_stamp":"2024-09-05T02:16:41.487221+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:00:01.507115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3836,"num_read_kb":3478,"num_write":1056,"num_write_kb":467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1182,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'414","reported_seq":1155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.532824+0000","last_change":"2024-09-05T02:16:35.532666+0000","last_active":"2024-09-05T02:16:35.532824+0000","last_peered":"2024-09-05T02:16:35.532824+0000","last_clean":"2024-09-05T02:16:35.532824+0000","last_became_active":"2024-09-05T00:49:27.888915+0000","last_became_peered":"2024-09-05T00:49:27.888915+0000","last_unstale":"2024-09-05T02:16:35.532824+0000","last_undegraded":"2024-09-05T02:16:35.532824+0000","last_fullsized":"2024-09-05T02:16:35.532824+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'414","last_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_deep_scrub":"264'414","last_deep_scrub_stamp":"2024-09-05T02:16:35.532436+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.532436+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:12:38.507010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080041,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":137827,"num_write":1317,"num_write_kb":57897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"264'4","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:53.624622+0000","last_change":"2024-09-05T02:16:53.624429+0000","last_active":"2024-09-05T02:16:53.624622+0000","last_peered":"2024-09-05T02:16:53.624622+0000","last_clean":"2024-09-05T02:16:53.624622+0000","last_became_active":"2024-09-05T00:49:31.903119+0000","last_became_peered":"2024-09-05T00:49:31.903119+0000","last_unstale":"2024-09-05T02:16:53.624622+0000","last_undegraded":"2024-09-05T02:16:53.624622+0000","last_fullsized":"2024-09-05T02:16:53.624622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-05T02:16:53.624247+0000","last_clean_scrub_stamp":"2024-09-05T02:16:53.624247+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:06:48.307668+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":725,"num_read_kb":723,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'304","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:52.262641+0000","last_change":"2024-09-05T02:16:52.262641+0000","last_active":"2024-09-05T02:16:52.262641+0000","last_peered":"2024-09-05T02:16:52.262641+0000","last_clean":"2024-09-05T02:16:52.262641+0000","last_became_active":"2024-09-05T00:49:33.907849+0000","last_became_peered":"2024-09-05T00:49:33.907849+0000","last_unstale":"2024-09-05T02:16:52.262641+0000","last_undegraded":"2024-09-05T02:16:52.262641+0000","last_fullsized":"2024-09-05T02:16:52.262641+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'304","last_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_deep_scrub":"264'304","last_deep_scrub_stamp":"2024-09-05T02:16:52.262443+0000","last_clean_scrub_stamp":"2024-09-05T02:16:52.262443+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:39:11.098650+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47523,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":500,"num_read_kb":1144,"num_write":402,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:49.860529+0000","last_change":"2024-09-05T02:16:49.860353+0000","last_active":"2024-09-05T02:16:49.860529+0000","last_peered":"2024-09-05T02:16:49.860529+0000","last_clean":"2024-09-05T02:16:49.860529+0000","last_became_active":"2024-09-05T00:49:35.940260+0000","last_became_peered":"2024-09-05T00:49:35.940260+0000","last_unstale":"2024-09-05T02:16:49.860529+0000","last_undegraded":"2024-09-05T02:16:49.860529+0000","last_fullsized":"2024-09-05T02:16:49.860529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:49.860160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:49.860160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:42:40.431987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'113","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:07.232271+0000","last_change":"2024-09-05T02:17:07.232271+0000","last_active":"2024-09-05T02:17:07.232271+0000","last_peered":"2024-09-05T02:17:07.232271+0000","last_clean":"2024-09-05T02:17:07.232271+0000","last_became_active":"2024-09-05T00:49:37.948018+0000","last_became_peered":"2024-09-05T00:49:37.948018+0000","last_unstale":"2024-09-05T02:17:07.232271+0000","last_undegraded":"2024-09-05T02:17:07.232271+0000","last_fullsized":"2024-09-05T02:17:07.232271+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'113","last_scrub_stamp":"2024-09-05T02:17:07.232045+0000","last_deep_scrub":"264'113","last_deep_scrub_stamp":"2024-09-05T02:17:07.232045+0000","last_clean_scrub_stamp":"2024-09-05T02:17:07.232045+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:31:18.319223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":154,"num_write":261,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'476","reported_seq":2075,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.011288+0000","last_change":"2024-09-05T02:16:40.011129+0000","last_active":"2024-09-05T02:16:40.011288+0000","last_peered":"2024-09-05T02:16:40.011288+0000","last_clean":"2024-09-05T02:16:40.011288+0000","last_became_active":"2024-09-05T00:49:29.913109+0000","last_became_peered":"2024-09-05T00:49:29.913109+0000","last_unstale":"2024-09-05T02:16:40.011288+0000","last_undegraded":"2024-09-05T02:16:40.011288+0000","last_fullsized":"2024-09-05T02:16:40.011288+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-09-05T02:16:40.010943+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.010943+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:14:00.723241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2524,"num_read_kb":2361,"num_write":572,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'319","reported_seq":966,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.936309+0000","last_change":"2024-09-05T02:16:33.936309+0000","last_active":"2024-09-05T02:16:33.936309+0000","last_peered":"2024-09-05T02:16:33.936309+0000","last_clean":"2024-09-05T02:16:33.936309+0000","last_became_active":"2024-09-05T00:49:27.883690+0000","last_became_peered":"2024-09-05T00:49:27.883690+0000","last_unstale":"2024-09-05T02:16:33.936309+0000","last_undegraded":"2024-09-05T02:16:33.936309+0000","last_fullsized":"2024-09-05T02:16:33.936309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'319","last_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_deep_scrub":"264'319","last_deep_scrub_stamp":"2024-09-05T02:16:33.936126+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.936126+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:20:49.975373+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":12836,"num_write":1013,"num_write_kb":35925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:51.503184+0000","last_change":"2024-09-05T02:16:51.503184+0000","last_active":"2024-09-05T02:16:51.503184+0000","last_peered":"2024-09-05T02:16:51.503184+0000","last_clean":"2024-09-05T02:16:51.503184+0000","last_became_active":"2024-09-05T00:49:31.918116+0000","last_became_peered":"2024-09-05T00:49:31.918116+0000","last_unstale":"2024-09-05T02:16:51.503184+0000","last_undegraded":"2024-09-05T02:16:51.503184+0000","last_fullsized":"2024-09-05T02:16:51.503184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:16:51.503000+0000","last_clean_scrub_stamp":"2024-09-05T02:16:51.503000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:19:52.964297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'268","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:59.169369+0000","last_change":"2024-09-05T02:16:59.169192+0000","last_active":"2024-09-05T02:16:59.169369+0000","last_peered":"2024-09-05T02:16:59.169369+0000","last_clean":"2024-09-05T02:16:59.169369+0000","last_became_active":"2024-09-05T00:49:33.925742+0000","last_became_peered":"2024-09-05T00:49:33.925742+0000","last_unstale":"2024-09-05T02:16:59.169369+0000","last_undegraded":"2024-09-05T02:16:59.169369+0000","last_fullsized":"2024-09-05T02:16:59.169369+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'268","last_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_deep_scrub":"264'268","last_deep_scrub_stamp":"2024-09-05T02:16:59.168997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:59.168997+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:26:49.788871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47269,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1091,"num_write":358,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.522236+0000","last_change":"2024-09-05T02:17:01.522113+0000","last_active":"2024-09-05T02:17:01.522236+0000","last_peered":"2024-09-05T02:17:01.522236+0000","last_clean":"2024-09-05T02:17:01.522236+0000","last_became_active":"2024-09-05T00:49:35.925054+0000","last_became_peered":"2024-09-05T00:49:35.925054+0000","last_unstale":"2024-09-05T02:17:01.522236+0000","last_undegraded":"2024-09-05T02:17:01.522236+0000","last_fullsized":"2024-09-05T02:17:01.522236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:01.521917+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.521917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:15:55.686761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'171","reported_seq":1658,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:01.873479+0000","last_change":"2024-09-05T02:17:01.873479+0000","last_active":"2024-09-05T02:17:01.873479+0000","last_peered":"2024-09-05T02:17:01.873479+0000","last_clean":"2024-09-05T02:17:01.873479+0000","last_became_active":"2024-09-05T00:49:37.940352+0000","last_became_peered":"2024-09-05T00:49:37.940352+0000","last_unstale":"2024-09-05T02:17:01.873479+0000","last_undegraded":"2024-09-05T02:17:01.873479+0000","last_fullsized":"2024-09-05T02:17:01.873479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-05T02:17:01.873172+0000","last_clean_scrub_stamp":"2024-09-05T02:17:01.873172+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:32:47.785372+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1186,"num_read_kb":1180,"num_write":372,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'346","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.488577+0000","last_change":"2024-09-05T02:16:39.488577+0000","last_active":"2024-09-05T02:16:39.488577+0000","last_peered":"2024-09-05T02:16:39.488577+0000","last_clean":"2024-09-05T02:16:39.488577+0000","last_became_active":"2024-09-05T00:49:29.915528+0000","last_became_peered":"2024-09-05T00:49:29.915528+0000","last_unstale":"2024-09-05T02:16:39.488577+0000","last_undegraded":"2024-09-05T02:16:39.488577+0000","last_fullsized":"2024-09-05T02:16:39.488577+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-09-05T02:16:39.488358+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.488358+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:26.414847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1986,"num_read_kb":1921,"num_write":382,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'356","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.518422+0000","last_change":"2024-09-05T02:16:30.518195+0000","last_active":"2024-09-05T02:16:30.518422+0000","last_peered":"2024-09-05T02:16:30.518422+0000","last_clean":"2024-09-05T02:16:30.518422+0000","last_became_active":"2024-09-05T00:49:27.893461+0000","last_became_peered":"2024-09-05T00:49:27.893461+0000","last_unstale":"2024-09-05T02:16:30.518422+0000","last_undegraded":"2024-09-05T02:16:30.518422+0000","last_fullsized":"2024-09-05T02:16:30.518422+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-05T02:16:30.517946+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.517946+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:33:37.139871+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432620,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":504,"num_read_kb":8860,"num_write":1095,"num_write_kb":38084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.170684+0000","last_change":"2024-09-05T02:16:44.170684+0000","last_active":"2024-09-05T02:16:44.170684+0000","last_peered":"2024-09-05T02:16:44.170684+0000","last_clean":"2024-09-05T02:16:44.170684+0000","last_became_active":"2024-09-05T00:49:31.903287+0000","last_became_peered":"2024-09-05T00:49:31.903287+0000","last_unstale":"2024-09-05T02:16:44.170684+0000","last_undegraded":"2024-09-05T02:16:44.170684+0000","last_fullsized":"2024-09-05T02:16:44.170684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-05T02:16:44.170506+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.170506+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:44:33.236636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'343","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:55.485820+0000","last_change":"2024-09-05T02:16:55.485686+0000","last_active":"2024-09-05T02:16:55.485820+0000","last_peered":"2024-09-05T02:16:55.485820+0000","last_clean":"2024-09-05T02:16:55.485820+0000","last_became_active":"2024-09-05T00:49:33.906973+0000","last_became_peered":"2024-09-05T00:49:33.906973+0000","last_unstale":"2024-09-05T02:16:55.485820+0000","last_undegraded":"2024-09-05T02:16:55.485820+0000","last_fullsized":"2024-09-05T02:16:55.485820+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-09-05T02:16:55.485485+0000","last_clean_scrub_stamp":"2024-09-05T02:16:55.485485+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:29:32.153291+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43005,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":543,"num_read_kb":1162,"num_write":428,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:00.170798+0000","last_change":"2024-09-05T02:17:00.170568+0000","last_active":"2024-09-05T02:17:00.170798+0000","last_peered":"2024-09-05T02:17:00.170798+0000","last_clean":"2024-09-05T02:17:00.170798+0000","last_became_active":"2024-09-05T00:49:35.927042+0000","last_became_peered":"2024-09-05T00:49:35.927042+0000","last_unstale":"2024-09-05T02:17:00.170798+0000","last_undegraded":"2024-09-05T02:17:00.170798+0000","last_fullsized":"2024-09-05T02:17:00.170798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T02:17:00.170359+0000","last_clean_scrub_stamp":"2024-09-05T02:17:00.170359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:22:09.289364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'133","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:17:02.526116+0000","last_change":"2024-09-05T02:17:02.526116+0000","last_active":"2024-09-05T02:17:02.526116+0000","last_peered":"2024-09-05T02:17:02.526116+0000","last_clean":"2024-09-05T02:17:02.526116+0000","last_became_active":"2024-09-05T00:49:37.928796+0000","last_became_peered":"2024-09-05T00:49:37.928796+0000","last_unstale":"2024-09-05T02:17:02.526116+0000","last_undegraded":"2024-09-05T02:17:02.526116+0000","last_fullsized":"2024-09-05T02:17:02.526116+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-09-05T02:17:02.525900+0000","last_clean_scrub_stamp":"2024-09-05T02:17:02.525900+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:34.211908+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":850,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":92,"num_write":302,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'435","reported_seq":2089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.163976+0000","last_change":"2024-09-05T02:16:43.163976+0000","last_active":"2024-09-05T02:16:43.163976+0000","last_peered":"2024-09-05T02:16:43.163976+0000","last_clean":"2024-09-05T02:16:43.163976+0000","last_became_active":"2024-09-05T00:49:29.891430+0000","last_became_peered":"2024-09-05T00:49:29.891430+0000","last_unstale":"2024-09-05T02:16:43.163976+0000","last_undegraded":"2024-09-05T02:16:43.163976+0000","last_fullsized":"2024-09-05T02:16:43.163976+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-09-05T02:16:43.163765+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.163765+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T14:12:41.045947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2597,"num_read_kb":2457,"num_write":517,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4549,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'378","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.805267+0000","last_change":"2024-09-05T02:16:32.805135+0000","last_active":"2024-09-05T02:16:32.805267+0000","last_peered":"2024-09-05T02:16:32.805267+0000","last_clean":"2024-09-05T02:16:32.805267+0000","last_became_active":"2024-09-05T00:49:27.896460+0000","last_became_peered":"2024-09-05T00:49:27.896460+0000","last_unstale":"2024-09-05T02:16:32.805267+0000","last_undegraded":"2024-09-05T02:16:32.805267+0000","last_fullsized":"2024-09-05T02:16:32.805267+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:32.804912+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.804912+0000","objects_scrubbed":10,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:43:04.484010+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":487,"num_read_kb":8853,"num_write":1134,"num_write_kb":34325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'1144","reported_seq":2643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.267542+0000","last_change":"2024-09-05T02:16:37.267542+0000","last_active":"2024-09-05T02:16:37.267542+0000","last_peered":"2024-09-05T02:16:37.267542+0000","last_clean":"2024-09-05T02:16:37.267542+0000","last_became_active":"2024-09-05T00:49:29.901125+0000","last_became_peered":"2024-09-05T00:49:29.901125+0000","last_unstale":"2024-09-05T02:16:37.267542+0000","last_undegraded":"2024-09-05T02:16:37.267542+0000","last_fullsized":"2024-09-05T02:16:37.267542+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1144","last_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_deep_scrub":"264'1144","last_deep_scrub_stamp":"2024-09-05T02:16:37.267346+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.267346+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:22:33.530651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5046,"num_read_kb":4428,"num_write":1568,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'332","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:30.795376+0000","last_change":"2024-09-05T02:16:30.795215+0000","last_active":"2024-09-05T02:16:30.795376+0000","last_peered":"2024-09-05T02:16:30.795376+0000","last_clean":"2024-09-05T02:16:30.795376+0000","last_became_active":"2024-09-05T00:50:04.181973+0000","last_became_peered":"2024-09-05T00:50:04.181973+0000","last_unstale":"2024-09-05T02:16:30.795376+0000","last_undegraded":"2024-09-05T02:16:30.795376+0000","last_fullsized":"2024-09-05T02:16:30.795376+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:30.794997+0000","last_clean_scrub_stamp":"2024-09-05T02:16:30.794997+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:04:12.891688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079906,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":505,"num_read_kb":102142,"num_write":1127,"num_write_kb":48976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'694","reported_seq":2124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:47.550350+0000","last_change":"2024-09-05T02:16:47.550350+0000","last_active":"2024-09-05T02:16:47.550350+0000","last_peered":"2024-09-05T02:16:47.550350+0000","last_clean":"2024-09-05T02:16:47.550350+0000","last_became_active":"2024-09-05T00:49:29.904257+0000","last_became_peered":"2024-09-05T00:49:29.904257+0000","last_unstale":"2024-09-05T02:16:47.550350+0000","last_undegraded":"2024-09-05T02:16:47.550350+0000","last_fullsized":"2024-09-05T02:16:47.550350+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'694","last_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_deep_scrub":"264'694","last_deep_scrub_stamp":"2024-09-05T02:16:47.550157+0000","last_clean_scrub_stamp":"2024-09-05T02:16:47.550157+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:09.741807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3272,"num_read_kb":2963,"num_write":906,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'312","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.519094+0000","last_change":"2024-09-05T02:16:36.518851+0000","last_active":"2024-09-05T02:16:36.519094+0000","last_peered":"2024-09-05T02:16:36.519094+0000","last_clean":"2024-09-05T02:16:36.519094+0000","last_became_active":"2024-09-05T00:49:27.893983+0000","last_became_peered":"2024-09-05T00:49:27.893983+0000","last_unstale":"2024-09-05T02:16:36.519094+0000","last_undegraded":"2024-09-05T02:16:36.519094+0000","last_fullsized":"2024-09-05T02:16:36.519094+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'312","last_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_deep_scrub":"264'312","last_deep_scrub_stamp":"2024-09-05T02:16:36.518501+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.518501+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:55.497838+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262399,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":431,"num_read_kb":411,"num_write":976,"num_write_kb":16789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'418","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.226428+0000","last_change":"2024-09-05T02:16:38.226428+0000","last_active":"2024-09-05T02:16:38.226428+0000","last_peered":"2024-09-05T02:16:38.226428+0000","last_clean":"2024-09-05T02:16:38.226428+0000","last_became_active":"2024-09-05T00:49:29.908003+0000","last_became_peered":"2024-09-05T00:49:29.908003+0000","last_unstale":"2024-09-05T02:16:38.226428+0000","last_undegraded":"2024-09-05T02:16:38.226428+0000","last_fullsized":"2024-09-05T02:16:38.226428+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-09-05T02:16:38.226250+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.226250+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:54:52.035389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2300,"num_read_kb":2186,"num_write":486,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'318","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.490829+0000","last_change":"2024-09-05T02:16:33.490696+0000","last_active":"2024-09-05T02:16:33.490829+0000","last_peered":"2024-09-05T02:16:33.490829+0000","last_clean":"2024-09-05T02:16:33.490829+0000","last_became_active":"2024-09-05T00:49:27.868997+0000","last_became_peered":"2024-09-05T00:49:27.868997+0000","last_unstale":"2024-09-05T02:16:33.490829+0000","last_undegraded":"2024-09-05T02:16:33.490829+0000","last_fullsized":"2024-09-05T02:16:33.490829+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-05T02:16:33.490479+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.490479+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:50:04.157446+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079948,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":737,"num_read_kb":8229,"num_write":1002,"num_write_kb":40314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'1684","reported_seq":3540,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.037874+0000","last_change":"2024-09-05T02:16:42.037729+0000","last_active":"2024-09-05T02:16:42.037874+0000","last_peered":"2024-09-05T02:16:42.037874+0000","last_clean":"2024-09-05T02:16:42.037874+0000","last_became_active":"2024-09-05T00:49:29.927331+0000","last_became_peered":"2024-09-05T00:49:29.927331+0000","last_unstale":"2024-09-05T02:16:42.037874+0000","last_undegraded":"2024-09-05T02:16:42.037874+0000","last_fullsized":"2024-09-05T02:16:42.037874+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1684","last_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_deep_scrub":"264'1684","last_deep_scrub_stamp":"2024-09-05T02:16:42.037537+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.037537+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":1600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:08:08.464426+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7497,"num_read_kb":6577,"num_write":2335,"num_write_kb":980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1415,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'362","reported_seq":1083,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.923360+0000","last_change":"2024-09-05T02:16:31.923360+0000","last_active":"2024-09-05T02:16:31.923360+0000","last_peered":"2024-09-05T02:16:31.923360+0000","last_clean":"2024-09-05T02:16:31.923360+0000","last_became_active":"2024-09-05T00:49:27.883202+0000","last_became_peered":"2024-09-05T00:49:27.883202+0000","last_unstale":"2024-09-05T02:16:31.923360+0000","last_undegraded":"2024-09-05T02:16:31.923360+0000","last_fullsized":"2024-09-05T02:16:31.923360+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-05T02:16:31.923168+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.923168+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:18:09.796286+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":540,"num_read_kb":75263,"num_write":1071,"num_write_kb":53169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'626","reported_seq":2268,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:42.513628+0000","last_change":"2024-09-05T02:16:42.513367+0000","last_active":"2024-09-05T02:16:42.513628+0000","last_peered":"2024-09-05T02:16:42.513628+0000","last_clean":"2024-09-05T02:16:42.513628+0000","last_became_active":"2024-09-05T00:49:29.910620+0000","last_became_peered":"2024-09-05T00:49:29.910620+0000","last_unstale":"2024-09-05T02:16:42.513628+0000","last_undegraded":"2024-09-05T02:16:42.513628+0000","last_fullsized":"2024-09-05T02:16:42.513628+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-05T02:16:42.513129+0000","last_clean_scrub_stamp":"2024-09-05T02:16:42.513129+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:45:25.607651+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2856,"num_write":817,"num_write_kb":250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'360","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.345367+0000","last_change":"2024-09-05T02:16:32.345367+0000","last_active":"2024-09-05T02:16:32.345367+0000","last_peered":"2024-09-05T02:16:32.345367+0000","last_clean":"2024-09-05T02:16:32.345367+0000","last_became_active":"2024-09-05T00:49:27.883606+0000","last_became_peered":"2024-09-05T00:49:27.883606+0000","last_unstale":"2024-09-05T02:16:32.345367+0000","last_undegraded":"2024-09-05T02:16:32.345367+0000","last_fullsized":"2024-09-05T02:16:32.345367+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-05T02:16:32.345077+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.345077+0000","objects_scrubbed":8,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:01:46.067374+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1453457,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":528,"num_read_kb":27144,"num_write":1118,"num_write_kb":48391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'685","reported_seq":2370,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.065195+0000","last_change":"2024-09-05T02:16:44.065049+0000","last_active":"2024-09-05T02:16:44.065195+0000","last_peered":"2024-09-05T02:16:44.065195+0000","last_clean":"2024-09-05T02:16:44.065195+0000","last_became_active":"2024-09-05T00:49:29.924790+0000","last_became_peered":"2024-09-05T00:49:29.924790+0000","last_unstale":"2024-09-05T02:16:44.065195+0000","last_undegraded":"2024-09-05T02:16:44.065195+0000","last_fullsized":"2024-09-05T02:16:44.065195+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'685","last_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_deep_scrub":"264'685","last_deep_scrub_stamp":"2024-09-05T02:16:44.064848+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.064848+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:21:18.934798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3624,"num_read_kb":3302,"num_write":961,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'376","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.778588+0000","last_change":"2024-09-05T02:16:33.778588+0000","last_active":"2024-09-05T02:16:33.778588+0000","last_peered":"2024-09-05T02:16:33.778588+0000","last_clean":"2024-09-05T02:16:33.778588+0000","last_became_active":"2024-09-05T00:49:27.908857+0000","last_became_peered":"2024-09-05T00:49:27.908857+0000","last_unstale":"2024-09-05T02:16:33.778588+0000","last_undegraded":"2024-09-05T02:16:33.778588+0000","last_fullsized":"2024-09-05T02:16:33.778588+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'376","last_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_deep_scrub":"264'376","last_deep_scrub_stamp":"2024-09-05T02:16:33.778363+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.778363+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:34:27.507514+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":588,"num_read_kb":10940,"num_write":1274,"num_write_kb":49571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'477","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.912137+0000","last_change":"2024-09-05T02:16:40.911914+0000","last_active":"2024-09-05T02:16:40.912137+0000","last_peered":"2024-09-05T02:16:40.912137+0000","last_clean":"2024-09-05T02:16:40.912137+0000","last_became_active":"2024-09-05T00:49:29.888142+0000","last_became_peered":"2024-09-05T00:49:29.888142+0000","last_unstale":"2024-09-05T02:16:40.912137+0000","last_undegraded":"2024-09-05T02:16:40.912137+0000","last_fullsized":"2024-09-05T02:16:40.912137+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-09-05T02:16:40.911681+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.911681+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:42:52.589997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2591,"num_read_kb":2419,"num_write":577,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:32.936616+0000","last_change":"2024-09-05T02:16:32.936616+0000","last_active":"2024-09-05T02:16:32.936616+0000","last_peered":"2024-09-05T02:16:32.936616+0000","last_clean":"2024-09-05T02:16:32.936616+0000","last_became_active":"2024-09-05T00:49:27.885159+0000","last_became_peered":"2024-09-05T00:49:27.885159+0000","last_unstale":"2024-09-05T02:16:32.936616+0000","last_undegraded":"2024-09-05T02:16:32.936616+0000","last_fullsized":"2024-09-05T02:16:32.936616+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:32.936402+0000","last_clean_scrub_stamp":"2024-09-05T02:16:32.936402+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:24:04.969865+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6461798,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":486,"num_read_kb":29011,"num_write":1195,"num_write_kb":23175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1110","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.389653+0000","last_change":"2024-09-05T02:16:37.389653+0000","last_active":"2024-09-05T02:16:37.389653+0000","last_peered":"2024-09-05T02:16:37.389653+0000","last_clean":"2024-09-05T02:16:37.389653+0000","last_became_active":"2024-09-05T00:49:29.915346+0000","last_became_peered":"2024-09-05T00:49:29.915346+0000","last_unstale":"2024-09-05T02:16:37.389653+0000","last_undegraded":"2024-09-05T02:16:37.389653+0000","last_fullsized":"2024-09-05T02:16:37.389653+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1110","last_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_deep_scrub":"264'1110","last_deep_scrub_stamp":"2024-09-05T02:16:37.389478+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.389478+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":1000,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:28:32.651447+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5091,"num_read_kb":4462,"num_write":1567,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'366","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:37.545413+0000","last_change":"2024-09-05T02:16:37.545413+0000","last_active":"2024-09-05T02:16:37.545413+0000","last_peered":"2024-09-05T02:16:37.545413+0000","last_clean":"2024-09-05T02:16:37.545413+0000","last_became_active":"2024-09-05T00:49:27.888366+0000","last_became_peered":"2024-09-05T00:49:27.888366+0000","last_unstale":"2024-09-05T02:16:37.545413+0000","last_undegraded":"2024-09-05T02:16:37.545413+0000","last_fullsized":"2024-09-05T02:16:37.545413+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-05T02:16:37.545206+0000","last_clean_scrub_stamp":"2024-09-05T02:16:37.545206+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:22:31.687864+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":812902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":610,"num_read_kb":61900,"num_write":1145,"num_write_kb":62529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'622","reported_seq":2305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.495551+0000","last_change":"2024-09-05T02:16:44.495551+0000","last_active":"2024-09-05T02:16:44.495551+0000","last_peered":"2024-09-05T02:16:44.495551+0000","last_clean":"2024-09-05T02:16:44.495551+0000","last_became_active":"2024-09-05T00:49:29.911809+0000","last_became_peered":"2024-09-05T00:49:29.911809+0000","last_unstale":"2024-09-05T02:16:44.495551+0000","last_undegraded":"2024-09-05T02:16:44.495551+0000","last_fullsized":"2024-09-05T02:16:44.495551+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'622","last_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_deep_scrub":"264'622","last_deep_scrub_stamp":"2024-09-05T02:16:44.495326+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.495326+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:30:02.043865+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3262,"num_read_kb":3046,"num_write":837,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3189,"num_omap_keys":13,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'350","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.044750+0000","last_change":"2024-09-05T02:16:36.044641+0000","last_active":"2024-09-05T02:16:36.044750+0000","last_peered":"2024-09-05T02:16:36.044750+0000","last_clean":"2024-09-05T02:16:36.044750+0000","last_became_active":"2024-09-05T00:49:27.883227+0000","last_became_peered":"2024-09-05T00:49:27.883227+0000","last_unstale":"2024-09-05T02:16:36.044750+0000","last_undegraded":"2024-09-05T02:16:36.044750+0000","last_fullsized":"2024-09-05T02:16:36.044750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'350","last_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_deep_scrub":"264'350","last_deep_scrub_stamp":"2024-09-05T02:16:36.044432+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.044432+0000","objects_scrubbed":13,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:47:25.636296+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953006,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":484,"num_read_kb":25097,"num_write":1158,"num_write_kb":42657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'543","reported_seq":2197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:35.753037+0000","last_change":"2024-09-05T02:16:35.752884+0000","last_active":"2024-09-05T02:16:35.753037+0000","last_peered":"2024-09-05T02:16:35.753037+0000","last_clean":"2024-09-05T02:16:35.753037+0000","last_became_active":"2024-09-05T00:49:29.886591+0000","last_became_peered":"2024-09-05T00:49:29.886591+0000","last_unstale":"2024-09-05T02:16:35.753037+0000","last_undegraded":"2024-09-05T02:16:35.753037+0000","last_fullsized":"2024-09-05T02:16:35.753037+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'543","last_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_deep_scrub":"264'543","last_deep_scrub_stamp":"2024-09-05T02:16:35.752698+0000","last_clean_scrub_stamp":"2024-09-05T02:16:35.752698+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:31:45.155213+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2860,"num_read_kb":2666,"num_write":703,"num_write_kb":233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'410","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:29.779143+0000","last_change":"2024-09-05T02:16:29.779143+0000","last_active":"2024-09-05T02:16:29.779143+0000","last_peered":"2024-09-05T02:16:29.779143+0000","last_clean":"2024-09-05T02:16:29.779143+0000","last_became_active":"2024-09-05T00:50:04.180365+0000","last_became_peered":"2024-09-05T00:50:04.180365+0000","last_unstale":"2024-09-05T02:16:29.779143+0000","last_undegraded":"2024-09-05T02:16:29.779143+0000","last_fullsized":"2024-09-05T02:16:29.779143+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'410","last_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_deep_scrub":"264'410","last_deep_scrub_stamp":"2024-09-05T02:16:29.778934+0000","last_clean_scrub_stamp":"2024-09-05T02:16:29.778934+0000","objects_scrubbed":8,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:24:09.661610+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262234,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":5699,"num_write":1247,"num_write_kb":21476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"264'1185","reported_seq":2845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.510478+0000","last_change":"2024-09-05T02:16:43.510341+0000","last_active":"2024-09-05T02:16:43.510478+0000","last_peered":"2024-09-05T02:16:43.510478+0000","last_clean":"2024-09-05T02:16:43.510478+0000","last_became_active":"2024-09-05T00:49:29.910585+0000","last_became_peered":"2024-09-05T00:49:29.910585+0000","last_unstale":"2024-09-05T02:16:43.510478+0000","last_undegraded":"2024-09-05T02:16:43.510478+0000","last_fullsized":"2024-09-05T02:16:43.510478+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1185","last_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_deep_scrub":"264'1185","last_deep_scrub_stamp":"2024-09-05T02:16:43.510160+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.510160+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":1100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:51.275393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5517,"num_read_kb":4875,"num_write":1632,"num_write_kb":687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'336","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:36.452460+0000","last_change":"2024-09-05T02:16:36.452295+0000","last_active":"2024-09-05T02:16:36.452460+0000","last_peered":"2024-09-05T02:16:36.452460+0000","last_clean":"2024-09-05T02:16:36.452460+0000","last_became_active":"2024-09-05T00:49:27.905699+0000","last_became_peered":"2024-09-05T00:49:27.905699+0000","last_unstale":"2024-09-05T02:16:36.452460+0000","last_undegraded":"2024-09-05T02:16:36.452460+0000","last_fullsized":"2024-09-05T02:16:36.452460+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-05T02:16:36.451991+0000","last_clean_scrub_stamp":"2024-09-05T02:16:36.451991+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:15:44.484998+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":5076,"num_write":1193,"num_write_kb":33220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'491","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.060981+0000","last_change":"2024-09-05T02:16:43.060842+0000","last_active":"2024-09-05T02:16:43.060981+0000","last_peered":"2024-09-05T02:16:43.060981+0000","last_clean":"2024-09-05T02:16:43.060981+0000","last_became_active":"2024-09-05T00:49:29.925248+0000","last_became_peered":"2024-09-05T00:49:29.925248+0000","last_unstale":"2024-09-05T02:16:43.060981+0000","last_undegraded":"2024-09-05T02:16:43.060981+0000","last_fullsized":"2024-09-05T02:16:43.060981+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'491","last_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_deep_scrub":"264'491","last_deep_scrub_stamp":"2024-09-05T02:16:43.060647+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.060647+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:25.428329+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2428,"num_read_kb":2254,"num_write":589,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'374","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.790434+0000","last_change":"2024-09-05T02:16:34.790296+0000","last_active":"2024-09-05T02:16:34.790434+0000","last_peered":"2024-09-05T02:16:34.790434+0000","last_clean":"2024-09-05T02:16:34.790434+0000","last_became_active":"2024-09-05T00:49:27.887638+0000","last_became_peered":"2024-09-05T00:49:27.887638+0000","last_unstale":"2024-09-05T02:16:34.790434+0000","last_undegraded":"2024-09-05T02:16:34.790434+0000","last_fullsized":"2024-09-05T02:16:34.790434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'374","last_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_deep_scrub":"264'374","last_deep_scrub_stamp":"2024-09-05T02:16:34.790058+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.790058+0000","objects_scrubbed":5,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:17:13.589152+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1342128,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":612,"num_read_kb":31375,"num_write":1285,"num_write_kb":18112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'688","reported_seq":2242,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:34.444897+0000","last_change":"2024-09-05T02:16:34.444760+0000","last_active":"2024-09-05T02:16:34.444897+0000","last_peered":"2024-09-05T02:16:34.444897+0000","last_clean":"2024-09-05T02:16:34.444897+0000","last_became_active":"2024-09-05T00:49:29.921968+0000","last_became_peered":"2024-09-05T00:49:29.921968+0000","last_unstale":"2024-09-05T02:16:34.444897+0000","last_undegraded":"2024-09-05T02:16:34.444897+0000","last_fullsized":"2024-09-05T02:16:34.444897+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'688","last_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_deep_scrub":"264'688","last_deep_scrub_stamp":"2024-09-05T02:16:34.444577+0000","last_clean_scrub_stamp":"2024-09-05T02:16:34.444577+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":600,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:36:27.270344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3373,"num_read_kb":3062,"num_write":959,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'349","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.051713+0000","last_change":"2024-09-05T02:16:39.051570+0000","last_active":"2024-09-05T02:16:39.051713+0000","last_peered":"2024-09-05T02:16:39.051713+0000","last_clean":"2024-09-05T02:16:39.051713+0000","last_became_active":"2024-09-05T00:49:27.910372+0000","last_became_peered":"2024-09-05T00:49:27.910372+0000","last_unstale":"2024-09-05T02:16:39.051713+0000","last_undegraded":"2024-09-05T02:16:39.051713+0000","last_fullsized":"2024-09-05T02:16:39.051713+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-05T02:16:39.051218+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.051218+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:08:07.873190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1117646,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":549,"num_read_kb":11105,"num_write":1131,"num_write_kb":45602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'524","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:43.037778+0000","last_change":"2024-09-05T02:16:43.037635+0000","last_active":"2024-09-05T02:16:43.037778+0000","last_peered":"2024-09-05T02:16:43.037778+0000","last_clean":"2024-09-05T02:16:43.037778+0000","last_became_active":"2024-09-05T00:49:29.915086+0000","last_became_peered":"2024-09-05T00:49:29.915086+0000","last_unstale":"2024-09-05T02:16:43.037778+0000","last_undegraded":"2024-09-05T02:16:43.037778+0000","last_fullsized":"2024-09-05T02:16:43.037778+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'524","last_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_deep_scrub":"264'524","last_deep_scrub_stamp":"2024-09-05T02:16:43.037438+0000","last_clean_scrub_stamp":"2024-09-05T02:16:43.037438+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:01.180965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2695,"num_read_kb":2495,"num_write":642,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'332","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:31.770992+0000","last_change":"2024-09-05T02:16:31.770992+0000","last_active":"2024-09-05T02:16:31.770992+0000","last_peered":"2024-09-05T02:16:31.770992+0000","last_clean":"2024-09-05T02:16:31.770992+0000","last_became_active":"2024-09-05T00:49:27.885304+0000","last_became_peered":"2024-09-05T00:49:27.885304+0000","last_unstale":"2024-09-05T02:16:31.770992+0000","last_undegraded":"2024-09-05T02:16:31.770992+0000","last_fullsized":"2024-09-05T02:16:31.770992+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-05T02:16:31.770780+0000","last_clean_scrub_stamp":"2024-09-05T02:16:31.770780+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:52:08.517290+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":115088,"num_write":1048,"num_write_kb":43431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'474","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:44.964444+0000","last_change":"2024-09-05T02:16:44.964444+0000","last_active":"2024-09-05T02:16:44.964444+0000","last_peered":"2024-09-05T02:16:44.964444+0000","last_clean":"2024-09-05T02:16:44.964444+0000","last_became_active":"2024-09-05T00:49:29.915106+0000","last_became_peered":"2024-09-05T00:49:29.915106+0000","last_unstale":"2024-09-05T02:16:44.964444+0000","last_undegraded":"2024-09-05T02:16:44.964444+0000","last_fullsized":"2024-09-05T02:16:44.964444+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-09-05T02:16:44.964260+0000","last_clean_scrub_stamp":"2024-09-05T02:16:44.964260+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:03:25.779977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2554,"num_read_kb":2426,"num_write":560,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'313","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:38.588790+0000","last_change":"2024-09-05T02:16:38.588790+0000","last_active":"2024-09-05T02:16:38.588790+0000","last_peered":"2024-09-05T02:16:38.588790+0000","last_clean":"2024-09-05T02:16:38.588790+0000","last_became_active":"2024-09-05T00:49:27.915029+0000","last_became_peered":"2024-09-05T00:49:27.915029+0000","last_unstale":"2024-09-05T02:16:38.588790+0000","last_undegraded":"2024-09-05T02:16:38.588790+0000","last_fullsized":"2024-09-05T02:16:38.588790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-05T02:16:38.588599+0000","last_clean_scrub_stamp":"2024-09-05T02:16:38.588599+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:14:12.567380+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":641,"num_write":1040,"num_write_kb":25720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'421","reported_seq":1128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:40.547611+0000","last_change":"2024-09-05T02:16:40.547611+0000","last_active":"2024-09-05T02:16:40.547611+0000","last_peered":"2024-09-05T02:16:40.547611+0000","last_clean":"2024-09-05T02:16:40.547611+0000","last_became_active":"2024-09-05T00:49:27.899273+0000","last_became_peered":"2024-09-05T00:49:27.899273+0000","last_unstale":"2024-09-05T02:16:40.547611+0000","last_undegraded":"2024-09-05T02:16:40.547611+0000","last_fullsized":"2024-09-05T02:16:40.547611+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-09-05T02:16:40.547395+0000","last_clean_scrub_stamp":"2024-09-05T02:16:40.547395+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:08:27.409142+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":738,"num_read_kb":35471,"num_write":1283,"num_write_kb":17997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'408","reported_seq":2011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:39.357291+0000","last_change":"2024-09-05T02:16:39.357127+0000","last_active":"2024-09-05T02:16:39.357291+0000","last_peered":"2024-09-05T02:16:39.357291+0000","last_clean":"2024-09-05T02:16:39.357291+0000","last_became_active":"2024-09-05T00:49:29.916446+0000","last_became_peered":"2024-09-05T00:49:29.916446+0000","last_unstale":"2024-09-05T02:16:39.357291+0000","last_undegraded":"2024-09-05T02:16:39.357291+0000","last_fullsized":"2024-09-05T02:16:39.357291+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-09-05T02:16:39.356925+0000","last_clean_scrub_stamp":"2024-09-05T02:16:39.356925+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:41:00.382840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2390,"num_read_kb":2268,"num_write":458,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2486,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'378","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:33.318136+0000","last_change":"2024-09-05T02:16:33.318136+0000","last_active":"2024-09-05T02:16:33.318136+0000","last_peered":"2024-09-05T02:16:33.318136+0000","last_clean":"2024-09-05T02:16:33.318136+0000","last_became_active":"2024-09-05T00:49:27.884831+0000","last_became_peered":"2024-09-05T00:49:27.884831+0000","last_unstale":"2024-09-05T02:16:33.318136+0000","last_undegraded":"2024-09-05T02:16:33.318136+0000","last_fullsized":"2024-09-05T02:16:33.318136+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-05T02:16:33.317918+0000","last_clean_scrub_stamp":"2024-09-05T02:16:33.317918+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:04:08.472687+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":487,"num_read_kb":26073,"num_write":1194,"num_write_kb":50143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'875","reported_seq":2446,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-05T02:16:45.477942+0000","last_change":"2024-09-05T02:16:45.477942+0000","last_active":"2024-09-05T02:16:45.477942+0000","last_peered":"2024-09-05T02:16:45.477942+0000","last_clean":"2024-09-05T02:16:45.477942+0000","last_became_active":"2024-09-05T00:49:29.907924+0000","last_became_peered":"2024-09-05T00:49:29.907924+0000","last_unstale":"2024-09-05T02:16:45.477942+0000","last_undegraded":"2024-09-05T02:16:45.477942+0000","last_fullsized":"2024-09-05T02:16:45.477942+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-09-05T02:16:45.477756+0000","last_clean_scrub_stamp":"2024-09-05T02:16:45.477756+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:50:07.361494+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4139,"num_read_kb":3695,"num_write":1144,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3055,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6020,"num_read_kb":4215,"num_write":1949,"num_write_kb":848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6000,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1022,"ondisk_log_size":1022,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15067,"num_read_kb":14717,"num_write":16717,"num_write_kb":4880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1846,"ondisk_log_size":1846,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1550994,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":19804,"num_read_kb":40130,"num_write":16519,"num_write_kb":12075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675288,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1951,"ondisk_log_size":1951,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212777,"num_read_kb":194096,"num_write":55357,"num_write_kb":18879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43016,"num_omap_keys":175,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":66708448,"num_objects":366,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36139,"num_read_kb":2043809,"num_write":71843,"num_write_kb":2233407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":134676480,"data_stored":133416896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3567,"ondisk_log_size":3567,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":174352,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":174298,"num_write":154,"num_write_kb":115922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510510,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285436,"kb_used_data":23788,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94086404,"statfs":{"total":96636764160,"available":96344477696,"internally_reserved":0,"allocated":24358912,"data_stored":22640434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":267909578},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510509,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221484,"kb_used_data":13980,"kb_used_omap":1,"kb_used_meta":207486,"kb_avail":94150356,"statfs":{"total":96636764160,"available":96409964544,"internally_reserved":0,"allocated":14315520,"data_stored":12734941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":212466118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510506,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120456,"kb_used_data":30968,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94251384,"statfs":{"total":96636764160,"available":96513417216,"internally_reserved":0,"allocated":31711232,"data_stored":30061356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510510,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":35928,"kb_used_omap":1,"kb_used_meta":261566,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":36790272,"data_stored":35092545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":267844039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510508,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":103096,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94268744,"statfs":{"total":96636764160,"available":96531193856,"internally_reserved":0,"allocated":9740288,"data_stored":8176150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510509,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149928,"kb_used_data":10520,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94221912,"statfs":{"total":96636764160,"available":96483237888,"internally_reserved":0,"allocated":10772480,"data_stored":9180748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543213,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150792,"kb_used_data":16952,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94221048,"statfs":{"total":96636764160,"available":96482353152,"internally_reserved":0,"allocated":17358848,"data_stored":15590745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137034181},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543214,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271424,"kb_used_data":19568,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100416,"statfs":{"total":96636764160,"available":96358825984,"internally_reserved":0,"allocated":20037632,"data_stored":18279783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15736832,"data_stored":15540753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":7036545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6131712,"data_stored":6032468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33136640,"data_stored":32946939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28102656,"data_stored":27918588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":13446327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10702848,"data_stored":10591792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20078592,"data_stored":19903484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":6529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T02:17:51.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-05T02:17:52.054 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-05T02:17:52.054 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-05T02:17:52.054 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-05T02:17:52.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:17:54.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-05T02:17:58.157 INFO:tasks.ceph.osd.0:Stopped 2024-09-05T02:17:58.157 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-05T02:17:58.157 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:17:58.242 INFO:tasks.ceph.osd.1:Stopped 2024-09-05T02:17:58.242 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-05T02:17:58.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:00.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-05T02:18:00.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-05T02:18:04.344 INFO:tasks.ceph.osd.2:Stopped 2024-09-05T02:18:04.345 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-05T02:18:04.345 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:04.441 INFO:tasks.ceph.osd.3:Stopped 2024-09-05T02:18:04.442 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-05T02:18:04.442 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:04.539 INFO:tasks.ceph.osd.4:Stopped 2024-09-05T02:18:04.539 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-05T02:18:04.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:04.639 INFO:tasks.ceph.osd.5:Stopped 2024-09-05T02:18:04.640 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-05T02:18:04.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:05.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-05T02:18:05.973 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-05T02:18:10.741 INFO:tasks.ceph.osd.6:Stopped 2024-09-05T02:18:10.742 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-05T02:18:10.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:11.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-05T02:18:11.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-05T02:18:16.844 INFO:tasks.ceph.osd.7:Stopped 2024-09-05T02:18:16.845 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-05T02:18:16.845 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-05T02:18:16.845 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:16.874 INFO:tasks.ceph.mgr.y:Stopped 2024-09-05T02:18:16.874 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-05T02:18:16.874 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:16.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2024-09-05T02:18:16.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-05T02:18:16.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-05T02:18:16.906 INFO:tasks.ceph.mgr.x:Stopped 2024-09-05T02:18:16.907 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-05T02:18:16.907 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-05T02:18:16.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:16.948 INFO:tasks.ceph.mon.a:Stopped 2024-09-05T02:18:16.948 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-05T02:18:16.948 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:17.015 INFO:tasks.ceph.mon.c:Stopped 2024-09-05T02:18:17.015 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-05T02:18:17.015 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T02:18:17.038 INFO:tasks.ceph.mon.b:Stopped 2024-09-05T02:18:17.039 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-05T02:18:17.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-05T02:18:17.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T02:18:17.078 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-05T02:18:17.499 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T02:18:17.499 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-05T02:18:17.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T02:18:17.723 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-05T02:18:17.895 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T02:18:17.895 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-05T02:18:18.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T02:18:18.105 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-05T02:18:18.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T02:18:18.468 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-05T02:18:18.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T02:18:18.629 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-05T02:18:18.763 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T02:18:18.763 DEBUG:teuthology.orchestra.run.smithi204:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-05T02:18:18.897 INFO:tasks.ceph:Archiving mon data... 2024-09-05T02:18:19.007 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/data/mon.a.tgz 2024-09-05T02:18:19.007 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-05T02:18:19.014 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.3UlAwggbGx 2024-09-05T02:18:19.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3UlAwggbGx 2024-09-05T02:18:19.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.3UlAwggbGx 2024-09-05T02:18:19.251 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.3UlAwggbGx is 526KB 2024-09-05T02:18:19.313 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.3UlAwggbGx 2024-09-05T02:18:19.319 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/data/mon.c.tgz 2024-09-05T02:18:19.319 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-05T02:18:19.368 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.HuPETiqT5b 2024-09-05T02:18:19.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HuPETiqT5b 2024-09-05T02:18:19.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.HuPETiqT5b 2024-09-05T02:18:19.607 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.HuPETiqT5b is 535KB 2024-09-05T02:18:19.670 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.HuPETiqT5b 2024-09-05T02:18:19.675 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/data/mon.b.tgz 2024-09-05T02:18:19.675 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-09-05T02:18:19.681 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.ipolLHTjmA 2024-09-05T02:18:19.682 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ipolLHTjmA 2024-09-05T02:18:19.862 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.ipolLHTjmA 2024-09-05T02:18:19.922 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.ipolLHTjmA is 535KB 2024-09-05T02:18:19.990 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.ipolLHTjmA 2024-09-05T02:18:19.995 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-05T02:18:19.995 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T02:18:19.998 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T02:18:20.113 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_DefinitelyLost operator new[](unsigned long) decode_message(ceph::common::CephContext*, int, ceph_msg_header&, ceph_msg_footer&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, boost::intrusive_ptr) ProtocolV2::handle_message() 2024-09-05T02:18:20.123 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-05T02:18:20.123 INFO:tasks.ceph:Archiving crash dumps... 2024-09-05T02:18:20.125 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi099/crash 2024-09-05T02:18:20.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T02:18:20.140 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi204/crash 2024-09-05T02:18:20.141 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T02:18:20.179 INFO:tasks.ceph:Compressing logs... 2024-09-05T02:18:20.180 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T02:18:20.184 DEBUG:teuthology.orchestra.run.smithi204:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T02:18:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66591.log 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55537.log 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.66591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68415.log 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55537.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.66591.log.gz 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106976.log 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr: 20.8% -- replaced with /var/log/ceph/ceph-client.admin.55537.log.gz 2024-09-05T02:18:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.68415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180122.log 2024-09-05T02:18:20.212 INFO:teuthology.orchestra.run.smithi099.stderr: 84.7%/var/log/ceph/ceph-client.admin.106976.log: -- replaced with /var/log/ceph/ceph-client.0.68415.log.gz 2024-09-05T02:18:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69697.log 2024-09-05T02:18:20.212 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106976.log.gz 2024-09-05T02:18:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.180122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62638.log 2024-09-05T02:18:20.212 INFO:teuthology.orchestra.run.smithi099.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.180122.log.gz 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.69697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178786.log 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62638.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.69697.log.gz 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.178786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153617.log 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178786.log.gz 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135301.log 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62638.log.gz 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.153617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32812.log 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.153617.log.gz 2024-09-05T02:18:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-09-05T02:18:20.219 INFO:teuthology.orchestra.run.smithi099.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135301.log.gz 2024-09-05T02:18:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56832.log 2024-09-05T02:18:20.219 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32812.log.gz 2024-09-05T02:18:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-09-05T02:18:20.219 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56832.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78065.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr: 58.0% -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56832.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46021.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.78065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51381.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.78065.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167738.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156642.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.46021.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51381.log: /var/log/ceph/ceph-client.0.167738.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51381.log.gz 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32280.log 2024-09-05T02:18:20.220 INFO:teuthology.orchestra.run.smithi099.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167738.log.gz 2024-09-05T02:18:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156617.log 2024-09-05T02:18:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.156642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156642.log.gz 2024-09-05T02:18:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145925.log 2024-09-05T02:18:20.221 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32280.log.gz 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.156617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53201.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156617.log.gz 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.145925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181597.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.53201.log.gz 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98716.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181597.log.gz 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58767.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145925.log.gzgzip 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.173048.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.98716.log: /var/log/ceph/ceph-client.admin.58767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-09-05T02:18:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.173048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2024-09-05T02:18:20.225 INFO:teuthology.orchestra.run.smithi099.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.173048.log.gz 2024-09-05T02:18:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108746.log 2024-09-05T02:18:20.225 INFO:teuthology.orchestra.run.smithi099.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-09-05T02:18:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159336.log 2024-09-05T02:18:20.228 INFO:teuthology.orchestra.run.smithi099.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.98716.log.gz 2024-09-05T02:18:20.228 INFO:teuthology.orchestra.run.smithi099.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2024-09-05T02:18:20.228 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.108746.log: -5 --verbose -- /var/log/ceph/ceph-client.0.69107.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.159336.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108746.log.gz 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.69107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48971.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32406.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134711.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.48971.log.gz 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32406.log.gz 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33268.log 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58767.log.gz 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134711.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159336.log.gz 2024-09-05T02:18:20.229 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.134711.log.gz 2024-09-05T02:18:20.232 INFO:teuthology.orchestra.run.smithi099.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.69107.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121140.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33268.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82785.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96946.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.121140.log: /var/log/ceph/ceph-client.admin.82785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72753.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.82785.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121140.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87505.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.96946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79245.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.72753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96946.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.87505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105206.log 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72753.log.gz 2024-09-05T02:18:20.233 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.87505.log.gz 2024-09-05T02:18:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107566.log 2024-09-05T02:18:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.79245.log: /var/log/ceph/ceph-client.admin.105206.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.79245.log.gz 2024-09-05T02:18:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147695.log 2024-09-05T02:18:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100486.log 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.107566.log: /var/log/ceph/ceph-client.admin.147695.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.107566.log.gz 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33292.log 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.147695.log.gz 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.100486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177558.log 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105206.log.gz 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.100486.log.gz -5 2024-09-05T02:18:20.245 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97536.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33292.log.gz 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55020.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.177558.log: /var/log/ceph/ceph-client.admin.97536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181779.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.177558.log.gz 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.97536.log.gz 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116417.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55020.log: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.55020.log.gz 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181779.log.gz 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170688.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32212.log 2024-09-05T02:18:20.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.116417.log: /var/log/ceph/ceph-client.0.170688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129400.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.116417.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.0.170688.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36909.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32212.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117007.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.129400.log: /var/log/ceph/ceph-client.0.36909.log: 88.1% 44.2% -- replaced with /var/log/ceph/ceph-client.0.36909.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58122.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129400.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.117007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99306.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58122.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117007.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164224.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.99306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33216.log 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6%/var/log/ceph/ceph-client.admin.164224.log: -- replaced with /var/log/ceph/ceph-client.admin.99306.log.gz 2024-09-05T02:18:20.247 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140025.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.164224.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33216.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42431.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144155.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.140025.log: /var/log/ceph/ceph-client.admin.42431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94585.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140025.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.144155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.94585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32612.log 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32410.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.94585.log.gz 2024-09-05T02:18:20.248 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95765.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132351.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32612.log: 93.2%/var/log/ceph/ceph-client.admin.95765.log: -- replaced with /var/log/ceph/ceph-client.admin.58122.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157257.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.144155.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32612.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.95765.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.132351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33046.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.157257.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132351.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133531.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157257.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33046.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21858.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33046.log.gz 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152437.log 2024-09-05T02:18:20.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.133531.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.133531.log.gz 2024-09-05T02:18:20.250 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.21858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2024-09-05T02:18:20.250 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21858.log.gz 2024-09-05T02:18:20.250 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.152437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76885.log 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141795.log 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48381.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.152437.log.gz 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.76885.log: 85.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55596.log 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.76885.log.gz 2024-09-05T02:18:20.259 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.141795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171868.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55596.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141795.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165402.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.55596.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161728.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.171868.log: /var/log/ceph/ceph-client.admin.165402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132941.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.171868.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.165402.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.161728.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5%/var/log/ceph/ceph-client.admin.132941.log: -- replaced with /var/log/ceph/ceph-client.admin.161728.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169508.log 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.132941.log.gz 2024-09-05T02:18:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154207.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.169508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181912.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.154207.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.169508.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26797.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181912.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154207.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181912.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151847.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181886.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.26797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26797.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.151847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.151847.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129990.log 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181886.log.gz 2024-09-05T02:18:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122910.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.129990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91045.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.129990.log.gz 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32403.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.122910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60703.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.122910.log.gz 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.91045.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.91045.log.gz 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54995.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32403.log: /var/log/ceph/ceph-client.admin.60703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91635.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32403.log.gz 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104026.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.91635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154797.log 2024-09-05T02:18:20.262 INFO:teuthology.orchestra.run.smithi099.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91635.log.gz 2024-09-05T02:18:20.263 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.104026.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.104026.log.gz 2024-09-05T02:18:20.263 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-05T02:18:20.263 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.154797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93995.log 2024-09-05T02:18:20.263 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154797.log.gz 2024-09-05T02:18:20.266 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26734.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26710.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26734.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26734.log.gz 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26710.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26710.log.gz 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26830.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26782.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26830.log.gz 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26758.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26782.log.gz 2024-09-05T02:18:20.267 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26758.log.gz 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26806.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-client.admin.26806.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26806.log.gz/var/log/ceph/ceph.audit.log: 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26686.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.26686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26686.log.gz 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26662.log 2024-09-05T02:18:20.268 INFO:teuthology.orchestra.run.smithi204.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T02:18:20.272 INFO:teuthology.orchestra.run.smithi204.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.26662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26662.log.gz 2024-09-05T02:18:20.272 INFO:teuthology.orchestra.run.smithi204.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161139.log 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.93995.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.93995.log.gz 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181831.log 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.161139.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.161139.log.gz 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43611.log 2024-09-05T02:18:20.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181831.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75113.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43611.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.43611.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67182.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.75113.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.75113.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83375.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.67182.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.67182.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32619.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54995.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181415.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.83375.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32619.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61348.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32619.log.gz 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181415.log: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175408.log 2024-09-05T02:18:20.278 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181415.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181623.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114647.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.175408.log: /var/log/ceph/ceph-client.admin.181623.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.175408.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181623.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50791.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181857.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.114647.log: /var/log/ceph/ceph-client.admin.50791.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.61348.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr: 85.5% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114647.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50791.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179525.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125270.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181857.log.gz 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119960.log 2024-09-05T02:18:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.179525.log: /var/log/ceph/ceph-client.admin.125270.log: 84.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.179525.log.gz 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.125270.log.gz 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.119960.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.119960.log.gz 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118187.log 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32407.log 2024-09-05T02:18:20.280 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.118187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32411.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32407.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.118187.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33019.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32407.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32411.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73933.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32411.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70983.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33019.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180718.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.73933.log: /var/log/ceph/ceph-client.admin.70983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109336.log 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.73933.log.gz 2024-09-05T02:18:20.283 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.70983.log.gz 2024-09-05T02:18:20.284 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.180718.log: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.60703.log.gz 2024-09-05T02:18:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158744.log 2024-09-05T02:18:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.109336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173638.log 2024-09-05T02:18:20.287 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.109336.log.gz 2024-09-05T02:18:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.158744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101076.log 2024-09-05T02:18:20.287 INFO:teuthology.orchestra.run.smithi099.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.0.158744.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89275.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.173638.log: /var/log/ceph/ceph-client.admin.101076.log: gzip 84.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.173638.log.gz -- 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.77475.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.101076.log.gz 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179401.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.89275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85735.log/var/log/ceph/ceph-client.admin.77475.log: 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: 82.0%/var/log/ceph/ceph-client.admin.179401.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.89275.log.gz 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77475.log.gz 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.179401.log.gz 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63284.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128810.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85735.log: /var/log/ceph/ceph-client.admin.63284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33387.log 2024-09-05T02:18:20.288 INFO:teuthology.orchestra.run.smithi099.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85735.log.gz 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.128810.log: gzip 82.5% -- replaced with /var/log/ceph/ceph-client.admin.128810.log.gz -5 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124680.log 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.33387.log: /var/log/ceph/ceph-client.admin.40611.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81605.log 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.33387.log.gz 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.124680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88095.log 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7%/var/log/ceph/ceph-client.admin.81605.log: -- replaced with /var/log/ceph/ceph-client.admin.124680.log.gz 2024-09-05T02:18:20.292 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.81605.log.gz 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181962.log 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.63284.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90455.log 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88095.log: /var/log/ceph/ceph-client.admin.181962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111106.log 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181962.log.gz 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.88095.log.gz 2024-09-05T02:18:20.293 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.90455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124090.log 2024-09-05T02:18:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.111106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140615.log 2024-09-05T02:18:20.297 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111106.log.gz 2024-09-05T02:18:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.124090.log: gzip -5 --verbose -- 86.3% /var/log/ceph/ceph-client.admin.61993.log 2024-09-05T02:18:20.297 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90455.log.gz 2024-09-05T02:18:20.297 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.124090.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.140615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181545.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: 86.1%/var/log/ceph/ceph-client.admin.61993.log: -- replaced with /var/log/ceph/ceph-client.admin.140615.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71573.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113466.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181545.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.71573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86325.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% 82.3% -- replaced with /var/log/ceph/ceph-client.admin.71573.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61993.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.113466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162317.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.86325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163635.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.86325.log.gz 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.162317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146515.log 2024-09-05T02:18:20.298 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113466.log.gz 2024-09-05T02:18:20.299 INFO:teuthology.orchestra.run.smithi099.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162317.log.gz 2024-09-05T02:18:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.163635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181727.log 2024-09-05T02:18:20.301 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.163635.log.gz 2024-09-05T02:18:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.146515.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-05T02:18:20.301 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.146515.log.gz 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175998.log 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181727.log: /var/log/ceph/ceph-osd.3.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181727.log.gz 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89865.log 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.175998.log: /var/log/ceph/ceph-client.admin.89865.log: 84.9% -- replaced with /var/log/ceph/ceph-client.0.175998.log.gz 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.89865.log.gz 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32412.log 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47201.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-09-05T02:18:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33340.log 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181363.log 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32412.log: /var/log/ceph/ceph-client.admin.33340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32412.log.gz 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33340.log.gz 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178811.log 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54691.log 2024-09-05T02:18:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181363.log: /var/log/ceph/ceph-client.admin.178811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181363.log.gz 2024-09-05T02:18:20.305 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.178811.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141205.log 2024-09-05T02:18:20.305 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54691.log: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.54691.log.gz 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127630.log 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181675.log 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.141205.log: /var/log/ceph/ceph-client.admin.127630.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.141205.log.gz 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.127630.log.gz 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167137.log 2024-09-05T02:18:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181675.log.gz 2024-09-05T02:18:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76293.log 2024-09-05T02:18:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44841.log 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.167137.log: /var/log/ceph/ceph-client.admin.76293.log: 82.3% 92.5% -- replaced with /var/log/ceph/ceph-client.admin.167137.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76293.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.180718.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142975.log 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131170.log 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44841.log: /var/log/ceph/ceph-client.admin.142975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.131170.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.142975.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44841.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.131170.log.gz 2024-09-05T02:18:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115237.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36325.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174228.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.115237.log: /var/log/ceph/ceph-client.0.36325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181519.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36325.log.gz 82.7% -- replaced with /var/log/ceph/ceph-client.admin.115237.log.gz 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.174228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114056.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.174228.log.gz 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55562.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181519.log.gz 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.114056.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.114056.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127040.log 2024-09-05T02:18:20.314 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.315 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55562.log: /var/log/ceph/ops-log-ceph-client.admin.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.55562.log.gz 2024-09-05T02:18:20.315 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151825.log 2024-09-05T02:18:20.316 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-05T02:18:20.316 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.127040.log: /var/log/ceph/ceph-client.admin.151825.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127040.log.gz 2024-09-05T02:18:20.316 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151825.log.gz 2024-09-05T02:18:20.317 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66001.log 2024-09-05T02:18:20.317 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83965.log 2024-09-05T02:18:20.317 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.66001.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66001.log.gz 2024-09-05T02:18:20.322 INFO:teuthology.orchestra.run.smithi099.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-05T02:18:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136481.log 2024-09-05T02:18:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32397.log 2024-09-05T02:18:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83965.log: /var/log/ceph/ceph-client.admin.136481.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83965.log.gz 2024-09-05T02:18:20.329 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.136481.log.gz 2024-09-05T02:18:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2024-09-05T02:18:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32332.log 2024-09-05T02:18:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32397.log: /var/log/ceph/ceph-client.admin.44226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32397.log.gz 2024-09-05T02:18:20.330 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2024-09-05T02:18:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51971.log 2024-09-05T02:18:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32820.log 2024-09-05T02:18:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32332.log.gz 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174818.log 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51971.log.gz 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32820.log.gz 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41201.log 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117597.log 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.174818.log: /var/log/ceph/ceph-client.admin.41201.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.174818.log.gz 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.41201.log.gz 2024-09-05T02:18:20.333 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55043.log 2024-09-05T02:18:20.335 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102256.log 2024-09-05T02:18:20.335 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.117597.log: /var/log/ceph/ceph-client.admin.55043.log: 91.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.117597.log.gz 2024-09-05T02:18:20.335 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55043.log.gz 2024-09-05T02:18:20.336 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33028.log 2024-09-05T02:18:20.336 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130580.log 2024-09-05T02:18:20.336 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.102256.log: /var/log/ceph/ceph-client.admin.33028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33028.log.gz 2024-09-05T02:18:20.336 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102256.log.gz 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143565.log 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134121.log 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.130580.log: /var/log/ceph/ceph-client.admin.143565.log: 85.7% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.130580.log.gz 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143565.log.gz 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176588.log 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168918.log 2024-09-05T02:18:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134121.log: /var/log/ceph/ceph-client.0.176588.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.176588.log.gz 2024-09-05T02:18:20.339 INFO:teuthology.orchestra.run.smithi099.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.134121.log.gz 2024-09-05T02:18:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38077.log 2024-09-05T02:18:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179424.log 2024-09-05T02:18:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.168918.log: /var/log/ceph/ceph-client.0.38077.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.38077.log.gz 2024-09-05T02:18:20.341 INFO:teuthology.orchestra.run.smithi099.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168918.log.gz 2024-09-05T02:18:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164813.log 2024-09-05T02:18:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102846.log 2024-09-05T02:18:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.179424.log: /var/log/ceph/ceph-client.admin.164813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179424.log.gz 2024-09-05T02:18:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33316.log 2024-09-05T02:18:20.343 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.164813.log.gz 2024-09-05T02:18:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.102846.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.102846.log.gz 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101666.log 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157847.log 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33316.log.gz 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.101666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32237.log 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3%/var/log/ceph/ceph-client.admin.157847.log: -- replaced with /var/log/ceph/ceph-client.admin.101666.log.gz 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.157847.log.gz 2024-09-05T02:18:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110516.log 2024-09-05T02:18:20.346 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181753.log 2024-09-05T02:18:20.346 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32237.log.gz 2024-09-05T02:18:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.110516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181649.log 2024-09-05T02:18:20.347 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.110516.log.gz 2024-09-05T02:18:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181753.log.gz 2024-09-05T02:18:20.347 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181571.log 2024-09-05T02:18:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181649.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2024-09-05T02:18:20.348 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181571.log.gz 2024-09-05T02:18:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179500.log 2024-09-05T02:18:20.348 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111696.log 2024-09-05T02:18:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31739.log: /var/log/ceph/ceph-client.admin.179500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2024-09-05T02:18:20.350 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179500.log.gz 2024-09-05T02:18:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-05T02:18:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156027.log 2024-09-05T02:18:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.111696.log: /var/log/ceph/ceph.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111696.log.gz 2024-09-05T02:18:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178761.log 2024-09-05T02:18:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.156027.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.156027.log.gz 2024-09-05T02:18:20.351 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104616.log 2024-09-05T02:18:20.352 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.178761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178761.log.gz 2024-09-05T02:18:20.353 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34561.log 2024-09-05T02:18:20.353 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.104616.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.104616.log.gz 2024-09-05T02:18:20.353 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103436.log 2024-09-05T02:18:20.354 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.34561.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.34561.log.gz 2024-09-05T02:18:20.354 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128220.log 2024-09-05T02:18:20.355 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.103436.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103436.log.gz 2024-09-05T02:18:20.355 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56185.log 2024-09-05T02:18:20.356 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.128220.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.128220.log.gz 2024-09-05T02:18:20.356 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33008.log 2024-09-05T02:18:20.368 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56185.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T02:18:20.371 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86915.log 2024-09-05T02:18:20.372 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33008.log.gz 2024-09-05T02:18:20.372 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.56185.log.gz 2024-09-05T02:18:20.373 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2024-09-05T02:18:20.374 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.86915.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86915.log.gz 2024-09-05T02:18:20.374 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63935.log 2024-09-05T02:18:20.374 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149465.log 2024-09-05T02:18:20.375 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2024-09-05T02:18:20.375 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63935.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.63935.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82195.log 2024-09-05T02:18:20.375 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.377 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138841.log 2024-09-05T02:18:20.378 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149465.log.gz 2024-09-05T02:18:20.378 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82195.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.82195.log.gz 2024-09-05T02:18:20.378 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170098.log 2024-09-05T02:18:20.379 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44201.log 2024-09-05T02:18:20.379 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.138841.log: /var/log/ceph/ceph-client.0.170098.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.138841.log.gz 2024-09-05T02:18:20.379 INFO:teuthology.orchestra.run.smithi099.stderr: 84.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151235.log 2024-09-05T02:18:20.379 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.170098.log.gz 2024-09-05T02:18:20.379 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44201.log.gz 2024-09-05T02:18:20.380 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179474.log 2024-09-05T02:18:20.380 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32603.log 2024-09-05T02:18:20.381 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.151235.log: /var/log/ceph/ceph-client.admin.179474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179474.log.gz 81.6% 2024-09-05T02:18:20.381 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151235.log.gz 2024-09-05T02:18:20.381 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98126.log 2024-09-05T02:18:20.381 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153027.log 2024-09-05T02:18:20.381 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32603.log: /var/log/ceph/ceph-client.admin.98126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32603.log.gz 2024-09-05T02:18:20.382 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.98126.log.gz 2024-09-05T02:18:20.382 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32598.log 2024-09-05T02:18:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.153027.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.153027.log.gz 2024-09-05T02:18:20.383 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137071.log 2024-09-05T02:18:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32604.log 2024-09-05T02:18:20.384 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32598.log.gz 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.137071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159925.log 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.137071.log.gz 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32604.log.gz 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108156.log 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.159925.log: /var/log/ceph/ceph-client.admin.54972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2024-09-05T02:18:20.386 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.159925.log.gz 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156667.log 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181701.log 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.108156.log: /var/log/ceph/ceph-client.admin.156667.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.108156.log.gz 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57477.log 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.156667.log.gz 2024-09-05T02:18:20.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181701.log.gz 2024-09-05T02:18:20.389 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74523.log 2024-09-05T02:18:20.389 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35735.log 2024-09-05T02:18:20.389 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57477.log: /var/log/ceph/ceph-client.admin.74523.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.74523.log.gz 2024-09-05T02:18:20.395 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.57477.log.gz 2024-09-05T02:18:20.397 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32818.log 2024-09-05T02:18:20.397 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-05T02:18:20.398 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.35735.log: /var/log/ceph/ceph-client.admin.32818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32818.log.gz 81.3% -- replaced with /var/log/ceph/ceph-client.0.35735.log.gz 2024-09-05T02:18:20.398 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:20.398 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181441.log 2024-09-05T02:18:20.398 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41816.log 2024-09-05T02:18:20.399 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.181441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181441.log.gz 2024-09-05T02:18:20.403 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125860.log 2024-09-05T02:18:20.404 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41816.log.gz 2024-09-05T02:18:20.404 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53791.log 2024-09-05T02:18:20.406 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.125860.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125860.log.gz 2024-09-05T02:18:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-09-05T02:18:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53791.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.53791.log.gz 2024-09-05T02:18:20.408 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67773.log 2024-09-05T02:18:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-09-05T02:18:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123500.log 2024-09-05T02:18:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.67773.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.67773.log.gz 2024-09-05T02:18:20.410 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79835.log 2024-09-05T02:18:20.410 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.123500.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.123500.log.gz 2024-09-05T02:18:20.411 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118780.log 2024-09-05T02:18:20.412 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.79835.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.79835.log.gz 2024-09-05T02:18:20.412 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54932.log 2024-09-05T02:18:20.413 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.118780.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118780.log.gz 2024-09-05T02:18:20.413 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112286.log 2024-09-05T02:18:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54932.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.54932.log.gz 2024-09-05T02:18:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95175.log 2024-09-05T02:18:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.112286.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.112286.log.gz 2024-09-05T02:18:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2024-09-05T02:18:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.95175.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95175.log.gz 2024-09-05T02:18:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84555.log 2024-09-05T02:18:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44251.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2024-09-05T02:18:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109926.log 2024-09-05T02:18:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84555.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.84555.log.gz 2024-09-05T02:18:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148875.log 2024-09-05T02:18:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.109926.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109926.log.gz 2024-09-05T02:18:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145335.log 2024-09-05T02:18:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148875.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.148875.log.gz 2024-09-05T02:18:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154822.log 2024-09-05T02:18:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.145335.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.145335.log.gz 2024-09-05T02:18:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148285.log 2024-09-05T02:18:20.425 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.154822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154822.log.gz 2024-09-05T02:18:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-05T02:18:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148285.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.148285.log.gz 2024-09-05T02:18:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32260.log 2024-09-05T02:18:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120550.log 2024-09-05T02:18:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32260.log.gz 2024-09-05T02:18:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122320.log 2024-09-05T02:18:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.120550.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.120550.log.gz 2024-09-05T02:18:20.467 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181311.log 2024-09-05T02:18:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.122320.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.122320.log.gz 2024-09-05T02:18:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T02:18:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181311.log.gz 2024-09-05T02:18:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178148.log 2024-09-05T02:18:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T02:18:20.504 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60057.log 2024-09-05T02:18:20.504 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.178148.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.178148.log.gz 2024-09-05T02:18:20.520 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166548.log 2024-09-05T02:18:20.526 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60057.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60057.log.gz 2024-09-05T02:18:20.527 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92225.log 2024-09-05T02:18:20.529 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.166548.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.166548.log.gz 2024-09-05T02:18:20.535 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54762.log 2024-09-05T02:18:20.536 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.92225.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.92225.log.gz 2024-09-05T02:18:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119370.log 2024-09-05T02:18:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54762.log: 48.3% -- replaced with /var/log/ceph/ceph-client.admin.54762.log.gz 2024-09-05T02:18:20.562 INFO:teuthology.orchestra.run.smithi099.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-05T02:18:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-09-05T02:18:20.565 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.119370.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.119370.log.gz 2024-09-05T02:18:20.565 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75703.log 2024-09-05T02:18:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39431.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-09-05T02:18:20.566 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2024-09-05T02:18:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.75703.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.75703.log.gz 2024-09-05T02:18:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-09-05T02:18:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2024-09-05T02:18:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138251.log 2024-09-05T02:18:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-09-05T02:18:20.569 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26895.log 2024-09-05T02:18:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.138251.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138251.log.gz 2024-09-05T02:18:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181389.log 2024-09-05T02:18:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.26895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26895.log.gz 2024-09-05T02:18:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121730.log 2024-09-05T02:18:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181389.log.gz 2024-09-05T02:18:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-05T02:18:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.121730.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.121730.log.gz 2024-09-05T02:18:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112876.log 2024-09-05T02:18:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 74.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-05T02:18:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-09-05T02:18:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.112876.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.112876.log.gz 2024-09-05T02:18:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131761.log 2024-09-05T02:18:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-09-05T02:18:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147105.log 2024-09-05T02:18:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.131761.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131761.log.gz 2024-09-05T02:18:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72163.log 2024-09-05T02:18:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.147105.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.147105.log.gz 2024-09-05T02:18:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135891.log 2024-09-05T02:18:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.72163.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.72163.log.gz 2024-09-05T02:18:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181337.log 2024-09-05T02:18:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135891.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135891.log.gz 2024-09-05T02:18:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52586.log 2024-09-05T02:18:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181337.log.gz 2024-09-05T02:18:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126450.log 2024-09-05T02:18:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52586.log.gz 2024-09-05T02:18:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73343.log 2024-09-05T02:18:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.126450.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.126450.log.gz 2024-09-05T02:18:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64819.log 2024-09-05T02:18:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.73343.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.73343.log.gz 2024-09-05T02:18:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105796.log 2024-09-05T02:18:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64819.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.64819.log.gz 2024-09-05T02:18:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172458.log 2024-09-05T02:18:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.105796.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.105796.log.gz 2024-09-05T02:18:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52561.log 2024-09-05T02:18:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.172458.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.172458.log.gz 2024-09-05T02:18:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150645.log 2024-09-05T02:18:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52561.log.gz 2024-09-05T02:18:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181938.log 2024-09-05T02:18:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.150645.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.150645.log.gz 2024-09-05T02:18:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179449.log 2024-09-05T02:18:20.594 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181938.log.gz 2024-09-05T02:18:20.594 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81015.log 2024-09-05T02:18:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.179449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179449.log.gz 2024-09-05T02:18:20.595 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-09-05T02:18:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.81015.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.81015.log.gz 2024-09-05T02:18:20.596 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-09-05T02:18:20.597 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz 2024-09-05T02:18:20.597 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88685.log 2024-09-05T02:18:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-09-05T02:18:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106386.log 2024-09-05T02:18:20.599 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88685.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88685.log.gz 2024-09-05T02:18:20.599 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41791.log 2024-09-05T02:18:20.600 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.106386.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.106386.log.gz 2024-09-05T02:18:20.600 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171278.log 2024-09-05T02:18:20.601 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41791.log.gz 2024-09-05T02:18:20.601 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181805.log 2024-09-05T02:18:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.171278.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.171278.log.gz 2024-09-05T02:18:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59412.log 2024-09-05T02:18:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181805.log.gz 2024-09-05T02:18:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33977.log 2024-09-05T02:18:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59412.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.59412.log.gz 2024-09-05T02:18:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65408.log 2024-09-05T02:18:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.33977.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.33977.log.gz 2024-09-05T02:18:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67825.log 2024-09-05T02:18:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65408.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.65408.log.gz 2024-09-05T02:18:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26650.log 2024-09-05T02:18:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.67825.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.67825.log.gz 2024-09-05T02:18:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32827.log 2024-09-05T02:18:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.26650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26650.log.gz 2024-09-05T02:18:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85145.log 2024-09-05T02:18:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32827.log.gz 2024-09-05T02:18:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155437.log 2024-09-05T02:18:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85145.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.85145.log.gz 2024-09-05T02:18:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32593.log 2024-09-05T02:18:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.155437.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155437.log.gz 2024-09-05T02:18:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35151.log 2024-09-05T02:18:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32593.log.gz 2024-09-05T02:18:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78655.log 2024-09-05T02:18:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.35151.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35151.log.gz 2024-09-05T02:18:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32609.log 2024-09-05T02:18:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.78655.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.78655.log.gz 2024-09-05T02:18:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-09-05T02:18:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32609.log.gz 2024-09-05T02:18:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99896.log 2024-09-05T02:18:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 2024-09-05T02:18:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96356.log 2024-09-05T02:18:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.99896.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99896.log.gz 2024-09-05T02:18:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32404.log 2024-09-05T02:18:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.96356.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.96356.log.gz 2024-09-05T02:18:20.622 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154847.log 2024-09-05T02:18:20.622 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32404.log.gz 2024-09-05T02:18:20.623 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80425.log 2024-09-05T02:18:20.624 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.154847.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154847.log.gz 2024-09-05T02:18:20.624 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178738.log 2024-09-05T02:18:20.625 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.80425.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80425.log.gz 2024-09-05T02:18:20.625 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50201.log 2024-09-05T02:18:20.626 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.178738.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.178738.log.gz 2024-09-05T02:18:20.626 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52611.log 2024-09-05T02:18:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50201.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.50201.log.gz 2024-09-05T02:18:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137661.log 2024-09-05T02:18:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52611.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.52611.log.gz 2024-09-05T02:18:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181467.log 2024-09-05T02:18:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.137661.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.137661.log.gz 2024-09-05T02:18:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93405.log 2024-09-05T02:18:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181467.log.gz 2024-09-05T02:18:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37493.log 2024-09-05T02:18:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.93405.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.93405.log.gz 2024-09-05T02:18:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139431.log 2024-09-05T02:18:20.633 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37493.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37493.log.gz 2024-09-05T02:18:20.633 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115827.log 2024-09-05T02:18:20.634 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.139431.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.139431.log.gz 2024-09-05T02:18:20.634 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33242.log 2024-09-05T02:18:20.635 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.115827.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.115827.log.gz 2024-09-05T02:18:20.635 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70393.log 2024-09-05T02:18:20.636 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33242.log.gz 2024-09-05T02:18:20.636 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144745.log 2024-09-05T02:18:20.637 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.70393.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.70393.log.gz 2024-09-05T02:18:20.637 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33017.log 2024-09-05T02:18:20.638 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.144745.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.144745.log.gz 2024-09-05T02:18:20.639 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150055.log 2024-09-05T02:18:20.639 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33017.log.gz 2024-09-05T02:18:20.640 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69056.log 2024-09-05T02:18:20.640 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.150055.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150055.log.gz 2024-09-05T02:18:20.641 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-09-05T02:18:20.641 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.69056.log: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.69056.log.gz 2024-09-05T02:18:20.642 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142385.log 2024-09-05T02:18:20.643 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40021.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-09-05T02:18:20.643 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162906.log 2024-09-05T02:18:20.645 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.142385.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.142385.log.gz 2024-09-05T02:18:20.645 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32813.log 2024-09-05T02:18:20.646 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.162906.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162906.log.gz 2024-09-05T02:18:20.647 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181493.log 2024-09-05T02:18:20.647 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32813.log.gz 2024-09-05T02:18:20.648 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32620.log 2024-09-05T02:18:20.648 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.181493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.181493.log.gz 2024-09-05T02:18:20.649 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92815.log 2024-09-05T02:18:20.649 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32620.log.gz 2024-09-05T02:18:20.649 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168328.log 2024-09-05T02:18:20.650 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.92815.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92815.log.gz 2024-09-05T02:18:20.651 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.168328.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.168328.log.gz 2024-09-05T02:18:21.101 INFO:teuthology.orchestra.run.smithi204.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-05T02:18:21.741 INFO:teuthology.orchestra.run.smithi099.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-05T02:18:21.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-05T02:18:21.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-05T02:18:21.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-05T02:18:22.049 INFO:teuthology.orchestra.run.smithi204.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-05T02:18:24.328 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-05T02:18:24.692 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-05T02:18:26.854 INFO:teuthology.orchestra.run.smithi099.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-05T02:18:30.153 INFO:teuthology.orchestra.run.smithi204.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-05T02:18:30.185 INFO:teuthology.orchestra.run.smithi204.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-05T02:18:30.769 INFO:teuthology.orchestra.run.smithi204.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-05T02:18:30.840 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-05T02:18:33.845 INFO:teuthology.orchestra.run.smithi204.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-05T02:18:33.846 INFO:teuthology.orchestra.run.smithi204.stderr: 2024-09-05T02:18:33.846 INFO:teuthology.orchestra.run.smithi204.stderr:real 0m13.613s 2024-09-05T02:18:33.846 INFO:teuthology.orchestra.run.smithi204.stderr:user 0m44.900s 2024-09-05T02:18:33.846 INFO:teuthology.orchestra.run.smithi204.stderr:sys 0m1.692s 2024-09-05T02:18:35.069 INFO:teuthology.orchestra.run.smithi099.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-05T02:18:40.024 INFO:teuthology.orchestra.run.smithi099.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-05T02:18:40.025 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-05T02:18:40.025 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m19.839s 2024-09-05T02:18:40.026 INFO:teuthology.orchestra.run.smithi099.stderr:user 1m0.170s 2024-09-05T02:18:40.026 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.158s 2024-09-05T02:18:40.027 INFO:tasks.ceph:Archiving logs... 2024-09-05T02:18:40.027 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi099/log 2024-09-05T02:18:40.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T02:18:46.977 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi204/log 2024-09-05T02:18:46.978 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T02:18:52.549 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 1975, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_DefinitelyLost operator new[](unsigned long) decode_message(ceph::common::CephContext*, int, ceph_msg_header&, ceph_msg_footer&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, boost::intrusive_ptr) ProtocolV2::handle_message() 2024-09-05T02:18:52.644 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T02:18:52.654 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 1975, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ede1507024117d16395cd6d958c594ff4aaf4da5/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_DefinitelyLost operator new[](unsigned long) decode_message(ceph::common::CephContext*, int, ceph_msg_header&, ceph_msg_footer&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, boost::intrusive_ptr) ProtocolV2::handle_message() 2024-09-05T02:18:52.655 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T02:18:52.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T02:18:52.658 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T02:18:52.719 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T02:18:52.729 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T02:18:52.729 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T02:18:52.732 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T02:18:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T02:18:52.746 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-05T02:18:52.746 INFO:teuthology.orchestra.run.smithi099.stdout:*hv01.front.sepi 67.205.162.81 3 u 117 128 377 0.108 -1.130 0.642 2024-09-05T02:18:52.746 INFO:teuthology.orchestra.run.smithi099.stdout:+hv02.front.sepi 63.231.80.2 3 u 118 128 377 0.145 -0.477 0.557 2024-09-05T02:18:52.747 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 128 377 0.172 -2.444 0.765 2024-09-05T02:18:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout:============================================================================== 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout:*hv01.front.sepi 67.205.162.81 3 u 54 128 377 0.085 -0.407 0.125 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout:+hv02.front.sepi 63.231.80.2 3 u 65 128 377 0.113 +0.328 0.084 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout:+hv03.front.sepi 74.6.168.72 3 u 124 128 377 0.102 -0.619 0.070 2024-09-05T02:18:52.748 INFO:teuthology.orchestra.run.smithi204.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-05T02:18:52.749 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T02:18:52.759 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T02:18:52.759 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T02:18:52.804 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T02:18:52.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T02:18:52.903 INFO:teuthology.task.internal:Duration was 6019.821625 seconds 2024-09-05T02:18:52.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T02:18:52.955 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T02:18:52.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T02:18:52.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T02:18:52.995 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T02:18:52.995 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-05T02:18:52.996 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T02:18:53.053 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-09-05T02:18:53.053 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T02:18:53.063 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T02:18:53.064 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T02:18:53.096 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T02:18:53.133 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T02:18:53.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T02:18:53.164 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T02:18:53.232 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T02:18:53.244 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T02:18:53.244 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T02:18:53.257 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T02:18:53.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T02:18:53.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:18:53.300 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:18:53.309 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-05T02:18:53.321 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-09-05T02:18:53.492 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:18:53.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:18:53.497 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:18:53.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:18:53.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T02:18:53.550 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T02:18:53.551 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi099 2024-09-05T02:18:53.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T02:18:53.575 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-04_19:08:10-rgw-pr-56597-distro-default-smithi/7889599/remote/smithi204 2024-09-05T02:18:53.576 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T02:18:53.603 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T02:18:53.603 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T02:18:53.613 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T02:18:53.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T02:18:53.664 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T02:18:53.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T02:18:53.689 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T02:18:53.689 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T02:18:53.692 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T02:18:53.695 INFO:teuthology.orchestra.run.smithi099.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 02:18 /home/ubuntu/cephtest 2024-09-05T02:18:53.700 INFO:teuthology.orchestra.run.smithi204.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 02:18 /home/ubuntu/cephtest 2024-09-05T02:18:53.701 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T02:18:53.739 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T02:18:53.789 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_DefinitelyLost operator new[](unsigned long) decode_message(ceph::common::CephContext*, int, ceph_msg_header&, ceph_msg_footer&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, boost::intrusive_ptr) ProtocolV2::handle_message() 2024-09-05T02:18:53.793 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 6019.821624517441 failure_reason: 'valgrind error: Leak_DefinitelyLost operator new[](unsigned long) decode_message(ceph::common::CephContext*, int, ceph_msg_header&, ceph_msg_footer&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, ceph::buffer::v15_2_0::list&, boost::intrusive_ptr) ProtocolV2::handle_message()' flavor: default owner: scheduled_cbodley@teuthology status: fail success: false 2024-09-05T02:18:53.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T02:18:53.877 INFO:teuthology.run:FAIL